Shawn-Inspur/Yuan-1.0

This is stars and forks stats for /Shawn-Inspur/Yuan-1.0 repository. As of 20 Apr, 2024 this repository has 581 stars and 123 forks.

Yuan-1.0 Yuan 1.0: Large-Scale Pre-trained Language Model in Zero-Shot and Few-Shot Learning Introduction Recent work like GPT-3 has demonstrated excellent performance of Zero-Shot and Few-Shot learning on many natural language processing (NLP) tasks by scaling up model size, data size and the amount of compute. While training a model like GPT-3 requires huge amount of computing power that is a challenge to the researchers. In this work, we propose a method that incorporates large-scale distributed...