01.AI, an AI company founded by Kai-fu Lee, Chairman and CEO of Sinovation Ventures, released the first open source Chinese-English bilingual large model Yi. Zero One Wish has completed a new round of financing, led by Alibaba Cloud. Currently, the valuation of Zero One Thousand Things has exceeded US$1 billion, making it one of the unicorns.
On November 2, Yi quietly uploaded two basic models with parameter sizes of 6B and 34B on Hugging Face. As of November 5, Yi-34B has climbed to No. 1 in the Hugging Face LLM Leaderboard (pretrained) (pre-trained large language model) and Chinese large model list C-Eval rankings. Yi currently has 200K context windows and can handle approximately 400,000 words of text - which is currently the longest context window among large models in the world. At the same time, by polishing AIInfra, Yi-34B has reduced training costs by 40%. Due to the lower quality of Chinese corpus, currently, the proportion of English corpus in Yi's training data is higher than that of Chinese corpus. (36 krypton)