China Telecom, one of many nation’s state-owned telecom giants, has created two LLMs that had been educated solely on domestically-produced chips.
This breakthrough represents a big step in China’s ongoing efforts to develop into self-reliant in AI know-how, particularly in gentle of escalating US limitations on entry to superior semiconductors for its rivals.
In response to the corporate’s Institute of AI, one of many fashions, TeleChat2-115B and one other unnamed mannequin had been educated on tens of hundreds of Chinese language-made chips. This achievement is particularly noteworthy given the tighter US export guidelines which have restricted China’s skill to buy high-end processors from Nvidia and different overseas corporations. In an announcement shared on WeChat, the AI institute claimed that this accomplishment demonstrated China’s functionality to independently prepare LLMs and indicators a brand new period of innovation and self-reliance in AI know-how.
The size of those fashions is outstanding. China Telecom acknowledged that the unnamed LLM has one trillion parameters. In AI terminology, parameters are the variables that assist the mannequin in studying throughout coaching. The extra parameters there are, the extra sophisticated and highly effective the AI turns into.
Chinese language corporations are striving to maintain tempo with world leaders in AI primarily based exterior the nation. Washington’s export restrictions on Nvidia’s newest AI chips such because the A100 and H100, have compelled China to hunt alternate options. Consequently, Chinese language corporations have developed their very own processors to scale back reliance on Western applied sciences. As an illustration, the TeleChat2-115B mannequin has roughly 100 billion parameters, and due to this fact can carry out in addition to mainstream platforms.
China Telecom didn’t specify which firm provided the domestically-designed chips used to coach its fashions. Nevertheless, as beforehand mentioned on these pages, Huawei’s Ascend chips play a key half within the nation’s AI plans.
Huawei, which has confronted US penalties in recent times, can be rising its efforts within the synthetic intelligence area. The corporate has lately began testing its newest AI processor, the Ascend 910C, with potential shoppers ready within the home market. Giant Chinese language server corporations, in addition to web giants which have beforehand used Nvidia chips, are apparently testing the brand new chip’s efficiency. Huawei’s Ascend processors, as one of many few viable alternate options to Nvidia {hardware}, are considered as a key part of China’s technique that may reduce its reliance on overseas know-how.
Along with Huawei, China Telecom is collaborating with different home chipmakers akin to Cambricon, a Chinese language start-up specialising in AI processors. The partnerships mirror a broader tendency in China’s tech business to construct a homegrown ecosystem of AI options, additional shielding the nation from the consequences of US export controls.
By growing its personal AI chips and know-how, China is progressively lowering its dependence on foreign-made {hardware}, particularly Nvidia’s extremely sought-after and due to this fact costly GPUs. Whereas US sanctions make it troublesome for Chinese language corporations to acquire the newest Nvidia {hardware}, a black marketplace for overseas chips has emerged. Reasonably than threat working within the gray market, many Chinese language corporations choose to buy lower-powered alternate options akin to previous-gen fashions to keep up entry to Nvidia’s official assist and companies.
China’s achievement displays a broader shift in its strategy to AI and semiconductor know-how, emphasising self-sufficiency and resilience in an more and more aggressive world financial system and in face of American protectionist commerce insurance policies.
(Picture by Mark Kuiper)
See additionally: Has Huawei outsmarted Apple within the AI race?
Wish to be taught extra about AI and large information from business leaders? Take a look at AI & Big Data Expo happening in Amsterdam, California, and London. The great occasion is co-located with different main occasions together with Intelligent Automation Conference, BlockX, Digital Transformation Week, and Cyber Security & Cloud Expo.
Discover different upcoming enterprise know-how occasions and webinars powered by TechForge here.
