China Telecom, a state-owned service, has developed two LLMs that have been completely skilled on domestically produced processors.
This breakthrough demonstrates China’s progress towards chip independence, notably within the discipline of AI.
The corporate’s AI Institute introduced that its open-source mannequin, TeleChat2-115B, together with one other undisclosed mannequin, was skilled on tens of 1000’s of Chinese language chips. That is particularly vital given the US’s growing restrictions on China’s entry to cutting-edge chips, similar to Nvidia’s newest AI processors.
In response to the AI Institute, this achievement displays China’s full self-sufficiency in coaching its personal LLMs, which energy instruments like OpenAI’s ChatGPT. Additionally they regard it as the start of a brand new chapter within the nation’s pursuit of AI know-how innovation and independence.
China Telecom revealed that the unnamed mannequin options one trillion parameters. In layman’s phrases, parameters are the variables that an AI mannequin utilises to be taught throughout coaching; the extra parameters the mannequin has, the smarter and extra highly effective it’s. TeleChat2-115B, the opposite mannequin, has over 100 billion parameters.
Chinese language firms are working laborious to remain aggressive in AI, particularly given Washington’s export restrictions. Whereas China Telecom didn’t specify precisely who supplied the chips, the South China Morning Post reported that it has beforehand talked about Huawei’s Ascend chips as a part of its LLM growth.
Huawei, which is below US sanctions, has these days begun testing a brand new AI processor with potential shoppers in China. Firms are looking for alternate options to Nvidia’s high-end {hardware}, and Huawei seems to be stepping in to fill the hole.
In response to sources, Huawei has already supplied samples of its Ascend 910C processor to main Chinese language server firms for testing. The chip can be being made out there to Chinese language web firms, a lot of which have lengthy relied on Nvidia’s know-how.
For native AI firms, Huawei’s Ascend chips and coaching options are rising as viable alternate options to Nvidia’s choices. Along with Huawei, China Telecom is providing processors from Cambricon, a Chinese language start-up, by its State Cloud service.
These collaborations are seemingly to assist China minimise its reliance on international chips similar to Nvidia’s GPUs, which have lengthy been the popular possibility for coaching AI fashions.
With US export laws limiting entry to superior Nvidia GPUs such because the A100 and H100, a number of Chinese language AI companies have resorted to black markets. Nevertheless, many choose to make use of lower-powered alternate options to make sure that they will proceed to get pleasure from Nvidia’s official help and providers.
See additionally: US examines safety dangers posed by China Telecom and China Cellular’s operations
Need to be taught extra about cybersecurity and the cloud from trade leaders? Take a look at Cyber Security & Cloud Expo going down in Amsterdam, California, and London. Discover different upcoming enterprise know-how occasions and webinars powered by TechForge here.
