Stability AI has introduced the most recent additions to its Secure LM 2 language mannequin sequence: a 12 billion parameter base mannequin and an instruction-tuned variant. These fashions had been educated on a powerful two trillion tokens throughout seven languages: English, Spanish, German, Italian, French, Portuguese, and Dutch.
The 12 billion parameter mannequin goals to strike a steadiness between robust efficiency, effectivity, reminiscence necessities, and pace. It follows the established framework of Stability AI’s beforehand launched Secure LM 2 1.6B technical report. This new launch extends the corporate’s mannequin vary, providing builders a clear and highly effective software for innovating with AI language know-how.
Alongside the 12B mannequin, Stability AI has additionally launched a brand new model of its Secure LM 2 1.6B mannequin. This up to date 1.6B variant improves dialog talents throughout the identical seven languages whereas sustaining remarkably low system necessities.
Secure LM 2 12B is designed as an environment friendly open mannequin tailor-made for multilingual duties with clean efficiency on broadly accessible {hardware}.
Based on Stability AI, this mannequin can deal with duties sometimes possible just for considerably bigger fashions, which frequently require substantial computational and reminiscence assets, corresponding to giant Combination-of-Specialists (MoEs). The instruction-tuned model is especially well-suited for numerous makes use of, together with as a central a part of retrieval RAG methods, resulting from its excessive efficiency in software utilization and performance calling.
In efficiency comparisons with in style robust language fashions like Mixtral, Llama2, Qwen 1.5, Gemma, and Mistral, Secure LM 2 12B affords strong outcomes when examined on zero-shot and few-shot duties throughout normal benchmarks outlined within the Open LLM leaderboard:
With this new launch, Stability AI extends the StableLM 2 household into the 12B class, offering an open and clear mannequin with out compromising energy and accuracy. The corporate is assured that this launch will allow builders and companies to proceed creating the longer term whereas retaining full management over their information.
Builders and companies can use Secure LM 2 12B now for business and non-commercial functions with a Stability AI Membership.
(Picture by Muha Ajjan)
See additionally: ML Olympiad returns with over 20 challenges
Wish to be taught extra about AI and large information from trade leaders? Take a look at AI & Big Data Expo happening in Amsterdam, California, and London. The great occasion is co-located with different main occasions together with BlockX, Digital Transformation Week, and Cyber Security & Cloud Expo.
Discover different upcoming enterprise know-how occasions and webinars powered by TechForge here.
