Need smarter insights in your inbox? Join our weekly newsletters to get solely what issues to enterprise AI, information, and safety leaders. Subscribe Now
Liquid AI, the startup fashioned by former Massachusetts Institute of Expertise (MIT) researchers to develop novel AI mannequin architectures past widely-used transformers, at the moment introduced the discharge of the Liquid Edge AI Platform (LEAP). The cross-platform software program improvement package (SDK) is designed to make it simpler for builders to combine small language fashions (SLMs) straight into cellular purposes.
Alongside LEAP, the corporate additionally launched Apollo, a companion iOS app for testing fashions domestically, furthering Liquid AI’s mission to allow privacy-preserving, environment friendly AI on client {hardware}.
The LEAP SDK arrives at a time when many builders are in search of alternate options to cloud-only AI companies because of issues over latency, price, privateness and offline availability.
LEAP addresses these wants head-on with a local-first strategy that permits small fashions to run straight on-device, lowering dependence on cloud infrastructure.
The AI Affect Collection Returns to San Francisco – August 5
The subsequent part of AI is right here – are you prepared? Be part of leaders from Block, GSK, and SAP for an unique have a look at how autonomous brokers are reshaping enterprise workflows – from real-time decision-making to end-to-end automation.
Safe your spot now – house is proscribed: https://bit.ly/3GuuPLF
Constructed for cellular devs with no prior ML expertise required
LEAP is designed for builders who wish to construct with AI however could not have deep experience in machine studying (ML).
In line with Liquid AI, the SDK will be added to an iOS or Android undertaking with just some traces of code, and calling an area mannequin is supposed to really feel as acquainted as interacting with a standard cloud API.
“Our analysis reveals builders are shifting past cloud-only AI and in search of trusted companions to assist them construct on-device,” Ramin Hasani, co-founder and CEO of Liquid AI, mentioned in a blog post asserting the information. “LEAP is our reply — a versatile, end-to-end deployment platform constructed from the bottom as much as make highly effective, environment friendly and personal edge AI actually accessible.”
As soon as built-in, builders can choose a mannequin from the built-in LEAP mannequin library, which incorporates compact fashions as small as 300MB — light-weight sufficient for contemporary telephones with as little as 4GB of RAM (!!) and up.
The SDK handles native inference, reminiscence optimization and gadget compatibility, simplifying the everyday edge deployment course of.
LEAP is OS- and model-agnostic by design. At launch, it helps each iOS and Android, and provides compatibility with Liquid AI’s personal liquid basis fashions (LFMs) in addition to many widespread open-source small fashions.
The objective: A unified ecosystem for edge AI
Past mannequin execution, LEAP positions itself as an all-in-one platform for locating, adapting, testing and deploying SLMs for edge use.
Builders can browse a curated mannequin catalog with numerous quantization and checkpoint choices, permitting them to tailor efficiency and reminiscence footprint to the constraints of the goal gadget.
Liquid AI emphasizes that enormous fashions are usually generalists, whereas small fashions usually carry out greatest when optimized for a slim set of duties. LEAP’s unified system is structured round that precept, providing instruments for fast iteration and deployment in real-world cellular environments.
The SDK additionally comes with a developer neighborhood hosted on Discord, the place Liquid AI provides workplace hours, assist, occasions and competitions to encourage experimentation and suggestions.
Apollo: Like Testflight for native AI fashions
To enrich LEAP, Liquid AI additionally launched Apollo, a free iOS app that lets builders and customers work together with LEAP-compatible fashions in an area, offline setting.
Initially a separate cellular app startup that allowed customers to speak with LLMs privately on their device, which Liquid acquired earlier this yr, Apollo has been rebuilt to assist your entire LEAP mannequin library.
Apollo is designed for low-friction experimentation — builders can “vibe test” a mannequin’s tone, latency or output conduct proper on their telephones earlier than integrating it right into a manufacturing app. The app runs totally offline, preserving person privateness and lowering reliance on cloud compute.
Whether or not used as a light-weight dev instrument or a non-public AI assistant, Apollo displays Liquid AI’s broader push to decentralize AI entry and execution.
Constructed on the again of the LFM2 mannequin household introduced final week
LEAP SDK launch builds on Liquid AI’s July 10 announcement of LFM2, its second-generation basis mannequin household designed particularly for on-device workloads.
LFM2 fashions are available in 350M, 700M, and 1.2B parameter sizes, and benchmark competitively with bigger fashions in velocity and accuracy throughout a number of analysis duties.
These fashions kind the spine of the LEAP mannequin library and are optimized for quick inference on CPUs, GPUs, and NPUs.
Free and prepared for devs to begin constructing
LEAP is at present free to make use of below a developer license that features the core SDK and mannequin library.
Liquid AI notes that premium enterprise options might be made out there below a separate business license sooner or later, however that it’s taking inquiries from enterprise prospects already through its website contact form.
LFM2 fashions are additionally free for educational use and business use by corporations with lower than $10 million in income; bigger organizations are required to contact the corporate for licensing.
Builders can get began by visiting the LEAP SDK website, downloading Apollo from the App Retailer or becoming a member of the Liquid AI developer neighborhood on Discord.
Source link
