ASUS IoT, edge AI computer systems now help “Supermode” for NVIDIA Jetson Orin NX and Orin Nano collection, doubling generative AI (GenAI) mannequin efficiency.
Supermode enhances AI TOPS by as much as 1.7X and reminiscence bandwidth by as much as 1.5X, enabling quicker processing for big language fashions (LLMs), visible language fashions (VLMs), and imaginative and prescient transformers (ViTs).
Jetson Orin modules are appropriate with standard machine studying frameworks like Hugging Face Transformers, NVIDIA TensorRT-LLM, and extra, making them preferrred for edge purposes and robotics.
ASUS IoT fashions (PE1102N, PE1101N, PE1100N) are designed for compactness, versatility, and ruggedness, appropriate for sensible metropolis, transportation, and logistics purposes. These gadgets provide quicker knowledge processing, enhanced safety, and diminished whole price of possession (TCO) for edge AI workloads.
The methods are constructed for excessive circumstances, with vast temperature vary operation and wonderful thermal efficiency for outside use.
Supermode is enabled by way of the newest NVIDIA JetPack 6.2 SDK, which incorporates updates like CUDA 12.6, TensorRT 10.3, and Ubuntu 22.04-based methods. JetPack 6.2 boosts AI inference efficiency for GenAI fashions by as much as 2X and helps high-power Supermodes for Jetson Orin Nano and NX modules.
ASUS continues to innovate in AIoT options, specializing in sustainability and making a net-zero enterprise for a round economic system.
Associated
AI/ML | AIoT | ASUS | edge AI | edge AI servers | generative AI | IoT | Nvidia