Primate Labs has formally launched Geekbench AI, a benchmarking software designed particularly for machine studying and AI-centric workloads.
The discharge of Geekbench AI 1.0 marks the fruits of years of improvement and collaboration with prospects, companions, and the AI engineering neighborhood. The benchmark, beforehand often called Geekbench ML throughout its preview part, has been rebranded to align with {industry} terminology and guarantee readability about its function.
Geekbench AI is now accessible for Home windows, macOS, and Linux by means of the Primate Labs web site, in addition to on the Google Play Retailer and Apple App Retailer for cell gadgets.
Primate Labs’ newest benchmarking software goals to offer a standardised methodology for measuring and evaluating AI capabilities throughout totally different platforms and architectures. The benchmark gives a singular strategy by offering three general scores, reflecting the complexity and heterogeneity of AI workloads.
“Measuring efficiency is, put merely, actually arduous,” defined Primate Labs. “That’s not as a result of it’s arduous to run an arbitrary take a look at, however as a result of it’s arduous to find out which exams are a very powerful for the efficiency you wish to measure – particularly throughout totally different platforms, and notably when everyone seems to be doing issues in subtly other ways.”
The three-score system accounts for the numerous precision ranges and {hardware} optimisations present in trendy AI implementations. This multi-dimensional strategy permits builders, {hardware} distributors, and fanatics to achieve deeper insights into a tool’s AI efficiency throughout totally different situations.
A notable addition to Geekbench AI is the inclusion of accuracy measurements for every take a look at. This characteristic acknowledges that AI efficiency isn’t solely about pace but additionally concerning the high quality of outcomes. By combining pace and accuracy metrics, Geekbench AI offers a extra holistic view of AI capabilities, serving to customers perceive the trade-offs between efficiency and precision.
Geekbench AI 1.0 introduces assist for a variety of AI frameworks, together with OpenVINO on Linux and Home windows, and vendor-specific TensorFlow Lite delegates like Samsung ENN, ArmNN, and Qualcomm QNN on Android. This broad framework assist ensures that the benchmark displays the most recent instruments and methodologies utilized by AI builders.
The benchmark additionally utilises extra intensive and numerous datasets, which not solely improve the accuracy evaluations but additionally higher characterize real-world AI use instances. All workloads in Geekbench AI 1.0 run for at least one second, permitting gadgets to succeed in their most efficiency ranges throughout testing whereas nonetheless reflecting the bursty nature of real-world purposes.
Primate Labs has printed detailed technical descriptions of the workloads and fashions utilized in Geekbench AI 1.0, emphasising their dedication to transparency and industry-standard testing methodologies. The benchmark is built-in with the Geekbench Browser, facilitating straightforward cross-platform comparisons and outcome sharing.
The corporate anticipates common updates to Geekbench AI to maintain tempo with market adjustments and rising AI options. Nonetheless, Primate Labs believes that Geekbench AI has already reached a degree of reliability that makes it appropriate for integration into skilled workflows, with main tech firms like Samsung and Nvidia already utilising the benchmark.
(Picture Credit score: Primate Labs)
See additionally: xAI unveils Grok-2 to problem the AI hierarchy
Need to study extra about AI and large information from {industry} leaders? Try AI & Big Data Expo happening in Amsterdam, California, and London. The great occasion is co-located with different main occasions together with Intelligent Automation Conference, BlockX, Digital Transformation Week, and Cyber Security & Cloud Expo.
Discover different upcoming enterprise expertise occasions and webinars powered by TechForge here.
