Saturday, 13 Dec 2025
Subscribe
logo
  • Global
  • AI
  • Cloud Computing
  • Edge Computing
  • Security
  • Investment
  • Sustainability
  • More
    • Colocation
    • Quantum Computing
    • Regulation & Policy
    • Infrastructure
    • Power & Cooling
    • Design
    • Innovations
    • Blog
Font ResizerAa
Data Center NewsData Center News
Search
  • Global
  • AI
  • Cloud Computing
  • Edge Computing
  • Security
  • Investment
  • Sustainability
  • More
    • Colocation
    • Quantum Computing
    • Regulation & Policy
    • Infrastructure
    • Power & Cooling
    • Design
    • Innovations
    • Blog
Have an existing account? Sign In
Follow US
© 2022 Foxiz News Network. Ruby Design Company. All Rights Reserved.
Data Center News > Blog > AI > Not everything needs an LLM: A framework for evaluating when AI makes sense
AI

Not everything needs an LLM: A framework for evaluating when AI makes sense

Last updated: May 4, 2025 12:48 am
Published May 4, 2025
Share
Not everything needs an LLM: A framework for evaluating when AI makes sense
SHARE

Be a part of our each day and weekly newsletters for the newest updates and unique content material on industry-leading AI protection. Be taught Extra


Query: What product ought to use machine studying (ML)?
Venture supervisor reply: Sure.

Jokes apart, the appearance of generative AI has upended our understanding of what use circumstances lend themselves greatest to ML. Traditionally, now we have at all times leveraged ML for repeatable, predictive patterns in buyer experiences, however now, it’s attainable to leverage a type of ML even with out a whole coaching dataset.

Nonetheless, the reply to the query “What buyer wants requires an AI resolution?” nonetheless isn’t at all times “sure.” Massive language fashions (LLMs) can nonetheless be prohibitively costly for some, and as with all ML fashions, LLMs will not be at all times correct. There’ll at all times be use circumstances the place leveraging an ML implementation is just not the precise path ahead. How will we as AI challenge managers consider our clients’ wants for AI implementation?

The important thing concerns to assist make this choice embody:

  1. The inputs and outputs required to meet your buyer’s wants: An enter is offered by the shopper to your product and the output is offered by your product. So, for a Spotify ML-generated playlist (an output), inputs may embody buyer preferences, and ‘favored’ songs, artists and music style.
  2. Mixtures of inputs and outputs: Buyer wants can range based mostly on whether or not they need the identical or completely different output for a similar or completely different enter. The extra permutations and mixtures we have to replicate for inputs and outputs, at scale, the extra we have to flip to ML versus rule-based programs.
  3. Patterns in inputs and outputs: Patterns within the required mixtures of inputs or outputs aid you determine what sort of ML mannequin you’ll want to use for implementation. If there are patterns to the mixtures of inputs and outputs (like reviewing buyer anecdotes to derive a sentiment rating), take into account supervised or semi-supervised ML fashions over LLMs as a result of they is likely to be less expensive.
  4. Price and Precision: LLM calls will not be at all times low cost at scale and the outputs will not be at all times exact/precise, regardless of fine-tuning and immediate engineering. Generally, you’re higher off with supervised fashions for neural networks that may classify an enter utilizing a hard and fast set of labels, and even rules-based programs, as an alternative of utilizing an LLM.
See also  Alembic melted GPUs chasing causal A.I. — now it's running one of the fastest supercomputers in the world

I put collectively a fast desk beneath, summarizing the concerns above, to assist challenge managers consider their buyer wants and decide whether or not an ML implementation looks like the precise path ahead.

Sort of buyer wantInstanceML Implementation (Sure/No/Relies upon)Sort of ML Implementation
Repetitive duties the place a buyer wants the identical output for a similar enterAdd my electronic mail throughout numerous varieties on-lineNoMaking a rules-based system is greater than ample that can assist you along with your outputs
Repetitive duties the place a buyer wants completely different outputs for a similar enterThe client is in “discovery mode” and expects a brand new expertise after they take the identical motion (akin to signing into an account):

— Generate a brand new paintings per click on

—StumbleUpon (keep in mind that?) discovering a brand new nook of the web by random search

Sure–Picture era LLMs

–Advice algorithms (collaborative filtering)

Repetitive duties the place a buyer wants the identical/related output for various inputs–Grading essays
–Producing themes from buyer suggestions
Relies uponIf the variety of enter and output mixtures are easy sufficient, a deterministic, rules-based system can nonetheless be just right for you. 

Nevertheless, in the event you start having a number of mixtures of inputs and outputs as a result of a rules-based system can not scale successfully, take into account leaning on:

–Classifiers
–Subject modelling

However provided that there are patterns to those inputs. 

If there are not any patterns in any respect, take into account leveraging LLMs, however just for one-off situations (as LLMs will not be as exact as supervised fashions).

Repetitive duties the place a buyer wants completely different outputs for various inputs –Answering buyer assist questions
–Search
SureIt’s uncommon to come back throughout examples the place you may present completely different outputs for various inputs at scale with out ML.

There are simply too many permutations for a rules-based implementation to scale successfully. Think about:

–LLMs with retrieval-augmented era (RAG)
–Choice timber for merchandise akin to search

Non-repetitive duties with completely different outputsEvaluate of a resort/restaurantSurePre-LLMs, one of these state of affairs was difficult to perform with out fashions that had been educated for particular duties, akin to:

–Recurrent neural networks (RNNs)
–Lengthy short-term reminiscence networks (LSTMs) for predicting the following phrase

LLMs are an excellent match for one of these state of affairs. 

The underside line: Don’t use a lightsaber when a easy pair of scissors may do the trick. Consider your buyer’s want utilizing the matrix above, taking into consideration the prices of implementation and the precision of the output, to construct correct, cost-effective merchandise at scale.

See also  QwenLong-L1 solves long-context reasoning challenge that stumps current LLMs

Sharanya Rao is a fintech group product supervisor. The views expressed on this article are these of the writer and never essentially these of their firm or group.


Source link
TAGGED: Evaluating, framework, LLM, Sense
Share This Article
Twitter Email Copy Link Print
Previous Article emmi AI Emmi AI Raises $17.1M in Seed Funding
Next Article In the Spotlight... Mitsubishi Electric Video Interview In the Spotlight… Mitsubishi Electric Video Interview
Leave a comment

Leave a Reply Cancel reply

Your email address will not be published. Required fields are marked *

Your Trusted Source for Accurate and Timely Updates!

Our commitment to accuracy, impartiality, and delivering breaking news as it happens has earned us the trust of a vast audience. Stay ahead with real-time updates on the latest events, trends.
FacebookLike
TwitterFollow
InstagramFollow
YoutubeSubscribe
LinkedInFollow
MediumFollow
- Advertisement -
Ad image

Popular Posts

OpenAI Operator kickstarts era of browser AI agents

OpenAI has unveiled Operator, a device that integrates seamlessly with net browsers to carry out…

January 24, 2025

Feds charge Iranian nationals for cyberattacks against US government

The US authorities has charged and sanctioned 4 Iranian nationals over claims they carried out…

April 25, 2024

Decoding Equinix Inc (EQIX): A Strategic SWOT Insight

Equinix Inc (EQIX, Monetary), a world chief in knowledge heart and interconnection options, operates an…

February 17, 2024

IBM claims 45% productivity gains with Project Bob, its multi-model IDE that orchestrates LLMs with full repository context

For a lot of enterprises, there proceed to be limitations to totally adopting and benefiting…

October 7, 2025

Microsoft and Brookfield Sign Biggest-Ever Clean Power Deal | DCN

(Bloomberg) -- Microsoft Corp. and Brookfield Asset Administration’s inexperienced vitality arm signed the most important…

May 1, 2024

You Might Also Like

Google’s new framework helps AI agents spend their compute and tool budget more wisely
AI

Google’s new framework helps AI agents spend their compute and tool budget more wisely

By saad
BBVA embeds AI into banking workflows using ChatGPT Enterprise
AI

BBVA embeds AI into banking workflows using ChatGPT Enterprise

By saad
Ai2's new Olmo 3.1 extends reinforcement learning training for stronger reasoning benchmarks
AI

Ai2's new Olmo 3.1 extends reinforcement learning training for stronger reasoning benchmarks

By saad
Experimental AI concludes as autonomous systems rise
AI

Experimental AI concludes as autonomous systems rise

By saad
Data Center News
Facebook Twitter Youtube Instagram Linkedin

About US

Data Center News: Stay informed on the pulse of data centers. Latest updates, tech trends, and industry insights—all in one place. Elevate your data infrastructure knowledge.

Top Categories
  • Global Market
  • Infrastructure
  • Innovations
  • Investments
Usefull Links
  • Home
  • Contact
  • Privacy Policy
  • Terms & Conditions

© 2024 – datacenternews.tech – All rights reserved

Welcome Back!

Sign in to your account

Lost your password?
We use cookies to ensure that we give you the best experience on our website. If you continue to use this site we will assume that you are happy with it.
You can revoke your consent any time using the Revoke consent button.