Nous Chat launches with access to Hermes 3-70B

Nous Research, the AI analysis group devoted to creating “personalized, unrestricted” AI fashions as a substitute for extra buttoned up company outfits resembling OpenAI, Anthropic, Google, Meta, and others, has beforehand launched a number of open supply fashions in its Hermes household, and new, extra environment friendly AI coaching strategies.

However earlier than at this time, if researchers and customers needed to truly deploy these fashions, they’d wanted to obtain and run the code on their very own machines — a time-consuming, finicky, and potential expensive endeavor — or use them on companion web sites.

Now not: Nous just announced its first user-facing chatbot inference, Nous Chat, which supplies customers entry to its massive language mannequin (LLM) Hermes 3-70B, a fine-tuned variant of Meta’s Llama 3.1, within the acquainted format of ChatGPT, Hugging Chat, and different standard AI chatbot instruments — with a textual content entry field on the backside for the consumer to kind in textual content prompts, and a big house for the chatbot to return outputs up prime. As Nous wrote in a post on the social network X:

“Since our first model of Hermes was launched over a yr in the past, many individuals have requested for a spot to expertise it. In the present day we’re glad to announce Nous Chat, a brand new consumer interface to expertise Hermes 3 70B and past.

https://hermes.nousresearch.com

We now have reasoning enhancements, new fashions, and experimental capabilities deliberate for the long run, and it will grow to be the perfect place to expertise Hermes and rather more.”

Preliminary impressions of Nous Chat

Nous’s design language is correct up my alley, utilizing classic fonts and characters evoking early PC terminals. It provides a darkish and lightweight mode the consumer can toggle between within the higher proper hand nook.

Curiously, like OpenAI ultimately did with ChatGPT — and plenty of different AI mannequin suppliers as properly — Nous Chat additionally provides urged or instance prompts on the backside of the display screen above the immediate entry textbox, together with “Information & Evaluation,” “Artistic Writing,” “Downside Fixing,” and “Analysis & Synthesis.”

Clicking any of those will ship a pre-written immediate to the underlying mannequin by means of the chatbot, and have it reply, resembling serving up a abstract of analysis on “intermittent fasting.”

In my transient exams of the chatbot, it was speedy, serving up solutions in single-digit seconds, and was capable of produce hyperlinks again to URLs on the internet for sources it cited, although it appeared to hallucinate these as properly, from time to time — and the chatbot itself claimed it couldn’t entry the online.

Regardless of its beforehand acknowledged goals of enabling individuals to deploy and management their very own AI fashions with out content material restrictions, Nous Chat itself really does seem to have some guardrails set, together with towards making unlawful narcotics resembling methamphetamine.

As well as, the underlying Hermes 3-70B mannequin specified to me that its information cutoff date was April 2023, making it much less helpful to acquire present occasions, one thing that OpenAI is now competing straight on towards Google and different startups resembling Perplexity.

Already jailbroken

That hasn’t stopped notorious AI jailbreakers such as Pliny the Prompter (@elder_plinius on X) from already quickly cracking the chatbot and getting previous the restrictions.

Whereas missing lots of the superior options of different main chatbots resembling file attachments, picture evaluation and era, and interactive code show canvases or trays, Nous Chat is unlikely to switch these rivals for a lot of enterprise customers.

However as an experiment it’s definitely attention-grabbing and price enjoying round with, in my view, and if Nous does add extra options to it, it may make for a compelling various — particularly if content material restrictions are lifted per Nous’s acknowledged goals.

I’ve reached out to the group for extra info on Nous Chat and its strategy to guardrails/content material restrictions, and I’ll replace after I hear again.