We collect cookies to analyze our website traffic and performance; we never collect any personal data. Cookie Policy
Accept
NEW YORK DAWN™NEW YORK DAWN™NEW YORK DAWN™
Notification Show More
Font ResizerAa
  • Home
  • Trending
  • New York
  • World
  • Politics
  • Business
    • Business
    • Economy
    • Real Estate
  • Crypto & NFTs
  • Tech
  • Lifestyle
    • Lifestyle
    • Food
    • Travel
    • Fashion
    • Art
  • Health
  • Sports
  • Entertainment
Reading: How Yelp reviewed competing LLMs for correctness, relevance and tone to develop its user-friendly AI assistant
Share
Font ResizerAa
NEW YORK DAWN™NEW YORK DAWN™
Search
  • Home
  • Trending
  • New York
  • World
  • Politics
  • Business
    • Business
    • Economy
    • Real Estate
  • Crypto & NFTs
  • Tech
  • Lifestyle
    • Lifestyle
    • Food
    • Travel
    • Fashion
    • Art
  • Health
  • Sports
  • Entertainment
Follow US
NEW YORK DAWN™ > Blog > Technology > How Yelp reviewed competing LLMs for correctness, relevance and tone to develop its user-friendly AI assistant
How Yelp reviewed competing LLMs for correctness, relevance and tone to develop its user-friendly AI assistant
Technology

How Yelp reviewed competing LLMs for correctness, relevance and tone to develop its user-friendly AI assistant

Last updated: March 7, 2025 9:04 pm
Editorial Board Published March 7, 2025
Share
SHARE

The overview app Yelp has offered useful data to diners and different shoppers for many years. It had experimented with machine studying since its early years. Throughout the latest explosion in AI expertise, it was nonetheless encountering hindrances because it labored to make use of trendy massive language fashions to energy some options. 

Yelp realized that prospects, particularly those that solely sometimes used the app, had bother connecting with its AI options, reminiscent of its AI-powered assistant. 

“One of the obvious lessons that we saw is that it’s very easy to build something that looks cool, but very hard to build something that looks cool and is very useful,” Craig Saldanha, chief product officer at Yelp, instructed VentureBeat in an interview.

It definitely wasn’t all straightforward. After it launched Yelp Assistant, its AI-powered service search assistant, in April 2024 to a broader swathe of shoppers, Yelp noticed utilization figures for its AI instruments really starting to say no. 

“The one that took us by surprise was when we launched this as a beta to consumers — a few users and folks who are very familiar with the app — [and they] loved it. We got such a strong signal that this would be successful, and then we rolled it out to everyone, [and] the performance just fell off,” Saldanha stated. “It took us a long time to figure out why.”

It turned out that Yelp’s extra informal customers, those that sometimes visited the location or app to discover a new tailor or plumber, didn’t count on to be be instantly speaking with an AI consultant. 

From easy to extra concerned AI options

Most individuals know Yelp as an internet site and app to lookup restaurant critiques and menu photographs. I exploit Yelp to seek out photos of meals in new eateries and to see if others share my emotions a couple of significantly bland dish. It’s additionally a spot that tells me if a espresso store I plan to make use of as a workspace for the day has WiFi, plugs and seating, a rarity in Manhattan.

Saldanha recalled that Yelp had been investing in AI “for the better part of a decade.”

“Way back when, I’d say in the 2013-2014 timeline, we were in a very different generation of AI, so our focus was on building our own models to do things like query understanding. Part of the job of making a meaningful connection is helping people refine their own search intent,” he stated.

However as AI continued to evolve, so did Yelp’s wants. It invested in AI to acknowledge meals in photos submitted by customers to establish common dishes, after which it launched new methods to connect with tradespeople and companies and assist information customers’ searches on the platform. 

Yelp Assistant helps Yelp customers discover the fitting “Pro” to work with. Individuals can faucet the chatbox and both use the prompts or sort out the duty they want achieved. The assistant then asks follow-up inquiries to slim down potential service suppliers earlier than drafting a message to Professionals who would possibly wish to bid for the job.

Saldanha stated Professionals are inspired to reply to customers themselves, although he acknowledges that bigger manufacturers typically have name facilities that deal with messages generated by Yelp’s AI Assistant. 

Along with Yelp Assistant, Yelp launched Evaluate Insights and Highlights. LLMs analyze consumer and reviewer sentiment, which Yelp collects into sentiment scores. Yelp makes use of an in depth GPT-4o immediate to generate a dataset for an inventory of subjects. Then, it’s fine-tuned with a GPT-4o-mini mannequin. 

The overview highlights characteristic, which presents data from critiques, additionally makes use of an LLM immediate to generate a dataset. Nonetheless, it’s based mostly on GPT-4, with fine-tuning from GPT-3.5 Turbo. Yelp stated it would replace the characteristic with GPT-4o and o1. 

Yelp joined many different firms utilizing LLMs to enhance the usefulness of critiques by including higher search features based mostly on buyer feedback. For instance, Amazon launched Rufus, an AI-powered assistant that helps folks discover beneficial objects.

Massive fashions and efficiency wants

For a lot of of its new AI options, together with the AI assistant, Yelp turned to OpenAI’s GPT-4o and different fashions, however Saldanha famous that regardless of the mannequin, Yelp’s knowledge is the key sauce for its assistants. Yelp didn’t wish to lock itself into one mannequin and saved an open thoughts about which LLMs would supply the perfect service for its prospects. 

“We use models from OpenAI, Anthropic and other models on AWS Bedrock,” Saldanha stated. 

Saldanha defined that Yelp created a rubric to check the efficiency of fashions in correctness, relevance, consciousness, buyer security and compliance. He stated that “it ‘s really the top end models” that carried out finest. The corporate runs a small pilot with every mannequin earlier than bearing in mind iteration price and response latency. 

Instructing customers

Yelp additionally launched into a concerted effort to coach each informal and energy customers to get comfy with the brand new AI options. Saldanha stated one of many first issues they realized, particularly with the AI assistant, is that the tone needed to really feel human. It couldn’t reply too quick or too slowly; it couldn’t be overly encouraging or too brusque.

“We put a bunch of effort into helping people feel comfortable, especially with that first response. It took us almost four months to get this second piece right. And as soon as we did, it was very obvious and you could see that hockey stick in engagement,” Saldanha stated. 

A part of that course of concerned coaching the Yelp Assistant to make use of sure phrases and to sound optimistic. In any case that fine-tuning, Saldanha stated they’re lastly seeing larger utilization numbers for Yelp’s AI options. 

Day by day insights on enterprise use circumstances with VB Day by day

If you wish to impress your boss, VB Day by day has you lined. We provide the inside scoop on what firms are doing with generative AI, from regulatory shifts to sensible deployments, so you’ll be able to share insights for max ROI.

An error occured.

You Might Also Like

Apple makes main AI advance with picture era know-how rivaling DALL-E and Midjourney

Microsoft unveils Xbox gaming handheld launching in 2025 (up to date with hands-on)

Like people, AI is forcing establishments to rethink their function

Activision confirms Name of Obligation: Black Ops 7 for 2025 launch

Microsoft unveils Xbox gaming handheld launching in 2025

TAGGED:assistantcompetingcorrectnessdevelopLLMsrelevancereviewedtoneuserfriendlyYelp
Share This Article
Facebook Twitter Email Print

Follow US

Find US on Social Medias
FacebookLike
TwitterFollow
YoutubeSubscribe
TelegramFollow
Popular News
Jake Sullivan, Biden’s Adviser, a Figure of Fascination and Schadenfreude
Politics

Jake Sullivan, Biden’s Adviser, a Figure of Fascination and Schadenfreude

Editorial Board November 30, 2021
Lauren Boebert’s Gun-Themed Restaurant, Shooters Grill, Closes
Hal Steinbrenner dishes on Yankees’ payroll, wants past Juan Soto, Roki Sasaki and extra
Intercourse-based mind variations: Construction of a single neuron in C. elegans supplies new insights
NFL fines Falcons $250K, docks DC Jeff Ulbrich $100K for Shedeur Sanders prank name negligence

You Might Also Like

How Yelp reviewed competing LLMs for correctness, relevance and tone to develop its user-friendly AI assistant
Technology

Agent-based computing is outgrowing the net as we all know it

June 7, 2025
Implicit Conversions ports Xseed’s Milano’s Odd Job Assortment to PS4
Technology

Implicit Conversions ports Xseed’s Milano’s Odd Job Assortment to PS4

June 7, 2025
Mundfish Video games pronounces Atomic Coronary heart II after first recreation cleared 10M bought
Technology

Mundfish Video games pronounces Atomic Coronary heart II after first recreation cleared 10M bought

June 7, 2025
Mundfish unveils two new video games: The Dice and In poor health
Technology

Mundfish unveils two new video games: The Dice and In poor health

June 7, 2025

Categories

  • Health
  • Sports
  • Politics
  • Entertainment
  • Technology
  • World
  • Art

About US

New York Dawn is a proud and integral publication of the Enspirers News Group, embodying the values of journalistic integrity and excellence.
Company
  • About Us
  • Newsroom Policies & Standards
  • Diversity & Inclusion
  • Careers
  • Media & Community Relations
  • Accessibility Statement
Contact Us
  • Contact Us
  • Contact Customer Care
  • Advertise
  • Licensing & Syndication
  • Request a Correction
  • Contact the Newsroom
  • Send a News Tip
  • Report a Vulnerability
Term of Use
  • Digital Products Terms of Sale
  • Terms of Service
  • Privacy Policy
  • Cookie Settings
  • Submissions & Discussion Policy
  • RSS Terms of Service
  • Ad Choices
© 2024 New York Dawn. All Rights Reserved.
Welcome Back!

Sign in to your account

Lost your password?