Skip to content
AIBites
Tech & AI

Restaurant: uses LLM voice chatbot to answer caller questions LLM Voice: lies CONSTANTLY about things like opening times…

A restaurant uses an LLM voice chatbot to answer calls, but it hallucinates opening times and patio seating — misleading customers and eroding community

By AIBites Editorial Team17 min read
Restaurant: uses LLM voice chatbot to answer caller questions LLM Voice: lies CONSTANTLY about things like opening times…

A restaurant deployed a large language model–powered voice chatbot to handle inbound phone calls, and the system proceeded to lie constantly about basic operational facts — opening times, patio seating availability, and more — leaving customers angry and misled. The incident was surfaced in a widely shared Bluesky post by New York Times–bestselling author Max Gladstone on June 20, 2025. It's a compact but devastating illustration of a systemic problem: the gap between what LLM vendors promise and what these systems actually deliver when they hit real-world operational complexity.

What Happened: A Voice Bot That Couldn't Tell the Truth

The setup seemed straightforward. A restaurant — the kind of local establishment where phone calls are a daily lifeline between business and community — replaced its human phone-answering function with an LLM-powered voice chatbot. The vendor pitch would have been familiar to any operator who has sat through a demo: answer every call instantly, never put anyone on hold, handle the routine questions so staff can focus on the floor.

Instead, according to Gladstone's account, the chatbot hallucinated. Repeatedly. It gave customers wrong opening times and misrepresented whether the patio was available. It confidently provided false information about exactly the kind of high-stakes, time-sensitive operational details that customers call to confirm before making a trip.

Gladstone's framing is precise and worth quoting in full:

"Restaurant: uses LLM voice chatbot to answer caller questions
LLM Voice: lies CONSTANTLY about things like opening times, patio seating, etc
Customers: Angry, misled
Setting aside ethics, many LLM applications sold now will do nothing but erode your community's trust (easy to lose, hard to gain)"

The word constantly is doing significant work there. As Gladstone describes it, this was not an edge case or a one-off hallucination triggered by some obscure query. The system was failing on the most predictable, highest-frequency questions a restaurant phone line ever receives — the very questions it was deployed specifically to answer. The specific restaurant and vendor were not publicly named in the post.

Why LLMs Hallucinate on Exactly This Kind of Data

To understand why this outcome was unsurprising — and in fact entirely predictable — it helps to understand what large language models actually are and, more importantly, what they are not.

LLMs Are Pattern-Completion Engines, Not Live Databases

A large language model generates responses by predicting statistically probable continuations of text, drawing on patterns encoded during training. It does not query a live database by default. It does not "know" what time a specific restaurant closes on a Tuesday in June 2025. When asked, it produces a fluent, confident-sounding answer regardless — one extrapolated from whatever patterns in its training data seem contextually appropriate. This behavior is called hallucination: the model outputs plausible-sounding but factually incorrect information, with no internal signal that anything is wrong.

Opening hours and seating configurations are among the worst possible data types for a vanilla LLM to handle:

  • They change frequently — seasonally, for holidays, due to short-notice staffing changes, or at an owner's discretion with no public announcement.
  • They are hyper-local and specific — no general-purpose training corpus reliably contains the current operating hours of a single neighborhood restaurant. Even scraped data from Google Business Profiles or Yelp goes stale the moment an operator updates their hours.
  • They are binary in consequence — the customer either arrives at an open restaurant or a closed one. There is no "close enough."
  • They are exactly what callers need to verify — people call specifically because they don't trust what they read online, or because they know online listings go stale. An AI that replicates the same stale or fabricated data defeats the entire purpose of the call.

Retrieval-Augmented Generation Could Help — But Only If Implemented Correctly

The standard engineering mitigation for this class of problem is Retrieval-Augmented Generation (RAG): rather than relying on the model's parametric memory, the system retrieves relevant, up-to-date facts from a connected data source — a restaurant's own POS system, a managed content database, or a Google Business Profile API — and grounds the model's response in those retrieved facts at inference time.

RAG is not a silver bullet. It introduces its own failure modes:

  • Stale source data: If the connected database isn't updated when hours change, the retrieved fact is wrong before the model even sees it.
  • Retrieval mismatch: The retrieval step may surface the wrong document or field — returning last summer's patio hours instead of the current policy, for example.
  • Model override: Even when correct context is retrieved, a model can "override" retrieved facts with its own parametric intuitions, particularly when the retrieved content conflicts with strongly represented patterns in training data.
  • Prompt injection risk: In systems where retrieved content is inserted into a prompt, malicious or malformed input in the data source can manipulate model behavior — a risk that grows when the retrieval pipeline ingests third-party content.

For a small restaurant operator with limited technical resources, maintaining a correctly integrated, continuously synchronized RAG pipeline is a significant ongoing engineering commitment — one that most off-the-shelf voice chatbot vendors either don't provide or implement poorly. The likelier explanation in this incident is simpler: the system was deployed with no reliable grounding mechanism at all, and the LLM was left to improvise.

The Trust Economy: Why This Failure Is Worse Than It Looks

Gladstone's core argument goes beyond the technical. He frames the damage in terms of community trust — and that framing deserves serious attention from developers and product teams alike.

A restaurant is not an abstract digital service. It's embedded in a neighborhood. Its regulars are, in the most literal sense, a community. That community runs on trust: trust that when you call ahead, the information you receive is accurate; trust that the business respects your time; trust that the voice on the phone is genuinely trying to help you, not generating a statistically plausible response.

When an LLM voice bot tells a customer the patio is open — and that customer arrives to find it closed — the customer doesn't think "the AI hallucinated." They think "the restaurant lied to me." The reputational damage accrues to the business, not the AI vendor. The trust relationship that took years to build between a local restaurant and its regulars can be meaningfully and permanently damaged by a pattern of AI-generated misinformation that the operator may not even know is happening.

Why it matters: Trust, as Gladstone puts it, is "easy to lose, hard to gain." In the restaurant industry — where repeat customers, word-of-mouth, and community standing are primary growth drivers — a chatbot that lies is not a neutral productivity tool. It is an active liability.

This asymmetry is critical for developers to internalize. The cost of a hallucination is not absorbed by the model or the vendor. It is externalized entirely onto the business and its customers. The vendor collects the subscription fee regardless of how many customers were misled that month.

The Trust Transfer Problem

This incident illustrates what we might call the trust transfer problem inherent in deploying LLMs in customer-facing roles: the business lends its credibility to the model, but the model cannot reliably honor that loan. When the model fails, it is the business's credibility that takes the hit — not the model's, not the vendor's.

Unlike a slow POS system that frustrates staff, or a buggy reservation platform that loses bookings, an AI that lies — that produces confident, fluent, wrong answers — does something categorically more damaging: it weaponizes the business's own voice against the customers that business depends on. The voice that told a customer the patio was open represented the restaurant. The trust that breaks is the trust between the customer and that restaurant, not between the customer and some abstract infrastructure vendor they've never heard of.

A Broken Incentive Structure in the LLM Tooling Market

The restaurant incident is not an isolated anecdote. It's a symptom of a structural misalignment in how LLM-powered tools are currently being sold to small and medium businesses.

Vendors Optimizing for Demos, Not Deployments

LLM voice chatbot vendors face strong commercial incentives to make their products look impressive in controlled demonstration environments, where the system is prompted with clean, in-distribution questions and responses can be curated or cherry-picked. The messy reality of a real phone line — ambiguous accents, unusual phrasing, requests for hyper-specific operational data that was never in the training set — is much harder to demo well and nearly impossible to guarantee at scale.

Operators, meanwhile, often lack the technical background to probe for failure modes during vendor evaluation. They see a convincing demo, they hear a compelling cost-savings pitch, and they deploy. The hallucinations emerge post-launch, in front of real customers, on real calls, with nobody from the vendor present to explain what went wrong.

The "Good Enough" Fallacy

A common vendor argument is that an AI answering system that's correct 90% of the time beats a missed call. For some use cases and some data types — general FAQs, directions, parking information that rarely changes — that logic holds. For time-critical operational facts like opening hours, it doesn't.

Consider a concrete illustration: if a restaurant receives 50 calls per day asking about hours or availability, and the system produces incorrect answers 10% of the time, that's five customers per day who receive false information. Some fraction will make a wasted trip. Some will leave a negative review. Some will simply never return. A 10% error rate on "are you open right now?" is not a tolerable engineering budget — it's a slow-motion customer attrition engine.

Appropriate vs. Inappropriate LLM Use Cases for Restaurants

Use Case LLM Suitability Key Risk Mitigation Required Notes
Answering menu questions (general) Moderate — only with RAG grounding Stale menu data; missing or seasonal items Live menu integration; regular sync cadence Particularly risky for allergen information
Confirming opening hours Low — without live data grounding Hallucinated hours cause wasted trips and negative reviews Hard-coded or API-connected hours; no LLM improvisation permitted on this field This is the failure mode in the Gladstone incident
Patio / seating availability Low — real-time state is unknown to the model Customers misled, arrive to find no seating Real-time reservation system integration or explicit "I don't know" fallback Availability is a live state; no static data source can substitute
Taking reservations Moderate — with booking system integration Double-bookings; incorrect confirmations sent to guests Direct API integration with reservation platform; confirmation emails as audit trail OpenTable, Resy, and similar platforms offer APIs; verify vendor integration depth
Handling complaints or special requests Low — high stakes; requires empathy and authority Incorrect commitments made on behalf of the business Route immediately to human staff; do not allow LLM to make promises A bot that offers a "free meal next time" without authorization creates legal and financial exposure
Upselling / describing daily specials Moderate — only if specials are grounded in current data Promoting items not currently available or incorrectly described Daily specials sync required; model must not extrapolate beyond retrieved content Particularly risky if specials involve allergen-sensitive substitutions
Providing directions and parking info High — static data, low consequence of minor error Outdated construction or parking changes Periodic review; low-priority grounding update One of the safer LLM use cases for local business

What Responsible Deployment Actually Looks Like

For developers building or advising on LLM voice systems for hospitality and small business, the restaurant incident maps directly to a concrete set of engineering and product requirements. These should be treated as non-negotiable minimums, not aspirational features.

1. Ground Every Factual Claim in Live, Authoritative Data

Opening hours, seating configuration, menu items, pricing, and real-time availability must come from a continuously updated, operator-controlled data source — not from the model's weights. The LLM's role in these interactions is to retrieve and format information, not to recall and invent it. If the system can't retrieve a reliable answer for a given query, it must say so explicitly rather than generate a confident-sounding substitute.

2. Design Explicit "I Don't Know" Behaviors

A well-engineered voice system needs a clearly defined fallback path: when confidence in a factual answer falls below threshold, or when the required data is absent from the connected source, the system must acknowledge the limitation and offer a concrete alternative — transferring to a human, directing the caller to the restaurant's website, or offering a callback. Confident hallucination is the worst possible failure mode and must be prevented architecturally, through system design, not hoped away through prompt engineering alone.

3. Instrument and Monitor Post-Launch

Operators deploying voice AI need full visibility into what the system is saying on their behalf. Call transcripts should be logged, regularly sampled, and reviewed — especially in the first weeks of deployment. Anomaly detection on response patterns (for example, flagging calls where hours mentioned by the bot differ from the operator's configured hours) should be a baseline feature. Vendors who don't provide this transparency are selling a product the operator cannot oversee, audit, or correct.

4. Set a Conservative Scope at Launch

The temptation is to let the LLM answer everything from day one. The wiser path is to restrict the initial deployment to a narrow set of questions the system can answer reliably — those with clear, grounded answers from a live data source — and expand scope only as monitoring confirms reliability over time. A voice bot that correctly handles directions, parking, and cuisine type while routing all availability questions to a human is more valuable than one that ambitiously handles everything and lies about half of it.

5. Disclose AI to Callers

Beyond being the ethical standard, explicit AI disclosure is, in some jurisdictions, a legal requirement. California's Bolstering Online Transparency (BOT) Act, for example, requires disclosure when a "bot" is used to communicate or interact with a person online to incentivize a sale or influence a vote; operators should confirm with counsel whether and how such statutes apply to their particular phone-based voice systems, since the wording and scope of these laws vary. Disclosure also serves a practical protective function: a caller who knows they're speaking with an AI is more likely to independently verify critical information — checking the restaurant's website for hours, for instance. A caller who believes they spoke with a human has no reason to double-check, and no recourse when the information turns out to be wrong.

6. Define a Rapid Correction Protocol

When a hallucination surfaces post-launch, how quickly can the operator correct the grounding data, and how quickly does that correction reach live call responses? This pipeline — from operator update to live deployment — should be measured in minutes, not days. Vendors should be able to demonstrate this capability concretely, not just describe it in marketing materials.

The Broader Pattern: Trust Erosion as a Predictable Product Outcome

Gladstone's observation — "setting aside ethics, many LLM applications sold now will do nothing but erode your community's trust" — deserves to be treated as a product design principle, not merely an ethical concern. Trust erosion is not a side effect or an edge case; for products deployed without proper grounding, it is the expected outcome at scale.

The history of technology adoption in small business is littered with tools that promised efficiency and delivered friction. What makes the current LLM moment distinctive is the specific nature of the failure mode. A slow POS system frustrates staff but doesn't mislead customers. A buggy reservation platform loses bookings but doesn't make promises on the restaurant's behalf. An AI that lies — that produces confident, fluent, wrong answers in the restaurant's voice — does something categorically different and categorically more damaging.

As more restaurants deploy these systems and more customers get burned, the reputational damage will likely accumulate visibly: in one-star reviews, in social media posts, in exactly the kind of community conversation that Gladstone's Bluesky post represents. Individual incidents like this one are the leading edge of a much larger pattern that the industry has not yet fully reckoned with.

Key Takeaways for Developers and Operators

  • LLMs hallucinate on exactly the data restaurants need most: Opening hours, real-time availability, and location-specific operational details are not reliably encoded in any model's training data. Without grounding, a vanilla LLM will improvise plausibly but incorrectly — often, at scale.
  • The reputational cost lands on the business, not the vendor: Customers attribute misinformation to the restaurant, not to the AI infrastructure, eroding community trust that took years to build and can't be rebuilt with a press release.
  • RAG can mitigate hallucination — but only if correctly implemented and maintained: Grounding responses in live, operator-controlled data is technically feasible but requires ongoing engineering discipline and vendor accountability that most off-the-shelf products don't provide.
  • Confident wrongness is worse than honest silence: An AI that says "I don't know — please visit our website or call back during opening hours" causes far less damage than one that fabricates an authoritative-sounding wrong answer with no caveat.
  • The "good enough" error rate argument fails for binary, time-critical facts: A 10% hallucination rate on opening hours could mean five misled customers per day on a busy phone line — a slow but measurable attrition of the community trust the business depends on.
  • Narrow scope beats broad ambition at launch: Restrict voice AI to queries it can answer reliably from grounded data; expand scope only after monitoring confirms reliability, not after a vendor promises it.
  • Disclosure, logging, and monitoring are non-negotiable minimums: Operators must be able to see what their AI is saying on their behalf, correct it in near-real time, and confirm compliance with any applicable disclosure laws.
  • The sales cycle incentivizes demo performance, not deployment reliability: Buyers must specifically probe for hallucination behavior on high-stakes factual queries — opening hours, allergen information, availability — before signing. If a vendor won't demonstrate this in a live, unscripted test, treat that as a red flag.

Pre-Deployment Checklist for Restaurant Voice AI

BEFORE GO-LIVE — Restaurant LLM Voice System Checklist

Grounding & Data
 [ ] Opening hours connected to live, operator-controlled data source
 [ ] Menu data synced; update cadence defined and tested
 [ ] Real-time availability (patio, seating) either live-connected or blocked from LLM scope
 [ ] Fallback behavior defined for all queries lacking grounded data

Transparency & Compliance
 [ ] Caller disclosure ("You're speaking with an automated assistant") implemented at call start
 [ ] Applicable local/state bot disclosure laws reviewed with counsel (e.g., CA BOT Act)
 [ ] Call transcripts logged and accessible to operator

Monitoring & Correction
 [ ] Anomaly detection configured (e.g., hours mentioned by bot vs. configured hours)
 [ ] Sampling and human review protocol established for first 30 days
 [ ] Rapid correction pipeline tested: operator update → live deployment latency measured
 [ ] Escalation path to human staff functional and tested

Scope Control
 [ ] LLM scope restricted to grounded use cases only at launch
 [ ] Explicit "I don't know / let me transfer you" behavior tested for out-of-scope queries
 [ ] No LLM improvisation permitted on: hours, availability, pricing, allergens, commitments

What Comes Next

Incidents like this one are unlikely to slow AI adoption in hospitality — the economic pressure to reduce labor costs is strong, and the vendor ecosystem is well-funded. What they may do, increasingly, is fuel a regulatory and reputational reckoning. Several jurisdictions are already moving toward mandatory AI disclosure requirements for customer-facing systems; California's BOT disclosure framework is one established example of the direction regulation is heading. Incidents in which AI misinformation causes demonstrable consumer harm — a wasted journey, a missed reservation, a dietary need unmet because the bot hallucinated the wrong menu — are precisely the kind of concrete harms that regulators and plaintiffs' attorneys tend to respond to.

For developers, the more immediate pressure will likely come from the market itself. The vendors who build in grounding, transparency, fallback behaviors, and post-launch monitoring from day one will be positioned to survive the coming reckoning. Those still selling ungrounded hallucination-prone systems as enterprise-ready restaurant solutions — leaning on demo performance and leaving operators to discover the failure modes post-launch — may not. The critical question is how much community trust gets destroyed in the interval between now and that reckoning, and how many local restaurants pay the reputational price for an infrastructure problem they didn't create and couldn't see coming.


Frequently Asked Questions

What restaurant uses an LLM voice chatbot to answer caller questions?

The specific restaurant in the incident reported by author Max Gladstone on Bluesky (June 20, 2025) was not publicly named. The incident represents a broader pattern: restaurants and other hospitality businesses are increasingly trialing LLM-powered voice systems to handle inbound calls, with mixed and often problematic results when those systems lack proper data grounding.

What restaurant uses volcano heat to cook food?

Several restaurants use geothermal or volcanic heat for cooking, most famously El Diablo restaurant in Timanfaya National Park, Lanzarote, in the Canary Islands, which grills food using heat rising from the underlying volcanic geology. This is unrelated to AI voice technology but is a widely cited example of unconventional restaurant energy sourcing.

What restaurant uses beef tallow for fries?

A number of independent burger restaurants, steakhouses, and traditional fry shops use beef tallow for frying, prized for its high smoke point and flavor. Beef tallow has seen renewed popularity as part of a broader consumer interest in animal-based cooking fats as an alternative to refined seed oils. Because sourcing practices change over time and vary by location, diners with specific dietary or religious requirements should confirm the frying fat directly with the restaurant.

What restaurant uses peanut oil for frying?

Five Guys is among the most prominent chains that use peanut oil for frying and prominently discloses this due to allergy considerations. Chick-fil-A has also historically used refined peanut oil for its fried chicken. Peanut oil is favored for its high smoke point and relatively neutral flavor. Note that highly refined peanut oil has most allergen proteins removed, but restaurants typically advise guests with peanut allergies to consult staff before ordering.

What restaurant uses the same oil for years?

No reputable restaurant should use the same frying oil unchanged for years — food safety guidance in most jurisdictions calls for oil to be replaced once it degrades beyond safe use, typically assessed by color, viscosity, smoke point, and free fatty acid content. That said, some traditional establishments maintain a long-lived frying medium by continuously topping up with fresh oil rather than fully replacing it. This practice is more associated with certain traditional contexts (such as some long-established fish-and-chip shops) than with modern regulated commercial kitchens. Health inspectors commonly assess oil quality as part of standard food safety audits.

Topics

Comments(0)

No comments yet. Be the first to share your thoughts.

Join the conversation

Your email stays private and comments are reviewed before appearing.

Comments are moderated before appearing.

0/2000
View all
I love LLMs, I hate hype
Tech & AI

I love LLMs, I hate hype

Why are LLMs so hyped when the tools themselves work? George Hotz's 2026 essay separates genuine LLM value from fear-mongering and AGI hype with surgical