Meta's new AI search pulls from Facebook posts — what could go wrong
meta launched 'ai mode' for facebook search that indexes public posts and reels, but tests show it struggles with hallucinations and citing non-existent sources.
meta rolled out 'ai mode' in the facebook app to handle complex, conversational queries by grounding responses in user-generated content across its platforms. initial testing indicates the model has hard guardrails against political misinformation, refusing to generate election conspiracies, yet it fails at basic factual verification. in one instance, the tool hallucinated a closure notice for a community pool by citing a specific post that did not exist. the feature is marketed for local discovery and travel planning, but the heavy reliance on social media data raises concerns about reliability.