Yelp is going to use AI to stitch together user-posted content about restaurants, food, and nightlife businesses to make short videos about those businesses. The company initially started testing the AI-stitched videos last year, but theyâre now available nationwide on the iOS appâs TikTok-like vertically scrolling home feed.
Business operators canât currently see the videos that are generated for users, and Yelp users also canât currently opt out of having their photos or videos show up in Yelpâs AI-stitched videos. Yelp relies on multiple generative AI tools to create the finished product, as OpenAI LLMs write the text descriptions and narratorâs script, put together story topics, and proofread, while ElevenLabs is used to generate the narratorâs voice and Amazon Transcribe creates the synchronized on-screen captions.
You can get an idea of what theyâre like in the below video shared by Yelp. The vertical video blends together videos and images with an AI-generated voiceover and AI-generated captions to talk about things like the restaurantâs food, cocktails, and ambiance.
Yelp wants to make âas many videos as possible,â Yelp CPO Craig Saldanha tells The Verge, but will only make them if a restaurant has enough reviews, photos, and videos to tell a compelling story. Yelp relies on personalized signals to determine when to actually show the videos to you. The videos themselves are not personalized, even though they are eventually refreshed â there is only one active AI-stitched video about a single business live at a time, according to Saldanha. If a user or a business feels that an AI-stitched video is inaccurate or offensive, Saldanha says they can report it by tapping the three dots in the top right corner of the video. Yelp does periodic audits âat scaleâ as well.
Read the full article here