Apple Watch Series 12 and Ultra 4 users can now access Audio Intelligence in the new watchOS 27.3 beta.
I’m someone who wishes the world had subtitles, so Live Rewind is pretty useful for me. With Live Rewind, Series 12 can transcribe the last 15 seconds of what was said.
Apple uses its S11 chip on the Apple Watch to process audio privately, so Apple can’t access it. For Live Rewind, it works through a continuous flow of audio entering your Apple Watch’s S11 chip, with old audio continuously replaced by new audio. If you double-press the Digital Crown, the last 15 seconds of buffered audio from your Apple Watch will be sent to your iPhone. Your phone converts audio to text, the raw audio is removed, and your Apple Watch displays the text. This was enough to remove my privacy concerns, but Apple explains it more thoroughly on its website and details how Audio Intelligence works with all its features.
Another feature coming to Audio Intelligence includes Siri Recap, which lets your Apple Watch listen to meetings or conversations and take AI notes in the Siri app. You can set it to turn off at certain times of the day, or turn it off when you get home. It does not contain anyone’s name unless it was specifically mentioned in the conversation and keeps user data private.
Finally, music recognition will automatically identify songs around you at all times. If you check your Smart Stack on your watch, you’ll see the song already listed in the Shazam widget.