Search

Cookies

We use cookies to improve your experience. By continuing, you accept our use of cookies.

Technology

Apple Watch Gains AI Audio Intelligence: Live Rewind & Siri Recap in watchOS 27.3

· · 2 min read

Apple is rolling out new AI-powered Audio Intelligence features to its smartwatches with watchOS 27.3. Live Rewind and Siri Recap will help users recall conversations, identify sounds, and recognize music, entering developer beta.

Apple's latest smartwatches are set to become even more indispensable with the introduction of advanced artificial intelligence capabilities. The company is integrating new Audio Intelligence features into watchOS 27.3, designed to assist users with memory recall and environmental awareness.

New AI Tools for Enhanced Communication and Awareness

These anticipated AI features, first unveiled with Apple's latest smartwatch lineup, are now entering developer beta testing. They aim to transform how users interact with their devices, moving beyond basic notifications and health tracking.

Live Rewind: Never Miss a Moment

  • Functionality: By double-pressing the Digital Crown, users can instantly retrieve the previous 15 seconds of a conversation.
  • Output: The spoken content is displayed as a text snippet directly on the watch screen.
  • Saving & Deletion: Users can save these snippets to the Siri app or ask Siri for more information. Unsaved snippets disappear automatically.
  • Privacy Indicator: An audible chime and microphone indicator are activated when Live Rewind is in use.

Siri Recap: Summarize Key Discussions

  • Functionality: Siri Recap automatically generates concise summaries and bullet points from conversations.
  • Key Information: It highlights essential details such as dates, deadlines, and crucial discussion points.
  • Saving & Deletion: Summaries can be reviewed and saved to Notes or Journal. Unwanted summaries are automatically deleted after seven days.

Sound and Music Recognition

Beyond conversational tools, watchOS 27.3 introduces two features focused on ambient sound:

  • Sound Recognition: This feature identifies important environmental sounds, including sirens, alarms, doorbells, and a baby crying, providing alerts to the wearer.
  • Music Recognition: Powered by Shazam, this tool automatically identifies songs playing nearby, displaying their titles and artists directly on the watch.

Compatibility, Privacy, and Availability

These new Apple Watch AI features leverage Apple’s S11 chip and Secure Enclave technology, working in conjunction with Apple Intelligence and Private Cloud Compute for secure processing.

  • Compatibility: Live Rewind and Siri Recap require an Apple Watch Series 12 or Apple Watch Ultra 4, paired with an Apple Intelligence-compatible iPhone 16 or later (excluding iPhone 16e).
  • Privacy: Apple emphasizes that all features are opt-in and do not create or store audio recordings. Siri Recap specifically avoids identifying speakers or generating word-for-word transcripts.
  • Availability: Initially, these features will support English. A public beta is expected before wider availability, though they will not be available in the European Union at launch.

Related