Google Pixel 10 Series: New AI-Powered Features
The Pixel 10 series, along with a new smartwatch and wireless earbuds, introduces several new artificial intelligence features. These features aim to streamline various phone functions and simplify daily tasks. The software improvements are designed to enhance user experience and efficiency, potentially extending to older Pixel phones and other Android devices in the future.
Camera Coach
The Pixel Camera app now includes Camera Coach, an AI-powered assistant designed to help users improve their photography skills. The feature guides users through the process of taking a picture, suggesting adjustments to composition, settings (like Portrait mode or zoom level), and viewpoint. It provides example shots to inspire users and helps them understand the phone's camera capabilities. While not intended to transform users into professional photographers, Camera Coach encourages exploration of the phone's features and encourages more thoughtful composition.
Magic Cue
Magic Cue is a feature integrated into the Google Messages app and Gboard. This AI-powered tool searches a user's personal information across Google apps to provide quick answers to incoming questions. For instance, it can retrieve flight details from Gmail or dinner reservation information from a calendar, allowing users to respond with a single tap. The feature operates on-device, ensuring data privacy by avoiding cloud processing. Users can also review the source of the provided information before sending it.
Pro Res Zoom
The Pixel 10 Pro and Pixel 10 Pro XL models feature Pro Res Zoom, an enhanced version of Super Res Zoom. This allows for up to 100x zoom, processing over 200 images to create a sharpened, less noisy final image. Generative AI fills in gaps in the image, similar to techniques used in other image enhancement tools. Google notes that this function is not designed to be used on individuals to avoid misrepresentation. Photos utilizing this feature will be marked with C2PA content credentials to indicate the use of AI-generated content.
Text-Based Photo Editing
Expanding on previous natural language search capabilities in Google Photos, the Pixel 10 series introduces text-based photo editing. Users can now interact with a chatbox within the editing workflow, using natural language requests to manipulate images (e.g., "erase the plastic bag in the photo"). This simplifies the editing process, consolidating various editing tools into a user-friendly conversational interface.
Revamped Voicemails
The "Take a Message" feature offers an alternative to traditional voicemail. Upon a missed call, the system can automatically request a message from the caller, transcribing it and displaying it within the dialer app. Actionable suggestions, such as creating reminders, are also provided based on the message content. This functionality utilizes Google's on-device Gemini Nano model and replaces standard voicemail if enabled.
AI-Generated Voice for Translations
The Pixel 10 series enhances real-time translation during phone calls. Instead of using a generic AI voice, the system generates a voice approximation of the user, delivering translations in a voice that resembles the user's. This aims to create a more natural and engaging experience for both participants in a call. Google asserts that no audio is recorded or stored; the process relies on an on-device model utilizing a brief audio sample for voice synthesis. Currently, this is available for a limited number of languages.
New Journal App and Daily Hub
Google introduces a new Journal app, offering prompts and AI-powered reflections to support users' well-being. The Daily Hub, similar to functions found in other mobile operating systems, provides a concise summary of daily calendar events, reminders, and activity suggestions based on search history. The information is accessible through a widget or Google Discover.
Pixel Watch 4 and Gemini Integration
The Pixel Watch 4 allows users to activate the Gemini assistant simply by raising their wrist. The system differentiates between a wrist raise for time checking and one intended to activate Gemini. Gemini's enhanced natural language processing improves interaction, allowing for more flexible query formulations. Users can customize the sensitivity of the wrist-activation feature.
New Gemini Live Voice Model and Minor Updates
A new Gemini Live voice model will offer adjustable speaking speeds, tones (including options like a Shakespearean or pirate voice), and a more empathetic tone for serious conversations. Further improvements include visual overlays in Gemini Live to clarify its focus, expanded app integrations, an improved “Add Me” feature for group photos, and a pre-capture version of Auto Best Take. The Google Recorder app now permits adding music tracks, and the NotebookLM app is pre-installed for local document note-taking using Gemini.