TMTPost -- Apple Inc. Finally begins to launch the most hyped artificial intelligence (AI) features on its hardware offerings to the public, starting a new leaf in its innovation with AI tech.
Apple announced Monday the first set of Apple Intelligence features for iPhone, iPad, and Mac users is now available through a free software update with the release of iOS 18.1, iPadOS 18.1, and macOS Sequoia 15.1.
Apple Intelligence is an advanced personal AI system introduced at the Worldwide Developers Conference (WWDC) in June. “Apple Intelligence unlocks exciting new capabilities that make your iPhone, iPad, and Mac even more helpful and useful, from Writing Tools to help refine your writing, to summarized notifications that surface what’s most important, to the ability to search for almost anything in your photos and videos by simply describing it,” said Craig Federighi, Apple’s senior vice president of Software Engineering.
Out of the first set of AI tricks, Writing Tools allow users to refine their language by rewriting, proofreading, and summarizing text virtually everywhere they write, including Mail, Messages, Notes, Pages, and third-party apps.With Rewrite, Apple Intelligence allows users to choose from different versions of what they have written, and adjust the tone — professional, concise, or friendly — to suit the audience and task at hand. Proofread checks grammar, word choice, and sentence structure while also suggesting edits.
In Photos, the Memories feature now enables users to create the movies they want to see by simply typing a description. Natural language can be used to search for specific photos, and search in videos gets more powerful with the ability to find specific moments in clips. The new Clean Up tool can identify and remove distracting objects in the background of a photo.
As part of improvement of email features, Priority Messages, a new section at the top of the inbox in Mail, shows the most urgent emails.Users can tap or click Summarize to view pertinent details for long threads across their inbox. Smart Reply provides suggestions for a quick response and will identify questions in an email to ensure everything is answered.
n the Notes and Phone apps, users can now record, transcribe, and summarize audio. When a recording is initiated while on a call in the Phone app, participants are automatically notified, and once the call ends, Apple Intelligence generates a summary to help recall key points.
Siri has a brand-new design with an elegant glowing light that wraps around the edge of the screen when active on iPhone, iPad, or CarPlay.Users can type to Siri at any time on iPhone, iPad, and Mac, and can switch fluidly between text and voice as they use Siri to accelerate everyday tasks. With richer language-understanding capabilities, Siri can follow along when users stumble over their words and can maintain context from one request to the next. In addition, with Siri’s extensive product knowledge, it can now answer thousands of questions about the features and settings of Apple devices.
Apple also confirmed more Apple Intelligence features will come in December, including the highly-anticipated ChatGPT integration. In December, Writing Tools will get even more powerful with the ability for users to describe a specific change they want to apply to their text, like making a dinner party invite read like a poem, or adding more dynamic action words to a résumé. And users will have the option to access ChatGPT’s broad world knowledge within Writing Tools and Siri, allowing them to benefit from its image- and document-understanding capabilities without needing to jump between tools.
Also be available in December, a new visual intelligence experience will build on Apple Intelligence and help users learn about objects and places instantly, thanks to the new Camera Control on the iPhone 16 lineup.2 Users will be able to pull up details about a restaurant in front of them and interact with information — for example, translating text from one language to another.Camera Control will also serve as a gateway to third-party tools with specific domain expertise, like when users want to search Google for where they can buy an item, or benefit from ChatGPT’s problem-solving skills. Users are in control of when third-party tools are used and what information is shared.
In the coming months, Priority Notifications will surface and Siri will thus become even more capable, with the ability to draw on a user’s personal context to deliver intelligence that’s tailored to them, Apple said. Siri will also gain onscreen awareness, as well as be able to take hundreds of new actions in and across Apple and third-party apps.
Users now can only tap into Apple Intelligence on an iPhone 15 Pro, iPhone 15 Pro Max or any iPhone 16 model as their chips empower the AI services, though some more complicated queries will be handled by Apple’s servers.
Apple also unveiled the new iMac supercharged by Apple Intelligence and available in fresh colorsy. With the M4 chip, iMac is up to 1.7 times faster for daily productivity, and up to 2.1 times faster for demanding workflows like photo editing and gaming, compared to iMac with M1.The new iMac features a new 12MP Center Stage camera with Desk View, up to four Thunderbolt 4 ports and color-matched accessories that include USB-C. Starting at $1,299, now with 16GB of unified memory, the new iMac is available to pre-order Monday, with availability beginning Friday.