Apple WWDC 2024: iOS 18, macOS 15, and other major announcements

Tim is going over the rest of the WWDC schedule, which means we're all done here. A lot to unpack but super interesting to see how Apple's ambitious foray into AI will heat up the race between Microsoft, Google, and Samsung. Apple Intelligence is coming to the iPhone 15 Pro and iPad and Macs with M1 and later. All with the new OSes, of course.

At WWDC 2024, Apple has announced that Siri will be integrating with ChatGPT, OpenAI's AI chatbot. This integration will allow Siri to access ChatGPT's capabilities and provide users with more advanced and personalized responses. When Siri wants to use ChatGPT, it will ask for permission to send information to the chatbot. ChatGPT is free to use without creating an account, and requests and information will not be logged. Paid ChatGPT users will also have access to additional features, such as advanced AI capabilities and personalized responses. The integration with ChatGPT is expected to roll out later this year. Apple also plans to add support for other AI models, according to Craig. This will allow Siri to access a wider range of AI capabilities and provide users with even more personalized and advanced responses.

One of the new AI tools is the Rewrite writing tool, which can help you write cover letters. This AI-powered tool uses machine learning to analyze your writing style and provide suggestions for improving your writing. Another innovative feature is Smart Reply, which can help you respond to emails more efficiently. But that's not all - Apple also unveiled Genmoji, a generative emoji creator that lets you create weird and wonderful emoji characters. Simply type a few words, and Genmoji will generate a unique emoji character based on your input. You can even use Genmoji to create custom emoji characters of your friends and family by selecting a photo from your library. Another new feature called Image Playground walks you through a image generator that works on-device and let's you create images in various styles.

At WWDC 2024 event, Apple unveiled a major update to Siri, its AI-powered assistant. With this new update, Siri is now more natural, more relevant, and more personal than ever before. Siri now pops open with a glowing light that wraps around your screen, making it easier to interact with the assistant. 'Type to Siri' is the ability to type to the assistant. This feature allows you to communicate with Siri in a more traditional way, making it easier to use the assistant in a variety of situations. Siri will soon have "on-screen awareness," which means it can see what's happening on your screen and take action accordingly. Siri will also have the ability to take action in and across apps. This means you can use Siri to perform tasks in multiple apps, making it easier to manage your digital life. Siri has awareness of personal context, including photos, messages, calendar events, and files. This means the assistant can provide more personalized recommendations and take action based on your specific needs.

The architecture for Apple Intelligence is on-device semantic index, which organizes and surfaces information from across your apps. Apple has developed multiple kinds of specialized models to power this new architecture. To further enhance the privacy and security of this new architecture, Apple has created Private Cloud Compute. This innovative system cryptographically locks the cloud to your phone, ensuring that your data can only be accessed by authorized software. When you make a request, your device decides whether it can handle the task on-device or if it needs to go to the cloud.

Apple Intelligence puts generative models at the core of iPhone, iPad, and Mac, allowing your devices to learn and adapt to your behavior. This means that your devices can anticipate your needs and take action before you even ask. The new iPhone can now prioritize notifications, so you only see the most important ones. The writing tools in Apple Intelligence can write, summarize, and condense text, making it easier to stay organized and productive. Apple Intelligence also includes a host of new image features, including the ability to create totally original images using photos in your library. Apple Intelligence can "take action across your apps," allowing you to control multiple apps with a single command. It can also reference the content on your screen, allowing you to quickly access information and take action. This feature uses AI to analyze the content on your screen and provide relevant suggestions.

Safari now has a new feature called Highlights, which uses machine learning to automatically detect interesting things on a webpage and show them to you with just a click. Reader mode in Safari has also been updated to include summaries and table of contents. This feature uses AI to analyze the content of a webpage and provide a concise summary and table of contents. The new Viewer feature in Safari lets you bring videos front and center with system video controls. This means that you can easily play, pause, and control video playback right from the Safari toolbar, without having to switch to a separate video player app.

The new Continuity feature in macOS Sequoia allows you to mirror your iPhone right from your Mac. You can see and control your iPhone on your Mac, and even hear iPhone audio through your Mac's speakers. macOS Sequoia now features automatic window tiling as well, making it easier to manage multiple windows and apps on your Mac. Presenter preview mode is a new feature in macOS Sequoia that's perfect for videoconferencing. This mode allows you to preview your videoconference before joining the call. macOS Sequoia also features built-in background replacement, which allows you to replace the background of your videoconference. The new Passwords app in macOS Sequoia is a dedicated app for managing your passwords. This app allows you to view and edit your passwords, as well as generate new ones. You can also use the Passwords app to autofill passwords when needed.

The new Math Notes experience on the iPad is a game-changer for math enthusiasts. With this feature, you can simply write equations using the pencil, and when you write an equals sign, the app will solve it for you. You can also create tables of numbers and get a sum just by drawing a line under a column. This means that you can quickly and easily calculate sums and averages without having to manually enter the numbers. Math Notes also supports algebra, with variable support. It will be available in both the Notes app and the Calculator app. Another cool feature is Smart Script, with which your handwriting will be transformed into a flowing script that's easy to read and understand. With Smart Script, you can also paste text into a handwritten note, and it'll show up in your handwriting.

iPadOS 18 starts with most of the new iOS 18, in addition to a new "floating tab bar" that can "morph" into a sidebar. This means that you can easily switch between apps and access your favorite features with just a tap. Apps will be designed for the iPad, meaning they will be optimized for the iPad's larger screen and more powerful processor. The Calculator app is finally coming to the iPad, making it easier to perform calculations and conversions on the go.

With watchOS 11, Apple is bringing a new Training Mode on Apple Watch. It measures how the intensity and duration of your workouts affect your body over time. You can rate your workout efforts, and then it tells you if you are above or below your average. The new Vitals app lets you "explore your most important health metrics" with just a glance. This app will provide you with a quick overview of your vital signs, including your heart rate, blood oxygen level, and more. When your metrics are outside of the normal range, they will be highlighted. The new cycle tracking features on Apple Watch include pregnancy tracking features.

Apple's WWDC 2024 event has brought some exciting updates to AirPods. Starting with AirPods, Apple is making it even easier to interact with Siri for a seamless hands-free experience. With this new feature, you can simply nod your head to confirm or shake your head to decline, all while wearing your AirPods. This is a game-changer for those who love using Siri on the go!

The Photos app is now a single grid, making it easier to browse through your photos and videos. The library is now located at the bottom of the screen, providing quick access to your media. The new filter button lets you narrow down your photos by type, making it easier to find specific content. A new space below the grid is dedicated to your favorite photos, called "Collections". These collections are like "people and pets" and specific days, making it easy to organize and view your photos and videos.

Apple's WWDC 2024 event has brought some exciting updates to its Mail app, with improved categorization features that will make it easier for users to manage their emails. One of the most exciting new features is the addition of trail maps in Maps, which will provide turn-by-turn guidance for hikers and outdoor enthusiasts. Another new feature is Tap to Cash, a private and quick way to move cash around using Apple's Wallet app.

You can now Tapback messages to react with any emoji or sticker. You can also bold, underline, and italicize text in Messages and even use new effects like jitter, shake, and bounce. With iOS 18, iPhone 14 and later will support Messages via Satellite for messaging with the satellite support when you don't have network reception. Apple is also adding support for RCS.

With iOS 18, your iPhone is set to get a major UI upgrade. Starting with Home Screen, you can have new look for icons in dark mode and even various app alignments. There are new levels of customization and capability within Control Center. You can also lock your apps using Face ID.

Apple Vision Pro is coming to eight more countries, starting with China, Japan, and Singapore from June 28 onward.

The new visionOS 2 lets you spatialize photos from regular photos using "advanced machine learning." For improved productivity, Apple is adding support for higher display resolution and size for Mac virtual display, including big widescreen. The company is also adding train support for travel mode so you can enjoy a movie while on the move. Apple is pushing for more spatial video content and in that regard, Canon has launched a dedicated lens for its EOS R7 camera. New iPhone 16 series, coming later this year, will also support spatial video recording.

WWDC is live! "I'm excited that we'll introduce profound new intelligence capabilities" today, says Tim Cook, CEO of Apple. Starting with Apple TV Plus. Tim says it has the "highest-rated originals in the industry for three years running."