Here’s everything that Apple announced at their World Wide Developer’s Conference Keynote for 2018. The event opened with this four-minute nature documentary style advertisement on migrating developers:
https://www.youtube.com/watch?v=xp6UCQvKKzI
iOS 12
Craig Federighi boasted about iOS 11 being available on iOS devices from 2013, and that the majority of their users are on 11 versus the 6% they claim are on the latest Android update. According to Google, the percentage of Android users running their latest operating system (Android 8.1) is 0.8%, ouch. I would guess that Apple based their estimate on the percentage of devices that are capable of running 8.0 or 8.1, which is 4.9% and 0.8% respectively. The majority of Android users (25.5%) appear to still be in the stone age on Android 6.0.
According to Federighi the primary focus of iOS 12 will be performance, specifically he said that older devices would perform better. Using an iPhone 6 Plus as an example, Federighi claimed that apps would launch 40% faster, the keyboard would display 50% faster, the camera would open 70% faster.
USDZ
Because this keynote is ostensibly for developers, Federighi announced a new format for 3D scenes to be bundled together, USDZ. Pixar created the USD format in 2012, and this is their update to it for 2018 (thanks to coolpowers).
Adobe’s CTO Abhay Parasnis announced that their products would support the new format and that Apple’s developer State of the Union would have some kind of demo of this integration.
Measure
Federighi announced a new app for augmented reality, Measure, which will presumably replace everyone’s first ARKit app by giving you measurements for real-world objects. The app can detect some shapes and automatically provide measurements for those, but you’ll need to tap at the ends or corners of most real-world objects to get the app to measure them.
Apple’s USDZ Demos
Federighi showed off a USDZ 3D scene of a fish embedded in their Apple News app, and then customized a guitar on Fender’s web store only to display it on the stage through an iPad’s AR viewfinder.
ARKit 2
Federighi said that iOS 12 would include a new version of their ARKit API for developers to create augmented reality experiences. The flagship feature for ARKit 2, shared experiences, allows multiple devices to view and interact with the same scene. A slide depicted a pre-recorded video of people playing a multiplayer AR game where both participants and an observer could see and interact.
Martin Sanders, the Director of Innovation at Lego, demonstrated the new object detection features of ARKit along with shared experiences by scanning a physical Lego set and then awkwardly holding two iPads around it with someone else from the Lego company. The iPads showed a city being built around the town square Lego set with some limited interactivity to place vehicles and minifigures. It looked like it could be fun, but this kind of AR scanning will probably be limited to sets that Lego produces, not the modifications people make to them. Sanders said that the Lego AR experience app would ship later this year.
Photos Search & For You
Federighi said that Photos would improve in iOS 12. He highlighted the search functionality that would offer suggestions and other improvements to help you find photos you’re looking for. The app will also get a new tab, For You, that offers suggestions of photos you might like to see or ways you could change them to make them more appealing. It seemed like the editing suggestions were limited to ones that involve Apple’s features like looping a live photo or making some specific change to a portrait photo.
The For You tab will also suggest sharing photos with people who appear in them. He said that they would be shared at full resolution, which is an improvement because photos shared today aren’t at the original resolution. Federighi also said that the recipient of shared photos would be prompted to share photos from the same event so that everyone ends up with the entire set.
Siri Shortcuts
Federighi mentioned a new feature called shortcuts that would let Siri easily start functions of other apps. The first example was “I lost my keys” which would have Siri open part of the Tile app’s functionality within Siri and look for them. Apps in iOS 12 would make suggestions of shortcuts to add to Siri. The iOS 12 lock screen and search will make suggestions of things to do like re-ordering coffee or turning on Do Not Disturb when you’re at a movie theater.
Federighi said that you’d be able to make your own shortcuts in a new “Shortcuts Editor” app.
Apple’s Kim Beverett demonstrated the shortcuts functionality with a few examples. One of which was adjusting a shortcut she made in the Shortcut Editor. Beverett’s Heading Home shortcut would compress a bunch of steps into one action. It lets her roommate know how long it’ll take her to get home, set her thermostat to 70 degrees and turns on a fan, and opens maps with the course home preconfigured. Beverett quickly used the editor to play a radio program she wanted to listen to every time she goes home whenever she uses the shortcut. This Shortcut Editor is clearly the Workflow app that Apple acquired last year.
Other App Updates
Apple’s Susan Prescott demonstrated a few other iOS 12 app updates. Apple News is going from a 5 tab interface to 3 tabs with a new tab called Browse to handle the functionality from the current Search and Following tabs.
The Stocks app is completely rebuilt, and has business news built-in and new charts. The app will also be on the iPad.
Voice Memos is “even easier to use” and is also on the iPad, it’ll also use iCloud for file synchronization.
iBooks is getting refurbished with a new name and interface, it’s just Apple Books on iOS 12.
CarPlay is going to support 3rd party navigation apps.
Do Not Disturb
Federighi returned to show us how iOS’ Do Not Disturb will be updated with a new feature called Do Not Disturb During Bedtime. It will hide notifications so you won’t be “barraged” with them if you wake up in the middle of the night and just want to see what time it is. You can also granularly enable Do Not Disturb until you leave a location or for a certain amount of time.
Notification Updates & The Screen Time App
You’ll be able to change the way notifications are delivered, or turn them off entirely, directly from the lock screen. You’ll also get suggestions to disable them for specific apps when you rarely interact with them.
Notifications will also be grouped together by what app sent them.
The Screen Time app will give you a weekly report of how you’re wasting your life on your devices. It’ll also let you set time limits for each app. You’ll get reminders about that limit when you’re about to reach it, or you can set limits for the apps your kids use by category or by picking each specific app.
Animoji & MeMoji
Animoji are getting updated to let you stick out your tongue with your 3D avatar, they’re also getting four new characters. The ghost, koala, tiger, and t-rex. You can also make a character based on your own face, Apple calls that a “MeMoji.”
Kelsey Peterson demonstrated these effects on stage, and the selfie camera can now display the characters over your real face.
Facetime
Facetime can now have up to 32 people on a group video chat. It can be launched directly from a group text message chat in Messages. The different camera effects, like Animoji, are also available on Facetime.
WatchOS 5
Apple’s Kevin Lynch talked about new improvements for fitness and communications.
WatchOS 5 is getting improvements to compete with your friends in exercise. The Workouts app is getting a Yoga workout type, hiking, running gets a rolling pace measurement, pace alerts, and cadence measurements. WatchOS 5 will also automatically detect when you’ve started some types of workouts, it’ll retroactively credit you with the workout if you tell the Apple Watch to start the workout late.
There’s a Walkie-Talkie app for WatchOS 5 that goes over cellular or wifi connections.
The Siri watch face is getting information about sports, map information, and your heart rate. Siri Shortcuts will be on that Watch Face, as well as third-party apps.
Raising your wrist will let you talk to Siri right away, you won’t need to use the “Hey Siri” hotword.
Notifications can also be more interactive, like on the phone. One example was getting a notification from Yelp about a dinner reservation
Apple’s WebKit embedded browser will be available for some web links on the Apple Watch.
The Podcasts app is going to work on the watch, it’ll sync full episodes from your phone.
Apple’s Julz demonstrated these new features while riding an exercise bike, which was pretty impressive.
Kevin Lynch returned to tell us about Student ID Cards coming to the watch, it’ll work with just 6 universities to start, but it includes Temple University in Philadelphia.
Lynch also introduced a new rainbow watch band and watch face for Pride month. The watch face is supposed to be available today.
Apple TV 4K
Apple’s Jen Folse talked about how the Apple TV 4K from last year is getting Dolby Atmos in the next version of tvOS, she also talked about how movies will get free upgrades to support the new audio format.
Folse reiterated Apple’s support for live TV and sports.
Folse also said that various cable providers are letting their users replace their cable boxes with the Apple TV, and use a new “Zero Sign-On” instead of the single sign-on system from last year.
The Aerial screensaver on the Apple TV is going to tell you what you’re looking at, finally. It’ll also get a new view from the International Space Station of the Earth.
macOS Mojave
Craig Federighi returned to talk about the new features in macOS Mojave.
As Apple leaked, the next version of macOS is getting a dark mode. Previously you could dim the menu bar dock in their settings, but this is a system-wide feature that is more complete.
Desktop Stacks is another new feature that organizes the crap that gets scattered all over your desktop into stacks of documents matched by type, or date, or by tags. It’ll automatically keep those stacks organized as new files are added to the desktop.
Finder gets a new Gallery View that appears to replace the Cover Flow view with thumbnails at the bottom of the screen and a quick look type of view at the top.
The Finder is also getting a detail side bar with shortcuts to different actions you might like to take on the file, Federighi specifically mentioned adding customized automator actions to the side bar for certain types of files like watermarking files with one that was put together earlier.
The quick look utility is enhanced to let you do more from it, Federighi demonstrated trimming a video without opening a separate editor and signing a PDF document.
Screenshots are enhanced to be similar to the iOS functionality but with more powerful functionality that you’d expect on a computer. You can also capture video directly from that utility now.
The Continuity Camera feature was demonstrated by Federighi to take a photo from his phone and pop it directly into a Keynote slide. It can also scan in documents from your phone directly into a Mac app.
A few iOS apps are hitting the Mac. Apple News, Stocks, Voice Memos, and Home for using HomeKit devices.
Privacy
Mojave will have better privacy enhancements to prevent other apps from getting access to your personal data unless you want them to do so.
Safari on Mojave and iOS 12 will prevent advertising publishers from tracking you based on sharing functions and comment fields. Mojave and iOS 12 will also hide more of your information from being fingerprinted by websites and advertising publishers.
Mac App Store
The Mac App Store is finally getting updated, it hasn’t had many changes since 2011. Apple’s Ann Thai showed off a redesigned UI that takes a lot from their iOS App Store. It looks much better.
Metal & Core ML on iOS and macOS
Federighi returned to talk about Apple’s Metal graphics and computation API and external GPUs. He boasted about the speedups that Macs can get from up to four GPUs. It’s kind of crazy that the only GPUs that Apple supports for external GPUs are from AMD.
Apple’s machine learning API, Core ML, is getting updated with a 2nd version. It’s supposed to be 30% faster with a 75% reduction in the model size.
UIKit on the Mac
As has been rumored, Apple is making it easier to bring iOS apps to macOS. No specific name was given for this technology, but Federighi says they’re using it internally with apps like Apple News and promises that it’ll be available for 3rd-party developers next year.
Release Dates for iOS 12 and macOS Mojave
“This fall”
Overall
I’m very happy that macOS is getting updated with a new Mac App Store, it’s been way too long and developers have been abandoning it for independent distribution systems. I like having apps bundled into one store, but it’s also good that Apple finally wants to compete with independent distribution.
It’s a little disappointing that the iPad Pro didn’t get updated with this event, but perhaps they’re moving the majority of hardware updates to the Fall event.
I’m very happy to see that Workflow is still getting updated, and it looks like it is even more useful after Apple has updated it under the Siri banner. I wish that it were on the Mac as an alternative to Automator.