Categories
apple

Everything Announced at Apple’s World Wide Developer’s Conference Infomercial 2022

Every year Apple starts their World Wide Developer’s Conference with a keynote, It’s been a pre-recorded infomercial with solely online sessions for the past two years. This year Apple changed it up and while most of the event was pre-recorded, some developers and journalists were invited to attend an in-person viewing of the pre-recorded video. Encouraging people to travel during a deadly pandemic is not a wise thing when hundreds of people are dying each week and thousands more are getting infected with a potentially deadly or long-term disease.

 

iOS 16

Lock Screen Customization, Notifications, Focus Mode Switching

The way iPhones look when they’re on but the screen is locked is changing in iOS 16 according to Apple’s Craig Federighi. Federighi showed off the new functionality using a portrait mode photo where his children appeared in the foreground, in front and slightly above the time on the lock screen, and the blurred background of the photo remained in the background behind everything. Pressing and holding on the screen let Federighi go into an editing mode to choose a new style or pick out other customization options like a font for the time and date or adding and removing widgets. Like with Apple Watch faces, users can store their customized iPhone lock screens to pick between them later on. Federighi also said that developers could use the WidgetKit API to add information from their apps. Given the grousing I’ve heard from developers about limitations in the current widget system, I’m curious how well that ends up working out.

Federighi also highlighted changes to the way notifications appear on the lock screen, with new notifications fanning out from the bottom of the screen and a new API called Live Activities that lets developers put information into something that sure looks a lot like a widget instead of a constant stream of notifications. Examples included a basketball game with a scoreboard replacing endless notifications about the game’s score, Uber notifications replaced by a live progress tracker, a Nike workout meter, and a music player that can expand to let the album art take up more of the lock screen.

The Focus modes introduced last year are also getting updated to include lock screen and home screen selections, and focus filters that go into apps to filter out messages, websites, mail, and calendar events according to Federighi. He said that users would be able to swipe between the lock screens to choose their focus mode.

Messages in iOS 16

Messages updates were next from Federighi with the ability to edit and undo sending messages, as well as marking messages as unread. A press release from Apple clarified that messages can only be edited or undone for 15 minutes after they’re sent and they’re recoverable for 30 days after they’re deleted. Presumably only from the sender’s side of the conversation? This feature sounds like it would be easy for people who are making mistakes to abuse it.

Federighi also said that the Shared with You feature that surfaces photos and links and other things shared in messages would get an API for developers to hook into.

SharePlay Apps and Messages

The SharePlay feature that lets users watch videos and do other stuff together during video calls is also getting updated to let users get into a SharePlay app directly from the video call screen or find more apps that support SharePlay. It’s also getting added to Apple’s Messages app so it seems like users don’t need to be on a call to watch a show together, which would be an improvement. My family has enjoyed using SharePlay when it’s available, but we would usually mute the call and turn off the camera because it wasn’t necessary to be on a call at the same time.

Dictation Improvements

Federighi had Robby Walker introduce improvements to the dictation feature on the iOS keyboard with a demonstration that showed the on-screen software keyboard remaining in-use for edits during dictation instead of being covered up by the voice interface as it is today with iOS 15. Walker demonstrated selecting text and then using their voice to replace the selected text, and dictating with automatic punctuation. Currently you have to dictate the punctuation by verbally saying “period” or “exclamation mark” to get a . or !

Walker also said there would be a new API for developers to work with SiriKit and Shortcuts called App Intents.

Live Text scraping added to Videos, Translation Improvements, Other Detection Improvements

iOS 15 got the ability for the operating system to scrape text from images, iOS 16 is adding videos. Walker said you would have to pause the video to do this and showed it working on a code sample. I wonder how well that will work as video quality degrades over slower connections and with user interface elements blocking the text. Some apps also reject Apple’s video player and I suspect those just won’t work at all.

Walker also said that it would be easier to quickly do things with text in images and videos like translations and showed an updated Translate app from Apple that lets people translate using a camera in the app.

It is can be frustrating to try and select an image instead of the text in the image in iOS 15, so I hope that gets ironed out in iOS 16.

Speaking of image selection, Walker demonstrated selecting the subject of a photo with a long press and dragging just the part of the image that shows the subject out of the photo by selecting a dog and dragging the dog without the background into a message.

Walker implied that some or all of these features would also come to Apple’s other operating systems.

Wallet Stuff: ID & Keys, Tap to Pay, Apple Pay Later, Order Tracking

Corey Fugman talked about Apple’s work in putting drivers licenses and ID cards into the Wallet app, which is only in Maryland and Arizona for now but said that 11 other states are working on it. Fugman said that some apps would be able to access the ID to verify the user’s age for something like an alcohol purchase. It would only let the app know if the user was over 21 instead of their specific age.

Fugman said that Apple is trying to make digital keys a standard so that keys can be shared to other operating systems but they would be shareable between Apple users first.

Fugman talked about how iPhones can “…starting this Month…” do Apple Pay with a tap-to-pay feature without needing other hardware.

Apple Pay Later is a buy now pay later service that extends credit lending to every day purchases by spreading the cost out over a period of time with preset increments. These services are being pretty widely exploited and rightfully criticized for their usurious nature by advertising no interest but of course making their money on buyers who fail to meet the timeline of repayment and usually charging a fee to merchants for the availability of the service under the pretense of enabling customers to buy things they would otherwise be unable to afford. So instead of owing just a credit card bill every month you could owe money to dozens of lenders for smaller purchases through different apps and bills. Fugman said this feature would require no additional integration for developers.

Apple Pay Order Tracking was introduced by Fugman to track where orders are at. They’ve really got a shit sandwich here of stuffing usurious garbage into the middle of things that people might fall asleep through.

Maps Updates

Federighi said that new map features are coming to 11 more countries later this year, I still can’t get bicycling directions on O?ahu.

Maps is getting multi-stop routing according to Meg Frost. MapQuest from 1996 probably had this but it does look like Apple has thought out the feature by setting up Siri to help and being able to plan and store these routes. The Maps app will integrate more with stored digital transit payment cards and let you know how much a ride will cost or remind users if they need to reload a card before a ride.

Frost also said that developers would get better map access through MapKit and more developer stuff later this year.

Sports

Rubie Edmondson was introduced to talk about sports stuff and reiterated previously mentioned features like the live activities scoreboard and said that the Apple TV app would display those scoreboards on the lockscreen.

Edmondson also boasted about Apple TV +’s Friday Night Baseball which isn’t great because it locks baseball games that would otherwise be broadcast for free locally behind yet another paywall. If you’ve already subscribed to Major League Baseball’s MLB TV service, too bad.

The News app is getting a My Sports section with sports-specific news from your chosen teams.

Family Sharing Updates

Craig Federighi said that Apple will be making it easier to create children’s Apple ID accounts, manage their parental controls and screen time, and set up new devices.

iCloud Shared Photo Library is a new feature that Federighi said would make it easier for families to share photos. There are so many flaws with the current photo sharing systems so this could be great, especially if the photos remain at their full quality. The camera app is also getting a toggle to immediately share photos to a shared library and there’s a feature to automatically share images taken when someone else who is in the shared photo library is nearby. That seems like a potentially broken feature but sure.

Federighi said everyone who has access to the shared library can edit, remove, and add photos so get ready for a relative who thinks they’re funny to edit in cartoon faces to your important family photos. Federighi even showed an edit going from color to black and white which is a perfect example of how destructive changes like this can be. 

Safety Check

Katie Skinner introduced the Safety Check feature specifically with the idea that it would be useful for revoking access to some functionality like privacy permissions and location data when people are escaping abusive situations. It looks useful but it’s especially important to remain skeptical about Apple’s motivations and what they’re providing when they’re talking about functionality like this that is ostensibly to help people in terrible situations. I hope Safety Check does exactly what it promises.

Home & CarPlay

Corey Wang talked about Smart Home garbage like the Matter standard for home stuff to communicate with each other and showed a redesigned Home app that categorizes devices or just lets you browse through the entire list of devices in one long list separated by rooms.

Emily Schubert introduced new changes to CarPlay to add support for more screens, customizable gauge clusters, calendars, music, and widgets to the new screens, bringing truly distracted driving to a whole new level. Vehicles running this next generation version of CarPlay are to be announced late in 2023 which feels like a long way away for Apple to be announcing anything but I suppose they need the developer components in sooner which means they might have been impossible to avoid talking about. 

iOS 16 Odds & Ends

Federighi returned to talk about Spatial Audio improvements that would scan your ears to tune Spatial Audio features for you. I turn off Spatial Audio immediately because it sounds like garbage simulated surround sound to me.

Quick Note is also coming to iOS. when it was previously only available on macOS and iPadOS. It still works very differently in both operating systems and is pretty inconsistent. I am glad to see Quick Note getting improved instead of being dumped into the pile of “marketing named feature we once talked about and then never updated.”

watchOS 9

Kevin Lynch appeared in a fitness studio to talk about new features coming to WatchOS 9. Lynch brought up “…four new watch faces” and then showed off a remade Astronomy watch face (are remakes new?), a Lunar calendar watch face, a bizarre watch face called Play Time by an artist named Joi Fulton that has odd characters for numerals, and Metropolitan another weird watch face with a font for the numerals that stretches if you turn the crown. Why is it version 9 of WatchOS and developers still cannot ship their own watch faces? Lynch went on to say that more of the older watch faces are getting “rich complications” which is Apple speak for updating the older software to match current functionality.

Using Siri will no-longer takes up the whole Watch screen with that interface, there will be banner notifications, and active apps get pinned in the app switcher.

The Podcasts app on WatchOS 9 is getting discoverability functionality to find and subscribe to new podcasts as well as letting kids use the app when their parents permit it.

Developers are getting new APIs for the share sheet (the thing that pops up when you tap on a box with an arrow pointing up and out of it) and the photo picker that lets users select images. Callkit will let developers manage VoIP calls on the Apple Watch.

Craig Bolton showed off new metrics and custom workout modes on the Apple Watch to help runners and other exercise types. Routes will be automatically saved for repeat comparisons and there are new workout types for automatically switching between cycling, swimming, and running for example.

Remarkably, Apple’s Fitness app has been locked out for everyone who doesn’t have an Apple Watch, Bolton said that with iOS 16 users could finally use the Fitness app without an Apple Watch to see stuff that iPhones can track without other hardware accessories and the results from other fitness apps. I’ve been pretty annoyed that the health benefits of the Apple Watch are unavailable to anyone who can’t afford it. I know that sounds ridiculous, but health should not be a luxury and it’s good more people could benefit from some of these features.

Dr. Sumbol Ahmad Desai announced updates to Apple’s Sleep app in watchOS 9. Desai said that the updated app would monitor which stage of sleep users are in and said users could optionally plug this data into a research study that Apple is running to help better understand sleep.

Desai also talked about heart health and atrial fibrillation and said that watchOS 9 would track that data over time.

Finally, Desai said that watchOS 9 and the Health app in iOS 16 would include medication tracking and warn users about potential drug interactions through manual medication entry and scanning labels.

M2

Johny Srouji introduced the M2 second generation of Apple’s processors, re-emphasized Apple’s focus on energy efficiency alongside performance and went over the specs of the base M2 chip. A “second-generation 5 nanometer” process, 20 billion transistors 25% more transistors than the base model of M1, a memory controller that supposedly has 100 gigs per second of bandwidth (50% more than the M1) and up to 24 GB of memory alongside the M2 chip when the M1 was limited to 16 GB. Surprisingly, Srouji admits that the M2 base chip still has less performance than the biggest mobile chips from Intel (without mentioning them by name) but promises “almost 90%” (the chart shows 87%) of the peak performance at less power. The graphs Apple are showing are ridiculous with “Relative performance” on the vertical y axis and “Power consumption” on the x axis. What is “Relative performance”? Who knows! I don’t doubt that these are powerful, efficient chips, but they need better graphs. The one good part of this graph is that Apple says what the competitor’s laptop is in the fine print, it’s the MSI Laptop Prestige 14Evo with Core i7-1260P and 16 GB of memory.

Srouji said that the base model of M2 could have two more GPU cores to make 10, two more than the M1, for a claimed 35% more GPU performance. Once again we got a silly “Relative performance” chart comparing GPU performance against Intel’s integrated graphics processing, very strange.

New versions of the secure enclave and neural engine, and more video performance for 8K rounds out the M2 package.

2022 MacBook Air

Kristin White introduced a redesigned M2-based MacBook Air for 2022 which dumps the wedge shape in favor for thinness and the big round feet from last year’s MacBook Pro lineup, gets a MagSafe plug that is interestingly color-matched to the four colors of MacBook Air (last year’s MacBook Pro’s MagSafe plugs are all silver), only has two thunderbolt ports, but keeps the audio jack. White claims the new 13.6” display to be Liquid Retina and it has a notch for the webcam which is 1080p and Apple says it has twice the resolution and twice the performance in low light as the previous Air. The performance Apple demonstrates with this webcam is literally unbelievable because it is a professionally lit shot with natural seeming light that does not at all match what I’ve seen from the same camera on the 2021 MacBook Pro. These webcams Apple ships aren’t terrible for laptop webcams but they are garbage compared to the cameras on the iPhone lineup.

White also said that speaker quality is improved and this I am willing to believe, Apple’s audio quality from their recent laptops has been surprisingly good. The microphone, well there are limits to how good they can get but at least fan noise won’t be a problem because there are no fans in the 2022 MacBook Air.

White showed off a smaller power adapter that has two USB-C ports, a separately available 67 watt power adapter could also fast-charge the new MacBook Air. White claimed this would bring the Air up to 50% capacity in thirty minutes.

$1200 for the lowest priced MacBook Air with 256 GB of disk space, 8 cores of CPU and GPU, 8 GB of RAM and a 30 watt USB-C power adapter.

$1500 for the step up that has 512 GB of disk space, 2 bonus unbroken GPU cores for 10 total and a 35 watt dual USB-C port charger.

Interestingly, the M1 MacBook Air is still hanging on with the old design and 256 GB of disk space at $1000 on Apple’s website, for now.

2022 MacBook Pro 13″

No redesign for the 13” MacBook Pro which differentiates itself from the Air by costing a little more, having fans and the old Touch Bar OLED replacing the F-Row, and a little more battery life.

$1300 for the base model of 13” MacBook Pro that has 256 GB of disk space, 8 Cores of CPU and 10 Cores of GPU, 8 GB of RAM, and nothing else to write home about.

$1500 for the step up model that just ups the disk space to 512 GB.

I have no idea why this 13” model of MacBook Pro exists, except to make up for the fact that the 14” MacBook Pro models start at $2000.

What a strange situation.

macOS Ventura Stage Manager & Spotlight

Craig Federighi demonstrated new features coming to macOS Ventura like Stage Manager that seems to replace fullscreen windows with a centered window and puts other windows off to the side. Federighi said this would help manage situations where there are a lot of applications with open windows. Apps could also be grouped together in the demo with a few visible windows stacked and overlapping in the center of the screen. Finally, Fererighi demonstrated accessing files by clicking on the desktop to hide the currently active application and dragging the files into one of the open app windows on the left side.

Spotlight on the Mac is also getting updates to quickly glance at the contents of search results by using the quick look feature of macOS with the space key, and search for images in the photo library, files, and on the web or search the contents of images using the live text feature. Federighi showed off starting a timer and running Apple’s Shortcuts scripts from Spotlight and showed how informational search results about shows, music, and other topics, would be improved in Ventura with more detail. Federighi said that these new Spotlight features were also coming to iOS and iPadOS with Spotlight on iOS 16 being accessible by tapping on the dots at the bottom of the home screen.

Mail in macOS Ventura, iOS 16, iPadOS 16

Mail is mercifully, finally, getting an undo send option for a few “moments” after hitting send when your brain finally processes the typo it made, according to Darin Adler who also introduced other new features in Mail. Scheduled sending. Follow-up suggestions looks awesome, it suggests replying to emails if you haven’t gotten a response. Remind me does what it should do and reminds you to check in on a thread later on. Adler also said that search is improved in basic ways by checking for typos in the search query, search suggestions, and other improvements.

Safari on macOS Ventura

Shared Tab Groups will let friends and family share groups of browser tabs and collaborate on them. I love tab groups but they are one of the least reliable features in the current versions of macOS. I routinely have trouble opening new tabs where they are instantly closed and renaming tab groups is often impossible. There seem to be a lot of others with the same issues online.

Passkeys

Adler introduced the Passkeys feature that replaces passwords with crytpographic data that is encoded with Touch ID or Face ID and synchronized across Apple devices. There has been a bit of talk about this lately under the “Fido alliance”  that Adler said includes Google and Microsoft so that Passkeys work on Android and Windows. Adler admitted that the “…transition away from passwords will be a journey.” which is an understatement but I hope it works because passwords are impossible for most people to manage safely and there are so many situations where passworded accounts are the ideal method right now due to sharing logins among teams or family members. 2 factor seemed great, until so many companies went towards text messages as the second factor which are easy to compromise due to telecom companies being completely garbage at security.

Gaming

Craig Federighi boasted about Apple’s gaming performance which is incredible because from the perspective of myself and other game developers I speak with, Apple does just about everything they can to push away game developers.

Metal Improvements

Jeremy Sandmel introduced new features to Apple’s Metal rendering API in Metal 3. Did you know that Nvidia and AMD both have upscaling pipelines that are becoming more widely adopted? Apple has heard about that too and Sandmel introduced MetalFX Upscaling. No Man’s Sky was demonstrated and Sandmel said it is coming to the Mac “later this year.”

Sandmel then introduced a Fast resource loading API that Apple didn’t waste any time creating a marketing name for. “This really is a new day for gaming on the Mac.” says Sandmel. The Apple Silicon transition started two years ago and Steam still doesn’t have a native version of the desktop client. Why hasn’t a dump truck full of money and engineers backed up to Valve’s headquarters to make it happen? Why isn’t there a reasonable gaming computer available from Apple? Apple doesn’t care about gaming on the Mac.

The next game Sandmel said was coming to the Mac is Resident Evil Village. It’s great but it came out last year. No Man’s Sky is six years old. A Capcom representative took over to say that the MacBook Air manages at 1080p and the Mac Studio does well at 4K.

Continuity

Federighi returned to talk about the Continuity features of Apple’s operating systems handing off FaceTime calls between devices, which is good, before introducing Continuity Camera to let Macs use the iPhone’s better camera systems. Federighi demonstrated the feature with Johnnie Manzari and Manzari showed how Continuity Camera includes a bunch of features to blur the background and do other tricks but the one that was the most impressive was a desk view that added in a second camera perspective using the ultra-wide camera on the iPhone to give an overhead view of Manzari’s desk. I use software from Elgato called Epoc Cam to use my iPhone’s cameras with the Mac and it is terrible software that crashes and only runs at 30fps. There are a bunch of other competitors out there that also do this and I honestly hope Apple’s version works well because some of the popular competitors have impressive business models like Reincubate’s Camo that’s either $5 a month, $40 a year, or $80 for a “Lifetime license” all of those prices are ridiculous.

Belkin is supposed to be offering stands to hold iPhones above Macs later this year.

iPadOS 16

Federighi reiterated all of the previously announced features in iPadOS 16 before mentioning that Apple is finally shipping their stock Weather app on iPad OS. It took them 12 years.

After acquiring and starting to sunset the fantastic DarkSky weather app and it’s API, Federighi also mentioned an API for developers called WeatherKit.

Federighi demonstrated new collaboration features with a team working on a document at the same time and discussing it with shared tabs over a video call. The features are also promised to come to Apple’s other platforms.

Freeform for iPadOS, macOS, and iOS

Elizabeth Reid showed off an upcoming app called Freeform that looks a lot like Apple’s Notes app and the semi-defunct Paper app from Fiftythree, except focused on collaboration and creative thinking for diagramming and sharing ideas on an ever-expanding canvas.

The Return of the Return of Game Center

Federighi talked about gaming features again like a revamped Game Center interface which has been stuck inside of the Settings app for a long time now and SharePlay gaming to let you play with friends with something that looks a little bit like streaming the game. It wasn’t clear what was going on in the short background video.

Desktop-class apps on iPadOS 16

Federighi said that apps on iPadOS are getting more features from their macOS counterparts like customizable toolbars and new APIs for developers.

Display Scaling on iPadOS 16

A higher resolution option for apps to show more stuff? Great.

Stage Manager & External Display Support on iPadOS 16

Fedrerighi demonstrated iPadOS 16 with overlapping windows managed by Stage Manager on an iPad and on an external monitor. Federighi said that with an iPad and an external monitor there can be eight apps running simultaneously on the iPad.

Overall

I’m pretty happy with most of these updates. It’s great that the iPad might finally be a little closer to a real computer with overlapping windows but that improvement is as impressive as the usurious work to add buy now pay later functionality to Apple Pay is disgusting. I cannot imagine any good outcomes that could come from setting up people for failure like that except for potentially doing it in a less evil way than companies like Klarna and Afterpay and that isn’t worth doing. Buy now pay later services should be regulated out of existence.

Categories
apple

Apple WWDC 2019 Event Notes

Apple held their annual World-Wide Developer Conference event in San Jose, California today. Here’s what they announced:

The event opened with this ad romanticizing overworked developers.

Tim Cook’s Services Showcase

Tim Cook hosted and reiterated how great he thinks Apple is, and briefly recapped their services event. As if to fix their perplexing lack of trailers or clips of their original TV programming (Apple TV+) from the services event, Cook introduced a clip for For All Mankind. It’s the Ron Moore-led show about the Russians winning the space race, and it was extremely incongruous with the rest of the event.

tvOS Updates

Cook introduced a redesigned home-screen for tvOS with full-screen background previews of shows.

Up next, multi-user support for tvOS so you only see your shows. A blessing for parents who never wanted Game of Thrones mixed with Sesame Street. Unless it’s in a Sesame Street parody of Game of Thrones, which I am ready for.

As an aside, Cook showed how you could swap users in tvOS using a new control-center menu that looks like it is available via a swipe in from the right.

The components in the new tvOS control center showed the time, date, profile pictures for the different tvOS users, a quick option to put the Apple TV to sleep, music controls, the audio output dingus which will be handy for AirPod users, and a search icon.

Cook showed that users would have personalized music options, again, my recommendations will no-longer be destroyed by the music I play for my family. Fantastic. This multi-user stuff needs to be on every Apple device.

The updated Apple Music app for tvOS would display lyrics while you’re listening.

Apple Arcade was demonstrated with Oceanhorn 2.

Cook promised that the Apple TV would now support the Xbox One S and the PlayStation Dual Shock 4 controllers, which both have Bluetooth functionality. This is fantastic because the only MFi controller that has clickable thumbsticks is wired. I believe this functionality is coming to iOS as well.

Screensavers are getting updated with underwater vistas in collaboration with the BBC’s Natural History team.

watchOS 6

Cook boasted the current functionality of the watches Apple makes before introducing Kevin Lynch to talk about new features.

Lynch promised “more watch faces this year since the very first Apple Watch.” I think he meant that there are more new faces this year than there have ever been before.

Lynch demonstrated five new faces. A gradient face that moves an angled gradient with the minute hand. A “large numerals face” that showed the current hour in multiple languages. A modern digital face with huge chunky numbers. Finally, a hideous analog California dial with roman numerals (X, XI, I, II) above the horizontal midpoint of the watch and traditional Arabic numbers (8, 7, 5, 4) below. Finally, a new solar face that had multiple circles to represent the movement of the sun during the day.

According to Lynch he new faces would have an optional hourly chimes that they call Taptic Chimes. Each hour you’d either feel a nudge on your wrist from the “taptic engine” of the watch or if sound is on you’d hear something like a bird singing with the new modern face. This is extremely obnoxious. I can’t imagine anyone using it.

There are also new apps for the Apple Watch, an audiobook app for books purchased through Apple’s book store and a Voice Memos app to match the phone’s. Another new app is an Apple-provided calculator.

Finally, WatchOS gets apps that run only on the Watch. Previously, every Watch app had to have a companion app for the iPhone, even when that made little sense.

In the first actual nod to developers for the event, Lynch promised new APIs. An Extended Runtime API lets apps run for longer. Lynch specifically called out that this would be for apps using sensor data, like meditation, exercise, or tooth brushing.

A new-to-the-watch Streaming Audio API would let developers stream audio over the network. Three examples were given, podcasts (Outcast app), music (Pandora), and the MLB’s watch app with the Phillies versus the Brewers.

Lynch also promised a new UI framework this year.

Independent apps also mean that the watch gets its own App Store app to browse for & install new apps.

Dr. Sumbal Desai, Apple’s Vice President of Health was introduced to talk about new health and fitness features for the Watch.

Desai promised an updated Activity app with more long-term information through trending data. The updated app is supposed to provide new data points that weren’t previously exposed.

One of the new features of the Watch is the new Noise app that monitors your auditory environment and alerts you when it’s so noisy that you could damage your hearing. There’s also a complication for the watch face to display the current noise level.

Desai promised that the Noise app wouldn’t record or save audio, and instead just sample the volume every so-often.

Another new feature for the Watch is the Cycle Tracking app for period tracking. It’ll also be available in the iOS Health app.

Lynch returned to discuss a newly redesigned iOS Health app. A Summary view provides health related notifications and other summarily-provided information. He also promised that all of your health information would be private and securely-stored on your iPhone or encrypted in their data centers.

WatchOS program lead Haley Allen demonstrated the new watchOS functionality. Allen started with a new watch face, the Modular Compact face that had four items on the screen, a large analog dial in the upper right, two new complications (Wind and Rain) on the left side, and a large complication space in the bottom with an upcoming calendar item. Allen replaced the large calendar complication with a Noise complication to measure the environmental volume and had the audience cheer to raise the volume.

Allen moved on to the Infograph Modular face with a pretty cool two-tone color scheme of whte numerals with red highlights. Allen demonstrated the audiobook complication that let her tap to get back into the audiobook watch app.

The new app store was demoed, and it looks fine, although it isn’t clear how easy it will be to navigate from these short demos.

Finally, Allen demonstrated the MLB app streaming Red Sox versus Orioles game.

Lynch returned with the traditional “didn’t have time” feature jumble and mentioned that the watch would finally update itself without requiring the user to do so on their iPhone.

Lynch said there would be new watch bands and colors, he specifically called out a new pride band.

Apple shortchanges all of their retail workers equally when they make people line up for mandatory off-the-clock searches before being allowed to leave at the end of their shift.

iOS 13

Cook returned to move things back to iOS and introduced Craig Federighi who joked about the tremendous creativity behind the iOS 13 name, and then moved on to talking about how much performance has increased in current devices with the new operating system.

Federighi gave some examples and said that Face ID would be 30% faster to unlock devices.

Apps would be packaged differently for iOS 13, and would be 50% smaller to download and updates would somehow be 60% smaller. Who knows how much work is involved on the part of developers to attain those numbers, and what exactly is going on. Compression, selective assets, it could be any number of things and those could be effective or not across a wide variety of apps and games.

Apps, Federighi said, would launch twice as quickly on iOS 13.

Moving on to new features, Federighi introduced a video advertising the new iOS dark mode.

Dark Mode is a feature that debuted on macOS last year. Federighi demonstrated it in use on an iPhone, starting with the lock screen switching from a light version of a wallpaper and theme to a darker version. He moved on to News, which will no-longer blind you in the middle of the night, then swapped to the Calendar, Notes, and Messages. It’s a feature that should have been on iOS as soon as OLED screens became an option.

While in Messages Federighi demonstrated that the keyboard, also updated for dark mode, has swiping functionality. He later called it the “quick path keyboard”.

Federighi showed that the new share sheet in photos also adjusted to dark mode, and it had sharing suggestions in addition to a redesigned interface for sharing to apps and actions.

The darkness embraced the music app, which also has time-synched lyrics just like the TV Music app.

Federighi exited the darkness and talked about other app updates.

Safari is promised to have quick functionality to scale the text of the site you’re viewing, and per-site preferences.

Mail is to get “…desktop-class text formatting, including support for rich fonts.”

Notes has a new gallery overview, shared folders, and “much more.”

Reminders has been “completely reinvented” and “completely rewritten from the ground-up.” It’s supposed to give you suggestions of when or where you might want to be reminded, a quick-type bar lets you quickly add locations or photos to your reminders.

To-do lists can be embedded inside a top-level reminder for more organizational functionality. People can be tagged in a reminder so you’re reminded to talk to them about something you wanted to remember.

The Maps app is supposedly updated with new information from a fleet of Apple’s mapping vehicles. The entire US is to have the new data by the end of the year.

Meg Frost was introduced for a demonstration of the new maps app. She’s wheelchair bound and has what I can honestly say is the most awesome looking wheelchair I’ve ever seen.

The redesigned Maps app has a horizontally-scrolling list of categorized favorites under the search bar, collections of places in a vertical list, and then your recently viewed places.

Finally, there’s a street view mode with a binocular icon that launches users into a “look-around” view that appears comparable to Google’s app.

Federighi returned to quickly list off a few more changes to the maps app. A junction view for China that lets people see how traffic will flow in an upcoming intersection, and ETA sharing via quick on-screen shortcuts.

Federighi reiterated his company’s commitment to privacy with another word jumble and then talked about new privacy controls. Location could be shared with an app just once, and then it’d have to ask for approval the next time. You’ll also get regular alerts to apps using your location in the background, and said they wouldn’t allow apps to scan WiFi and Bluetooth signals to track your location.

Federighi promised that Apple would create a new single-sign on functionality for streamlining logins to apps without third-party services or new accounts. It’ll be up to the developer to support this method of sign-on. Federighi promised that this would create a new account for the app without revealing “… any new personal information.” Signing in would use Face ID, or presumably Touch ID. Developers can optionally request your name and e-mail address. Users can optionally share a one-time email address that Apple creates on the spot to forward mail from that app. Federighi said that you could delete the new address at any time to stop receiving mail from that app.

This will inhibit situations where, for example, you want to log into the web version of an app, so it isn’t clear to me how that will work but Federighi said that it’ll work on websites. It won’t work in Firefox, Chrome, or Edge unless Apple has built something for those browsers.

Next, Federighi talked about a new feature of HomeKit, Secure Video, for home security cameras to analyze video locally (on an iPad, HomePod, or Apple TV box) instead of on remote servers. When the video is uploaded, it’ll go to iCloud but be encrypted and Federighi promised that Apple can’t even see the video.

Federighi said that storage for 10 days of video recordings would be included in existing iCloud accounts, and that this video storage wouldn’t count against iCloud storage limits.

The first companies to support this new Secure Video functionality are Netatmo, Logitech, and Eufy. At leat two of those sound like Pokemon.

Federighi promised that there would be HomeKit enabled routers which just makes it even more infuriating that they stopped developing their AirPort line of network routers. HomeKit-enabled routers would segregate the network connections of internet-of-things devices. Federighi said that Linksys, Amazon-owned Eero, and the Spectrum ISP would make these routers at first.

Moving back to Messages, Federighi immediately sherlocked Casey Liss’s Vignette by saying that you could optionally share your name and photo with people you message so they wouldn’t just get a random phone number.

Federighi introduced popular YouTube spec workers’ “Memoji” avatars to talk about new features for those avatars. There are a ton of new features, here’s the video:

After the video, Federighi spoke about Memoji stickers. These could replace regular emoji with automatically generated Memoji versions of the regular emojis. It’s interesting that these are also included in the system keyboard, and Federighi said that the customized stickers would work in mail or other apps.

Finally, Federighi said that users without FaceID, but who had at least an A9 SoC, could create, edit, and share Memoji. Although they wouldn’t be animated without the iPhone and iPad Pro sensor suite.

The Camera and Photo apps have also been updated.

New Portrait Mode features include “high key mono,” and you’ll be able to move the virtual portrait lighting lights further or closer to your subject.

Edits are promised to be easier to make, have new features, and be available for video as well. You can finally rotate a video while editing without using another app.

Browsing photos is to be easier, separating out screenhots and photos of things like receipts, and organizing photos to only show a single photo of a particularly scene instead of every duplicate.

Justin Titi demonstrated the new Photos app, and how it organizes photos into easier collections of days, months, years, or still allows users to dig into every photo.

Federighi returned to introduce Stacy Leizeig (not sure on the spelling of that name) to talk about AirPods, HomePods, CarPlay, and Siri updates for iOS 13.

AirPods can optionally announce incoming messages as soon as they come in, so you can reply immediately. Leizeig said this would work with any messaging application that uses Apple’s SiriKit API.

Audio sharing will be available in iOS 13 to share audio between multiple devices. There is a user consent dialog before this happens, and audio is controlled independently.

Leizeig said that people could use the HandOff API to share music or a podcast to a HomePod by holding their device close to the HomePod. Recovering the listening session happens by the same gesture.

Siri is promised to have live radio access with over a hundred-thousand live stations.

The HomePod will finally recognize multiple speakers and personalize answers and data for Messages, Music, Reminders, Notes, and so on.

CarPlay updates include a new dashboard view with more information. Siri is promised to stay “out of the way” and not obscure the entire display. We need that functionality on regular iOS.

Siri Shortcuts is built into iOS 13 and “more powerful than ever.” The Shortcuts app will make more suggestions about multi-step shortcuts that might be useful to you.

The Siri voice in iOS 13 is promised to be entirely software generated for the first time, as opposed to generated using clips of different speech sounds to create each word. I hope this fixes Siri’s pronounciation of Hawaiian names, because it’s pretty awful. Leizeig compared iOS 12’s Siri to iOS 13’s Siri pronouncing a complex sentence scientifically describing absolute zero. The iOS 13 Siri sounded much more natural and human.

iPadOS

Federighi returned to close out the iOS 13 discussion and talk about the split to iPadOS. He introduced a video that has not been excerpted onto Apple’s YouTube channel yet, it showed new functionality that would be exclusive to the iPad.

Federighi demonstrated the newly defined iPadOS. He showed that an iPad Pro (2018) running iPad OS with more icons on the home screen, and by swiping over from the left, the widgets previously on their own home screen are now visible on the regular screen.

Multitasking is improved by giving slide-over windows their own grab handle at the bottom of the slide-over window that lets you quickly choose a recent window.

Split-view was demonstrated in Notes by grabbing a note from the list and splitting it off into a different split-view window. Finally. The iPad has been available for almost 10 years and multitasking needs these improvements.

Federighi demonstrated dragging and dropping individual notes next to other “spaces” with other apps open in other windows. App Expose would allow you to see any fullscreen space with a Note open, in Federighi’s example.

Federighi also demonstrated two Microsoft Word documents side-by-side in SplitView.

Federighi then demonstrated splitting e-mail composition into a new window while continuing to browse through other emails before dragging and dropping an image from another e-mail he had received to the e-mail he was composing. He also showed previewing a link in another e-mail, and then dragging that link and dropping the link into the e-mail he was composing.

An e-mail in the background joked about screensavers for iPad OS, including Flying Toasters. I’ll be holding out for the Dancing Disco Pig.

Federighi also talked about improvements to the Files app. New views like icon and list views. A Column view with previews, and quick actions.

iCloud Drive will finally get folder sharing.

The Files app in iPadOS is to get Samba sharing, it sounded like it was just to access network shares and not share from iOS.

Finally, the Files app will get external storage support for thumb-drives, SD cards, and other connected drives. Holy shit this took forever.

Finally, you can import directly from a camera into an app (Lightroom was the example) instead of going through iCloud Photos.

Safari is also getting updated on the iPad with “Desktop-class browsing” so that iPad users won’t get served the mobile version of websites.

Federighi specifically said that browser apps like Google Docs, Squarespace, and WordPress would work better now.

As rumored, Safari is getting a download manager. There will also be 30 new keyboard shortcuts for Safari.

Also rumored, fonts are easier to manage in iOS 13. They’ll be downloadable from the App Store. Fonts have been an important focus of Apple’s software for as long a very long time, this is a big Finally for iOS. It will be interesting to see how fonts are managed, and if they will be freely loadable without going through the App Store.

iPadOS multitouch is supposed to be easier. Federighi showed a giant hand grabbing the page scroll indicator directly on a long document, grabbing the cursor while editing a note and moving it easier while also adjusting that movement into a selection. A new gesture enables copy and paste on the iPad. Once text is selected it is possible to copy by pinching with three fingers and then pasting by moving the cursor and spreading three fingers out.

A three-finger swipe left is the new iPad undo gesture. Federighi joked about how people won’t have to shake-to-undo the iPad anymore.

The Apple Pencil latency is supposed to be reduced from 20 miliseconds to 9 miliseconds. The Pencil drawing tools are improved and available to third-party developers via a new API called PencilKit.

iPadOS 13 will allow you to mark-up “…anything on any app” by dragging up with the pencil from the corner of the screen to get a screenshot of the screen and mark it up. This is said to also work with an entire document, instead of just the currently visible screen area.

Toby Patterson was introduced to show off iPadOS’ new editing functionality, including bringing up a small iPhone-sized keyboard for typing with one hand. He accessed that new small keyboard by pinching the large keyboard with two fingers. Patterson was visibly flustered when trying to demonstrate some of the text selection gestures, which weren’t cooperating with him.

Patterson said you could still shake to undo, but he also showed off the new three-finger swipe. He said these gestures would work in any application that supports cut, copy, and paste with undo and redo, not just text-based document applications.

Moving onto the Pencil’s new tool pallete. Patterson showed it being dragged and dropped around the screen, so it could get out of the way of his work. It can be pinned to the edge, or minimized out of the way.

Patterson also showed the markup mode, and how it works with screenshots and can be toggled in apps that support it to the document mark-up mode.

Mac Pro 2019

Cook was brought back out to move things to the Mac Pro. John Siracusa’s dreams have come true. After a decade he can finally get a new 2019 Advanced-Cheese Grater Mac Pro.

John Ternus was introduced to talk about the long overdue replacement for the Trashcan Mac Pro. The Intel Xeon-based computer supports up to 28 cores.

The RAM is 2933Mhz ECC RAM, 6 memory channels, there are 12 DIMM slots. You could havce up to 1.5 terabytes of RAM.

Ternus said the new Mac Pro has 8 internal PCI-express slots. Four double-wide, three single-wide, and one additional half-wide slot that has IO ports. That card has two Thunderbolt 3 ports, two USB-A ports, and a regular 3.5 mm audio minijack. There are two more Thunderbolt 3 ports on the top of the computer.

There are two gigabit ethernet ports near the power connector at the bottom of the back of the 2019 Mac Pro.

Ternus said there is a new Mac Pro Expansion (MPX) module specifically for containing video cards that has it’s own 500 watts of power, a regular x16 PCI express edge connector, and then an additional PCI express/ DisplayPort/Power thing on the end. The starting graphics card would be a Radeon Pro 580X. I’m a little confused by that part, because it sounds like the 2017 Radeon Pro 580. Another option for graphics is the Radeon Pro Vega II, or two of those Vega II GPUs. I really wish the Nvidia and Apple feud would end so some other competing options could be availalbe.

Ternus called the dual Vega II configuration “The world’s most powerful graphics card.” before he introduced another marketing term, the Infinity Fabric Link, which supposedly lets data move between the GPUs five times faster than the PCI express bus.

Ternus said you could also configure the new Mac Pro with two dual Vega IIs modules.

Ternus talked about an add-on card for editing ProRes and ProRes RAW video. This card has a custom ASIC that allows the Mac Pro to process huge video data streams. Ternus said the Mac Pro could play 3 8K ProRes RAW streams.

The new Mac Pro has a 1.4 kiloWatt power supply. Ternus said that “under typical load conditions” the new three-fans-and-one-blower thermal cooling setup in the new Mac Pro is as quiet as an iMac Pro.

There are optional wheels for the Mac Pro.

Ternus boasted about the third-parties that are working with Apple for the new Mac Pro and specifically boasted about performance beating an Nvidia+Windows configuration.

David Earl was introduced to talk about Logic and Final Cut, and showed adding hundreds of instruments to a soundtrack for a documentary. He added about a thousand tracks and then worked with 8K video.

The starting price for this Mac Pro $6000. The availability was given as “this Fall.”

There will also be a special version of the 2019 Mac Pro for rack-mount configurations.

Apple Pro Display XDR

Colleen Novielli was brought out to talk about the new display for the new Mac Pro. She compared it to a pro display that costs $43,000. The APDXDR is 32 inches and has a resolution of 6016 x 3384. Novielli called it a 6K Retina Display. The new display was said to support P3 wide color gamut, 10-bit color, and has Reference modes built-in. Novielli said the display has contrast that is 25x better than a typical LCD.

Novielli also said there was a superior matte option available for the display that doesn’t degrade image quality compared to older technologies.

This display is supposed to maintain higher brightness levels, 1000 nits in perpituity, 1600 nits at the peak. Novielli said the display would have a 1,000,000:1 contrast ratio.

Novielli said the 15 inch MacBook Pro can have two of these displays connected, while the new Mac Pro can have six of these displays connected.

The arm for the display is custom, and supposedly makes the monitor feel weightless while it is being adjusted. There is also an optional VESA mounting adapter.

The Apple Pro Display XDR costs $5000. There is also a “Nano-Textured” version of the display that costs $6000. The VESA adapter is $200. The “Pro-stand” is a laughable $1000. If you don’t have either I guess you’ve gotta get some plywood and screws out or keep it on your lap?

macOS 10.15 Catalina’s iTunes Breakdown

Cook returned to summon Craig Federighi to talk about the new version of macOS.

Federighi walked us through some of the features of iTunes added over the past 18 years, paused to joke about adding Mail and Safari and a Dock to iTunes, before introducing a split of iTunes into three apps. Apple Music, Apple Podcasts, and Apple TV. It wasn’t immediately clear if the new app would still support local libraries of music and features like iTunes Match.

Federighi talked about how the Apple Music experience would be better in the new app before introducing the idea that sync for iOS devices would be moved to the Finder app.

Apple Podcasts gets its own app, as well. Federighi said that the new Podcasts app has machine learning’d it up to scan the spoken word content of the podcasts so you can search for the actual content instead of just the name or episode title.

The Apple TV app is split off into its own app. Federighi boasted that the new app would support 4K HDR playback supporting HDR-10, Dolby Atmos, and Dolby Vision standards.

The rumored iPad-as-external-display feature is real, and it is called Sidecar. Goodbye to the podcast ads? This functionality supports the Apple Pencil, and works wired or wirelessly.

Accessibility

Federighi introduced an accessibility ad for new voice features to control Macs and iOS, as well as rich text composition:

Find My

As rumored, Find My iPhone and Find My Friends have been combined for both iOS and macOS into one app just called Find My. Apparently devices will now emit Bluetooth signals so you can track them down even when they are offline, via a mesh network of Apple devices. Federighi promises that this is encrypted and anonymous.

Activation Lock

Macs with the T2 security chip (an ARM SoC from Apple) get the ability to be locked down via activation lock.

macOS 10.15 Catalina, Again

Federighi talked about how the new updates to Photos would make it to this version of macOS, along with an updated start page in Safari, and the new gallery view in Notes. Reminders is also coming to macOS along with Screen Time.

Project Catalyst (Marzipan?)

Federighi’s got a marketing name for the stuff that brought shit iPad versions of News, Stocks, Voice Memos, and Home to macOS Mojave. Federighi says that this new cross-platform support is much improved, the slides are not very convincing.

In terms of third-party support, Federighi boasted about the racing game Asphalt, Twitter’s iPad client which is not somebody I want to hear about when they hate third-party developers to a degree that is profoundly disturbing for the long-term success of that platform. Finally, Federighi introduced somebody from Atlassian to talk about Jira for the Mac. Zzz. it’ll be in the Mac App Store this Fall.

Catalyst is available to developers in Xcode preview today. No multiple window support was demonstrated. I am not hopeful that this feature is at all improved over the awful News, Stocks, Voice Memos, and Home apps on macOS today.

AR

Federighi talked about the new AR API RealityKit, for developers that don’t have experience with existing game engines. Reality Composer is a new app as part of Xcode, or for iOS and iPad. It has a bunch of pre-existing models to stuff into your app. Very strange. ARKit 3 was demonstrated with a new people occlusion feature to allow for people to be better placed in-between AR models. Motion capture was also demonstrated.

Minecraft Earth AR Demo

It wouldn’t be a modern Apple event without an awkward demo featuring VR or AR. VR is a little out of fashion, so it’s an AR demo from Lydia Winters and Saxs Persson of Mojang. I’m not sure how many people will want to hold an iPhone or iPad for hours to view an AR version of Minecraft called Minecraft Earth. All things considered this demo could have been much worse.

SwiftUI

Federighi returned to talk about a new framework for the Swift programming language, SwiftUI. Federighi gave an example of a huge list that would be a huge piece of code but minimized when it was converted to the SwiftUI framework.

Federighi said that new features would be brought to apps with SwiftUI automatically, like Dark Mode. He also said that there’s a new interactive, upgraded preview type of thing in Xcode for SwiftUI. Federighi compared it to Swift Playgrounds but said it was much more powerful.

Josh Schafer was brought out to demo SwiftUI’s new editor in Xcode. He made a joke app to make up phony versions of MacOS, and immediately showed his changes both in the Xcode Preview as well as on a live iPhone.

Federighi returned to say that the SwiftUI framework was also available for watchOS, and all Apple platforms.

Cook’s Close-out Deals

Cook returned to tell us that developers betas were available for all of the new operating systems and software today, with public betas in July. The usual promised release window for the new operating systems was “The Fall.”

Overall

The world’s most performant Mac Pro is great if you’re working on movies or high-end audio production Apple still can’t ship a reliable laptop keyboard or a tower for normal people who aren’t at Pixar. It’s also not clear at all what storage upgrades for the Mac Pro will look like, I’m not sure if the word “T2” was mentioned during the keynote, but the product page for the new Mac Pro mentions the dedicated ARM SoC Apple calls T2 so it seems like you might be limited to add-on PCI-express modules or hooking up external peripheral storage. This is especially galling on the base-model Mac Pro that only includes 256GB of storage.

The display that costs extra if you want to put it somewhere besides flat on your floor is just the ridiculous cherry-on-top of unapproachable high-end hardware.

The OS update for the Mac was couched in the end of iTunes, which will hopefully still be available if some functionality is missing from the new Music, Podcast, and TV apps. Windows users, are of course still suck with the worst version of iTunes.

iCloud is still capped to an increasingly paltry 5GBs of free storage. I am very tired of reading help posts from iPhone users online who have lost their entire photo and video library when their phone breaks and they couldn’t afford enough iCloud storage. Somehow Apple has deemed the subset of their user base that has home video security cameras more important than the millions of iPhone users who would refuse to pay for secure backups.

One way that Apple could work around this is with their own home network router that had a disk inside for backups of all your devices, but the AirPort line of routers is dead and I am sad about that.

I’m not sure how much I buy the split of iOS and iPadOS, it didn’t seem like this event was organized to emphasize that split, but I am glad that they’re working on the iPad to make it a better competitor to a traditional laptop computer. Still, there are so many limitations of an iPad compared to a modern Mac. For example, there is still no generally available multi-user mode for the iPad. The HomePod is getting that feature first, I’m glad the HomePod is going to be more useful, but it’s ridiculous and looks more like a cash grab that everyone in a house needs their own iPad if they want it to be tailored to their uses.

I am a little concerned that the only way improvements can come to these platforms is bundled in a cute marketing name. The iPad needs more improvements yet to be more competitive as a laptop replacement, maybe we don’t need our home screen to be just a list of apps and a select few widgets. Maybe a home screen could include files and be arranged however someone wants it, just like a real computer. Apple is so slowly trickling out features to the iPad, I’m looking forward to more. Perhaps they’ll come faster with the rebranding to iPadOS.

The most important Pro app for iPads to be a full computer and ship their own apps is Xcode, and we still don’t have it. Until an iPad can ship iPad software without any other device, I’m not sure Apple is really onboard with the iPad as a real computer.