Apple WWDC 2019 Event Notes

Apple held their annual World-Wide Developer Conference event in San Jose, California today. Here’s what they announced:

The event opened with this ad romanticizing overworked developers.

Tim Cook’s Services Showcase

Tim Cook hosted and reiterated how great he thinks Apple is, and briefly recapped their services event. As if to fix their perplexing lack of trailers or clips of their original TV programming (Apple TV+) from the services event, Cook introduced a clip for For All Mankind. It’s the Ron Moore-led show about the Russians winning the space race, and it was extremely incongruous with the rest of the event.

tvOS Updates

Cook introduced a redesigned home-screen for tvOS with full-screen background previews of shows.

Up next, multi-user support for tvOS so you only see your shows. A blessing for parents who never wanted Game of Thrones mixed with Sesame Street. Unless it’s in a Sesame Street parody of Game of Thrones, which I am ready for.

As an aside, Cook showed how you could swap users in tvOS using a new control-center menu that looks like it is available via a swipe in from the right.

The components in the new tvOS control center showed the time, date, profile pictures for the different tvOS users, a quick option to put the Apple TV to sleep, music controls, the audio output dingus which will be handy for AirPod users, and a search icon.

Cook showed that users would have personalized music options, again, my recommendations will no-longer be destroyed by the music I play for my family. Fantastic. This multi-user stuff needs to be on every Apple device.

The updated Apple Music app for tvOS would display lyrics while you’re listening.

Apple Arcade was demonstrated with Oceanhorn 2.

Cook promised that the Apple TV would now support the Xbox One S and the PlayStation Dual Shock 4 controllers, which both have Bluetooth functionality. This is fantastic because the only MFi controller that has clickable thumbsticks is wired. I believe this functionality is coming to iOS as well.

Screensavers are getting updated with underwater vistas in collaboration with the BBC’s Natural History team.

watchOS 6

Cook boasted the current functionality of the watches Apple makes before introducing Kevin Lynch to talk about new features.

Lynch promised “more watch faces this year since the very first Apple Watch.” I think he meant that there are more new faces this year than there have ever been before.

Lynch demonstrated five new faces. A gradient face that moves an angled gradient with the minute hand. A “large numerals face” that showed the current hour in multiple languages. A modern digital face with huge chunky numbers. Finally, a hideous analog California dial with roman numerals (X, XI, I, II) above the horizontal midpoint of the watch and traditional Arabic numbers (8, 7, 5, 4) below. Finally, a new solar face that had multiple circles to represent the movement of the sun during the day.

According to Lynch he new faces would have an optional hourly chimes that they call Taptic Chimes. Each hour you’d either feel a nudge on your wrist from the “taptic engine” of the watch or if sound is on you’d hear something like a bird singing with the new modern face. This is extremely obnoxious. I can’t imagine anyone using it.

There are also new apps for the Apple Watch, an audiobook app for books purchased through Apple’s book store and a Voice Memos app to match the phone’s. Another new app is an Apple-provided calculator.

Finally, WatchOS gets apps that run only on the Watch. Previously, every Watch app had to have a companion app for the iPhone, even when that made little sense.

In the first actual nod to developers for the event, Lynch promised new APIs. An Extended Runtime API lets apps run for longer. Lynch specifically called out that this would be for apps using sensor data, like meditation, exercise, or tooth brushing.

A new-to-the-watch Streaming Audio API would let developers stream audio over the network. Three examples were given, podcasts (Outcast app), music (Pandora), and the MLB’s watch app with the Phillies versus the Brewers.

Lynch also promised a new UI framework this year.

Independent apps also mean that the watch gets its own App Store app to browse for & install new apps.

Dr. Sumbal Desai, Apple’s Vice President of Health was introduced to talk about new health and fitness features for the Watch.

Desai promised an updated Activity app with more long-term information through trending data. The updated app is supposed to provide new data points that weren’t previously exposed.

One of the new features of the Watch is the new Noise app that monitors your auditory environment and alerts you when it’s so noisy that you could damage your hearing. There’s also a complication for the watch face to display the current noise level.

Desai promised that the Noise app wouldn’t record or save audio, and instead just sample the volume every so-often.

Another new feature for the Watch is the Cycle Tracking app for period tracking. It’ll also be available in the iOS Health app.

Lynch returned to discuss a newly redesigned iOS Health app. A Summary view provides health related notifications and other summarily-provided information. He also promised that all of your health information would be private and securely-stored on your iPhone or encrypted in their data centers.

WatchOS program lead Haley Allen demonstrated the new watchOS functionality. Allen started with a new watch face, the Modular Compact face that had four items on the screen, a large analog dial in the upper right, two new complications (Wind and Rain) on the left side, and a large complication space in the bottom with an upcoming calendar item. Allen replaced the large calendar complication with a Noise complication to measure the environmental volume and had the audience cheer to raise the volume.

Allen moved on to the Infograph Modular face with a pretty cool two-tone color scheme of whte numerals with red highlights. Allen demonstrated the audiobook complication that let her tap to get back into the audiobook watch app.

The new app store was demoed, and it looks fine, although it isn’t clear how easy it will be to navigate from these short demos.

Finally, Allen demonstrated the MLB app streaming Red Sox versus Orioles game.

Lynch returned with the traditional “didn’t have time” feature jumble and mentioned that the watch would finally update itself without requiring the user to do so on their iPhone.

Lynch said there would be new watch bands and colors, he specifically called out a new pride band.

Apple shortchanges all of their retail workers equally when they make people line up for mandatory off-the-clock searches before being allowed to leave at the end of their shift.

iOS 13

Cook returned to move things back to iOS and introduced Craig Federighi who joked about the tremendous creativity behind the iOS 13 name, and then moved on to talking about how much performance has increased in current devices with the new operating system.

Federighi gave some examples and said that Face ID would be 30% faster to unlock devices.

Apps would be packaged differently for iOS 13, and would be 50% smaller to download and updates would somehow be 60% smaller. Who knows how much work is involved on the part of developers to attain those numbers, and what exactly is going on. Compression, selective assets, it could be any number of things and those could be effective or not across a wide variety of apps and games.

Apps, Federighi said, would launch twice as quickly on iOS 13.

Moving on to new features, Federighi introduced a video advertising the new iOS dark mode.

Dark Mode is a feature that debuted on macOS last year. Federighi demonstrated it in use on an iPhone, starting with the lock screen switching from a light version of a wallpaper and theme to a darker version. He moved on to News, which will no-longer blind you in the middle of the night, then swapped to the Calendar, Notes, and Messages. It’s a feature that should have been on iOS as soon as OLED screens became an option.

While in Messages Federighi demonstrated that the keyboard, also updated for dark mode, has swiping functionality. He later called it the “quick path keyboard”.

Federighi showed that the new share sheet in photos also adjusted to dark mode, and it had sharing suggestions in addition to a redesigned interface for sharing to apps and actions.

The darkness embraced the music app, which also has time-synched lyrics just like the TV Music app.

Federighi exited the darkness and talked about other app updates.

Safari is promised to have quick functionality to scale the text of the site you’re viewing, and per-site preferences.

Mail is to get “…desktop-class text formatting, including support for rich fonts.”

Notes has a new gallery overview, shared folders, and “much more.”

Reminders has been “completely reinvented” and “completely rewritten from the ground-up.” It’s supposed to give you suggestions of when or where you might want to be reminded, a quick-type bar lets you quickly add locations or photos to your reminders.

To-do lists can be embedded inside a top-level reminder for more organizational functionality. People can be tagged in a reminder so you’re reminded to talk to them about something you wanted to remember.

The Maps app is supposedly updated with new information from a fleet of Apple’s mapping vehicles. The entire US is to have the new data by the end of the year.

Meg Frost was introduced for a demonstration of the new maps app. She’s wheelchair bound and has what I can honestly say is the most awesome looking wheelchair I’ve ever seen.

The redesigned Maps app has a horizontally-scrolling list of categorized favorites under the search bar, collections of places in a vertical list, and then your recently viewed places.

Finally, there’s a street view mode with a binocular icon that launches users into a “look-around” view that appears comparable to Google’s app.

Federighi returned to quickly list off a few more changes to the maps app. A junction view for China that lets people see how traffic will flow in an upcoming intersection, and ETA sharing via quick on-screen shortcuts.

Federighi reiterated his company’s commitment to privacy with another word jumble and then talked about new privacy controls. Location could be shared with an app just once, and then it’d have to ask for approval the next time. You’ll also get regular alerts to apps using your location in the background, and said they wouldn’t allow apps to scan WiFi and Bluetooth signals to track your location.

Federighi promised that Apple would create a new single-sign on functionality for streamlining logins to apps without third-party services or new accounts. It’ll be up to the developer to support this method of sign-on. Federighi promised that this would create a new account for the app without revealing “… any new personal information.” Signing in would use Face ID, or presumably Touch ID. Developers can optionally request your name and e-mail address. Users can optionally share a one-time email address that Apple creates on the spot to forward mail from that app. Federighi said that you could delete the new address at any time to stop receiving mail from that app.

This will inhibit situations where, for example, you want to log into the web version of an app, so it isn’t clear to me how that will work but Federighi said that it’ll work on websites. It won’t work in Firefox, Chrome, or Edge unless Apple has built something for those browsers.

Next, Federighi talked about a new feature of HomeKit, Secure Video, for home security cameras to analyze video locally (on an iPad, HomePod, or Apple TV box) instead of on remote servers. When the video is uploaded, it’ll go to iCloud but be encrypted and Federighi promised that Apple can’t even see the video.

Federighi said that storage for 10 days of video recordings would be included in existing iCloud accounts, and that this video storage wouldn’t count against iCloud storage limits.

The first companies to support this new Secure Video functionality are Netatmo, Logitech, and Eufy. At leat two of those sound like Pokemon.

Federighi promised that there would be HomeKit enabled routers which just makes it even more infuriating that they stopped developing their AirPort line of network routers. HomeKit-enabled routers would segregate the network connections of internet-of-things devices. Federighi said that Linksys, Amazon-owned Eero, and the Spectrum ISP would make these routers at first.

Moving back to Messages, Federighi immediately sherlocked Casey Liss’s Vignette by saying that you could optionally share your name and photo with people you message so they wouldn’t just get a random phone number.

Federighi introduced popular YouTube spec workers’ “Memoji” avatars to talk about new features for those avatars. There are a ton of new features, here’s the video:

After the video, Federighi spoke about Memoji stickers. These could replace regular emoji with automatically generated Memoji versions of the regular emojis. It’s interesting that these are also included in the system keyboard, and Federighi said that the customized stickers would work in mail or other apps.

Finally, Federighi said that users without FaceID, but who had at least an A9 SoC, could create, edit, and share Memoji. Although they wouldn’t be animated without the iPhone and iPad Pro sensor suite.

The Camera and Photo apps have also been updated.

New Portrait Mode features include “high key mono,” and you’ll be able to move the virtual portrait lighting lights further or closer to your subject.

Edits are promised to be easier to make, have new features, and be available for video as well. You can finally rotate a video while editing without using another app.

Browsing photos is to be easier, separating out screenhots and photos of things like receipts, and organizing photos to only show a single photo of a particularly scene instead of every duplicate.

Justin Titi demonstrated the new Photos app, and how it organizes photos into easier collections of days, months, years, or still allows users to dig into every photo.

Federighi returned to introduce Stacy Leizeig (not sure on the spelling of that name) to talk about AirPods, HomePods, CarPlay, and Siri updates for iOS 13.

AirPods can optionally announce incoming messages as soon as they come in, so you can reply immediately. Leizeig said this would work with any messaging application that uses Apple’s SiriKit API.

Audio sharing will be available in iOS 13 to share audio between multiple devices. There is a user consent dialog before this happens, and audio is controlled independently.

Leizeig said that people could use the HandOff API to share music or a podcast to a HomePod by holding their device close to the HomePod. Recovering the listening session happens by the same gesture.

Siri is promised to have live radio access with over a hundred-thousand live stations.

The HomePod will finally recognize multiple speakers and personalize answers and data for Messages, Music, Reminders, Notes, and so on.

CarPlay updates include a new dashboard view with more information. Siri is promised to stay “out of the way” and not obscure the entire display. We need that functionality on regular iOS.

Siri Shortcuts is built into iOS 13 and “more powerful than ever.” The Shortcuts app will make more suggestions about multi-step shortcuts that might be useful to you.

The Siri voice in iOS 13 is promised to be entirely software generated for the first time, as opposed to generated using clips of different speech sounds to create each word. I hope this fixes Siri’s pronounciation of Hawaiian names, because it’s pretty awful. Leizeig compared iOS 12’s Siri to iOS 13’s Siri pronouncing a complex sentence scientifically describing absolute zero. The iOS 13 Siri sounded much more natural and human.

iPadOS

Federighi returned to close out the iOS 13 discussion and talk about the split to iPadOS. He introduced a video that has not been excerpted onto Apple’s YouTube channel yet, it showed new functionality that would be exclusive to the iPad.

Federighi demonstrated the newly defined iPadOS. He showed that an iPad Pro (2018) running iPad OS with more icons on the home screen, and by swiping over from the left, the widgets previously on their own home screen are now visible on the regular screen.

Multitasking is improved by giving slide-over windows their own grab handle at the bottom of the slide-over window that lets you quickly choose a recent window.

Split-view was demonstrated in Notes by grabbing a note from the list and splitting it off into a different split-view window. Finally. The iPad has been available for almost 10 years and multitasking needs these improvements.

Federighi demonstrated dragging and dropping individual notes next to other “spaces” with other apps open in other windows. App Expose would allow you to see any fullscreen space with a Note open, in Federighi’s example.

Federighi also demonstrated two Microsoft Word documents side-by-side in SplitView.

Federighi then demonstrated splitting e-mail composition into a new window while continuing to browse through other emails before dragging and dropping an image from another e-mail he had received to the e-mail he was composing. He also showed previewing a link in another e-mail, and then dragging that link and dropping the link into the e-mail he was composing.

An e-mail in the background joked about screensavers for iPad OS, including Flying Toasters. I’ll be holding out for the Dancing Disco Pig.

Federighi also talked about improvements to the Files app. New views like icon and list views. A Column view with previews, and quick actions.

iCloud Drive will finally get folder sharing.

The Files app in iPadOS is to get Samba sharing, it sounded like it was just to access network shares and not share from iOS.

Finally, the Files app will get external storage support for thumb-drives, SD cards, and other connected drives. Holy shit this took forever.

Finally, you can import directly from a camera into an app (Lightroom was the example) instead of going through iCloud Photos.

Safari is also getting updated on the iPad with “Desktop-class browsing” so that iPad users won’t get served the mobile version of websites.

Federighi specifically said that browser apps like Google Docs, Squarespace, and WordPress would work better now.

As rumored, Safari is getting a download manager. There will also be 30 new keyboard shortcuts for Safari.

Also rumored, fonts are easier to manage in iOS 13. They’ll be downloadable from the App Store. Fonts have been an important focus of Apple’s software for as long a very long time, this is a big Finally for iOS. It will be interesting to see how fonts are managed, and if they will be freely loadable without going through the App Store.

iPadOS multitouch is supposed to be easier. Federighi showed a giant hand grabbing the page scroll indicator directly on a long document, grabbing the cursor while editing a note and moving it easier while also adjusting that movement into a selection. A new gesture enables copy and paste on the iPad. Once text is selected it is possible to copy by pinching with three fingers and then pasting by moving the cursor and spreading three fingers out.

A three-finger swipe left is the new iPad undo gesture. Federighi joked about how people won’t have to shake-to-undo the iPad anymore.

The Apple Pencil latency is supposed to be reduced from 20 miliseconds to 9 miliseconds. The Pencil drawing tools are improved and available to third-party developers via a new API called PencilKit.

iPadOS 13 will allow you to mark-up “…anything on any app” by dragging up with the pencil from the corner of the screen to get a screenshot of the screen and mark it up. This is said to also work with an entire document, instead of just the currently visible screen area.

Toby Patterson was introduced to show off iPadOS’ new editing functionality, including bringing up a small iPhone-sized keyboard for typing with one hand. He accessed that new small keyboard by pinching the large keyboard with two fingers. Patterson was visibly flustered when trying to demonstrate some of the text selection gestures, which weren’t cooperating with him.

Patterson said you could still shake to undo, but he also showed off the new three-finger swipe. He said these gestures would work in any application that supports cut, copy, and paste with undo and redo, not just text-based document applications.

Moving onto the Pencil’s new tool pallete. Patterson showed it being dragged and dropped around the screen, so it could get out of the way of his work. It can be pinned to the edge, or minimized out of the way.

Patterson also showed the markup mode, and how it works with screenshots and can be toggled in apps that support it to the document mark-up mode.

Mac Pro 2019

Cook was brought back out to move things to the Mac Pro. John Siracusa’s dreams have come true. After a decade he can finally get a new 2019 Advanced-Cheese Grater Mac Pro.

John Ternus was introduced to talk about the long overdue replacement for the Trashcan Mac Pro. The Intel Xeon-based computer supports up to 28 cores.

The RAM is 2933Mhz ECC RAM, 6 memory channels, there are 12 DIMM slots. You could havce up to 1.5 terabytes of RAM.

Ternus said the new Mac Pro has 8 internal PCI-express slots. Four double-wide, three single-wide, and one additional half-wide slot that has IO ports. That card has two Thunderbolt 3 ports, two USB-A ports, and a regular 3.5 mm audio minijack. There are two more Thunderbolt 3 ports on the top of the computer.

There are two gigabit ethernet ports near the power connector at the bottom of the back of the 2019 Mac Pro.

Ternus said there is a new Mac Pro Expansion (MPX) module specifically for containing video cards that has it’s own 500 watts of power, a regular x16 PCI express edge connector, and then an additional PCI express/ DisplayPort/Power thing on the end. The starting graphics card would be a Radeon Pro 580X. I’m a little confused by that part, because it sounds like the 2017 Radeon Pro 580. Another option for graphics is the Radeon Pro Vega II, or two of those Vega II GPUs. I really wish the Nvidia and Apple feud would end so some other competing options could be availalbe.

Ternus called the dual Vega II configuration “The world’s most powerful graphics card.” before he introduced another marketing term, the Infinity Fabric Link, which supposedly lets data move between the GPUs five times faster than the PCI express bus.

Ternus said you could also configure the new Mac Pro with two dual Vega IIs modules.

Ternus talked about an add-on card for editing ProRes and ProRes RAW video. This card has a custom ASIC that allows the Mac Pro to process huge video data streams. Ternus said the Mac Pro could play 3 8K ProRes RAW streams.

The new Mac Pro has a 1.4 kiloWatt power supply. Ternus said that “under typical load conditions” the new three-fans-and-one-blower thermal cooling setup in the new Mac Pro is as quiet as an iMac Pro.

There are optional wheels for the Mac Pro.

Ternus boasted about the third-parties that are working with Apple for the new Mac Pro and specifically boasted about performance beating an Nvidia+Windows configuration.

David Earl was introduced to talk about Logic and Final Cut, and showed adding hundreds of instruments to a soundtrack for a documentary. He added about a thousand tracks and then worked with 8K video.

The starting price for this Mac Pro $6000. The availability was given as “this Fall.”

There will also be a special version of the 2019 Mac Pro for rack-mount configurations.

Apple Pro Display XDR

Colleen Novielli was brought out to talk about the new display for the new Mac Pro. She compared it to a pro display that costs $43,000. The APDXDR is 32 inches and has a resolution of 6016 x 3384. Novielli called it a 6K Retina Display. The new display was said to support P3 wide color gamut, 10-bit color, and has Reference modes built-in. Novielli said the display has contrast that is 25x better than a typical LCD.

Novielli also said there was a superior matte option available for the display that doesn’t degrade image quality compared to older technologies.

This display is supposed to maintain higher brightness levels, 1000 nits in perpituity, 1600 nits at the peak. Novielli said the display would have a 1,000,000:1 contrast ratio.

Novielli said the 15 inch MacBook Pro can have two of these displays connected, while the new Mac Pro can have six of these displays connected.

The arm for the display is custom, and supposedly makes the monitor feel weightless while it is being adjusted. There is also an optional VESA mounting adapter.

The Apple Pro Display XDR costs $5000. There is also a “Nano-Textured” version of the display that costs $6000. The VESA adapter is $200. The “Pro-stand” is a laughable $1000. If you don’t have either I guess you’ve gotta get some plywood and screws out or keep it on your lap?

macOS 10.15 Catalina’s iTunes Breakdown

Cook returned to summon Craig Federighi to talk about the new version of macOS.

Federighi walked us through some of the features of iTunes added over the past 18 years, paused to joke about adding Mail and Safari and a Dock to iTunes, before introducing a split of iTunes into three apps. Apple Music, Apple Podcasts, and Apple TV. It wasn’t immediately clear if the new app would still support local libraries of music and features like iTunes Match.

Federighi talked about how the Apple Music experience would be better in the new app before introducing the idea that sync for iOS devices would be moved to the Finder app.

Apple Podcasts gets its own app, as well. Federighi said that the new Podcasts app has machine learning’d it up to scan the spoken word content of the podcasts so you can search for the actual content instead of just the name or episode title.

The Apple TV app is split off into its own app. Federighi boasted that the new app would support 4K HDR playback supporting HDR-10, Dolby Atmos, and Dolby Vision standards.

The rumored iPad-as-external-display feature is real, and it is called Sidecar. Goodbye to the podcast ads? This functionality supports the Apple Pencil, and works wired or wirelessly.

Accessibility

Federighi introduced an accessibility ad for new voice features to control Macs and iOS, as well as rich text composition:

Find My

As rumored, Find My iPhone and Find My Friends have been combined for both iOS and macOS into one app just called Find My. Apparently devices will now emit Bluetooth signals so you can track them down even when they are offline, via a mesh network of Apple devices. Federighi promises that this is encrypted and anonymous.

Activation Lock

Macs with the T2 security chip (an ARM SoC from Apple) get the ability to be locked down via activation lock.

macOS 10.15 Catalina, Again

Federighi talked about how the new updates to Photos would make it to this version of macOS, along with an updated start page in Safari, and the new gallery view in Notes. Reminders is also coming to macOS along with Screen Time.

Project Catalyst (Marzipan?)

Federighi’s got a marketing name for the stuff that brought shit iPad versions of News, Stocks, Voice Memos, and Home to macOS Mojave. Federighi says that this new cross-platform support is much improved, the slides are not very convincing.

In terms of third-party support, Federighi boasted about the racing game Asphalt, Twitter’s iPad client which is not somebody I want to hear about when they hate third-party developers to a degree that is profoundly disturbing for the long-term success of that platform. Finally, Federighi introduced somebody from Atlassian to talk about Jira for the Mac. Zzz. it’ll be in the Mac App Store this Fall.

Catalyst is available to developers in Xcode preview today. No multiple window support was demonstrated. I am not hopeful that this feature is at all improved over the awful News, Stocks, Voice Memos, and Home apps on macOS today.

AR

Federighi talked about the new AR API RealityKit, for developers that don’t have experience with existing game engines. Reality Composer is a new app as part of Xcode, or for iOS and iPad. It has a bunch of pre-existing models to stuff into your app. Very strange. ARKit 3 was demonstrated with a new people occlusion feature to allow for people to be better placed in-between AR models. Motion capture was also demonstrated.

Minecraft Earth AR Demo

It wouldn’t be a modern Apple event without an awkward demo featuring VR or AR. VR is a little out of fashion, so it’s an AR demo from Lydia Winters and Saxs Persson of Mojang. I’m not sure how many people will want to hold an iPhone or iPad for hours to view an AR version of Minecraft called Minecraft Earth. All things considered this demo could have been much worse.

SwiftUI

Federighi returned to talk about a new framework for the Swift programming language, SwiftUI. Federighi gave an example of a huge list that would be a huge piece of code but minimized when it was converted to the SwiftUI framework.

Federighi said that new features would be brought to apps with SwiftUI automatically, like Dark Mode. He also said that there’s a new interactive, upgraded preview type of thing in Xcode for SwiftUI. Federighi compared it to Swift Playgrounds but said it was much more powerful.

Josh Schafer was brought out to demo SwiftUI’s new editor in Xcode. He made a joke app to make up phony versions of MacOS, and immediately showed his changes both in the Xcode Preview as well as on a live iPhone.

Federighi returned to say that the SwiftUI framework was also available for watchOS, and all Apple platforms.

Cook’s Close-out Deals

Cook returned to tell us that developers betas were available for all of the new operating systems and software today, with public betas in July. The usual promised release window for the new operating systems was “The Fall.”

Overall

The world’s most performant Mac Pro is great if you’re working on movies or high-end audio production Apple still can’t ship a reliable laptop keyboard or a tower for normal people who aren’t at Pixar. It’s also not clear at all what storage upgrades for the Mac Pro will look like, I’m not sure if the word “T2” was mentioned during the keynote, but the product page for the new Mac Pro mentions the dedicated ARM SoC Apple calls T2 so it seems like you might be limited to add-on PCI-express modules or hooking up external peripheral storage. This is especially galling on the base-model Mac Pro that only includes 256GB of storage.

The display that costs extra if you want to put it somewhere besides flat on your floor is just the ridiculous cherry-on-top of unapproachable high-end hardware.

The OS update for the Mac was couched in the end of iTunes, which will hopefully still be available if some functionality is missing from the new Music, Podcast, and TV apps. Windows users, are of course still suck with the worst version of iTunes.

iCloud is still capped to an increasingly paltry 5GBs of free storage. I am very tired of reading help posts from iPhone users online who have lost their entire photo and video library when their phone breaks and they couldn’t afford enough iCloud storage. Somehow Apple has deemed the subset of their user base that has home video security cameras more important than the millions of iPhone users who would refuse to pay for secure backups.

One way that Apple could work around this is with their own home network router that had a disk inside for backups of all your devices, but the AirPort line of routers is dead and I am sad about that.

I’m not sure how much I buy the split of iOS and iPadOS, it didn’t seem like this event was organized to emphasize that split, but I am glad that they’re working on the iPad to make it a better competitor to a traditional laptop computer. Still, there are so many limitations of an iPad compared to a modern Mac. For example, there is still no generally available multi-user mode for the iPad. The HomePod is getting that feature first, I’m glad the HomePod is going to be more useful, but it’s ridiculous and looks more like a cash grab that everyone in a house needs their own iPad if they want it to be tailored to their uses.

I am a little concerned that the only way improvements can come to these platforms is bundled in a cute marketing name. The iPad needs more improvements yet to be more competitive as a laptop replacement, maybe we don’t need our home screen to be just a list of apps and a select few widgets. Maybe a home screen could include files and be arranged however someone wants it, just like a real computer. Apple is so slowly trickling out features to the iPad, I’m looking forward to more. Perhaps they’ll come faster with the rebranding to iPadOS.

The most important Pro app for iPads to be a full computer and ship their own apps is Xcode, and we still don’t have it. Until an iPad can ship iPad software without any other device, I’m not sure Apple is really onboard with the iPad as a real computer.

The Steam Link App is Finally Out for iOS & tvOS

The Steam Link app is finally available on iOS (and tvOS) after being available on Android, and then the Raspberry Pi sbc, for a year. The Steam Link app acts like the now-discontinued Steam Link box and streams your Steam library (and more) to your phone, tablet, or TV. The iOS & Apple TV tvOS app allows for Bluetooth controllers like the Steam Controller as well as Apple-approved controllers that are already available for iOS and tvOS.

Apple initially approved and then blocked the Steam Link app for iOS last year. Presumably that was because Valve’s Steam store was available to users, which was a not-great on Apple’s part but makes about as much sense (none) as Apple demanding a cut of Amazon’s ebooks. The new version of the Steam Llink iOS app doesn’t let people access Valve’s store while streaming, it only allows people to play their game library.

The newest versions of the Android app also allows people to stream games when they’re away from home, the iOS app doesn’t have that feature yet and so you’ll be stuck playing on your home network.

As I’ve said before, I don’t think it is any good that the streaming of games you own locally is controlled by any store, platform, or driver company (like Nvidia’s Shield game streaming service.)  There could be a third-party, entirely open-source effort to stream your desktop with performance in-mind, but there isn’t. The closest thing is the Moonlight project, but it is only available for people with Nvidia’s graphics cards.

All that said, I played a game of Into the Breach streamed to my iPhone from a Windows host using the new app and while that was a confusing setup process (disabling the virtual mouse, enabling the virtual gamepad) it was ultimately rewarding.

I did have one crash when I switched apps and the network connection had been dropped, but I just resumed the game once I re-launched the Link app.

Streaming from a macOS host is a giant pain in the ass, involving the installation of multiple kernel extensions, reboots, and then installing more kernel extensions and more reboots. I can’t imagine this will get any easier with macOS 10.15, if it’s possible at all. Apple delivers a warning to let you know that something Valve is doing won’t work with “…a future version” of macOS:

Screen Shot 2019 06 03 at 12 49 37 AM

That is an ominous warning for a person to read who just wants to play a fucking game. I’m sure they’ll rush out to install the next big macOS upgrade.

Apple’s “Fuck You” to Mac Game Developers & Players

This wasn’t in the keynote, but Apple had some bad news buried in the “What’s New in macOS” section of their developer site for anyone who makes games or other software with the OpenGL graphics API :

Deprecations and Removed APIs
Periodically, Apple adds deprecation macros to APIs to indicate that those APIs should no longer be used in active development. When a deprecation occurs, it’s not an immediate end of life for the specified API. Instead, it is the beginning of a grace period for transitioning from that API and to newer and more modern replacements. Deprecated APIs typically remain present and usable in the system for a reasonable time past the release in which they were deprecated. However, active development on them ceases, and the APIs receive only minor changes to accommodate security patches or to fix other critical bugs. Deprecated APIs may be removed entirely from a future version of the operating system.

As a developer, avoid using deprecated APIs in your code as soon as possible. At a minimum, new code you write should never use deprecated APIs. And if your existing code uses deprecated APIs, update that code as soon as possible.

Deprecation of OpenGL and OpenCL
Apps built using OpenGL and OpenCL will continue to run in macOS 10.14, but these legacy technologies are deprecated in macOS 10.14. Games and graphics-intensive apps that use OpenGL should now adopt Metal. Similarly, apps that use OpenCL for computational tasks should now adopt Metal and Metal Performance Shaders.

Metal is designed from the ground up to provide the best access to the modern GPUs on iOS, macOS, and tvOS devices. Metal avoids the overhead inherent in legacy technologies and exposes the latest graphics processing functionality. Unified support for graphics and compute in Metal lets your apps efficiently utilize the latest rendering techniques. For information about developing apps and games using Metal, see the developer documentation for Metal, Metal Performance Shaders, and MetalKit. For information about migrating OpenGL code to Metal, see Mixing Metal and OpenGL Rendering in a View.

Apple is already requiring that apps get updated to be 64-bit, or they’ll stop working in a future update.

As much as I loathe John Carmack today, and it certainly didn’t help that he decided to write this on Facebook, he recently wrote about how he persuaded Steve Jobs to support OpenGL on the Mac:

I was brought in to talk about the needs of games in general, but I made it my mission to get Apple to adopt OpenGL as their 3D graphics API. I had a lot of arguments with Steve.

Part of his method, at least with me, was to deride contemporary options and dare me to tell him differently. They might be pragmatic, but couldn’t actually be good. “I have Pixar. We will make something [an API] that is actually good.”

It was often frustrating, because he could talk, with complete confidence, about things he was just plain wrong about, like the price of memory for video cards and the amount of system bandwidth exploitable by the AltiVec extensions.

But when I knew what I was talking about, I would stand my ground against anyone.

When Steve did make up his mind, he was decisive about it. Dictates were made, companies were acquired, keynotes were scheduled, and the reality distortion field kicked in, making everything else that was previously considered into obviously terrible ideas.

I consider this one of the biggest indirect impacts on the industry that I have had. OpenGL never seriously threatened D3D on PC, but it was critical at Apple, and that meant that it remained enough of a going concern to be the clear choice when mobile devices started getting GPUs. While long in the tooth now, it was so much better than what we would have gotten if half a dozen SoC vendors rolled their own API back at the dawn of the mobile age.

While OpenGL isn’t going away immediately in macOS Mojave, when it is finally gone there will be many fewer games on macOS, it has been the only portable graphics API available for developers to bring their games to Linux and macOS, as well as other platforms, for decades.

Without OpenGL on macOS the Mac and Linux will both suffer, as will new platforms. They’ll have a harder time getting games and other software when bigger platforms are locked to vendor-specific APIs like Metal instead of cross-platform ones like Vulkan and OpenGL.

If I had to guess, I would hope that Valve will ship an intermediary layer to translate OpenGL calls for games on Steam, and hopefully they will make this software available for everyone else. There are already some other projects to translate OpenGL to platform-specific calls but it’s not going to be easy for games to support them. It’d be better if these projects had something to handle the translation on-the-fly. It’s also entirely possible that Valve will just give up on older games supporting modern versions of macOS after Apple fully deprecates OpenGL.

I don’t envy anyone trying to support old software and write good OpenGL drivers like Apple has (even when they don’t update their OpenGL support for years), but the deprecation of OpenGL is a real “Fuck You” to game developers and players unlike any other. Games getting updated from 32-bit to 64-bit, as well as going through the process of having any kind of graphics portability layer added on top, seems unlikely. Thousands of games are going to be lost to time when OpenGL dies off. Competition with popular hardware and software platforms will be even more difficult. I understand the desire to get rid of technical debt, but this is bad.

Apple’s WWDC 2018 Event Notes

Here’s everything that Apple announced today.

Keynote

Here’s everything that Apple announced at their World Wide Developer’s Conference Keynote for 2018. The event opened with this four-minute nature documentary style advertisement on migrating developers:

iOS 12
Craig Federighi boasted about iOS 11 being available on iOS devices from 2013, and that the majority of their users are on 11 versus the 6% they claim are on the latest Android update. According to Google, the percentage of Android users running their latest operating system (Android 8.1) is 0.8%, ouch. I would guess that Apple based their estimate on the percentage of devices that are capable of running 8.0 or 8.1, which is 4.9% and 0.8% respectively. The majority of Android users (25.5%) appear to still be in the stone age on Android 6.0.

According to Federighi the primary focus of iOS 12 will be performance, specifically he said that older devices would perform better. Using an iPhone 6 Plus as an example, Federighi claimed that apps would launch 40% faster, the keyboard would display 50% faster, the camera would open 70% faster.

USDZ
Because this keynote is ostensibly for developers, Federighi announced a new format for 3D scenes to be bundled together, USDZ. Pixar created the USD format in 2012, and this is their update to it for 2018 (thanks to coolpowers).

Adobe’s CTO Abhay Parasnis announced that their products would support the new format and that Apple’s developer State of the Union would have some kind of demo of this integration.

Measure
Federighi announced a new app for augmented reality, Measure, which will presumably replace everyone’s first ARKit app by giving you measurements for real-world objects. The app can detect some shapes and automatically provide measurements for those, but you’ll need to tap at the ends or corners of most real-world objects to get the app to measure them.

Apple’s USDZ Demos
Federighi showed off a USDZ 3D scene of a fish embedded in their Apple News app, and then customized a guitar on Fender’s web store only to display it on the stage through an iPad’s AR viewfinder.

LegoARKit 2
Federighi said that iOS 12 would include a new version of their ARKit API for developers to create augmented reality experiences. The flagship feature for ARKit 2, shared experiences, allows multiple devices to view and interact with the same scene. A slide depicted a pre-recorded video of people playing a multiplayer AR game where both participants and an observer could see and interact.

Martin Sanders, the Director of Innovation at Lego, demonstrated the new object detection features of ARKit along with shared experiences by scanning a physical Lego set and then awkwardly holding two iPads around it with someone else from the Lego company. The iPads showed a city being built around the town square Lego set with some limited interactivity to place vehicles and minifigures. It looked like it could be fun, but this kind of AR scanning will probably be limited to sets that Lego produces, not the modifications people make to them. Sanders said that the Lego AR experience app would ship later this year.

Search in photos

Photos Search & For You
Federighi said that Photos would improve in iOS 12. He highlighted the search functionality that would offer suggestions and other improvements to help you find photos you’re looking for. The app will also get a new tab, For You, that offers suggestions of photos you might like to see or ways you could change them to make them more appealing. It seemed like the editing suggestions were limited to ones that involve Apple’s features like looping a live photo or making some specific change to a portrait photo.

The For You tab will also suggest sharing photos with people who appear in them. He said that they would be shared at full resolution, which is an improvement because photos shared today aren’t at the original resolution. Federighi also said that the recipient of shared photos would be prompted to share photos from the same event so that everyone ends up with the entire set.

Siri Shortcuts
Federighi mentioned a new feature called shortcuts that would let Siri easily start functions of other apps. The first example was “I lost my keys” which would have Siri open part of the Tile app’s functionality within Siri and look for them. Apps in iOS 12 would make suggestions of shortcuts to add to Siri. The iOS 12 lock screen and search will make suggestions of things to do like re-ordering coffee or turning on Do Not Disturb when you’re at a movie theater.

Federighi said that you’d be able to make your own shortcuts in a new “Shortcuts Editor” app.

Shortcuts editor

Apple’s Kim Beverett demonstrated the shortcuts functionality with a few examples. One of which was adjusting a shortcut she made in the Shortcut Editor. Beverett’s Heading Home shortcut would compress a bunch of steps into one action. It lets her roommate know how long it’ll take her to get home, set her thermostat to 70 degrees and turns on a fan, and opens maps with the course home preconfigured. Beverett quickly used the editor to play a radio program she wanted to listen to every time she goes home whenever she uses the shortcut. This Shortcut Editor is clearly the Workflow app that Apple acquired last year.

Other App Updates
Apple’s Susan Prescott demonstrated a few other iOS 12 app updates. Apple News is going from a 5 tab interface to 3 tabs with a new tab called Browse to handle the functionality from the current Search and Following tabs.

The Stocks app is completely rebuilt, and has business news built-in and new charts. The app will also be on the iPad.

Voice Memos is “even easier to use” and is also on the iPad, it’ll also use iCloud for file synchronization.

iBooks is getting refurbished with a new name and interface, it’s just Apple Books on iOS 12.

CarPlay is going to support 3rd party navigation apps.

Dnd

Do Not Disturb
Federighi returned to show us how iOS’ Do Not Disturb will be updated with a new feature called Do Not Disturb During Bedtime. It will hide notifications so you won’t be “barraged” with them if you wake up in the middle of the night and just want to see what time it is. You can also granularly enable Do Not Disturb until you leave a location or for a certain amount of time.

Notification Updates & The Screen Time App
You’ll be able to change the way notifications are delivered, or turn them off entirely, directly from the lock screen. You’ll also get suggestions to disable them for specific apps when you rarely interact with them.

Notifications will also be grouped together by what app sent them.

The Screen Time app will give you a weekly report of how you’re wasting your life on your devices. It’ll also let you set time limits for each app. You’ll get reminders about that limit when you’re about to reach it, or you can set limits for the apps your kids use by category or by picking each specific app.

 

Animoji

Animoji & MeMoji
Animoji are getting updated to let you stick out your tongue with your 3D avatar, they’re also getting four new characters. The ghost, koala, tiger, and t-rex. You can also make a character based on your own face, Apple calls that a “MeMoji.”

Kelsey Peterson demonstrated these effects on stage, and the selfie camera can now display the characters over your real face.

Facetime
Facetime can now have up to 32 people on a group video chat. It can be launched directly from a group text message chat in Messages. The different camera effects, like Animoji, are also available on Facetime.

WatchOS 5
Apple’s Kevin Lynch talked about new improvements for fitness and communications.

WatchOS 5 is getting improvements to compete with your friends in exercise. The Workouts app is getting a Yoga workout type, hiking, running gets a rolling pace measurement, pace alerts, and cadence measurements. WatchOS 5 will also automatically detect when you’ve started some types of workouts, it’ll retroactively credit you with the workout if you tell the Apple Watch to start the workout late.

There’s a Walkie-Talkie app for WatchOS 5 that goes over cellular or wifi connections.

The Siri watch face is getting information about sports, map information, and your heart rate. Siri Shortcuts will be on that Watch Face, as well as third-party apps.

Raising your wrist will let you talk to Siri right away, you won’t need to use the “Hey Siri” hotword.

Watch notifications

Notifications can also be more interactive, like on the phone. One example was getting a notification from Yelp about a dinner reservation

Apple’s WebKit embedded browser will be available for some web links on the Apple Watch.

The Podcasts app is going to work on the watch, it’ll sync full episodes from your phone.

Apple’s Julz demonstrated these new features while riding an exercise bike, which was pretty impressive.

Kevin Lynch returned to tell us about Student ID Cards coming to the watch, it’ll work with just 6 universities to start, but it includes Temple University in Philadelphia.

Lynch also introduced a new rainbow watch band and watch face for Pride month. The watch face is supposed to be available today.

Apple TV 4K
Apple’s Jen Folse talked about how the Apple TV 4K from last year is getting Dolby Atmos in the next version of tvOS, she also talked about how movies will get free upgrades to support the new audio format.

Folse reiterated Apple’s support for live TV and sports.

Folse also said that various cable providers are letting their users replace their cable boxes with the Apple TV, and use a new “Zero Sign-On” instead of the single sign-on system from last year.

The Aerial screensaver on the Apple TV is going to tell you what you’re looking at, finally. It’ll also get a new view from the International Space Station of the Earth.

Mojave

macOS Mojave
Craig Federighi returned to talk about the new features in macOS Mojave.

As Apple leaked, the next version of macOS is getting a dark mode. Previously you could dim the menu bar dock in their settings, but this is a system-wide feature that is more complete.

Desktop Stacks is another new feature that organizes the crap that gets scattered all over your desktop into stacks of documents matched by type, or date, or by tags. It’ll automatically keep those stacks organized as new files are added to the desktop.

Finder gets a new Gallery View that appears to replace the Cover Flow view with thumbnails at the bottom of the screen and a quick look type of view at the top.

The Finder is also getting a detail side bar with shortcuts to different actions you might like to take on the file, Federighi specifically mentioned adding customized automator actions to the side bar for certain types of files like watermarking files with one that was put together earlier.

The quick look utility is enhanced to let you do more from it, Federighi demonstrated trimming a video without opening a separate editor and signing a PDF document.

Screenshots are enhanced to be similar to the iOS functionality but with more powerful functionality that you’d expect on a computer. You can also capture video directly from that utility now.

The Continuity Camera feature was demonstrated by Federighi to take a photo from his phone and pop it directly into a Keynote slide. It can also scan in documents from your phone directly into a Mac app.

A few iOS apps are hitting the Mac. Apple News, Stocks, Voice Memos, and Home for using HomeKit devices.

Mac voice memos

Privacy
Mojave will have better privacy enhancements to prevent other apps from getting access to your personal data unless you want them to do so.

Safari on Mojave and iOS 12 will prevent advertising publishers from tracking you based on sharing functions and comment fields. Mojave and iOS 12 will also hide more of your information from being fingerprinted by websites and advertising publishers.

New mac app store

Mac App Store
The Mac App Store is finally getting updated, it hasn’t had many changes since 2011. Apple’s Ann Thai showed off a redesigned UI that takes a lot from their iOS App Store. It looks much better.

Metal & Core ML on iOS and macOS
Federighi returned to talk about Apple’s Metal graphics and computation API and external GPUs. He boasted about the speedups that Macs can get from up to four GPUs. It’s kind of crazy that the only GPUs that Apple supports for external GPUs are from AMD.

Apple’s machine learning API, Core ML, is getting updated with a 2nd version. It’s supposed to be 30% faster with a 75% reduction in the model size.

UIKit on the Mac
As has been rumored, Apple is making it easier to bring iOS apps to macOS. No specific name was given for this technology, but Federighi says they’re using it internally with apps like Apple News and promises that it’ll be available for 3rd-party developers next year.

Release Dates for iOS 12 and macOS Mojave
“This fall”

Overall
I’m very happy that macOS is getting updated with a new Mac App Store, it’s been way too long and developers have been abandoning it for independent distribution systems. I like having apps bundled into one store, but it’s also good that Apple finally wants to compete with independent distribution.

It’s a little disappointing that the iPad Pro didn’t get updated with this event, but perhaps they’re moving the majority of hardware updates to the Fall event.

I’m very happy to see that Workflow is still getting updated, and it looks like it is even more useful after Apple has updated it under the Siri banner. I wish that it were on the Mac as an alternative to Automator.

Homebrew Users: Run brew cleanup & Get Your Gigs Back

If you use a macOS machine for development, or even just to get some bonus commands that you wish the system came with, then you probably use Homebrew as your command-line package manager.

Perhaps you’re like me, you’ve been using it for years and didn’t realize that it has left gigabytes of detritus on your local drive, I certainly didn’t until someone in the homebrew IRC channel mentioned the brew cleanup command, and now I have 21.3 gigs of disk back.

Joakim Sandberg’s Iconoclasts Out on Steam, PS4, Vita

It can be pretty frustrating to find out that something you want to fix is difficult or impossible to repair. Glued-on screens cover batteries that are all custom fit inside small cases that prevent curious people from learning how things work and fixing problems with their devices. Iconoclasts from Joakim Sandberg takes that a step further, it’s a world where a mechanic, Robin, finds that her profession is outlawed. Your mission is to get Robin and her friends together to fix things in what looks like a bit of a metroidvania side-scrolling action-adventure with a Metal Slug-y vibe to the art.

Andy Kelly likes it:

Iconoclasts is a fine game, offering both satisfyingly sharp platforming and shooting, and some really smart puzzles. It’s enormous too, packed with secret areas and other stuff to discover. And although I found the humour a little glib and childish at times, it tells its heartfelt story well. A lot of Metroidvania games go for a bleak, downbeat atmosphere, but Iconoclasts is infectiously vibrant and sunny, even if the story does occasionally venture into dark territory.

Iconoclasts is out now for $20 on Steam on Windows, macOS, and Linux, gog (same platforms)as well as the PlayStation 4 and Vita.

Apple Has a Patch out for the macOS Root Access Security Vulnerability

Go to the Updates tab in the Mac App Store to apply it now, you won’t even need to reboot. Apple has more details about the update at this link.

Here’s the post from yesterday with the details of the vulnerability.

Update:
If you have any trouble with file sharing after applying this security patch Apple has another fix for that, oops.

The macOS Root Access Security Vulnerability

There’s a vulnerability in the latest version of macOS High Sierra (10.13.1) that may let anyone with physical access to a Mac log in and gain system administrator (root) access. Or, if they already have an account, upgrade their access to the system administrator (root) level.

You can work around the issue by setting a root password as described in this support document from Apple. They’re working on fixing it.

The vulnerability works like this:

  1. At any login or a privilege escalation dialog a user types in the username root
  2. The user hits the login button or enter a few times in quick succession
  3. The system enables the root user account and assigns it no password.

This is incredibly bad for Apple to have a vulnerability this easy to exploit, and it’s ridiculous that it was also apparently publicly available on Apple’s developer forums weeks ago.

Apple’s WWDC 2017 Press Event Notes

Every year Apple has at least two big events, their iPhone event in the second half of the year and their developers conference event in the first half of the year. Each event has it’s own press briefing, here are my notes from today’s WWDC 2017 press briefing. It is long as hell.

The show opened with a comedy skit about a new Apple engineer sitting down at a new desk and accidentally unplugging the iOS app store servers, disabling every app. Soon, the world descends into chaos as people can’t get directions and we see a marketplace of people trying to substitute for the missing apps:

Tim Cook was the first live human on stage with numbers and then to announce that Amazon’s Prime Video service is finally going to the Apple TV.

WatchOS 4:
Kevin Lynch announced new Siri functionality that would automatically present information you might want on the new Siri watch face. Rotating the crown scrolls through the available information. For example you might want to see your upcoming appointments and weather changes. They’re displayed as tiny cards as seen here:

There’s also a new kaleidoscope face along with several animated Toy Story character faces.

WatchOS 4 also has more customized notifications for activity encouragement and better reward animations when you’re done exercising.

The exercise tracking is more advanced and detects when you’re paused while swimming to determine your intervals, for example. It’s also easier now to move from one workout type into another without stopping.

New gym equipment will be Apple Watch enabled and will help you record your fitness activities on that equipment when you swipe your watch near a certain area on the equipment.

Apple Music is improved on the watch with a new app.

The new WatchOS will be out this Fall with a pre-release version available to developers today.


Mac Updates:
Tim Cook introduced Craig Federighi to talk about macOS updates. macOS 10.13 will be called High Sierra, another stability update along the lines of Snow Leopard and Mountain Lion. Craig joked about the name’s obvious weed reference.

Craig promises these new features in 10.13:

Faster Safari web browsing with faster Javascript.

Safari will also block autoplaying video and audio on web pages. That’s great.

Safari will have “Intelligent Tracking Prevention” to prevent sites from identifying you across domains.

Search is better somehow. Apple didn’t really explain how

Mail gets a split view in full-screen mode to edit new messages alongside reading others and is also more optimized for storage.

Photos gets all kinds of improvements such as improvements in detecting faces.

Finally, Photos’ machine learning stuff gets synced across devices.

Photos also has way more advanced editing features on the Mac.

Apple’s Apple File System came to iOS recently to replace HFS+, APFS will be on High Sierra as well.

MacOS will also support h.265 for video compression, which will also be supported with dedicated hardware on Macs.

Craig boasted about their graphics API Metal for a while before announcing Metal 2 that is supposed to give a 10x draw call throughput improvement. It’ll also have better debugging and optimization tools.

Interestingly, Craig talked about how there is a new Thunderbolt 3 enclosure with an AMD Radeon RX 580 and USB-C hub available for developers who want to offload Metal GPU computation tasks to an external device from a Mac. It isn’t clear if this can offload desktop graphics rendering, as well, but you would assume so.

Craig announced VR support coming to the Mac from Valve with SteamVR and engines from Epic (Unreal) and Unity.

All systems that support Sierra will support High Sierra. It’ll be out this Fall with a public beta later in June.


Mac Hardware Updates
New iMacs are coming with 50% brighter displays and Kaby Lake chipsets from Intel. The iMacs are getting support for more RAM, 32 gigs on the 21.5 inch and 64 gigs on the 27. The 27 also gets fusion drives by default. The 21.5 iMac gets improved integrated graphics. The 4k 21.5 inch iMac gets the Radeon Pro 555 and 560 with up to 4 gigs of RAM.

The 27inch 5K iMac gets the Radeon Pro 570, 575, and 580 with up to 6 gigs of RAM.

MacBooks and MacBook Pros are also getting updated with new chipsets.

Industrial Light & Magic’s John Knoll & Epic’s Lauren Ridge showed up to give a VR demo running on the new iMacs. The demo featured live edits to a Star Wars scene in the Unreal Engine. It was incredibly awkward and didn’t demonstrate anything new over what Windows desktop machines could do last year.


iMac Pro

 

There’s a new 27 inch iMac Pro in Space Gray to offer an option for anyone missing the Mac Pro that hasn’t been updated in years. With copious options in CPU (up to 18 cores) and RAM (up to 128GB).

According to Apple it’ll be much cheaper than a comparable workstation that would cost over $7000, this one will start at $5000. It’ll be available this December.


iOS 11
Tim Cook boasted about iOS 10’s lack of fragmentation compared to Android and then reintroduced Craig Federighi to talk about iOS 11.

iMessage apps get an updated app drawer.

iMessages is now in the cloud to sync your message history to all of your devices, and it is still encrypted end-to-end, which should mean that Apple can’t access your messages in any situation. Although practically they could do so and you might not know about it.

Apple Pay is getting person-to-person payments, and it’ll have integration with Messages. Although it’ll store by default to an Apple Pay Wallet you can transfer money to your bank account. Sounds like the introduction of an Apple Bank.

Siri is getting an improved voice that sounds more natural and is still the only option with both male and female voices. Siri will also support translation in beta with some languages. SiriKit for developers will do more and support more applications. The last update only worked with a few custom actions like sending messages in third-party apps.

iPhone photos and videos are getting new compression formats that are supposedly much more efficient. The portrait camera is getting more features for a higher quality end-result.

Memories are enhanced. Video editing is supposed to be much improved as well.

Control Center is now modular and a single page. If you 3D touch a control module you get more controls and more information for that module as it expands to take up more space on the display.

The lock screen notification area will now expand with a swipe to display all of your notifications, not just the most recent ones.

Live Photos are improved, you can pick the key photo and loop the short video in live photos or choose other effects.

Maps gets improved maps for inside buildings like malls and airports. Navigation gets speed limits and lane-guidance. There’s a new feature for drivers called Do Not Disturb while Driving, it’ll be automatically suggested while driving and hide notifications. It can also notify anyone texting you that you’re driving and that you won’t see their messages unless they’re on a VIP list or they can break through by responding with “urgent.”

AirPlay 2 supports multi-room speaker systems from all iOS devices as well as the 4th generation Apple TV.

Apple Music can optionally share your playlists and music library with your friends, developers can also access this information through new APIs.

Phil Schiller appeared on stage to announce some updates coming for developers and users. The iOS App Store gets a complete redesign that looks more like Apple Music. A new Today screen shows off new cards with different stories about new apps. There are new dedicated screens for showing off games and a different screen for non-game apps. Category editors can display videos demonstrating tips and tricks for different apps.

Craig came back to talk about other technology improvements, including ARKit for augmented reality. It’ll work with Unity, Unreal Engine, and Apple’s SceneKit. Craig demonstrated 3D objects like coffee cups and lamps displayed on surfaces like tables that are detected instead of just having the 3D objects overlaid on what the camera sees without any interaction with real-world objects. An updated version of Pokemon Go will support this new ARKit and display Pokemon on the ground instead of just floating in the air.

Peter Jackson’s WingnutAR team appeared on stage to demonstrate an AR application running on an iPad with a science fiction action scene. Using AR to display a pre-configured action sequence is pretty boring, honestly.


The 10.5 inch iPad Pro

Apple introduced a new iPad Pro with a 10.5 inch display and an A10x processor. Joz told us that this supports a full-size software keyboard along with a better keyboard case. It’ll have a better refresh rate that looks smoother when motion is displayed on the screen, so Apple called this ProMotion. It’ll also dynamically adjust the display refresh rate for whatever the content is you’re working on, for better performance or battery life at a slower refresh rate.

The new 10.5 inch iPad Pro also has the same camera as the iPhone 7 and the base model has 64 gigs of storage. They’re available for order today and will ship next week.

Craig came back to talk about iOS improvements for the iPad. The dock can now have a large amount of apps. It can be pulled up from the bottom of the screen in any app. You can pull apps out of the dock into a slide-over multi-tasking split-view. iOS 11 will also support drag and drop. There’s a new Files app that supports iCloud drive and third-party cloud file management services like Dropbox.

The Notes app now supports handwritten notes that get interpreted using OCR as text by the system for searching and can scan a document for editing.

The 12.9 (let’s be honest, 13) inch iPad Pro also gets the new display, processor, increased base storage (64GB) and other features. All of these iPads 10.5 and 12.9 also have the 2nd generation TouchID sensor with quicker fingerprint recognition, but still appear to have physical home buttons instead of the haptic-driven virtual home buttons of the iPhones 7 and 7 Plus.


HomePod

Phil Schiller came back on stage to talk about “Reinventing Home Music” with a new speaker from Apple called HomePod. The first non-Beats branded speaker from Apple since the iPod Hi-Fi. HomePod is a rotund  7-inch tall device with a little bit of an urn shape and has its own A8 chip inside. Supposedly this speaker is very advanced and detects the kind of environment it is in to adjust for different types of rooms and adjust the audio for clarity. It’ll also work with another HomePod automatically for better stereo separation.

Of course, this speaker will support Siri and be Apple’s competitor to Amazon’s Echo and Google’s Home device as was rumored for months. Apple says that this speaker will have advanced Siri functionality that is tailored specifically to it.

The HomePod will be $349, in white and space gray, this December.


Overall, this feels like Apple trying to catch up, in VR and AR, with a speaker for Siri and finally getting updates to the iPad Pro and an iMac Pro to help reassure Mac Pro users like video editors that Apple hasn’t completely abandoned them when the Mac Pro still doesn’t have a release scheduled beyond “not this year.”

It’s good to see VR on the Mac, but nothing today addressed the desire for a desktop Mac for gamers to play VR applications unless you want a machine with a built-in display and a GPU you can’t upgrade. As terrible as Nvidia can be as we’ve seen with the GTX 970 memory debacle, I don’t ever want to buy a desktop with an AMD graphics chipset.

I would probably want a HomePod as Apple is the only company offering an AI assistant speaker that gives a damn about privacy and isn’t just trying to sell you shit through their store like Amazon with their Echo.

iOS & macOS Updates

Today’s software updates from Apple are notable for a lot of reasons. macOS 10.12.4 gets Night Shift from iOS, I can now find my AirPods in the Find My iPhone app, there are the beginnings of a standard to control apps that nag you for reviews on iOS 10.3, Siri enhancements on watchOS 3.2, but the most important change is he first switch from HFS+ to APFS. APFS is Apple’s new file system for iOS, macOS, tvOS, and watchOS. It’ll be installed with the latest iOS update, and will come to macOS in the future.

File systems keep track of where your files are on a storage medium like a hard drive or SD card, and Apple has been using some variation of the same file system, HFS and HFS+, for the past thirty years.

APFS should be an improvement in performance and reliability because it is targeted towards modern computing devices that use flash memory instead of spinning disks, but it is going to be a little bit like pulling a table cloth out from under a plated dinner and table setting in order for the operating system to replace the file system on the devices during the update.

I made sure my iCloud backups were all up to date before starting the upgrade, you should too.