0:00:00Ladies and gentlemen, your pal John Gruber here.
0:00:04This is a very special episode of the talk show.
0:00:06It is a different episode of the talk show as you're about to find out.
0:00:09And so it has a different kind of sponsorship set up.
0:00:12I'm just going to tell you right here, this episode is exclusively brought to you by Meh.com.
0:00:19That's Meh.com.
0:00:21If you don't know what's Meh, it's a daily deal site.
0:00:24You guys remember Woot, W-O-O-T?
0:00:26That was a daily deal site where they put funny content and videos and stuff like that
0:00:30up and they'd have one thing a day that they would sell at an extraordinary discount.
0:00:34Then they sold to Amazon.
0:00:35That was Woot.
0:00:36They sold to Amazon and Amazon started changing everything around and eventually got rid of
0:00:40everything about Woot that made Woot Woot.
0:00:42So the team laughed.
0:00:43They left Amazon when they could and they started a new site that was like Woot except
0:00:48even better than it used to be.
0:00:50And that's Meh.
0:00:51It's the guys behind Woot.
0:00:52They have a new site, Meh, and you go there every day and they have a daily deal.
0:00:56Something is on sale at an extraordinary discount, like a G.
0:01:00I wonder if they like rip these off the back of a truck sort of discount.
0:01:03Gadgets, oftentimes, toys, stuff like that.
0:01:07But the main reason to go there, it's not even to find the discount.
0:01:09It's not a shopping site.
0:01:10It's one thing a day that's available at a limited time.
0:01:13The reason to go to Meh.com every day are the videos that they make,
0:01:17the descriptions that they write that are hilarious,
0:01:20sometimes not even about the product at all.
0:01:23It's really just a great site to work
0:01:25into your daily routine of places to go
0:01:28when you wanna be not bored or entertained
0:01:31for a couple of minutes.
0:01:32So go there, check them out at med.com.
0:01:35Check out the videos, check out the site.
0:01:37And you can even keep your eye on the daily deals.
0:01:40You might find something really, really worthwhile.
0:01:42They're great and they're the ones
0:01:43who are bringing you today's episode.
0:01:46And without any further ado,
0:01:48Ladies and gentlemen, the talk show.
0:01:51This is gonna be fun.
0:01:52We've got Eddie Q, senior vice president,
0:01:56internet, software and services.
0:01:57Eddie, welcome to the talk show.
0:01:59- How you doing?
0:02:01- And returning to the talk show,
0:02:02which is, must mean I didn't botch it up too badly.
0:02:06Craig Federighi, senior vice president
0:02:08of software engineering.
0:02:10- It's a rare honor to be here, John.
0:02:13- Here's my question.
0:02:14This is a tough one.
0:02:15I wanna know it now.
0:02:17Eddie, you're a big sports fan.
0:02:18Has Steve Dowling sent you to like photography school for like taking
0:02:23pictures after sporting events now post Super Bowl? You know I love that because
0:02:28you may know Tim and I went to the Super Bowl together and he's a huge Broncos
0:02:33fan huge huge Broncos fan and so when they won the game we were all excited
0:02:39we got high-fiving each other we went onto the field he's taking the photos
0:02:42and he's so excited he wanted to congratulate him and sent the picture
0:02:45And then the next morning I wake up and I get to see all of those
0:02:48Messages and tweets and everything else and I thought it was great
0:02:52Because it's it shows you know
0:02:54Tim is just like you and me
0:02:56He's a huge sports fan and was loving it and he loved that his team actually won the Super Bowl. I
0:03:01said this I
0:03:04I just thought it was that's exactly what I thought
0:03:07I thought it was like Tim Tim as a human being and it's a real sports fans photo. I thought it was goofy, but I
0:03:14Thought it was gooey the reaction that people had to me. It was just a happy moment. All right
0:03:17I'm hoping I'm hoping to have a few more for you this year
0:03:20Maybe another repeat for the Warriors repeat Duke national championship, you know, well that so I don't know about the Duke one
0:03:26I wasn't gonna mention Duke Eddie. No. No, I was look I've been
0:03:30We've been wanting to talk to you for like three weeks, but I told I told Dallin
0:03:34There's no way I'm gonna talk to John right now because we've been losing games straight
0:03:38So I waited till we've won the last we've won the last like two games in a row
0:03:42We're hot and I'm like, let's get on the call now
0:03:44No, my my last sports related suggestion to you is just in case the Warriors keep it up and just in case, you know
0:03:52Maybe WWDC sticks to the typical schedule
0:03:54Maybe you want to rehearse more and if you have extra tickets for a Warriors Finals game
0:03:59I know a guy, you know, maybe you could take them off your hands just saying just
0:04:03You're on
0:04:08Let's let's get down to brass tacks here one of the things one of the reasons that this is even happening is
0:04:14that Apple is
0:04:16talking about and and telling its users a lot more about what is
0:04:23coming down the pipeline in
0:04:26Software so for I mean and the best example of that is is that there's a big it's not even like a developer page
0:04:31It's a big product marketing page on what's coming in
0:04:34iOS 9.3
0:04:37Yeah. Yeah, we have a real feature release here with 9.3.
0:04:44And so we certainly wanted to talk about it.
0:04:46And we also wanted to get it out in public seeds.
0:04:49So many of you are running it.
0:04:52Certainly all of us here are.
0:04:55And there's a lot of really cool stuff we were able to do.
0:04:58And we didn't want to wait all the way till WWDC to get it out.
0:05:02is so I I'm not imagining things that this is a
0:05:06At least a subtle change away from keeping features as a sort of
0:05:13major, you know new features that you want to promote and in the OS as a
0:05:18Monolithic once a year at WWDC will announce them and once a year a couple months later in the fall
0:05:26We'll release them sort of schedule
0:05:30Yeah, you know a huge part of what we do with with iOS every year is we're really advancing a platform for developers
0:05:37And you really can't sort of trickle out a big change for developers at the platform level
0:05:43continuously throughout the year, so that's something where it makes a ton of sense for us to
0:05:48Advance it all at once have a conference
0:05:50Get everyone early access to the SDKs that they're going to use give them a chance to get their apps
0:05:57ready and take advantage of all the new capabilities and then get it out with a major OS.
0:06:02But there are things that we can do that don't have that characteristic.
0:06:06You know, and if you look at the kind of features coming in 9.3 with our support for education and, you know,
0:06:12shared use iPads and the classroom app or the night shift feature,
0:06:16or, you know, some of the improvements we made to
0:06:20photos or even the smart keyboard handling on the iPad Pro.
0:06:24So these are things that we wanted to get out right away
0:06:28to everyone 'cause we think everyone can enjoy them
0:06:30and they aren't the kind of things
0:06:31that really impact moving the platform forward
0:06:33for developers.
0:06:35- Right, it's not really developer changes,
0:06:37but it is, they're definitely major features.
0:06:40One of my favorites is for the smart keyboard
0:06:42that when you'd go to Spotlight Search,
0:06:44you can arrow key down to the search results.
0:06:49- Yeah, I know you did helpfully note for us
0:06:52shortly after we shipped the iPad Pro that we missed one there.
0:06:56So it's been great to miss more than one, let me say.
0:07:00And so we've been responding to all the kind of great feedback we've gotten on the iPad
0:07:04Pro, which we're all excited about the device and so excited about how people have really
0:07:08embraced it.
0:07:09But we all have our – as we all use it more deeply, we're all seeing things where we
0:07:15can improve a bunch of things, including the keyboard support.
0:07:17So we've taken this opportunity in 9.3 to make some of those enhancements.
0:07:21So that is an interesting thing.
0:07:26So one of the things is you guys actually are all, and I say,
0:07:29not just you like Craig and Eddie,
0:07:31but everybody on the executive leadership team, in addition to having,
0:07:36you know, these jobs that are very specific in terms of your responsibilities,
0:07:39you're also users of the products that Apple makes.
0:07:44Oh yeah. Oh yeah. No, I mean,
0:07:47Well, that's why we're here for sure.
0:07:50I mean, no one was more enthusiastic to get access to the inside of Apple and software
0:07:56than myself and Eddie.
0:07:58And certainly, you know, I am installing, I think I probably install something like 500 versions.
0:08:05I mean, literally it's 500 or a thousand versions of OS X and iOS myself every year.
0:08:10I mean, I have, you know, four Macs and four iPads and two phones and I upgrade them all
0:08:16to the newest build pretty much every day.
0:08:19So I don't know, I think I did the math wrong.
0:08:21I think it's like 100,000 versions of OS X
0:08:23and OIOS I install every year.
0:08:26John, I've been doing this for more than 30 years.
0:08:30You know, the way I started with this was bringing my Mac
0:08:33into the office for my first job.
0:08:36And so working on the Mac for me was like a dream come true.
0:08:40So I live on our products every day.
0:08:43I use all of our products every day.
0:08:44They're, they're part of my life, my kids, my family. And so it's, it's great.
0:08:48And we share that experience and we give each other feedback and we, uh, you know,
0:08:53we, we, it's, it's what we do.
0:08:55But so like you like Eddie, like you, when you get like a,
0:09:00a new Mac book pro or whatever you're going to use, you know,
0:09:04but you set it up yourself.
0:09:05Oh, absolutely. My, my, my, first of all,
0:09:09hopefully everyone can set it up themselves because that's what we build it for.
0:09:12And it's really easy.
0:09:14I set it up.
0:09:15I, I transfer my content from my old Mac book or I just did a new iMac.
0:09:20As a matter of fact, I actually bought it myself.
0:09:21I bought, I went on the online store.
0:09:23I wanted to see what the experience was.
0:09:25I ordered it, checked all the mail.
0:09:27I wanted to see the mail, the notifications that came to my phone and then installed it all.
0:09:31Yeah.
0:09:32And I mean, no, no joke at ease.
0:09:33Seriously.
0:09:34Most meetings I'm in with Eddie at some point in the meeting, he breaks out one of his devices and starts upgrading it mid meeting.
0:09:39And then we're able to get on the fly feedback on the new software during the meeting.
0:09:43So it's very helpful.
0:09:46I know it sounds like a trivial question, but it's something I've always wanted to ask
0:09:50people like you, because I can see it both ways, where I know you guys are technically
0:09:54adept and have the background to do it.
0:09:58But on the other hand, as the senior vice president of a semi-large corporation, you
0:10:04don't have to.
0:10:05If you wanted to have somebody set up your stuff for you, you could do it.
0:10:08So it's always been curious to me
0:10:09whether you guys go through it
0:10:11because you want to get that,
0:10:12like what's it like to be a real user experience
0:10:15or do you take advantage of it,
0:10:18the fact that you don't have to if you don't want to?
0:10:20- Oh yeah, and it's not just that.
0:10:22I mean, we're both involved every day
0:10:26in the development of the software
0:10:28that's being put together.
0:10:30And so we all wanna run the latest thing
0:10:33that we were just in a HAI review talking about.
0:10:35We wanna get that feature
0:10:37that we talked about last week and start living on it
0:10:40so we can start giving the team feedback
0:10:42on what we're seeing.
0:10:44And so it's an integral part of how we develop here
0:10:48is that we all live on the software.
0:10:51And at the same time, I mean, probably like yourself,
0:10:53and we're all the tech support teams for our families
0:10:56and our parents and our in-laws.
0:10:59And so I have all my kids are running the betas all the time
0:11:03so we get live feedback, helpful feedback
0:11:07from the whole family nonstop.
0:11:08We're immersed in the Apple universe of feedback.
0:11:12- John, let me give you an example of something,
0:11:15'cause this happens all the time for me.
0:11:17I'm using our products.
0:11:17So this weekend I was using Apple TV.
0:11:19I've got the new Apple TV.
0:11:20And by the way, which we should talk about,
0:11:22there's a lot of great new features coming out with this.
0:11:25This is a major release of Apple TV.
0:11:27But I'm doing a purchase of a movie
0:11:31and I've got a family plan, Apple Music,
0:11:34the whole thing with everybody.
0:11:35And the message that comes up on the screen says,
0:11:38somebody from your family has already purchased this.
0:11:41Would you like to buy it again?
0:11:43Pretty dumb message.
0:11:46And so it's an example of I got on there and it's like,
0:11:50I'm talking to my team, why are we doing it this way?
0:11:52And it's just a history thing of before there was family
0:11:54plan, it would ask you that question,
0:11:56'cause it was a single user.
0:11:57Once you have a family plan, it should just download.
0:12:00It shouldn't even bother to ask you.
0:12:02And so, you know, we live both Craig and I,
0:12:05and that's part of what we love doing.
0:12:06And so it's great to be able to have an impact
0:12:09and change these things, 'cause we're using them ourselves.
0:12:12- Yeah, that's a perfect example.
0:12:15One of the questions I wanted to ask you
0:12:16is what was the last bug that you encountered yourself?
0:12:19And that's a good one.
0:12:20And it's an interesting explanation, right?
0:12:22Just to clarify, what you're saying is,
0:12:24it's saying that the person who's now in your family plan,
0:12:28who made that purchase earlier,
0:12:30made the purchase before there was a thing
0:12:31called the family plan and therefore it did not automatically download.
0:12:34No, it was just,
0:12:35it wasn't what they did make the purchase and they were part of the family plan.
0:12:39Originally when we were doing this, um,
0:12:41there wasn't a thing as family plan.
0:12:44And so it was designed just to ask you if you wanted to purchase again,
0:12:47when we did this software for family plan, we didn't take into account that we
0:12:51just said, Oh, somebody already purchased it.
0:12:53And instead of just downloading it, we didn't do that.
0:12:55But I want to give you, since you said,
0:12:56I want to give you a little to tell you a little bit how crazy Craig and I are,
0:13:00about this stuff and you said what's the latest because it just reminded me of this. I was
0:13:06installing a new version of OS X on my iMac. It's a non-release version a couple of days ago and I
0:13:13ran into a problem that I couldn't, I knew would be very difficult to recreate and this is about
0:13:187 30 at night. I had just gotten home doing the update and I called Craig up and I said here's
0:13:24the problem that I've got. I was leaving the next day to Yuma, Arizona by the way. I want to give a
0:13:28shout out to the kids and teachers out in Yuma, Arizona that are using iPads.
0:13:34But I called Craig up, told him about the problem, and I said, "Look, I'm leaving
0:13:37tomorrow." I said, "I want you guys to kind of look at this because I think this is
0:13:41kind of weird. I don't think it's gonna be easy to recreate." He says, "Sure." So I
0:13:44took the iMac, put in my car, drove to Craig's house, gave him the iMac, came back
0:13:49home, went on my trip. Craig is engineering. The engineer was looking at
0:13:52it, figured it out, and the next day got the iMac back. So it was sort of like
0:13:58preserving a crime scene. That's right except we found out at the end that no
0:14:04crime was committed because we fixed it. Right but if you know if you have a bug
0:14:10or just an edge case that you're worried you can't reproduce it's like you really
0:14:15do just want to like freeze the computer right where it is and let the engineers
0:14:19you know start debugging. Yeah absolutely and it was was helpful that Eddie was
0:14:25was on the case on that one. That's a really great story though. I love that he just drops it off.
0:14:32It's good to know people. But that's it is interesting. But it's that's exactly the sort
0:14:40of question I had is how how involved do you guys get when you run into one of these little,
0:14:45you know, it's inevitable. I mean, there's nobody has ever written bug free software. It's the nature
0:14:49of software. But what do you guys do when you guys encounter it? And that's driving over to
0:14:55Craig's house is the answer.
0:14:57I like it.
0:14:57(laughing)
0:14:59So before we forget, let's go back and talk about
0:15:01what's coming up in Apple TV.
0:15:03So right now it's a beta, it's tvOS 9.2.
0:15:08And there is a lot of, it really is a major feature.
0:15:12Just off the top of my head.
0:15:14Siri dictation for text entry and searching for apps.
0:15:18That's something people started complaining about
0:15:20as soon as the new Apple TV shipped.
0:15:23That's a big one.
0:15:25Yeah, it's huge. Look, when you get your Apple TV the first time,
0:15:29the first thing you've got to do is enter your Apple ID and your password.
0:15:33And being able to...you've got Siri built into this remote.
0:15:37Why not just tell it and spell it out instead of having to, you know,
0:15:41go through the typing mechanism of doing it?
0:15:43And so we wanted to do that right from the beginning.
0:15:45And then searching on the App Store, we added searching across movies, TV shows,
0:15:49and Netflix and Hulu.
0:15:50We've added a bunch of new content providers like FX.
0:15:54You can search Disney Channel.
0:15:56We're adding, we continue to add more,
0:15:57but obviously the App Store is a huge one.
0:15:59And so we've done that.
0:16:01We've added some languages, Spanish, French to that.
0:16:06And we've added iCloud photo library, full support
0:16:09so you can see all of your photos.
0:16:11And also, one of the things that you've noticed
0:16:13if you've downloaded a lot of apps on the App Store,
0:16:15from the App Store, having folders now.
0:16:18So just like you have on iOS, you can add folders.
0:16:22- Right, so you could just group together
0:16:24all your little arcade games, put them in an arcade folder.
0:16:27- That's right.
0:16:28- Right.
0:16:29What, can you tell me, I know this is from the list,
0:16:33and this is how lazy I am at preparing
0:16:35for a very important talk show.
0:16:37One of the features is conference room display mode.
0:16:40What is that?
0:16:42- We had this in the original Apple TV,
0:16:44and part of this is, if you know most conference rooms
0:16:48from Wi-Fi connectivities into the networks,
0:16:50You have people, you have private networks that are set up for the corporation, but then
0:16:55somebody comes in to present and you don't really want to let them into your private
0:16:59network from the company.
0:17:01And so we had this capability and we wanted to add that to the Apple TV so that it would
0:17:06be easy for people to come in and present.
0:17:09We can also lock the display so that instead of showing you the latest top movies at the
0:17:14beginning of every meeting, it can just tell you that you can airplay to it.
0:17:18We all stay on top of all the top films here at Apple when we start every meeting
0:17:22But now we have now we have an alternative. That's
0:17:24So it's not it's really Siri wide. I mean and this affects every platform but
0:17:31The expansion to include new languages obviously that is really super important to let's just say people who speak Spanish
0:17:39It's really like a make-or-break feature. How how
0:17:46difficult is that to do each language going, you know,
0:17:50to keep adding languages to Siri
0:17:52and to keep the level of quality of Siri's recognition.
0:17:57- Yeah, we have over 35 languages in Siri.
0:18:00Apple TV presents an actually an interesting problem
0:18:04compared to just Siri itself in that
0:18:06a lot of the things that you search for
0:18:08are not in the native language you're speaking.
0:18:11So you're actually, let's say speaking in Spanish,
0:18:13but you're searching for an English title.
0:18:16And so Siri has to be aware that it's actually able
0:18:20to speak multiple languages because you wouldn't,
0:18:23and understand when it is that it's asking for a title
0:18:27versus when it is that you're actually giving a verb
0:18:30or a noun to it from that.
0:18:31And so it's an interesting, challenging problem,
0:18:34which is why we've been adding languages to Siri.
0:18:36We're not quite, to Apple TV, we're not quite up to the 35
0:18:38that Siri has, but we'll keep adding on.
0:18:41and it's supporting that multi-language aspect of Siri
0:18:44that makes it even more fun for us to try to resolve.
0:18:48- Yeah, our machine learning teams at Apple
0:18:52and within the Siri team have done some remarkable work,
0:18:55and I know you've noticed some of the improvements
0:18:57to Siri's both performance and its ability to recognize,
0:19:00but the core technology has improved so much
0:19:03that it's really helped us get high accuracy
0:19:07when we take on all of these new languages.
0:19:10And some of these challenges, like now we have to know, not just that you're
0:19:13speaking Spanish, but while you're speaking Spanish, you're talking about,
0:19:16they might be giants, but you're pronouncing those words with a Spanish
0:19:19accent and Siri needs to recognize that these are, these are the kinds of things
0:19:23that, uh, you know, a few years ago were just out of reach and now we have the
0:19:26core technology, uh, to do it.
0:19:28And I think the experience with Siri is just taken some giant leaps forward.
0:19:32By the way, and, uh, at a huge scale, uh, these are billions of requests
0:19:38that come in every week.
0:19:39uh... to siri
0:19:41across all the platforms
0:19:45so in addition to that here's another one that that's added to uh...
0:19:49tv o_s_ nine point two is sort of the
0:19:52old-school way of text entry bluetooth keyboard support
0:19:56and it's a little thing but
0:19:59it's one of those were things that where the old apple t_v_ supported it
0:20:03including at setup so that you could set up like if you had the apple uh...
0:20:08Magic keyboard you could you could connect to it and then the new Apple TV came out and it didn't have it and everybody
0:20:14Was some people maybe were a little annoyed that everything they had to do with the new Apple TV in November was up down left
0:20:21Right to you know enter everything
0:20:23Is is this just an issue of?
0:20:26Hey, it was a new version of tvOS all new it's you know integrating it with iOS
0:20:32We just didn't get to it by November or was this like a rethink like hey a lot of people are asking us
0:20:38for Bluetooth keyboard support?
0:20:39Let's go back and put it back in.
0:20:41That's a great question.
0:20:42In that case, it was really simple.
0:20:43We were doing the new OS, and it's
0:20:45something we wanted to get to.
0:20:47We knew it wasn't the majority of customers,
0:20:49and so we felt like we could add it later.
0:20:51And we always planned it.
0:20:52And yes, I did get a few emails and a few tweets about it.
0:20:57You know what's just hilarious about this, though,
0:20:59is we have a very vocal community, as you know.
0:21:03And when we were getting this feedback--
0:21:07even actually before making the decision not to include it in the first release,
0:21:10that the team had done the analysis based on our diagnostics and usage data of
0:21:14you know, how, about how many customers use a Bluetooth keyboard with their,
0:21:17with their Apple TV every week. And they charted it out over time.
0:21:21And it's a, it's a, it's a small rate relative to the, you know,
0:21:24how people are using the built-in remote and so forth.
0:21:27But we noticed that that rate of use of the Bluetooth keyboard dropped to almost
0:21:31nothing during WWDC.
0:21:34And what this told us was pretty much everyone
0:21:37who's using it as a developer who's going to WWDC
0:21:40or an Apple employee.
0:21:41Now that didn't stop all of them from writing Eddie
0:21:44when it was missing, but just to give you a sense
0:21:46of kind of what's going on underneath all that.
0:21:48- That is hilarious.
0:21:52'Cause I was going to say that I think it's a hard sell
0:21:57across your family.
0:21:59Like whether there's one person in the family
0:22:01who's technically adept and wants to put
0:22:03Bluetooth keyboard in the living room. I think it's a hard sell family-wide to
0:22:07keep a keyboard in the living room. And we do have a little bit something even a
0:22:11little bit better coming out in a few months which is we have a new remote app
0:22:14so that if you have your iPhone you can use the keyboard on the iPhone to do
0:22:19that and I think that certainly will get a lot more use. And more than that I mean
0:22:23really the full you know Siri to your phone communicating with your TV and
0:22:27that's a it's a great upgrade to that app. Well you could there's a remote app
0:22:32for the iPhone now that you can connect to Apple TV. There is, as Craig said, it only does the
0:22:37keyboard. The new remote app will do all of the capabilities that the existing new Apple TV remote
0:22:43does like Siri. And like gestures, for instance, because you have obviously, you know, the trackpad
0:22:48function of the remote can be done with your phone now too with that remote. So it's a really
0:22:52full replacement. Oh, so I have a scoop here. There you go. That's actually heard it here first.
0:22:58Well, you can't broadcast this for three months.
0:23:01(laughing)
0:23:04- I think that's gonna actually make a lot of people
0:23:06very happy though.
0:23:07And it might, would that work with some of the games too?
0:23:11So that if there's a two player game
0:23:13that somebody could use their phone
0:23:15and have it be the slider
0:23:16and somebody else can use the remote?
0:23:18- Yes, that's exactly, you can use the metal,
0:23:20the Apple TV remote for one person
0:23:22and their phone for the second person.
0:23:25- Oh, that sounds great.
0:23:27Let's move on and sort of talk about something that it almost feels like a Groundhog Day.
0:23:34And it's almost, you know, since it's February, it actually is close to Groundhog Day.
0:23:37Is that last year, there were a couple of posts that came up early in the year about
0:23:40Apple having little tiny sort of death by a thousand paper cut software problems across
0:23:47the board.
0:23:48And there was a lot of discussion about it and sort of culminated, at least for me, when
0:23:54Phil Schiller was on this show at the live show at WWDC and we talked about it
0:23:58and I thought Phil talked about it really openly and then it seemed to fade
0:24:03away from the punditry discussion and then last week Walt Mossberg had a
0:24:09column I think the headline was Apple's app problem do you got what do you guys
0:24:15say to this this just the general nothing specific let's not get in any
0:24:18specific app, but the general idea that Apple's software has declined in quality, let's say,
0:24:25over the last five years.
0:24:27I would say first that there's nothing we care about more.
0:24:32So it's not just me and Eddie filing lots of radars and using our devices, but everyone
0:24:40who works here at Apple, we recognize this is the single most important thing about what
0:24:44we do and what we come to work to do every day.
0:24:47So I take extremely seriously any time any of our customers says that they aren't having
0:24:54the experience that they expected from us.
0:24:57And clearly Walt's article indicates that he is at the moment in that camp.
0:25:03I look at it and say, "I know our core software quality has improved over the last five years,
0:25:12improved significantly.
0:25:15But the bar just keeps going up and that's a bar that we embrace.
0:25:21That is a challenge that, you know, every year we realize we, the things we were good
0:25:26at last year and the techniques we were using to build the best software we can are not
0:25:32adequate for the next year because the bar keeps going up.
0:25:35We have a billion active devices now.
0:25:38And you know, if you think back to just nine years ago now with the iPhone, it, how many
0:25:45much think back then of kind of how you interface with technology and
0:25:49comparatively how narrowly each of us interface with technology and now think
0:25:53about how integral your iPhone your iPad and and and still your Mac are to your
0:26:00life how many hours a day I mean we see the usage metrics and year after year as
0:26:04our team builds a new phone and thinks how big a battery should we put in this
0:26:08phone we have to go back to them and say guys actually you're gonna have to up
0:26:11that a good bit because people are using their phones more than ever this year
0:26:13year and we see that trend go up and up and up and people are doing more and
0:26:16more and what this means is when you have a billion people running phones in
0:26:21every corner of their lives with all of these third-party apps in all these
0:26:24countries and all these languages that there are going there are going to be
0:26:29issues there were always issues but now these issues are you know you have
0:26:33plenty of people that can can encounter one here and there and it gets it gets
0:26:38amplified and and maybe I could ask you I mean I feel like something if you go
0:26:41back five years or ten years in just the nature of internet journalism and the
0:26:46press and how stories like this get communicated and amplified is change
0:26:52things a little bit as well and so I think that plays into this the
0:26:57element of why are we hearing about this again or why do we hear about it in
0:27:00the way we do but I know we put just tremendous focus on improving our game
0:27:07every year yeah I there's there's a certain aspect to the the basic idea
0:27:16that to me is a little bit more of a then not just me I'm saying what I
0:27:20detect when I when I see people nodding their heads in agreement on Twitter and
0:27:25and follow up post to say the the like Mossberg's column last week that it's
0:27:30more of a gut feeling than anything that anybody can put their finger on and say
0:27:35here's this one thing that's, you know, absolutely terrible. And I know just from, you know, talking
0:27:44with Phil last year, and like what you're saying now, that you guys have a lot of ways that you
0:27:51measure this stuff with real analytics from the the diagnostics that people explicitly opt in to
0:27:58provide to you when they're setting up devices. That's right. And that it there, I sense it, you
0:28:03you guys, I mean, you two are both, you know, optimistic, cheerful people, but I,
0:28:08I can't help, but I suspect,
0:28:11and it's not coming from your voices here on this show,
0:28:13but I just suspect in general that there's a sort of frustration within the
0:28:17walls at Apple that you guys have these numbers that say software quality is
0:28:22going up. And then on the outside, everybody is saying, wow, so Apple software,
0:28:26they're, they're eyes off the ball. Is that, is it frustrating?
0:28:29No, look, I think you said a few words that I would,
0:28:32I would disagree with you, said everybody.
0:28:34Uh, I think the vast majority of our customers are quite happy with our products
0:28:39and the feedback that they've, they get and, and they ask for help.
0:28:42And that's why we built things like Genius bars, which have been very popular.
0:28:45Uh, why we, you know, we spend a great deal of money and effort on our Apple
0:28:50care and support lines so that when people need help, um, you know,
0:28:54training all of those things.
0:28:55So I think it's, it's not to say that we don't have any bugs or
0:29:00that we don't have any issues.
0:29:01Every piece of software does.
0:29:03We care deeply about it, which is why we all, you know, do all of these
0:29:07different touch points, monitor them, look at them, make sure we're addressing them.
0:29:11And, and at the same time as doing that, upping the game even more, because part
0:29:16of upping the game is not just standing still and making the things that you have
0:29:20worked, but making them even better, making them easier to use, those are all
0:29:24the things we have to do at the same time.
0:29:26- And Apple customers deserve the best.
0:29:30And that's absolutely what we're signed up for.
0:29:34So if and when we hear people are having challenges,
0:29:39while on the one hand, we're frustrated, of course,
0:29:43to hear it overall characterized as this,
0:29:47the quality is dropping overall,
0:29:50because we know that's not true,
0:29:51but at the same time, there's certainly reality
0:29:54if people are having these experiences,
0:29:57then there's something we can improve.
0:29:59And I can tell you the number of meetings we have
0:30:03and have had even over the last few weeks
0:30:05where we're constantly talking about how do we up the game?
0:30:09Because when you talk about a billion customers
0:30:12and you talk about the kind of upgrade rates we have,
0:30:15I mean, I think back to when we shipped Snow Leopard
0:30:18and how many people installed 10.6.0?
0:30:23Effectively no one.
0:30:24Okay.
0:30:25I mean, you know, approximately no one.
0:30:27In fact, we used to talk about, well, the, the, the upgrade rate to this OS
0:30:30will about match the sales of new Macs that have it installed, you know?
0:30:34I mean, people just didn't upgrade.
0:30:36And if they did upgrade, it's like, why don't we wait for 10.6.5 or something?
0:30:39You know, now we release a piece of software and in a matter of a couple
0:30:45of weeks, we have, you know, coming up on 50% of our base running that piece of
0:30:49software, I mean, hundreds of millions of people suddenly pounding on it, running
0:30:53a diversity of apps that just is unprecedented
0:30:57and using it in these incredibly connected ways.
0:31:00And so, yeah, the bar is higher
0:31:04and we will continue to adapt every year
0:31:09to meet that challenge.
0:31:10- And the scale, John, for this is truly amazing
0:31:14because of the usage that people,
0:31:16I mean, they rely on these for their lives.
0:31:18I'll give you a couple points that we peak out
0:31:22at 200,000 messages a second
0:31:25that are sent on messages, for example.
0:31:27We do 750 million transactions every week
0:31:32in our app store, iTunes store.
0:31:34We've done billions of dollars,
0:31:37now you're talking about dollars for payments in Apple Pay.
0:31:40So, you know, this is like,
0:31:42it's a part of everyone's lives, and it's great,
0:31:45we love this, this is the reason why, you know,
0:31:48we do what we do and we get up in the morning
0:31:51we're excited about coming in is because we can do more.
0:31:54Um, and so the scale of this is, is huge, huge.
0:31:58So what was the number for hot for messages? 200 K per second at the peak.
0:32:04That's right.
0:32:05People got a lot to say apparently.
0:32:08Yeah. That was probably right. Uh,
0:32:10like right at the moment in the first quarter of the Superbowl where they didn't
0:32:14over overturn that catch.
0:32:16Yeah. For some reason,
0:32:19For some reason, it was really high from North Carolina. I don't know what was
0:32:22but that is extraordinary. So that Eddie, that gets to a specific point.
0:32:29And this is clearly an, in a ball that's in your court is,
0:32:33is the general meme that Apple doesn't do online service as
0:32:38well. And you know, that's, that's your responsibility.
0:32:41What do you say to that?
0:32:44Well, I think you go back to the things that we do really well.
0:32:49Some of that we earned, to be clear, right? Part of the reason we did that many years ago
0:32:54with MobileMeer Maps, but we've corrected those. And you look at iCloud,
0:32:58we do, you know, we have 782 million iCloud users.
0:33:03Some have multiple devices, which is why we have a billion devices.
0:33:07They upload billions of photos every single week, every single day.
0:33:11And you look at the scale of messages, you look at Apple Pay, you look at our stores,
0:33:19We run some of the largest services in the world, very successfully.
0:33:24You take a look at Maps, we've corrected more than 2.5 million customer feedback
0:33:33that we've gotten from customers directly to Maps, that we've corrected and notified them back that we fixed them.
0:33:38So the scale of this is huge and I would compare it to any company out there.
0:33:44And the ramp is unbelievable.
0:33:46I mean, you consider when we launch a new release of iOS and OS X and the corresponding
0:33:52cloud services, how we go from effectively zero to unbelievable international scale,
0:34:01you know, literally overnight.
0:34:03It's incredible.
0:34:04And the team has, you know, done that at a scale, I think, that is, I can't think of
0:34:10another example of what happens when we turn the lights on on a new service like we do.
0:34:16And you know it generally goes off without a hitch the other thing I love about which is and I love this
0:34:23We're not out harping
0:34:25Our services as the brand the service isn't the thing it's the experience
0:34:30And so you know whether you're typing in a note on your iPhone, and it's on your Mac
0:34:36We're not
0:34:38Advertising this as notes services or anything
0:34:40We just want the experience to be so a lot of these things are behind the scenes and they just work and it's great for
0:34:45customers. Yeah, even iMessage is a good example of that. And I personally have, I
0:34:51I'd send, I don't even know, I'm a big chunk of that 200,000 messages per
0:34:56second. I spend, I send a lot of messages and almost all my messages are
0:35:02blue. Well you have good friends. But if you just look at how many people are
0:35:13are using iMessage and how many messages they're sending, it compares, you know, very, very favorably
0:35:21to a lot of the independent messaging apps and services out there like what app, what app and
0:35:29WeChat and things like that. And I feel like that's one of those things that Apple doesn't
0:35:33really get credit for, that they've got this messaging service with an extraordinary number
0:35:39of users who are extraordinarily engaged with it and it's not really
0:35:43figured into, you know, what Apple does at all because you guys don't really
0:35:48brand it that way. You're just like, "Hey, just use this app and send it, you know,
0:35:51send it to the, send your message to the person you know," and it goes through.
0:35:54Yeah, I think that's what's great really about what we do is we tie
0:36:00together, you know, the hardware, the software, and the services in a way that
0:36:04you aren't thinking you just used a cloud service necessarily when you bought
0:36:09your new iPhone and all your settings came back exactly the way you expected
0:36:12and so forth or when we do a feature like Apple Pay. I mean Apple Pay is a
0:36:16hardware feature, it's a software feature, it's a cloud feature, and it just works.
0:36:21And it's a tremendous complex undertaking but the customer doesn't
0:36:26have to think about any of those component pieces. They get an
0:36:29experience that hopefully delights them. I'll give you a real quick anecdote,
0:36:33hopefully quick. I was on an airplane recently and the plane took off and I
0:36:38got on the Wi Fi and an online service from a different company wasn't an Apple thing,
0:36:43it was somebody else gave me a warning that I couldn't, you know, look like I was signing
0:36:48in from an unusual location, because it was, I don't know where the plane Wi Fi was saying
0:36:52it from. How do I want to verify that it's really me and I had the only options were
0:36:56to get a phone call or an SMS text message, which I can't get because I'm 10,000 feet
0:37:02up in the air. And I showed it to the guy this the my my friend for the day sitting
0:37:06next to me on the plane who you know we'd spoken before the flight took off
0:37:10and he was like oh yeah you can get text I'm texting my I'm texting my wife right
0:37:13now he was saying he was sending an i-mess right and I just like oh yeah
0:37:18okay I'll do that you know cuz I didn't want to explain but he was he thought he
0:37:22was solving my problem because he just thought no no it's great this is
0:37:25absolutely wonderful I'm texting right now he didn't really have to think about
0:37:29what he's using to text he's just doing it yeah I think I think that's a
0:37:33fantastic example. So let's shift from services to talk about a specific bit of
0:37:47software which isn't really about how it works but really sort of how its design
0:37:50and it's iTunes on the desktop and here is where I wanted to quote Walt. So
0:37:55here's what Walt Mossberg wrote, "Apple's iTunes program was once the envy of the
0:37:59world. A combined digital music store and player could also sync your iPod.
0:38:02And it worked on both Mac and Windows. It was reasonably fast and very sure-footed.
0:38:07Now I dread opening the thing. And that's sort of damning, and the thing that to me is more damning
0:38:17is that I don't... I see a lot of people who agree with that, and I don't see anybody who really
0:38:21disagrees with it. Yeah, look, let's go back to Walt's thing specifically to address, which is
0:38:31this is performance issues and that.
0:38:33We've actually looked at it, nothing to do with iTunes.
0:38:35But your question is still dead on because it's something we started about
0:38:39two years ago thinking about what we wanted to do with iTunes.
0:38:42And let me walk you back with where it's designed from and
0:38:46where I think it can go to.
0:38:48So first of all,
0:38:49we designed it in a time when everybody was syncing directly via cable.
0:38:53So the things didn't exist in the cloud.
0:38:58And having a centralized place where all of your content was there
0:39:01to sync was really key because it made it really easy to do.
0:39:04It didn't matter where the content was.
0:39:06You didn't have to launch multiple apps.
0:39:07You didn't have a separate app that made it really difficult
0:39:09to see.
0:39:10And so it worked really, really well.
0:39:12And by the way, given that we have a billion devices out
0:39:14there, there are still hundreds of millions of people
0:39:16doing exactly that.
0:39:18When we went to Apple Music, we said, well, let's see.
0:39:21We're building a new service.
0:39:22Why don't we do it all in the cloud?
0:39:24Apple Music's all in the cloud.
0:39:25Let's do it that way.
0:39:27And one of the things that we wanted to do that was different
0:39:29was we didn't want just the music that lived in the cloud.
0:39:32If you had music, whether it was a live performance
0:39:37with Bruce Springsteen, for example, which I just bought,
0:39:39'cause I haven't seen the new show and I'm a huge Bruce fan,
0:39:42how do I get that to the cloud?
0:39:43Well, in most of the services that are out there,
0:39:45there's no way to do that.
0:39:47Because it lives in iTunes, it lets you do that,
0:39:49and it's very easy to upload that into the cloud
0:39:52and then exists in all of your devices.
0:39:54And so we decided that in the short term,
0:39:56what we wanted to do is really make it
0:39:58so that when you're in music and iTunes,
0:40:00all you see is music.
0:40:02And if you were doing a separate music app,
0:40:05it would really look a lot like iTunes
0:40:07when you're in the music player,
0:40:09because there's only one area
0:40:10where you pick which media type you wanna do.
0:40:13That's not to say that we are continuing,
0:40:15and we'll continue to think about what's the best way
0:40:18to architect the app,
0:40:19and whether it makes sense to do a separate app.
0:40:22For some of the components that are in there,
0:40:23or all of the components that are in there,
0:40:25but right now we think we've designed iTunes,
0:40:27And you'll see we've got a new refresh
0:40:29with the new version of OS X that's coming out next month
0:40:33that makes it even easier to use in the music space.
0:40:37- There are definitely, there's a big responsibility
0:40:40in transitioning the experiences for a lot of these apps.
0:40:44So these are so important to people
0:40:45and we see it every time we change them at all.
0:40:47And there are cases where, if you look at photos,
0:40:50where we did a really bold rethink
0:40:53of where photos needed to go and how to transition it.
0:40:56And by and large, I think that's been well received.
0:40:58Um, and, uh, I, I, I personally love it.
0:41:01And, uh, but, but you'll hear people who say, hold on, you know, there was a reason
0:41:05why I liked the way things used to be.
0:41:07And, uh, people are pretty serious about their music and, uh, about their
0:41:12collection.
0:41:12And so, um, I think, I think we, we talk, we debate pretty heavily internally, the
0:41:19right, the right way to evolve these things.
0:41:21And, and, you know, we, we tend to err on the side of being pretty bold.
0:41:24Um, but, uh, there, there's a lot of responsibility.
0:41:28We can, we, you get the other side of these, these stories.
0:41:31Um, you know, some of the people, when you talk about people nodding your, your head,
0:41:35if I, if I look at some of the comments that come online, when people say, yeah,
0:41:38Apple, uh, Apple's quality is bad.
0:41:41And someone will say, yeah, like when they took away my, my iPhoto app and replaced
0:41:45it with photos, I don't like the new photos app and that's why they think Apple
0:41:49software quality is bad.
0:41:51Now, many of us would say, well, hold on.
0:41:52there's exactly an example of where Apple's software quality is quite good. We delivered
0:41:57something faster, cleaner, simpler, but someone's going to say no, but it's changed and I was
0:42:03attached to it. And so this is a tricky balancing act and I think our customers give us a lot
0:42:10of responsibility to thoughtfully evolve their experiences and we try to take that responsibility
0:42:15very seriously.
0:42:16I don't think anybody would disagree that institutionally Apple compared to its, any company you might compare it against,
0:42:23has been always more willing to push through changes.
0:42:28Whether you go back to the 80s and say that the Macintosh debuted without any kind of command line at all,
0:42:34which was the only way anybody knew how to use a computer up until then.
0:42:37And they're like, "No, this is the right way."
0:42:39to another almost canonical example of it was the 1998 original iMac shipping
0:42:46without a floppy disk and it's nobody had ever how can you have a personal
0:42:49computer without a floppy disk little things like that do you do you guys find
0:42:54though that it's getting harder to do that now that you're talking about
0:42:58having 700 800 million users is it harder because of that resist that that
0:43:04natural part of humanity that just is resistant to change of any kind sure of
0:43:08Of course it's harder.
0:43:09When you have more customers, those things are harder to do.
0:43:12But that doesn't, at least for me, and I've been here when we were really small and now
0:43:17when we're much larger, it hasn't really changed.
0:43:20We're still willing to push.
0:43:21We just have to make sure that we think about the ways that people are using the product
0:43:26and when we make the changes that they're not significant and we're improving more than
0:43:31we're actually taking away or that it's the right thing to do.
0:43:35And so you have to be a little more conscious of understanding all of the different ways
0:43:38and which customers use it, but you bet we got to keep pushing because if you want to
0:43:43innovate you got to move.
0:43:45You can't sit still with what you have.
0:43:47Yeah, and that's so strong internally.
0:43:49I mean the base instinct of everyone here is let's do it the right way.
0:43:57If this is now the right way, forget the past, let's do it the right way.
0:44:00And it's a second thought then to, well, hold on.
0:44:03Okay, what does that mean for the transition and taking our customers along with us on
0:44:08this, but it's so integral to who we are and how people think here, that yeah, there's
0:44:14more of an external, there's a larger customer base that we have responsibility for, but
0:44:19we know part of why they're Apple customers is because that's what they expect from us.
0:44:23We would be doing them a disservice if we stopped pushing.
0:44:27All right, let me make the specific comparison between two apps that we've just been talking
0:44:32about is iTunes and photos for Mac.
0:44:37So in the digital hub era, when the Mac was positioned, here's our idea for the Mac.
0:44:43It's your digital hub for all of these little devices like cameras and iPods that you have
0:44:47in your life.
0:44:49iPhoto was the Mac solution to photos and iTunes was the Mac and Windows solution to
0:44:54music.
0:44:55And then later, media, like TV shows and stuff.
0:45:00The new strategy is clearly iCloud centric.
0:45:03guys have been explicit about that since iCloud was announced in on stage in 2011.
0:45:08Yeah. And it didn't come right away. It wasn't like photos for Mac came out immediately. But
0:45:13that was the answer in and last year was really that transition year. But the idea was look,
0:45:19iPhoto was great for then. But now we've got this photos app, which is truly just appear to what
0:45:26you've got on your iOS devices. And it's really designed for the modern age in the modern modern
0:45:30model and iTunes and music haven't really made that shift is is that
0:45:35because music is different and because iTunes has different responsibilities or
0:45:39is it because iTunes has to exist for Windows and iPhoto didn't or or is it
0:45:43something else no it's look I think you're seeing music make that
0:45:46transition now since last year when we introduced Apple music the truth is
0:45:51music before that was very local it really didn't live in the cloud and you
0:45:56You moved your content by moving it to a device locally,
0:46:01and then the device was there.
0:46:02And then if you wanted to update that device,
0:46:04you brought it back.
0:46:05Now that we've-- and it's not just bringing a subscription
0:46:08service, as I said.
0:46:09It's about bringing all of your music,
0:46:11no matter how you acquired it.
0:46:12If it doesn't exist in the subscription service
0:46:15and you bought it yourself separately,
0:46:17or it's available separately as a bootleg, all of the things
0:46:20that you consume with music.
0:46:22And we're seeing that transition now.
0:46:24So for myself, I live in a world where my music
0:46:28is all in the cloud.
0:46:29And I think we're gonna see more and more customers.
0:46:31We just passed over 11 million Apple Music subscribers,
0:46:35and all of those people live in a world
0:46:37where music is in the cloud.
0:46:38- So that's a big, 11 million Apple Music subscribers
0:46:46is a big number, and it's only since,
0:46:50I mean, when did it come out of beta?
0:46:53It came out in September, but we gave away the first three months for free.
0:46:57So think about it as later in the year, October.
0:47:03And the growth rate is good on that.
0:47:07We've been very pleased.
0:47:08It's great.
0:47:09Just this past week, we introduced it in Taiwan, and we also introduced it in Turkey, which
0:47:15has been great.
0:47:16We introduced a version for Android, our first Android application.
0:47:20That's our second.
0:47:22had moved to iOS. That's true, thank you. Much loved app on the Android Play Store.
0:47:29It's always a good source of humor is to go... it's like going to read the
0:47:35Yelp reviews for your favorite local restaurant and seeing the people who
0:47:39don't get it. And one of the things we've learned by the way as we've gone to
0:47:44Apple Music is that we have to educate people as much as all of us know about
0:47:50music subscriptions, when you go around the world,
0:47:52what does it mean to have access
0:47:55to all of the music in the world?
0:47:57And what does that mean and how does that work?
0:47:59And that's something that we're doing
0:48:02a lot of work on right now.
0:48:04'Cause we noticed that a lot of times
0:48:06people just didn't understand the concept.
0:48:07What do you mean I pay 99, what do I get, how do I get it?
0:48:11All of those things.
0:48:12And that's been a big part of moving the number
0:48:15and continuing to move the number forward.
0:48:18- All right, before we wrap this up,
0:48:19there's a topic I want to get to,
0:48:21and I guess it's a little bit more
0:48:22on Craig's side of the court,
0:48:24but I've got some good friends
0:48:25who if I don't talk about this,
0:48:26I think are gonna shoot me,
0:48:28'cause I have the opportunity.
0:48:29- Is this about dynamic dispatch and Objective-C?
0:48:31I'm ready.
0:48:32- No.
0:48:33(laughing)
0:48:35It's about radar.
0:48:36So Eddie mentioned that with Maps.
0:48:38Maps has a feature where if you see an error,
0:48:41you can report the error,
0:48:43and when it gets fixed, you get notified,
0:48:45and it says, "Hey, thank you for reporting
0:48:47that this road is not where it used to be, or there's a new road here. We have now fixed it.
0:48:53What I hear a lot from my friends who are third-party developers is the sense that radar
0:49:01is nearly a black hole, that you file your report, it goes in there, and an awful lot of bugs that
0:49:09even ones that are submitted with examples, like here, run this example code and it will prove that
0:49:14that this is a bug in this new version of the OS.
0:49:17And then you just never,
0:49:18they just never hear anything about it.
0:49:19- Yeah.
0:49:20- Like how can radar get more like Apple maps
0:49:23where it gives, I'm serious.
0:49:27I think that developers really,
0:49:28and I feel like it's a,
0:49:30what's the, I don't know what the opposite
0:49:33of a virtuous circle, an in-virtuous circle,
0:49:35where developers, if they feel like it's a black hole,
0:49:37they report fewer bugs
0:49:39because they feel like they're wasting their time.
0:49:40And developers not reporting bugs is, I'm sure,
0:49:43not what you want?
0:49:44- That's for sure, yeah.
0:49:47I mean, quite honestly, we're not where we wanna be
0:49:50with radar as an externally facing tool.
0:49:53I mean, it's the lifeblood of the organization
0:49:55in terms of how we manage our bugs and manage our releases
0:49:58and I file tons of them
0:50:00and so does everyone who works here in software.
0:50:05But our external interface is not great.
0:50:07And a big part of that is something we struggle with
0:50:10is how we sort out communicating about the issues
0:50:14that we fix, because you may report an issue,
0:50:18we may dupe it to a bug that we're working on fixing,
0:50:22we may fix that bug, maybe we fix it in iOS 10,
0:50:24maybe we fix it in something that's probably
0:50:26gonna go in iOS 9.3.
0:50:28You wanna know that we've fixed it,
0:50:30we don't necessarily right now have a great way
0:50:33to decide when we wanna communicate to you
0:50:35that there's a release that it's getting fixed in,
0:50:37that we're promising that the fix is gonna happen,
0:50:40And so we fundamentally have communication feedback problems
0:50:43that we need to sort out.
0:50:44I can tell you that the reports do get read,
0:50:47that they do influence what we do,
0:50:50but our back channel communication needs some work
0:50:54because we are reading them,
0:50:58we just don't tell you what's happening with them.
0:51:00And I understand absolutely the frustration
0:51:02of a lot of developers who file those bugs.
0:51:05- Do you agree that that sort of improving that
0:51:09as a, it's sort of a point where the trickle down from that,
0:51:14where if you guys could improve
0:51:15the back channel communication from radar,
0:51:16it would influence the sort of lots of little bugs
0:51:21getting fixed that people are complaining about
0:51:24and address, it's like a centralized place
0:51:26to address the widespread entire user-based wide program,
0:51:30problem of, hey, this little thing is going wrong
0:51:33and I don't understand why.
0:51:35- I think it helps.
0:51:37I think we have other ways also
0:51:38that we're getting a lot of great feedback.
0:51:40We did our first, as you know, public beta for iOS
0:51:43in a year ago, the public beta for OS X.
0:51:45And actually in that way brought, you know,
0:51:47over a million people into the program.
0:51:51And we did include in those a feedback assistant tool,
0:51:54which was meant as a, you know,
0:51:57kind of radar-like feedback tool,
0:51:59but one that we could, you know,
0:52:00the average person could use, whether an iOS and OS X.
0:52:02And it automatically, not only does it give us
0:52:05what the user types, but it automatically gives us
0:52:07a lot of additional diagnostics.
0:52:11They get prompted and says,
0:52:12oh, is it okay if we send this, this and this back?
0:52:14And gives us some really great actionable information
0:52:17about the issues they uncover.
0:52:18And so that's another great channel
0:52:20to find out about the issues people are running into.
0:52:24And it's made a huge difference
0:52:25on the quality of our software.
0:52:28I mean, just one metric and it's not,
0:52:31there are lots of different ways in which,
0:52:33lots of different kinds of feedback we get,
0:52:34but something that's very measurable
0:52:36are things like crash rate.
0:52:37And I can tell you in the past,
0:52:39you'd see this seesaw pattern
0:52:40where a .0 release would come out
0:52:42and that would have a certain high crash rate
0:52:45and then we'd issue our software updates
0:52:47and that rate would go down.
0:52:49After doing the public beta here for iOS,
0:52:53our release, our .0, our 9.0 was better
0:52:58than any previous release of iOS 8.
0:53:01That the numbers that,
0:53:02and those are the kind of systematic steps
0:53:04where you can get feedback from our users,
0:53:06both automatic and the kind of things
0:53:08where they write up an issue
0:53:09and it helps us improve the product.
0:53:11So you're gonna see more and more of that from us
0:53:14and we think it continues to pay off.
0:53:16- So just to reiterate that,
0:53:19I just wanna make sure I heard you correctly.
0:53:20You're saying that when 9.0 came out, the release version,
0:53:23that the crash rate for apps was actually lower
0:53:26than the version of iOS 8,
0:53:28whatever the stable version of iOS 8 was
0:53:30that people were upgrading from.
0:53:31- That's right, of our apps.
0:53:34- Right, oh, okay.
0:53:35Yeah, yeah. Third party apps are a,
0:53:39I don't actually have the number on that,
0:53:40but that's always a challenge.
0:53:42I mean, one thing honestly that can happen to us on quality
0:53:46is sometimes also a third party will happen to ship an app
0:53:49about the same time we ship an OS update
0:53:51and independent of that, that app starts crashing
0:53:53and that affects user, so you gotta cut,
0:53:55it's always a challenge to cut through the noise,
0:53:57but we have pretty good analytics
0:53:58and our numbers are showing we're on the right track there.
0:54:03Well, it's about the time to wrap this up.
0:54:06I wanted to know though,
0:54:06because you guys were nice enough to come on.
0:54:08Is there anything that I haven't asked you
0:54:10that you wished I had?
0:54:11Is there something that you guys wanted to talk about
0:54:14that we haven't discussed?
0:54:16- Well, since this is an audio podcast and not a video one,
0:54:19I'm disappointed that you can't see
0:54:22the purple shirt I'm wearing.
0:54:23- He did really rise to the occasion.
0:54:25I don't know if Eddie thought he was gonna be on camera here
0:54:27but he's in full stage wear.
0:54:30It's-- - You know,
0:54:31I thought about that just before we got on the air.
0:54:34I linked to a story the New York Times had
0:54:38about this amazing science that astronomers have done
0:54:42where they've measured as audio this gravitational wave
0:54:47that proves this thing Einstein predicted 100 years ago
0:54:50that if two black holes collided,
0:54:52you'd be able to produce this gravity wave
0:54:54that you could hear.
0:54:55And I thought, wouldn't that be great if we had a microphone
0:54:57that could produce a sound--
0:54:59- Of Eddie's shirt?
0:55:00Eddie's shirt.
0:55:01We all just didn't a synesthetic experience.
0:55:08Yeah.
0:55:09I know it's all the senses come alive when we
0:55:11see Eddie's shirt.
0:55:12We just didn't have enough time to set up the
0:55:15technology.
0:55:15Maybe next time.
0:55:17This was great.
0:55:19I hope you guys enjoyed it as much as I did.
0:55:22I love it.
0:55:22John, I got one question for you though.
0:55:24So since we started with sports and it's almost
0:55:27baseball season, give me your world series
0:55:29prediction.
0:55:29Oh, I, uh, I hate to say it, but I, I think the Cubs, it doesn't seem like a good bet,
0:55:40but boy, the Cubs look good in the national league and in the American league.
0:55:46Boy, I don't, I'll just go out in the lemon, say the New York Yankees.
0:55:53That was fulfilled.
0:55:55So that's, that's great.
0:55:57You gotta remember though, it is an even year.
0:56:00And in even years, the San Francisco Giants always win.
0:56:03(laughing)
0:56:04- That's the weirdest little like, inexplicable,
0:56:07like they've, and they've kept a core together.
0:56:09I don't understand that at all.
0:56:11I don't know if they just party way too hard
0:56:13after they win the World Series
0:56:14and it tanks the hole next season or what.
0:56:17But that is the weirdest little mini dynasty streak
0:56:21I've ever seen.
0:56:21- It is great. - So I don't know.
0:56:23I don't know that I'd wanna bet against the Giants next year.
0:56:26All right, well, it was great talking to you.
0:56:27Thank you.
0:56:29Thank you both.
0:56:29Eddie Q Craig Federighi.
0:56:31I really greatly appreciate the time.