25 Comments

Summary:

Apple’s been quietly assembling a lot of very interesting headphone tech. Will we see it make its way to the Beats line?

In early May, the tech world was buzzing about a rumor posted on Secret that Apple might make earpods with biometric sensors for heart rate and blood pressure. The only problem was that the Secret post was a hoax written by someone with no knowledge of Apple’s plans. I don’t have any particular inside knowledge about the R&D labs in Cupertino either, but perhaps the rumor wasn’t as wild as it first seemed: Apple, even if it isn’t planning to release some kind of advanced wearable headphones, has almost certainly toyed with the idea.

Apple is interested in health technology and it seems as if Apple will launch an wearable wrist computer is coming later this year. Many aspects of that device — such as its reported reliance on biometric sensors — could also be included in headphones, as well.

The elephant in the room is Apple’s $3 billion acquisition of Beats Electronics, the market leader in high-end headphones. Beats doesn’t seem to fit exactly in with Apple’s product philosophy, but it’s hard to see Apple killing a wildly profitable line of products with billion-dollar annual revenue just because it wanted the associated streaming music service. And the firm that designed Beats, Ammunition, has confirmed that it is no longer working with the colorful headphones after the Apple sale, which would imply that Apple has brought R&D for headphones in-house. It does look as if there will eventually — at some point — be a new Beats design, this time headed up by Apple. So what’s going to be included?

Apple Secret

Replacing the headphone jack

To do anything interesting with sensors in headphones, Apple would first need to decide how to transfer data from the headphones to a device. Bluetooth is one option, but equally interesting is Apple’s proprietary Lightning cable. According to 9to5Mac, Apple has introduced a specification in its Made-For-iOS (MFi) program that allows headphones to be connected through a Lightning cord, instead of the 3.5mm headphone jack.

Why would they do this? There are a few immediate advantages that have nothing to do with ear sensors: first, the headphones could draw power from an Apple device or — if the headphones had a built-in battery — could even power the iPhone they’re plugged into.

Audiophiles will point out that the 3.5mm jack outputs analog audio, and the Lightning port is capable of passing digital audio, which could be 48kHz and lossless and converted in a higher-quality digital audio converter included with the headphones. But few people have stereos sophisticated enough to hear the difference, and besides,Beats don’t offer what many consider to be the best sound quality, and people bought them anyway.

Eventually, ditching the 3.5mm jack in favor of a single port could also allow Apple more design flexibility — thinner devices, bigger batteries, increased water resistance.

But what the Lightning jack opens up most of all is a way for a sensors and microphones embedded in headphones to talk back to an Apple device. This could mean using Apple’s greater device processing power to run noise cancelling software, or it could send back biometric data to Healthkit app with data. Sure, that could be done through Bluetooth, but that would also mean the headphones would need a battery. With sensors that don’t need a ton of power, “smart earbuds” could be powered through the device.

It’s important to note that the MFi program is for third-party accessory makers, and it doesn’t necessarily signal a major Apple push. For instance, the MFi specifications also allow for iOS-compatible controllers, but Apple hasn’t given those accessories much love or special attention: no Apple apps work with them, and Apple doesn’t even publish a list of apps compatible with those controllers.

US08655004-20140218-D00000

Apple’s been working on these ideas… and it has the patents to prove it

Before a wearable sensor-laden wristwatch was a glimmer in CEO Tim Cook’s eye, Apple was working on a health monitoring system. Of course, patents never guarantee products, but they’re a good sign that certain concepts have been pondered. In 2008, Apple applied for a patent called “Sports Monitoring System for Headphones, Earbuds and Headsets.” The idea, at the time, pertained to Nike + iPod, which over the years has evolved into a component of HealthKit and an app built into iOS. The patent was eventually granted a few months ago. From the summary:

The monitoring system can, for example, be used to monitor user activity, such as during exercise or sporting activities. The positioning of the monitoring system can also facilitate sensing of other user characteristics (e.g., biometric data), such as temperature, perspiration and heart rate.

Patent 8,655,004 also includes a general description of the way gestures could be incorporated into a headset, which is a theme that comes up again and again in Apple’s later patent applications.

One such application, filed in November 2012 but not granted, described how Apple would incorporate presence sensors into both earbuds and over-ear cans (like the ones Beats is famous for). One graphic illustrates that if the headphones were to be taken off or fall off, the phone would be able to stop the music. The sensors described by Apple are akin to the proximity sensors included in phones that disable the touch screen when it is near to a face, like when the user picks up a call.

And last Thursday, the US Patent & Trademark office published yet another headphone patent from Apple relating to over-ear cans.

An aside: there are two kinds of headphones. One is called closed-back, which is what Beats makes: the earcups not only surround the user’s ear, but also have a sealed ear cup. Open-back sound better than closed-back, but are significantly less well-suited for public transit or the office because their open backs leak ound into and from the environment. Closed cans generally have better passive noise cancellation both for the listener and people around him, but open cans avoid resonance that can really degrade sound. Patent application 20140169579, which was also filed toward the end of 2014, describes a system that combines the best aspects of closed-back and open-ear headphones through a technology called active noise cancellation.

Currently, the market leader in canceling headphones is Bose, whose headphone require a battery and a dongle on their cords to cancel environmental noise. Apple’s noise-canceling cans, connected through a Lightning cord, would not need the battery or dongle.

Smart people think the ear is a good place for wearable computing

Of course, the Secret rumor was posted before the public had a hint of the Beats deal  and as Rachel Feltman at QZ writes, companies other than Apple have done a lot of work on wearable ear computerse. The ear doesn’t move around the way the wrist does, so taking readings of biological metrics like heart rate and blood pressure is easier.

Some heart-rate monitors on the market today, like the irviverON, take readings through the ears and pair them a phone through Bluetooth. Intel announced a set of sensor-packed earbuds earlier this year, but they’re are unlikely to make it to market.

Plans or fantasy? Beats me

I don’t think Apple’s iconic white earbuds are going anywhere. Apple continues to refine them, many consider them perfectly fine headphones, and I expect them to be included with iPhones for the foreseeable future. Apple’s $80 in-ear headphones, sold separately, face a much more uncertain future. I could see Apple updating its EarPods to work with a Lightning connector, but I do not think it is likely that they will have noise cancelling, proximity sensors for gesture control, nor sensors to record biometric data.

Apple is reevaluating all the headphones it currently makes and sells. For instance, Beats is one of the best-selling headphones inside Apple stores. Could Apple drum up support for its back-to-school promotion by including free Beats headphones? Is that even in Apple’s best interest? I don’t think we’ll see Beats-branded audio products included with an Apple device in the near future.

I suspect if there were to be an ear-mounted device that took biometric data, it would be sold separately, and would be an alternative to the wearable device that is most likely coming out this fall. But what I find much more likely is that Apple releases a pair of over-ear, noise-cancelling headphones, possibly branded Beats. Beats does make a pair of noise-cancelling headphones but they require batteries. Active noise-cancelling headphones which draw power from a phone would be a first, and as Tim Cook likes to say, is the kind of feature that “only Apple” can pull off, because of its tight integration of devices and services, starting in this case with the Lightning cable.

Regardless, when Apple bought Beats, they became one of the largest high-end headphone makers in the world. Even before the Beats deal, Apple produced 10s of millions of their white earbuds. Apple has an opportunity to do something wild with headphone technology, and eventually, it won’t be a secret.

You’re subscribed! If you like, you can update your settings

Comment

Community guidelines
Monday, September 1, 2014
you are commenting using your account. Sign out / Change

Comment using:

Or comment as a guest

Be sure to review our Community Guidelines. By continuing you are agreeing to our Terms of Service and Privacy Policy.

25 Comments

  1. Taste_of_Apple Sunday, June 22, 2014

    Reblogged this on Taste of Apple and commented:
    There’s some interesting thoughts here and some valid points. While it remains to be seen exactly what Apple has in store for Beats, the future is going to hold a lot of promise. Beyond what seems to be a massive second half of 2014, Apple is planning it’s future in many product areas to ensure it remains on top for years to come.

  2. Hi Kif,
    Great minds think alike. After all, headphones were the original wearable device :)
    After the Beats acquisition and the introduction of HealthKit at WWDC, I connected the dots and wrote about biometric headphones and Beats on June 6th.

    http://robovue.com/2014/06/06/was-beats-a-mhealth-wearables-play/

  3. A Ch0w, sneeze Sunday, June 22, 2014

    Unless you plan to make a phone less than 3.5mm thick, I don’t see how the good old headphone jack is a hindrance.

    1. From Apple, “The real victory, though, would come in hardware design. Because of the manner in which connectors are made, designers must account for a seating area around the jack, not just the jack itself. In the case of the 3.5-millimeter headphone jack, Apple put this seating area at around 6 millimeters. Even the controversially minimalistic connector on Apple’s own EarPods comes in at around 5 millimeters, a full millimeter thicker than the first-generation Lightning connector — and the company promised yet smaller Lightning form factors at WWDC. The entire iPhone 5s, in comparison, is just 7.1 millimeters thick.”

      1. Your argument is that the chips needed for lightening are somehow less intrusive than a printed set of wires towards the DAC, which is often part of the chipset anyway?

      2. By the way, there is also a 2.5mm headphone jack. It used to be popular with phones in the mid 2000s until around 2008 when music phones and the iPhone made the 3.5mm jack predominant.

    2. It’s not, unless you want your headphones to talk to your phone, to say, communicate health data.

      1. Data comms have always been possible on the 3.5mm jack. IIRC, Panasonic used to make portable cd players with a display inline on the headphones that displayed track data and other stuff. Sure, it probably was low bit rates anyway, but I think techniques are available to design faster rates, especially with modern coding techniques. If backwards compatibility was important, ways can be found.

        Like the lightening connector, the 3.5mm jack is omnidirectional but unlike the lightening, it doesn’t require fancy chips. Anyway, I am curious to see what apple cones up with, as well as a more coherent justification for it.

        1. Good point, the 3.5mm jack is omnidirectional.

  4. “Currently, the market leader in canceling headphones is Bose, whose headphone require a battery and a dongle…”

    Bose headphones don’t have a dongle. All of the electronics are housed in the earcups themselves.

    1. You’re right, I was thinking of their noise-cancelling earbuds.

  5. ConcernedCitizen Sunday, June 22, 2014

    @Kif

    “Audiophiles will point out that the 3.5mm jack outputs analog audio, and the Lightning port is capable of passing digital audio, which could be 48kHz and lossless. ”

    This makes no sense and shows you don’t really understand what you are writing about, nor do the “audiophiles” you reference. Did you research this fact on an Internet forum?

    All audio is analogue. It is actually just a silent datastream of 1s and 0s until it’s converted to an analogue signal that can be amplified and transduced. All a Lightning connection would do is move the digital to analogue (DA) conversion step from the iPhone to some converter in the headphones. It still needs to be converted to analogue, then amplified to drive the headphone motors and produce sound.

    Also, all converters are “lossless” – that is a designation for the file format, not the audio converter. If it’s and ALAC, WAV, AIFF or FLAC, you get lossless audio. If it’s AAC, MP3, M4A, it’s lossless. Lossy and lossless are compression schemes, not digital to analogue conversion schemes. Converters are agnostic to the compression scheme as any decompression happens in software prior to conversion. The converter doesn’t know what file format the audio file is – all it cares is that it can handle the sample rate and bit depth of the file.

    The only advantages to a Lightning connection are 1. Unload the conversion duties to possibly superior converters in the headphones. 2. Provide a bidirectional connection back to the iPhone for whatever sensors are in the headphones. 3. Possibly some powersupply. It doesn’t, just by the de facto connection, actually improve anything about the audio. The converters in the headphones could conceptually be worse, and you will probably see this in some cheap knockoff devices.

    1. I agree with you — and I didn’t want to get into the specifics of where the DAC would be placed and whether that could ultimately provide higher audio quality. Obviously, first, you’d need a high-fidelity file.

      My main point is the advantages to a Lightning connector dealing with unique sensors and gestures far outweighs the potential increase in audio fidelity.

    2. Whether trying to or not, you come off as sounding douche-y and argumentive.

    3. Just sayin’ – you can make points without sounding like mister know-it-all.

      ““Audiophiles will point out that the 3.5mm jack outputs analog audio, and the Lightning port is capable of passing digital audio, which could be 48kHz and lossless. ”

      This makes no sense and shows you don’t really understand what you are writing about, nor do the “audiophiles” you reference. Did you research this fact on an Internet forum?”

      The standard headphone jack is analog, the lightning port is digital. or is that not correct?

      I believe the spirit of the comment regarding”lossless” was that the lightning (digital) audio wouldn’t be going through the headphone amp. I could be wrong, but that’s the way I understood it.

  6. Mega Gadget Hub Sunday, June 22, 2014

    Apple will have to come out with some innovative designs with the growing competition. The only issue with using the ear is that, for a lot of people, it is a sensitive area. A lot of people have trouble with headaches and such when they have something in/on their ear such as sunglasses or Bluetooth headsets. As for Apple’s future releases against its competition, there are rumors of a smart watch: http://www.megagadgethub.com/gadget-blog/apples-smart-watch

    1. Agreed. I personally hate in-ear tips for earbuds and would avoid any wearable that used them.

  7. Andreas Beer Monday, June 23, 2014

    I guess they’ll build headphones, where the iPod is integrated in the headphone part. No more cables or wireless transmission necessary.

  8. Apple’s proprietary Lightning – NOT lightening – cable is the problem. The rest of the world use micro-USB, and that was agreed upon by the world group who make decisions regarding cellphones.

    Those tiny 2.5mm headphone jacks were prone to bend / break because of their small diameter. Same was true for the tiny plugs on the chargers. Today’s charging plugs require more metal, but they are not as likely to break. And then came Apple with their “proprietary cables” that make it difficult to do anything but spend more money, especially if one has any other phone or music player.

    1. Lightning has two sides, so you don’t have to think about which way the plug is going.

      Think of how much easier it would be if HDMI, VGA, or even USB cables were dual-sided?

      That’s what it’s all about. Not being proprietary. It’s ease of use.

  9. From a user experience point of view, headphones are barbaric. (Re: Beats – how foolish do its users look? Like airport baggage handlers.) Let’s see if Apple has any true innovation left in its bones….

  10. Enrico Caruso Tuesday, June 24, 2014

    The elephant that no one is considering is that if you run audio through a Lightning connector, there is no longer any way to charge the device while using headphones. There would need to be some sort of dongle/splitter type solution, and we can predict how Apple might feel about that.

    1. You could always have two ports.

      For me anyway, it seems implausible that Apple would want to implement complex design to solve what looks like a relatively straightforward problem: Bidirectional data transfers with an ear mounted piece of hardware.

  11. A Ch0w, sneeze Tuesday, June 24, 2014

    I can’t pretend I know it all–but audio controls and Mics have been implemented off this same 3.5mm jack for a while now– and Bluetooth can always be added for extra connectivity.