I listen to color - Neil Harbisson

[Music] [Music] [Applause] Well, I was born with a rare visual condition called achromatopsia, which is total color blindness. So, I've never seen color and I don't know what color looks like, 'cause I come from a gray scale world. To me, the sky is always gray, flowers are always gray, and television is still in black and white. But since the age of 21, instead of seeing color, I can hear color.

In 2003, I started a project with computer scientist Adam Montandon, and the result with further collaborations with Peter Kes from Slovenia and Matias Lisana from Barcelona is this electronic eye. It's a color sensor that detects the color frequency in front of me and sends this frequency to a chip installed at the back of my head. I hear the color in front of me through the bone, through bone conduction.

So, for example, if I have, like, this is the sound of purple; for example, this is the sound of grass. This is red, like that. This is the sound of a dirty sock [Music]—like, which is like yellow, this one. So, I've been hearing color all the time for eight years since 2004. I find it completely normal now to hear color all the time.

At start, though, I had to memorize the names you give for each color. So, I had to memorize the notes, but after some time, all this information became a perception. I didn't have to think about the notes, and after some time, this perception became a feeling. I started to have favorite colors, and I started to dream in colors.

So, when I started to dream in color is when I felt that the software and my brain had united, 'cause in my dreams it was my brain creating electronic sounds; it wasn't the software. So, that's when I started to feel like a cyborg. It's when I started to feel that the cybernetic device was no longer a device; it had become a part of my body, an extension of my senses.

After some time, it even became a part of my official image. This is my passport from 2004; you're not allowed to appear on UK passports with electronic equipment. But I insisted to the passport office that what they were seeing was actually a new part of my body, an extension of my brain, and they finally accepted me to appear with the passport.

So, life has changed dramatically since I hear color, because color is almost everywhere. So, biggest changes, for example, is going to an art gallery. I can listen to a Picasso, for example, so it's like going to a concert hall because I can listen to the paintings.

In supermarkets, I find this is very shocking, very, very attractive to walk along a supermarket—it's like going to a nightclub. It's full of different melodies, yeah, especially the aisle with cleaning products. It's just fabulous. Also, the way I dress has changed; before, I used to dress in a way that it looked good. Now, I dress in a way that it sounds good.

So, today I'm dressed in C major, so it's quite a happy chord. If I had to go to a funeral, though, I would dress in B minor, which would be turquoise, which is purple and orange. Also, the way I look at food has changed, 'cause now I can display the food on a plate. So, I can eat my favorite song.

So, depending on how I display it, I can hear, and I can compose music with food. So, imagine a restaurant where we can have like Lady Gaga salads as starters. I mean, this would get teenagers to eat their vegetables probably, and also some Rammstein piano coner as main dishes and some Madonna desserts. That would be a very exciting restaurant where you can actually eat songs.

Also, the way I perceive beauty has changed, because when I look at someone, I hear their face. So, someone might look very beautiful but sound terrible, and it might happen the opposite the other way around. So, I really enjoy creating sound portraits of people instead of drawing someone's face, like drawing the shape; I point at them with the eye, and I write down the different notes I hear, and then I create sound portraits.

Here's some [Music] faces, yeah, Nicole Kidman, sounds good. Some people I would never relate, but they sound similar; Prince Charles has some similarities with Nicole Kidman—they have similar sound of eyes. So, you relate people that you wouldn't relate, and you can actually also create sound concerts by looking at the audience's faces.

So, I connect the eye, and then I play the audience's faces. The good thing about this is if the concert doesn't sound good, it's their fault; it's not my fault. And so, another thing that happens is that I started having this secondary effect that normal sounds started to become color. I heard a telephone tone, and it felt green because it sounded just like the color green. The BBC beeps, they sound turquoise, and listening to Mozart became a yellow experience.

So, I started to paint music and paint people's voices, because people's voices have frequencies that I relate to color. And here's some music translated into color. For example, Mozart's Queen of the Night looks like this—very yellow and very colorful, 'cause there's many different [Music] frequencies.

And this is a completely different song—it's Justin Bieber's Baby, so it's very pink and very yellow. So, also voices, I can transform speeches into color. For example, these are two well-known speeches; one of them is Martin Luther King's "I Have a Dream," and the other one is Hitler.

And I like to exhibit these paintings in the exhibition hall without labels, and then I ask people which one do you prefer. Most people change their preference when I tell them that the one on the left is Hitler and the one on the right is Martin Luther King.

So, I got to a point when I was able to perceive 360 colors, just like human vision. I was able to differentiate all the degrees of the color wheel, but then I just thought that this human vision wasn't good enough—there's many, many more colors around us that we cannot perceive but that electronic eyes can perceive.

So, I decided to continue extending my color senses and I added infrared, and I added ultraviolet to the color to sound scale. So, now I can hear colors that the human eye cannot perceive. For example, perceiving infrared is good because you can actually detect if there's movement detectors in a room.

I can hear if someone points at me with a remote control. And the good thing about perceiving ultraviolet is that you can hear if it's a good day or a bad day to sunbathe, because ultraviolet is a dangerous color that can actually kill.

So, I think we should all have this wish to perceive things that we cannot perceive. That's why, two years ago, I created the Cyborg Foundation, which is a foundation that tries to help people become a cyborg; tries to encourage people to extend their senses by using technology as part of the body.

We should all think that knowledge comes from our senses, so if we extend our senses, we will consequently extend our knowledge. I think life will be much more exciting when we stop creating applications for mobile phones and we start creating applications for our own body.

I think this will be a big, big change that we'll see during this century. So, I do encourage you all to think about which senses you'd like to extend. I would encourage you to become a cyborg; you won't be alone. Thank you. [Music]