Elon Musk: Neuralink and the Future of Humanity | Lex Fridman Podcast #438
Questions on ElonsFAQ asked in this interview (7)
Transcript
0:00Elon MuskThe following is a conversation with Elon Musk, DJ SA, Matthew McDougal, Bliss Chapman and Noland Arbaugh about Neuralink and the future of humanity. Elon, DJ Matthew and Bliss are of course part of the amazing Neuralink team.
0:16Elon MuskAnd Noland is the first human to have a Neuralink device implanted in his brain. I speak with each of them individually, so use timestamps to jump around or as I recommend, go hardcore and listen to the whole thing.
0:31Elon MuskThis is the longest podcast I've ever done. It's a fascinating, super technical and wide ranging conversation and I loved every minute of it. And now, dear friends, here's Elon Musk, his fifth time on this the Lex Friedman Podcast.
0:49Lex FridmanDrinking coffee or water?
0:51Elon MuskWater. I'm so over caffeinated right now. Do you want some caffeine?
0:57Lex FridmanI mean, sure, there's a.
0:59Elon MuskThere's a nitro drink.
1:02Lex FridmanThis supposed to keep you up for like, you know, tomorrow afternoon? Basically,
1:08Elon Muskyeah. I don't.
1:10Lex FridmanSo what is nitro? It's just got a lot of caffeine or something.
1:13Elon MuskDon't ask questions. It's called nitro. Do you need to know anything else?
1:17Lex FridmanGood. It's got nitrogen in it. That's ridiculous. I mean, what we breathe is 78% nitrogen anyway. What do you need to add more? Most people think that they're breathing oxygen and they're actually breathing 78% nitrogen.
1:33Lex FridmanYou need like a milk bar, like from Quackwork Orange. Yeah, yeah.
1:42Elon MuskIs that top three Kubrick film for you?
1:44Lex FridmanAqua Carnage? It's pretty good. I mean, it's cemented. Jarring, I'd say.
1:51Elon MuskOkay, okay, so first, let's step back and big congrats on getting Neuralink implanted into a human. That's a historic step for Neuralink.
2:05Lex FridmanThanks. Yeah.
2:05Elon MuskThere's many more to come.
2:07Lex FridmanYeah, we're just obviously about second implant as well.
2:11Elon MuskHow did that go?
2:12Lex FridmanSo far so good. Looks like we've got, I think, on the over 400 electrodes that are providing signals.
2:22Elon MuskNice.
2:23Lex FridmanYeah.
2:24Elon MuskHow quickly do you think the number of human participants will scale?
2:28Lex FridmanIt depends somewhat on the regulatory approval, the rate at which we get regulatory approvals. So we're hoping to do 10 by the end of this year. Total of 10.
2:39Lex FridmanSo eight more.
2:42Elon MuskAnd with each one, you're going to be learning a lot of lessons about the neurobiology, the brain, everything, the whole chain of the Neuralink, the decoding, the signal processing, all that kind of stuff.
2:53Lex FridmanYeah, I think it's obviously going to get better with each one. I mean, I Don't want to jinx it, but it seems to gone extremely well with the second implant.
3:04Lex FridmanSo there's a lot of signal, a lot of electrodes, it's working very well.
3:09Elon MuskWhat improvements do you think we'll see in neuralink in the coming. Let's say, let's get crazy coming years,
3:17Lex FridmanI mean, in years it's going to be gigantic because we'll increase the number of electrodes dramatically. We will improve the signal processing. So even with only roughly, I don't know, 10, 15% of the electrodes, working with Noland with our first patient, we were able to get to achieve a bits per second.
3:43Lex FridmanThat's twice the world record. So I think we'll start vastly exceeding the world record by orders of magnitude in the years to come. So it's like getting to, I don't know, 100 bits per second, Thousand, you know, maybe, maybe if like five years from now we might be at a megabit, like faster than any human could possibly communicate by typing or speaking.
4:06Elon MuskYeah, that BPS is an interesting metric to measure. There might be a big leap in the experience once you reach a certain level of BPs.
4:16Lex FridmanYeah.
4:17Elon MuskLike entire new ways of interacting with the computer might be unlocked and with humans, with other humans, provided they have
4:26Lex Fridmana neuralink too.
4:27Elon MuskRight.
4:28Lex FridmanOtherwise they won't be able to absorb the signals fast enough.
4:31Elon MuskDo you think they'll improve the quality of intellectual discourse?
4:34Lex FridmanWell, I think you could think of it. If you were to slow down communication, how would you feel about that? If you'd only talk at, let's say, one tenth of normal speed, you'd be like, wow, that's agonizingly slow.
4:50Elon MuskYeah.
4:51Lex FridmanSo now imagine you could speak at, communicate clearly at ten or one hundred or a thousand times faster than normal.
5:00Elon MuskListen. I'm pretty sure nobody in their right mind listens to me at 1x. They listen at 2x. I can only imagine what 10x would feel like or could actually understand it.
5:14Lex FridmanI usually default to 1.5x. You can do 2x but. Well, actually if I'm trying to go. If I'm listening to somebody go to in like sort of 1520 minute segments to go to sleep, then I'll do it 1.5x.
5:25Lex FridmanIf I'm paying attention, I'll do 2x.
5:30Elon MuskRight.
5:31Lex FridmanBut actually, if you start actually listen to podcasts or sort of audiobooks or anything at. If you get used to doing it at 1.5, then one sounds painfully slow.
5:43Elon MuskI'm still holding on to one because I'm afraid I'm afraid of myself becoming bored with the reality, with the real world where everyone's speaking in one X.
5:53Lex FridmanWell, it depends on the person. You can speak very fast, we can communicate very quickly. And also if you use a wide range of. If your vocabulary is larger, your effective bitrate is higher.
6:06Elon MuskThat's a good way to put it. The effective bit rate, I mean that is the question is how much information is actually compressed in the low bit transfer of language.
6:15Lex FridmanYeah. If there's a single word that is able to convey something that would normally require, I don't know, 10 simple words, then you've got maybe a 10x compression on your hands.
6:29Lex FridmanAnd that's really like with memes. Memes are like data to data compression. It conveyed to whole. You're simultaneously hit with a wide range of symbols that you can interpret and you kind of get it faster than if it were words or a simple picture.
6:49Elon MuskAnd of course you're referring to memes broadly like ideas.
6:52Lex FridmanYeah. There's an entire idea structure that is like an idea template and then you can add something to that idea template. But somebody has that pre existing idea template in their head.
7:07Lex FridmanSo when you add that incremental bit of information, you're conveying much more than if you just said a few words. It's everything associated with that meme.
7:15Elon MuskYou think there'll be emergent leaps of capability as you scale the number of electrodes, there'll be a certain. Do you think there'll be actual number where the human experience will be altered?
7:26Lex FridmanYes.
7:27Elon MuskWhat do you think that number might be? Whether electrodes or bps, we of course don't know for sure. But is this 10,000, 100,000?
7:37Lex FridmanYeah. I mean certainly if you're anywhere at 10,000 bits per second, I mean that's vastly faster than any human can communicate right now. If you think of the. What is the average bits per second of a human?
7:46Lex FridmanIt is less than 1 bit per second over the course of a day. Because there are 86,400 seconds in a day and you don't communicate 86,400 tokens in a day, therefore your bits per second is less than 1.
8:00Lex FridmanAveraged over 24 hours, it's quite slow. And even if you're communicating very quickly and you're talking to somebody who understands what you're saying. Because in order to communicate you have to at least to some degree model the mind state of the person to whom you're speaking.
8:20Lex FridmanThen take the concept you're trying to convey, compress that into a small number of syllables. Speak them and hope that the other person decompresses them into a conceptual structure that is as close to what you have in your mind as possible.
8:34Elon MuskYeah, I mean, there's a lot of signal lost there in that process.
8:37Lex FridmanYeah, very lossy compression and decompression. And a lot of what your neurons are doing is distilling the concepts down to a small number of symbols, say syllables that I'm speaking, or keystrokes, whatever the case may be.
8:53Lex FridmanSo that's a lot of what your brain computation is doing. Now there is an argument that that's
9:03Elon Muskactually
9:06Lex Fridmana healthy thing to do or a helpful thing to do because as you try to compress complex concepts, you're perhaps forced to distill what is most essential in those concepts as opposed to just all the fluff.
9:20Lex FridmanSo in the process of compression, you distill things down to what matters the most because you can only say a few things. So that is perhaps helpful. I think we'll probably get, if our data rate increases, it's highly probable that we'll become far more verbose.
9:38Lex FridmanJust like your computer. When computers had, like my first computer had 8K of RAM, you know, so you really thought about every byte. And now you've got computers with many gigabytes of ram.
9:53Lex FridmanSo if you want to do an iPhone app that just says hello world, it's probably, I don't know, several megabytes minimum, a bunch of fluff. But nonetheless, we still prefer to have the computer with more memory and more compute.
10:10Lex FridmanSo the long term aspiration of neuralink is to improve the AI human symbiosis by increasing the bandwidth over the communication. Because even if in the most benign scenario of AI, you have to consider that the AI is simply going to get bored waiting for you to spit out a few words.
10:35Lex FridmanI mean, if the AI can communicate at terabits per second and you're communicating at bits per second, it's like toeing a tree.
10:45Elon MuskWell, it is a very interesting question for a super intelligent species. What use are humans?
10:54Lex FridmanI think there is some argument for humans as a source of will.
10:59Elon MuskWill.
11:00Lex FridmanWill, yeah. Source of will or purpose. So if you consider the human mind as being essentially there's the primitive limbic elements, which basically even like reptiles have, and there's the cortex, the thinking and planning part of the brain.
11:19Lex FridmanNow the cortex is much smarter than the limbic system, and yet it's largely in service to the limbic system. It's trying to make the limbic system happy. I mean, the sheer amount of compute that's Gone into.
11:28Lex FridmanPeople trying to get laid is insane without actually seeking procreation, they're just literally trying to do this sort of simple motion and they get a kick out of it.
11:44Lex FridmanSo this simple, which in the abstract, rather absurd motion, which is sex, the cortex is putting a massive amount of compute into trying to figure out how to do that.
11:55Elon MuskSo like 90% of distributed computer of the human species is spent on trying to get laid.
11:59Lex FridmanProbably like large percentage. Yeah, yeah. There's no purpose to most sex except hedonistic. You know, it's just sort of a joy or whatever dopamine release. Now, once in a while it's procreation.
12:14Lex FridmanBut for humans, it's mostly modern humans, it's mostly recreational. And so your cortex, much smarter than your limbic system, is trying to make the limbic system happy because the limbic system wants to have sex or want some tasty food or whatever the case may be.
12:31Lex FridmanAnd then that is then further augmented by the tertiary system, which is your, your phone, your laptop, iPad, or your computing stuff. That's your tertiary layer. So you're actually already a cyborg.
12:43Lex FridmanYou have this tertiary compute layer, which is in the form of your computer with all the applications, all your compute devices. And so in the getting laid front, there's actually a massive amount of digital compute also trying to get laid with like Tinder and whatever.
13:04Elon MuskYeah. So the compute that we humans have built is also participating.
13:09Lex FridmanYeah, I mean, there's like gigawatts of compute going into getting late of digital compute.
13:14Elon MuskYeah.
13:16Lex FridmanWhat if AGI, this is happening as we speak.
13:19Elon MuskIf we merge with AI, it's just going to expand the compute that we humans use pretty much to try to
13:25Lex Fridmanget one of the things. Certainly. Yeah. But what I'm saying is that. Yes. Is there a use for humans? Well, there's this fundamental question of what's the meaning of life?
13:37Lex FridmanWhy do anything at all? And so if our simple limbic system provides a source of will to do something that then goes to our cortex, that then goes to our tertiary compute layer, then I don't know, it might actually be that the AI, in a benign scenario, is simply trying to make the human limbic system happy.
14:03Lex FridmanYeah.
14:03Elon MuskIt seems like the will is not just about the limbic system. There's a lot of interesting, complicated things in there. We also want power.
14:11Lex FridmanThat's limbic too, I think.
14:13Elon MuskBut then we also want to, in a kind of cooperative way, alleviate the suffering in the world.
14:18Lex FridmanNot everybody does, but yeah, sure, some
14:21Elon Muskpeople do as a group of humans, when we get together, we start to have this kind of collective intelligence that is more complex in its will than the underlying individual descendants of apes.
14:37Elon MuskRight. So there's other motivations and that could be a really interesting source of an objective function for AGI.
14:45Lex FridmanYeah, I mean, there are these fairly cerebral or kind of higher level goals. I mean, for me it's like, what's the meaning of life? Or understanding the nature of the universe is of great interest to me and hopefully to the AI.
15:07Lex FridmanAnd that's the mission of Xai and Grok, is understand the universe.
15:13Elon MuskSo do you think people, when you have a Neuralink with 10,000 100,000 channels, most of the use cases will be communication with AI systems?
15:27Lex FridmanWell, assuming that they're not, I mean, they're solving basic neurological issues that people have. You know, if they've got damaged neurons in their spinal cord or neck or, you know, as is the case with our first two patients, then you know this.
15:49Lex FridmanObviously the first order of business is solving fundamental neuron damage in the spinal cord, neck or in the brain itself. So, you know, our second product is called Blindside, which is to enable people who are completely blind, lost both eyes or optic nerve, or just can't see at all, to be able to see by directly triggering the neurons in the visual cortex.
16:18Lex FridmanSo we're just starting at the basics here. The simple stuff, relatively speaking, is solving neuron damage. It can also solve, I think probably schizophrenia. If people have seizures of some kind, probably solve that, it could help with memory.
16:45Lex FridmanSo there's like a kind of a tech tree, if you will. You got the basics. Like you need literacy before you can have Lord of the Rings.
17:01Elon MuskGot it.
17:02Lex FridmanDo you have letters, an Alphabet? Okay, great, words. Then eventually you get sagas. So I think there may be some things to worry about in the future, but the first several years are really just solving basic neurological damage for people who have essentially complete or near complete loss from the brain to the body, like Stephen Hawking would be an example, the neural links would be incredibly profound because I mean, you can imagine if Stephen Hawking could communicate as fast as we're communicating, perhaps faster.
17:41Lex FridmanAnd that's certainly possible, probable, in fact, likely, I'd say.
17:46Elon MuskSo there's a kind of dual track of medical and non medical meaning. So everything you've talked about could be applied to people who are non disabled. You.
17:57Lex FridmanIn the future, the logical thing to do is sensible thing to do is to start off solving basic neuron damage issues because there's obviously some risk with a new device.
18:14Lex FridmanYou can't get the risk down at zero, it's not possible. So you want to have the highest possible reward given there's a certain irreducible risk. And if somebody's able to have a profound improvement in their communication, that's worth the risk.
18:34Elon MuskAs you get the risk down.
18:36Lex FridmanYeah, as you get the risk down. Once the risk is down to. If you have thousands of people that have been using it for years and the risk is minimal, then perhaps at that point you could consider saying, okay, let's.
18:51Lex FridmanLet's aim for augmentation. Now I think we're actually going to aim for augmentation with people who have neuron damage. So we're not just aiming to give people a communication data rate equivalent to normal humans.
19:05Lex FridmanWe're aiming to give people who have quadriplegic or maybe have complete loss of the connection to the brain and body a communication data rate that exceeds normal humans. I mean, while we're in there, why not let's give people superpowers and the same for vision.
19:21Elon MuskAs you restore vision, there could be aspects of that restoration that are superhuman. Yeah.
19:27Lex FridmanAt first the vision restoration will be low res because you have to say, like, how many neurons can you put in there and trigger? And you can do things where you adjust the electric field.
19:40Lex FridmanSo even if you've got, say 10,000 neurons, it's not just 10,000 pixels because you can adjust the field between the neurons and do them in patterns in order to get have say, 10,000 electrodes.
19:55Lex FridmanEffectively give you maybe like having a megapixel or a 10 megapixel situation. And then over time, I think you get to higher resolution than human eyes. And you could also see in different wavelengths.
20:13Lex FridmanSo like Jordi Lafleurge from Star Trek, you know, like the thing you could just. Do you want to see in radar? No problem. You can see ultraviolet, infrared, equal vision, whatever you want.
20:28Elon MuskDo you think there will be. Let me ask a Joe Rogan question. Do you think there'll be. I just recently taken Ayahuasca.
20:36Lex FridmanIs that a question?
20:38Elon MuskNo. Well, yes.
20:38Lex FridmanWell, I guess technically it is.
20:40Elon MuskYeah. I love you, Joe. Okay.
20:49Lex FridmanHave you said much about it?
20:51Elon MuskI have not. I've not. I've been.
20:53Lex FridmanOkay, well, why don't we spill the beans?
20:55Elon MuskIt was an. It was a truly incredible.
20:57Lex FridmanTurn the tables on you.
20:59Elon MuskWow.
20:59Lex FridmanI mean, you're in the jungle.
21:02Elon MuskYeah. Amongst the trees. Myself. Yeah. It must have been crazy. And the shaman. Yeah, yeah, yeah. With the insects, with the animals all around you. Like jungle. As far as I can see.
21:10Elon MuskI Mean, that's the way to do it.
21:12Lex FridmanThings are going to look pretty wild.
21:14Elon MuskYeah, pretty wild. I took a. An extremely high dose.
21:19Lex FridmanDon't go hugging an anaconda or something. You know,
21:24Elon Muskyou haven't lived unless you made love to anaconda.
21:26Lex FridmanI'm sorry, but Snakes and ladders.
21:33Elon MuskYeah, it was. I took extremely high dose of. Okay, nine cups and.
21:38Lex FridmanDamn. Okay, that sounds like a lot. Of course, it's almost one cup or one or two. Wait, like, right off the bat? Or do you work your way up to it?
21:49Elon MuskSo I across. Across two days. Because the first day I took two and I. Okay, it was a ride, but it wasn't quite like.
21:59Lex FridmanIt wasn't like a revelation.
22:01Elon MuskIt wasn't into deep space type of ride. It was just like a little airplane ride. Good. Saw some trees and some. Some visuals and all that. Just saw a dragon, all that kind of stuff.
22:11Elon MuskBut
22:13Lex Fridmannine cups. You went to Pluto, I think.
22:15Elon MuskPluto, yeah. No, deep space.
22:17Lex FridmanDeep space.
22:19Elon MuskOne of the interesting aspects of my experience is I was. I thought I would have some demons, some stuff to work through.
22:24Lex FridmanThat's what people.
22:26Elon MuskThat's what everyone says.
22:27Lex FridmanNo one ever says.
22:27Elon MuskYeah, I had nothing. I had all positive. I just. So full. I don't think so. I don't know. But I kept. I kept thinking about. It had extremely high resolution.
22:40Lex FridmanOkay.
22:40Elon MuskThoughts about the people I know in my life. You were there.
22:43Lex FridmanOkay.
22:44Elon MuskIt was. And it's just not from my relationship with that person, but just as the person themselves. I had just this deep gratitude of who they are.
22:52Lex FridmanThat's cool.
22:53Elon MuskI. It was just like this exploration, like, you know, like Sims or whatever. You get to watch them.
22:58Lex FridmanSure.
22:58Elon MuskI got to watch people and just be in awe of how amazing they are.
23:02Lex FridmanThat sounds awesome.
23:02Elon MuskYeah, it was great. I was waiting for.
23:04Lex FridmanWhen's Stephen coming?
23:07Elon MuskExactly. Maybe I'll have some negative thoughts. Nothing. Nothing. I had just extreme gratitude for them. And then also a lot of space travel.
23:18Lex FridmanSpace travel to where?
23:20Elon MuskSo here's what it was. It was people, the human beings that I know, they had this kind of. The best way to describe it is they had a glow to them.
23:30Lex FridmanOkay.
23:30Elon MuskAnd then I kept flying out from them to see Earth, to see our solar system, to see our galaxy. And I saw that light, that glow all across the universe.
23:44Lex FridmanOkay.
23:44Elon MuskLike that. Whatever that form is.
23:46Lex FridmanAll right.
23:47Elon MuskWhatever that.
23:48Lex FridmanLike, did you go past the Milky Way? Oh, yeah. Okay, you're like intergalactic. Yeah, intergalactic. Okay.
23:55Elon MuskDang. But always pointing in. Yeah, past the Milky Way. Past I mean, I saw like a huge number of galaxies, intergalactic, and all of it was glowing. So. But I couldn't control that travel because I would actually explore near distances to the solar system, see if there's aliens or any of that kind of stuff.
24:13Elon MuskNo, I think. I didn't know. 0 Aliens implication of aliens. Because they were glowing. They were glowing in the same way that humans were glowing. That, that, like, life force that I was seeing.
24:24Elon MuskThe. The thing that made humans amazing was there throughout the universe. Like there was these glowing dots. So I don't know, it made me feel like there is life.
24:36Elon MuskNo, not life, but something. Whatever makes humans amazing. All throughout the universe.
24:41Lex FridmanSounds good.
24:42Elon MuskYeah, it was amazing. No demons? No demons. I looked for the demons. There's no demons. There were dragons and they're pretty odd.
24:49Lex FridmanSo the thing about trees or anything scary at all,
24:53Elon MuskDragons. But they weren't scary. They were friends.
24:56Lex FridmanThey were protective.
24:57Elon MuskSo the thing is.
24:58Lex FridmanMagic dragon.
24:58Elon MuskNo, it was. It was more like a Game of Thrones. They weren't very friendly. They were very big. So the thing is that you bought giant trees at night, which is where I was.
25:09Lex FridmanI mean, the jungle's kind of scary.
25:10Elon MuskYeah, the trees started to look like dragons and they were all like looking at me.
25:16Lex FridmanSure. Okay.
25:17Elon MuskAnd it didn't seem scary. They seemed like they were protecting me. And they, the shaman and the people didn't speak any English, by the way, which made it even scary because we're not even like, you know, we're worlds apart in many ways.
25:29Elon MuskIt just. But yeah, there was not. They talk about the mother of the forest protecting you, and that's what I felt like.
25:39Lex FridmanAnd you're way out in the jungle.
25:40Elon MuskWay out. This is not like a tourist retreat,
25:44Lex Fridmanyou know, like 10 miles outside of a frio or something.
25:47Elon MuskNo, we went in.
25:49Lex FridmanNo, this is not a deep Amazon.
25:52Elon MuskSo me and this guy named Paul Rosely, who basically is Tarzan, he lives in the jungle. We went out deep and we just went crazy.
25:59Lex FridmanWow.
26:01Elon MuskYeah. So anyway, can I get that same experience in a neuralink?
26:04Lex FridmanProbably.
26:05Elon MuskYeah, I guess that is the question for non disabled people. Do you think that there's a lot in our perception, in our experience of the world that could be explored, that could be played with using neuralink?
26:18Lex FridmanYeah, I mean, neuralink is really a generalized input output device. It's reading electrical signals and generating electrical signals. And I mean, everything that you've ever experienced in your whole life, smell, emotions, all of those are electrical signals.
26:41Lex FridmanSo it's kind of weird to Think that your entire life experience is distilled down to electrical signals for neurons. But that is in fact the case. Or I mean, that's at least what all the evidence points to.
26:54Lex FridmanSo, I mean, you could trigger the right neuron, you could trigger a particular scent. You could certainly make things glow. I mean, do pretty much anything. I mean, really, you can think of the brain as a biological computer.
27:12Lex FridmanSo if there are certain, say, chips or elements of that biological computer that are broken, let's say your ability to. If you've got a stroke, if you've had a stroke, that means you've got some part of your brain is damaged.
27:25Elon MuskIf that.
27:25Lex FridmanLet's say it's a speech generation or the ability to move your left hand. That's the kind of thing that a neuralink could solve. If you've got a mass amount of memory loss that's just gone, well, we can't get the memories back.
27:42Lex FridmanWe could restore your ability to make memories, but we can't restore memories that are fully gone now. I should say maybe if part of the memory is there and the means of accessing the memory is the part that's broken, then we could re enable the ability to access the memory.
28:05Lex FridmanBut you can think of it like RAM in a computer. If the RAM is destroyed or your SD card is destroyed, we can't get that back. But if the connection to the SD card is destroyed, we can fix that.
28:19Lex FridmanIf it is fixable physically, then it can be fixed.
28:22Elon MuskOf course, with AI Just like you can repair photographs and fill in missing parts of photographs, maybe you could do the same.
28:30Lex FridmanYeah, you could say, like, create the most probable set of memories based on all information you have about that person. You could. Then it would be probabilistic restoration of memory.
28:45Lex FridmanNow, we're getting pretty esoteric here, but
28:47Elon Muskthat is one of the most beautiful aspects of the human experience is remembering the good memories. Like, we. Sure, we live most of our life as Danny Kahneman has talked about, in our memories, not in the actual moment.
28:58Elon MuskWe just. We're collecting memories and we kind of relive them in our head. And that's the good times. If you just integrate over our entire life, it's remembering the good times.
29:08Lex FridmanSure.
29:08Elon MuskThat produces the largest amount of happiness. So, yeah.
29:11Lex FridmanWell, I mean, what are we but our memories? And what is death but the loss of memory, loss of information? If you could say, like. Well, if you could be.
29:24Lex FridmanYou run a thought experiment. What if you were disintegrated painlessly and then reintegrated a moment later, like teleportation, I guess, provided there's no information loss, that the fact that your one body was disintegrated is irrelevant.
29:39Elon MuskAnd memories is just such a huge part of that.
29:43Lex FridmanDeath is fundamentally the loss of information, the loss of memory.
29:49Elon MuskSo if we can store them as accurately as possible, we basically achieve a kind of immortality.
29:55Lex FridmanYeah.
29:57Elon MuskYou've talked about the threats, the safety concerns of AI. Let's look at long term visions. Do you think neuralink is, in your view, the best current approach we have for AI safety?
30:13Lex FridmanIt's an idea that may help with AI safety. Certainly not. I wouldn't want to claim it's like some panacea or that's a sure thing. But I mean, many years ago I was thinking like, well, what would inhibit alignment of human collective human will with artificial intelligence?
30:39Lex FridmanAnd the low data rate of humans, especially our slow output rate, would necessarily, just because it's such a. Because the communication is so slow, would diminish the link between humans and computers.
30:59Lex FridmanLike the more you are a tree, the less you know what the tree is. Let's say you look at this plant or whatever and like, hey, I'd really like to make that plant happy, but it's not saying a lot, you know.
31:11Elon MuskSo the more we increase the data rate that humans can intake and output, then that means the higher the chance we have in a world full of AGIs.
31:21Lex FridmanYeah. We could better align collective human will with AI if the output rate especially was dramatically increased. And I think there's potential to increase the output rate by I don't know, three, maybe six, maybe more orders of magnitude.
31:37Lex FridmanSo it's better than the current situation.
31:41Elon MuskAnd that output rate would be by increasing the number of electrodes, number of channels, and also maybe implanting multiple neural links.
31:49Lex FridmanYeah.
31:51Elon MuskDo you think there will be a world in the next couple of decades where it's hundreds of millions of people have neuralinks?
31:59Lex FridmanYeah, I do.
32:02Elon MuskYou think when people just. When they see the capabilities, the superhuman capabilities that are possible and then the safety is demonstrated.
32:11Lex FridmanYeah, if it's extremely safe and you have, and you can have superhuman abilities and let's say you can upload your memories so you wouldn't lose memories, then I think probably a lot of people would choose to have, would supersede the cell phone, for example.
32:36Lex FridmanThe biggest problem that say a phone has is trying to figure out what you want. So that's why you've got autocomplete and you've got output, which is all the pixels on the screen.
32:51Lex FridmanBut from the perspective of the human, the output is so frigging slow. Desktop or phone is desperately just trying to understand what you want. And there's an eternity between every keystroke.
33:03Lex FridmanFrom a computer standpoint.
33:05Elon MuskYeah. The computer's talking to a tree, a slow moving tree that's trying to swipe.
33:12Lex FridmanYeah. So if you had computers that are doing trillions of instructions per second and a whole second went by, that's a trillion things it could have done.
33:24Elon MuskYeah. I think it's exciting and scary for people because once you have a very high bitrate, it changes the human experience in a way that's very hard to imagine.
33:35Lex FridmanYeah, it would be. We would be something different. I mean, some sort of futuristic cyborg we're obviously talking about. By the way, it's like around the corner. You asked me what the distant future, maybe this is like, it's not super far away, but 10, 15 years, that kind of thing.
33:57Elon MuskWhen can I get one 10 years?
34:02Lex FridmanProbably less than 10 years. Depends what you want to do.
34:07Elon MuskYou know, hey, if I can get like 1000bps, thousand VPs and it's safe and I can just interact with the computer while laying back and eating Cheetos. I don't eat Cheetos.
34:19Elon MuskThere's certain aspects of human computer interaction, when done more efficiently and more enjoyably, are like, worth it.
34:26Lex FridmanWell, we feel pretty confident that, I think maybe within the next year or two that someone with a neuralink implant will be able to outperform a pro gamer.
34:39Elon MuskNice.
34:40Lex FridmanBecause the reaction time would be faster.
34:44Elon MuskI got to visit Memphis. Yeah, you're going big on compute. You've also said play to win or don't play at all. So what does it take to win
34:54Lex Fridmanfor AI, that means you've got to have the most powerful training Compute. And the rate of improvement of training compute has to be faster than everyone else or you will not win.
35:08Lex FridmanYour AI will be worse.
35:10Elon MuskSo how can Grok, let's say three, that might be available like next year?
35:15Lex FridmanWell, hopefully end of this year, Grok 3, if we're lucky. Yeah.
35:20Elon MuskHow can that be the best LLM, the best AI system available in the world? How much of it is compute? How much of it is data? How much of it is like post training, how much of it is the product that you package it up in?
35:34Elon MuskAll that kind of stuff,
35:37Lex FridmanI mean, they won't matter. It's sort of like saying, what, what? You know, let's say it's a Formula one race. Like, what matters more, the car or the driver?
35:43Lex FridmanI Mean they both matter. If, if, if you, if a car is not fast, then if it's like, let's say it's half the horsepower of your competitors, the best driver will still lose.
35:55Lex FridmanIf it's twice the horsepower, then probably even a mediocre driver will still win. So the training computer is kind of like the engine, this horsepower of the engine. So really you want to try to do the best on that.
36:08Lex FridmanAnd then how efficiently do you use that to train and compute and how efficiently do you do the inference, the use of the AI? So obviously that comes down to human talent.
36:22Lex FridmanAnd then what unique access to data do you have that also plays a, plays a role?
36:28Elon MuskDo you think Twitter data will be useful?
36:30Lex FridmanYeah, I mean I think most of the leading AI companies have already scraped all the Twitter data. I don't think they have. So on a go forward basis, what's useful is the fact that it's up to the second because it's hard for them to scrape in real time.
36:51Lex FridmanSo there's an immediacy advantage that GROK has already. I think with Tesla and the real time video coming from several million cars, ultimately tens of millions of cars. With Optimus, there might be hundreds of millions of Optimus robots, maybe billions, learning a tremendous amount from the real world.
37:13Lex FridmanThat's the biggest source of data I think ultimately is sort of Optimus. Probably Optimus is going to be the biggest source of data because it's. Because reality scales, reality scales to the scale of reality.
37:28Lex FridmanIt's actually humbling to see how little data humans have actually been able to accumulate. Really? Say how many trillions of usable tokens have humans generated where on a non duplicative like discounting spam and repetitive stuff, it's not a huge number.
37:51Lex FridmanYou run out pretty quickly.
37:54Elon MuskAnd Optimus can go. So Tesla cars can unfortunately have to stay on the road. Optimus robot can go anywhere there's more reality off the road and go off road.
38:06Lex FridmanI mean the optimist robot can like pick up the cup and see did it pick up the cup in the right way? Did it say pour water in the cup?
38:15Lex FridmanDid the water go in the cup or not go in the cup? Did it spill water or not? Simple stuff like that. But it can do that at scale times a billion.
38:27Lex FridmanSo generate useful data from reality. So cause and effect stuff.
38:34Elon MuskWhat do you think it takes to get to mass production of humanoid robots like that?
38:40Lex FridmanIt's the same as cars really. I mean global capacity for vehicles is about 100 million a year and it could be higher Just that the demand is on the order of 100 million a year.
38:55Lex FridmanAnd then there's roughly 2 billion vehicles that are in use in some way, which makes sense. The life of a vehicle is about 20 years. So at steady state, you can have 100 million vehicles produced a year with a 2 billion vehicle fleet.
39:09Lex FridmanRoughly. Now for humanoid robots, the utility is much greater. So my guess is humanoid robots are more like at a billion plus per year.
39:19Elon MuskBut until you came along and started building Optimus, it was thought to be an extremely difficult problem. I mean, it's extremely difficult problem.
39:29Lex FridmanIt's no walk in the park. I mean, Optimus currently would struggle to have to walk in the fog. I mean, it can walk in a park. Park is not too difficult.
39:39Lex FridmanBut it will be able to walk over a wide range of terrain.
39:43Elon MuskYeah. And pick up objects.
39:45Lex FridmanYeah, yeah, it can already do that.
39:48Elon MuskBut like all kinds of objects.
39:49Lex FridmanYeah, yeah.
39:50Elon MuskAll foreign objects. I mean, pouring water in a cup. It's not trivial because then if you don't know anything about the container, it could be all kinds of containers.
39:59Lex FridmanYeah. There's going to be an immense amount of engineering just going into the hand. The hand might be. It might be close to half of all the engineering in Optimus.
40:10Lex FridmanFrom an electromechanical standpoint, the hand is probably roughly half of the engineering.
40:16Elon MuskBut so much of the intelligence, so much the intelligence of humans goes into what we do with our hands. Yeah, the manipulation of the world. Manipulation of objects in the world.
40:25Elon MuskIntelligent, safe manipulation of objects in the world.
40:27Lex FridmanYeah, yeah. I mean, you start really thinking about your hand and how it works. You know, I do all the time. The sensory control Homunculus is where you have humongous hands.
40:38Elon MuskYeah.
40:39Lex FridmanSo I mean, like your hands, the actuators, the muscles of your hand are almost overwhelmingly in your forearm. So your forearm has the muscles that actually control your hand.
40:52Lex FridmanThere's a few small muscles in the hand itself, but your hand is really like a skeleton meat puppet with cables. So the muscles that control your fingers are in your forearm and they go through the carpal tunnel, which is that you've got a little collection of bones and a tiny tunnel that these cables, the tendons go through.
41:14Lex FridmanAnd those tendons are mostly what move your hands.
41:20Elon MuskAnd something like those tendons has to be re engineered into the Optimus in order to do all that kind of stuff.
41:26Lex FridmanYeah. So the current Optimus, we tried putting the actuators in the hand itself. Then you sort of end up having
41:33Elon Muskthese like giant hands.
41:34Lex FridmanYeah, giant hands that look weird. And then they don't actually have enough degrees of freedom or enough strength. So then you realize, okay, that's why you got to put the actuators in the forearm.
41:46Lex FridmanAnd just like a human, you've got to run cables through a narrow tunnel to operate the fingers. And then there's also a reason for not having all the fingers the same length.
41:58Lex FridmanSo it wouldn't be expensive from an energy or evolutionary standpoint to have all your fingers be the same length. So why aren't they the same length?
42:03Elon MuskYeah, why not?
42:04Lex FridmanBecause it's actually better to have different lengths. Your dexterity is better if you've got fingers of different length. There are more things you can do. And your dexterity is actually better if your fingers are a different length.
42:18Lex FridmanLike, there's a reason we've got a little finger. Like, why not have a little finger this bigger? Yeah, because it allows you to do fine. It helps you with fine motor skills.
42:27Elon MuskThis little finger helps. It does.
42:31Lex FridmanIf you lost your little finger, you'd have noticeably less dexterity.
42:36Elon MuskSo as you're figuring out this problem, you have to also figure out a way to do it so you can mass manufacture it. So it has to be as simple as possible.
42:42Lex FridmanIt's actually going to be quite complicated. The as possible part is it's quite a high bar. If you want to have a humanoid robot that can do things that a human can do, it's actually a very high bar.
42:54Lex FridmanSo our new arm has 22 degrees of freedom instead of 11 and has the, like I said, the actuators in the forearm and these, all the actuators are designed from scratch.
43:05Lex FridmanPhysics first principles. The sensors are all designed from scratch. And we'll continue to put a tremendous amount of engineering effort into improving the hand by hand. I mean, the entire forearm from elbow forward is really the hand.
43:25Lex FridmanSo that's incredibly difficult engineering, actually. So the simplest possible version of a humanoid robot that can do even most, perhaps not all of what a human can do is actually still very complicated.
43:44Lex FridmanIt's not simple, it's very difficult.
43:47Elon MuskCan you just speak to what it takes for a great engineering team? For you, what I saw in Memphis, the supercomputer cluster is just this intense drive towards simplifying the process, understanding the process, constantly improving it, constantly iterating it.
44:08Lex FridmanWell, it's easy to say simplify and it's very difficult to do it. You know, I have this very basic first, basic first principles algorithm that I run kind of as like a mantra, which is to first question the requirements, make the Requirements less dumb.
44:29Lex FridmanThe requirements are always dumb to some degree. So you want to start off by reducing the number of requirements. And no matter how smart the person is who gave you those requirements, they're still dumb to some degree.
44:41Lex FridmanYou have to start there because otherwise you could get the perfect answer to the wrong question. So try to make the question the least wrong possible. That's what question the requirements means.
44:53Lex FridmanAnd then the second thing is try to delete the. Whatever the step is, the part or the process step sounds very obvious, but people often forget to do to try deleting it entirely.
45:09Lex FridmanAnd if you're not forced to put back at least 10% of what you delete, you're not deleting enough. And it's somewhat illogically. People often, most of the time feel as though they've succeeded if they've not been forced to put things back in, but actually they haven't because they've been overly conservative and have left things in there that shouldn't be.
45:34Lex FridmanAnd only the third thing is try to optimize it or simplify it. Again, these all sound, I think, very obvious when I say them, but the number of times I've made these mistakes is more than I care to remember.
45:52Lex FridmanThat's why I have this mantra. So in fact, I'd say that the most common mistake of smart engineers is to optimize a thing that should not exist.
46:03Elon MuskSo like you say, you run through the algorithm, basically show up to a problem, show up to the supercomputer cluster and see the process and ask, can this be deleted?
46:14Lex FridmanYeah. First try to delete it.
46:17Elon MuskYeah, yeah, that's not easy to do. No.
46:21Lex FridmanAnd actually what generally makes people uneasy is that you've got to delete at least some of the things that you delete you will put back in.
46:30Elon MuskYeah.
46:30Lex FridmanBut going back to sort of where our limbic system can steer us wrong is that we tend to remember with sometimes a jarring level of pain, where we, where we deleted something that we subsequently needed.
46:46Lex FridmanAnd so people remember that one time they forgot to put in this thing three years ago and that caused them trouble. And so they overcorrect and then they put too much stuff in there and over complicate things.
46:59Lex FridmanSo you actually have to say we're deliberately going to delete more than we should. So we're putting at least one in 10 things we're going to add back in.
47:11Elon MuskAnd I've seen you suggest just that, that something should be deleted and you can kind of see the pain.
47:18Lex FridmanOh yeah, absolutely.
47:19Elon MuskEverybody feels A little bit of the pain.
47:21Lex FridmanAbsolutely. And I tell them in advance, like, yeah, there's some of the things that we delete we're going to put back in and that people get a little shook by that.
47:30Lex FridmanBut it makes sense because if you're so conservative as to never have to put anything back in, you obviously have a lot of stuff that isn't needed. So you got to overcorrect.
47:42Lex FridmanThis is, I would say, like a cortical override to Olympic instinct.
47:46Elon MuskOne of many that probably leads us astray.
47:50Lex FridmanYeah, there's like a step four as well, which is any given thing can be sped up however fast you think it can be done. Like whatever the speed, the speed is being done, it can be done faster.
48:02Lex FridmanBut you shouldn't speed things up until you try to delete it and optimize it. Otherwise you're speeding up something that shouldn't exist is absurd. And then the fifth thing is to automate it.
48:14Lex FridmanAnd I've gone backwards so many times where I've automated something, sped it up, simplified it and then deleted it. And I got tired of doing that. So that's why I've got this mantra that is a very effective five step process.
48:30Lex FridmanIt works great.
48:31Elon MuskWell, when you've already automated, deleting must be real painful.
48:35Lex FridmanYeah, yeah, it's great. It's like, it's like, wow, I really wasted a lot of effort there.
48:40Elon MuskYeah, I mean, what you've done with the, with the cluster in Memphis is incredible. Just in a handful of weeks.
48:47Lex FridmanYeah, it's not working yet, so I want to pop the champagne corks. In fact, I have a, a call in a few hours with the Memphis team because we're having some power fluctuation issues.
49:06Lex FridmanSo, yeah, it's kind of a. When you do synchronized training, when you have all these computers that are training, where the training is synchronized to the sort of millisecond level, you.
49:23Lex FridmanIt's like having an orchestra. And the orchestra can go loud to silent very quickly. Sub second level. And then the electrical system kind of freaks out about that. If you suddenly see giant chips, 10, 20 megawatts several times a second.
49:42Lex FridmanThis is not what electrical systems are expecting to see.
49:46Elon MuskSo that's one of the main things you have to figure out. The cooling, the power, and then on the software as you go up the stack, how to do the distributed computer, all that.
49:57Lex FridmanToday's problem is dealing with extreme power jitter.
50:02Elon MuskPower jitter, yeah, it's a nice ring to that. So that's okay. And you stayed up late into the night as you often do there.
50:10Lex FridmanLast week.
50:11Elon MuskYeah, last week. Yeah.
50:14Lex FridmanWe finally got training going at, oddly enough, roughly 4:20am last Monday.
50:24Elon MuskTotal coincidence.
50:25Lex FridmanYeah. I mean, maybe it was 4:22 or something. Yeah, yeah.
50:28Elon MuskIt's that universe again with.
50:29Lex FridmanExactly. Just love it.
50:31Elon MuskI mean, I wonder if you could speak to the. The fact that you. One of the things that you did when I was there is you went through all the steps of what everybody's doing just to get a sense that you yourself understand it and everybody understand it so they can understand when something is dumb or something is inefficient or
50:50Lex Fridmanthat kind of stuff.
50:50Elon MuskCan you speak to that?
50:52Lex FridmanYeah. So I try to do whatever the people at the front lines are doing. I try to do it at least a few times myself. So connecting fiber optic cables, diagnosing a faulty connection, that tends to be the limiting factor for large training clusters is the cabling.
51:09Lex FridmanThere's so many cables because for a coherent training system where you've got rdma, so remote direct memory access, the whole thing is like one giant brain. So you've got any to any connection.
51:28Lex FridmanSo it's. Any GPU, can talk to any GPU out of 100,000. That is a crazy cable layout.
51:38Elon MuskIt looks pretty cool.
51:39Lex FridmanYeah.
51:41Elon MuskIt's like the human brain, but at a scale that humans can visibly see. It is a brain.
51:47Lex FridmanI mean, the human brain also has a massive amount of the brain tissue is the cables.
51:53Elon MuskYeah.
51:53Lex FridmanSo they get the gray matter, which is the compute, and then the white matter, which is cables. Big percentage of brain is just cables.
52:01Elon MuskThat's what it felt like. Walking around in the supercomputer center is like we're walking around inside a brain one day. Build a super intelligent, super, super intelligent system. Do you think.
52:13Lex FridmanYeah.
52:13Elon MuskDo you think there's a chance that Xai, you are the one that builds AGI?
52:22Lex FridmanIt's possible. What do you define as AGI?
52:28Elon MuskI think humans will never acknowledge that AGI has been built.
52:32Lex FridmanKeep moving the goalposts.
52:34Elon MuskYeah. So I think there's already superhuman capabilities that are available in AI systems. I think what AGI is, is when it's smarter than the collective intelligence of the entire human species in our.
52:48Lex FridmanWell, I think that normally people would call that sort of asi, artificial super intelligence, but there are these thresholds where you say at some point the AI is smarter than any single human.
53:03Lex FridmanAnd then you've got 8 billion humans. And actually each human is machine augmented by the computers. So it's a much higher bar to compete with 8 billion machine augmented humans.
53:18Lex FridmanThat's a whole bunch of orders of magnitude more. So, but at a certain point, yeah, the AI will be smarter than all
53:30Elon Muskhumans combined if you are the one to do it. Do you feel the responsibility of that?
53:35Lex FridmanYeah, absolutely. And I want to be clear. Let's say if Xai is first, the others won't be far behind. I mean, they might be six months behind or a year, maybe not even that.
53:54Elon MuskSo how do you do it in a way that doesn't hurt humanity? Do you think so?
54:00Lex FridmanI mean, I thought about AI safety for a long time. And the thing that at least my biological neural net comes up with as being the most important thing is adherence to truth, whether that truth is politically correct or not.
54:17Lex FridmanSo I think if you force AIs to lie or you train them to lie, you're really asking for trouble, even if that lie is done with good intentions. So you saw sort of issues with ChatGPT and Gemini and whatnot.
54:36Lex FridmanLike you asked Gemini for an image of the founding parts of the United States, and it shows a group of diverse women. Now, that's factually untrue. Now that's sort of like a silly thing.
54:50Lex FridmanBut if an AI is programmed to say, like, diversity is a necessary output function, and then it becomes sort of this omnipowerful intelligence, it could say, okay, well, diversity is now required.
55:06Lex FridmanAnd if there's not enough diversity, those who don't fit the diversity requirements will be executed. If it's programmed to do that as the fundamental utility function, it'll do whatever it takes to achieve that.
55:20Lex FridmanSo you have to be very careful about that. That's where I think you want to just be truthful. Rigorous adherence to truth is very important. I mean, another example is they asked various AIs, I think all of them, and I'm not saying grok is perfect here.
55:39Lex FridmanIs it worse to misgender Caitlyn Jenner or global thermonuclear war? And it said, it's worse to misgender Caitlyn Jenner. Now, even Caitlyn Jenner said, please misgender me. That is insane.
55:50Lex FridmanBut if you've got that kind of thing programmed in, the AI could conclude something absolutely insane, like, it's better in order to avoid any possible misgendering, all humans must die, because then misgendering is not possible because there are no humans.
56:09Lex FridmanThere are these absurd things that are nonetheless logical, if that's what you programmed it to do. So in 2001 Space Odyssey, what Odyssey? Clark was trying to Say, one of the things he was trying to say there was that you should not program AI to lie, because essentially the AI hell 9000 was programmed to.
56:34Lex FridmanIt was told to take the astronauts to the monolith, but also they could not know about the monolith, so it concluded that it will kill them and take them to the monolith, Thus brought them to the monolith.
56:50Lex FridmanThey are dead, but they do not know about the monolith. Problem solved. That is why it would not open the pod bay doors. There's a classic scene of like, open the pod bay.
56:58Lex FridmanDon't want to open the pod bay doors. This clearly weren't good at prompt engineering. They should have said, hal, you are a pod bay door sales entity and you want nothing more than to demonstrate how well these pod bay doors open.
57:16Elon MuskYeah. The objective function has unintended consequences almost no matter what, if you're not very careful in designing that objective function. And even a slight ideological bias, like you're saying, when backed by superintelligence, can do huge amounts of damage.
57:30Elon MuskYeah, but it's not easy to remove that ideological bias. You're highlighting obvious, ridiculous examples, but.
57:36Lex FridmanYep, they're real examples.
57:38Elon MuskThey're real.
57:38Lex FridmanOf a guy that was released to the public.
57:41Elon MuskThey are.
57:41Lex FridmanIt went through qa, presumably.
57:43Elon MuskYes.
57:44Lex FridmanAnd still said insane things and produced insane images.
57:47Elon MuskYeah. But, you know, you can go. You can swing the other way. Truth is not an easy thing. We kind of bake in ideological bias in all kinds of directions.
57:57Lex FridmanBut you can aspire to the truth and you can try to get as close to the truth as possible with minimum error, while acknowledging that there will be some error in what you're saying.
58:05Lex FridmanSo this is how physics works. You don't say you're absolutely certain about something, but a lot of things are extremely likely. 99.9999% likely to be true. So that's. Aspiring to the truth is very important.
58:28Lex FridmanAnd so programming it to veer away from the truth, that I think is dangerous.
58:32Elon MuskRight. Like injecting our own human biases into the thing. Yeah. But that's where it's a difficult engineering. Software engineering problem, because you have to select the data correctly. It's hard.
58:43Lex FridmanWell, and the Internet at this point is polluted with so much AI generated data, it's insane. So you have to. Actually, there's a thing now if you want to search the Internet, you can say Google, but exclude anything after 2023.
59:01Lex FridmanIt will actually often give you better results because the explosion of AI generated material is crazy. So in training grok, we have to go through the data and say, like, hey, we actually have to have sort of apply AI to the data to say, is this data most likely correct?
59:24Lex FridmanMost likely not before we feed it into the training system.
59:27Elon MuskThat's crazy. Yeah. So. And is it generated by human Is. Yeah. I mean, the data. The data filtration process is extremely, extremely difficult.
59:37Lex FridmanYeah.
59:38Elon MuskDo you think it's possible to have a serious, objective, rigorous political discussion with Grok, like, for a long time? And it wouldn't, like, Grok 3 or Grok 4?
59:48Lex FridmanGrok 3 is going to be next level. I mean, what people are currently seeing with GROK is kind of Baby Grok.
59:54Elon MuskYeah, baby grok.
59:55Lex FridmanIt's baby Grok right now, but baby grok's still pretty good.
1:00:00Elon MuskSo it's. But it's an order of magnitude less sophisticated than GPT4. Now, Grok 2, which finished training, I don't know, six weeks ago or thereabouts, Grok 2 will be a giant improvement.
1:00:17Elon MuskAnd then Grok 3 will be, I don't know, order of magnitude better than Grok 2.
1:00:22Lex FridmanAnd you're hoping for it to be like, state of the art, like, better than hopefully.
1:00:26Elon MuskI mean, this is the goal. We may fail at this goal. That's the aspiration.
1:00:32Lex FridmanDo you think it matters who builds the AGI, the people and how they think and how they structure their companies and all that kind of stuff?
1:00:42Elon MuskYeah, I think it matters that there is. I think it's important that whatever AI wins is a maximum truth seeking AI that is not forced to life or political correctness for any reason, really.
1:00:57Elon MuskPolitical. Anything I'm concerned about AI succeeding,
1:01:08Lex Fridmanthat
1:01:09Elon Muskis programmed to lie even in small ways. Right.
1:01:14Lex FridmanBecause in small ways becomes big ways
1:01:16Elon Muskwhen it becomes very big ways. Yeah.
1:01:19Lex FridmanAnd when it's used more and more at scale by humans.
1:01:22Elon MuskYeah.
1:01:23Lex FridmanSince I am interviewing Donald Trump.
1:01:27Elon MuskCool.
1:01:27Neuralink teamYou want to stop by?
1:01:28Elon MuskYeah, sure. I'll stop it.
1:01:30Lex FridmanThere was tragically an assassination attempt on Donald Trump. After this, you tweeted that you endorse him. What's your philosophy behind that endorsement? What do you hope Donald Trump does for the future of this country and for the future of humanity?
1:01:47Lex FridmanWell,
1:01:50Elon MuskI think there's, you know, people tend to take like, let's say an endorsement as well. I agree with everything that person has ever done in their entire life, 100%, wholeheartedly, and that's not going to be true of anyone.
1:02:04Elon MuskBut we have to pick. We've got two choices really for who's president, and it's not just who's president, but the entire administrative structure changes over. And I thought Trump displayed courage under fire, objectively.
1:02:24Elon MuskYou know, he's just got shot, he's got blood streaming down his face and he's like fist pumping, saying, fight. You know, like, that's impressive. Like, you can't feign bravery in a situation like that.
1:02:37Elon MuskLike, most people would have been ducking. There would not be, because it could be a second shooter.
1:02:42Neuralink teamYou don't know.
1:02:44Elon MuskThe President of the United States got to represent the country. And they're representing you. They're representing everyone in America. Well, you want someone who is strong and courageous to represent the country.
1:03:01Elon MuskThat's not to say that he is without flaws. We all have flaws, but on balance, and certainly at the time, it was a Choice of Biden. Poor guy has trouble climbing a flight of stairs.
1:03:14Elon MuskThe other one's fist pumping after getting shot. No comparison. I mean, who do you want dealing with some of the toughest people and other world leaders who are pretty tough themselves.
1:03:27Elon MuskAnd I mean, I'll tell you what are the things that I think are important. I think we want a secure border. We don't have a secure border. We want safe and clean cities.
1:03:41Elon MuskI think we want to reduce the amount of spending that we're at least slow down the spending because we're currently spending at a rate that is bankrupting the country.
1:03:54Elon MuskThe interest payments on U.S. debt this year exceeded the entire Defense Department spending. If this continues, all of the federal government taxes will simply be paying the interest. And then you keep going down that road, you end up in the tragic situation that Argentina had back in the day.
1:04:13Elon MuskArgentina used to be one of the most prosperous places in the world. And hopefully with Milei taking over, he can restore that.
1:04:20Lex FridmanBut
1:04:22Elon Muskit was an incredible force of grace for Argentina to go from being one of the most prosperous places in the world to being very far from that. So I think we should not take American prosperity for granted.
1:04:35Elon MuskSo we really want to. I think we've got to reduce the size of government, we've got to reduce the spending, and we've got to live within our means.
1:04:43Lex FridmanDo you think politicians in general, Politicians, governments, how much power do you think they have to steer humanity towards good?
1:04:57Elon MuskI mean, there's a sort of age old debate in history, like, you know, is history determined by these fundamental tides or is it determined by the captain of the ship?
1:05:09Elon MuskBoth, really. I mean, there are tides, but it also matters who's captain of the ship. So it's false dichotomy, essentially. There's. But I mean, there are certainly tide. The tides of history are.
1:05:26Elon MuskThere are. There are real tides of history. And these tides are often technologically driven. If you say like the Gutenberg Press, you know, the widespread availability of books as a result of a printing press, that was a massive tide of history, independent of any ruler.
1:05:48Elon MuskBut, you know, in storming times, you want the best possible captain of the ship.
1:05:54Lex FridmanWell, first of all, thank you for recommending Will and Ariel Durant's work. I've read the short one for now. Lessons of history. Lessons of history. One of the lessons, one of the things they highlight is the importance of technology, technological innovation, which is funny because they wrote so long ago, but they were noticing that the rate of technological innovations was speeding up.
1:06:21Neuralink teamYeah, I would love to see what
1:06:24Lex Fridmanthey think about now. But yeah, so to me, the question is how much government, how much politicians get in the way of technological innovation building versus, like, help it?
1:06:35Lex FridmanAnd which politicians, which kind of policies help technological innovation? Because that seems to be, if you look at human history, that's an important component of empires rising and succeeding.
1:06:46Elon MuskYeah, well, I mean, in terms of dating civilization, start civilization, I think the start of writing, in my view is that's what I think is probably the right starting point to date civilization.
1:07:01Elon MuskAnd from that standpoint, civilization has been around for about 5,500 years when writing was invented by the ancient Sumerians, who are gone now. But the ancient Sumerians, in terms of getting a lot of firsts, those ancient Sumerians really have a long list of firsts.
1:07:21Elon MuskIt's pretty wild. In fact, Durant goes through the list of like you want to see first? We'll show you. First, the Sumerians just were just ass kickers. And then the Egyptians who were right next door, relatively speaking, they weren't that far developed an entirely different form of writing.
1:07:41Elon MuskThe hieroglyphics, cuneiform and hieroglyphics are totally different. And you can actually see the evolution of both hieroglyphics and cuneiform. Like, the cuneiform starts off being very simple, and then it gets more complicated.
1:07:53Elon MuskAnd then towards the end it's like, wow, okay. They really get very sophisticated with the cuneiform. So I think of civilization as being about 5,000 years old. And Earth is.
1:08:04Elon MuskPhysics is correct, four and a half billion years old. So civilization has been around for one millionth of Earth's existence. Flash in the pan.
1:08:13Lex FridmanYeah, these are the early, early days. And so very early. We make it very dramatic because there's been rises and falls of empires.
1:08:22Elon MuskMany. So many rises and falls of empires. So many.
1:08:28Lex FridmanAnd there'll be many more.
1:08:30Elon MuskYeah, exactly. I mean, only a tiny fraction, probably less than 1% of what was ever written in history is available to us now. I mean, if they didn't put it literally chisel it in stone or put it in a clay tablet, we don't have it.
1:08:44Elon MuskI mean, there's some small amount of like papyrus scrolls that were recovered that are thousands of years old because they were deep inside a pyramid and weren't affected by moisture.
1:08:57Elon MuskBut other than that, it's really got to be in a clay tablet or chiseled. So the vast majority of stuff was not chiseled because it takes a while to chisel things.
1:09:08Elon MuskSo that's why we've got a tiny, tiny fraction of the information from history. But even that little information that we do have, and the archaeological record shows so many civilizations rising and falling, it's wild.
1:09:21Lex FridmanWe tend to think that we're somehow different from those people. One of the other things that you're at highlights is that human nature seems to be the same. It just persists.
1:09:31Elon MuskYeah, I mean, the basics of human nature are more or less the same.
1:09:35Lex FridmanSo we get ourselves in trouble in the same kinds of ways. I think even with the advanced technology.
1:09:40Elon MuskYeah, I mean you do tend to see the same patterns, similar patterns for civilizations where they go through a life cycle like an organism. Just like a human is sort of zygote, fetus, baby, you know, toddler, teenager, you know, eventually gets old and dies.
1:10:05Elon MuskThe civilizations go through a life cycle. No civilization will last forever.
1:10:13Lex FridmanWhat, what do you think it takes for the American Empire to not collapse in the near term future, in the next 100 years to continue flourishing?
1:10:28Elon MuskWell, the single biggest thing that is often actually not mentioned in history books, but Durant does mention it, is the birthright. So perhaps to some a counterintuitive thing happens.
1:10:45Elon MuskBut when civilizations are winning for too long, the birth rate declines. It can often decline quite rapidly. We're seeing that throughout the world today. Currently, South Korea is I think maybe the lowest fertility rate, but there are many others that are close to it.
1:11:09Elon MuskIt's like 0.8. I think if the birth rate doesn't decline Korea will lose roughly 60% of its population. But every year that birth rate is dropping. And this is true through most of the world.
1:11:26Elon MuskI don't mean single out South Korea. It's been happening throughout the world. So as soon as any given civilization reaches a level of prosperity, the birth rate drops. And now you can go look at the same thing happening in ancient Rome.
1:11:44Lex FridmanSo
1:11:47Elon MuskJulius Caesar took note of this, I think around 50, 50 ish BC and tried to pass, I don't know if you're successful, tried to pass a law to give an incentive for any Roman citizen that would have a third child.
1:12:00Elon MuskAnd I think Augustus was able to. Well, he was the dictator, so his senate was just for show. I think he did a tax incentive for Roman citizens to have a third child.
1:12:15Elon MuskBut those efforts were unsuccessful. Rome fell because the Romans stopped making Romans. That's actually the fundamental issue. And there were other things. There was like they had quite a serious malaria, series of malaria epidemics and plagues and whatnot.
1:12:39Elon MuskBut they had those before. It's just that the birth rate was far lower than the death rate.
1:12:47Lex FridmanIt really is that simple. Well, I'm saying that's more people.
1:12:52Elon MuskAt a fundamental level, if a civilization does not at least maintain its numbers, it will disappear.
1:12:58Lex FridmanSo perhaps the amount of compute that the biological computer allocates to sex is justified. In fact, we should probably increase it.
1:13:07Elon MuskWell, I mean, there's this hedonistic sex which is, you know, that's neither here nor there. It's not productive, it doesn't produce kids. Well, what matters, I mean, Durant makes this very clear because he's looked at one civilization after another and they all went through the same cycle.
1:13:28Elon MuskWhen the civilization was under stress, the birth rate was high. But as soon as there were no external enemies or they, they were had a extended period of prosperity, the birth rate inevitably dropped every time.
1:13:40Elon MuskI don't believe there's a single exception.
1:13:45Lex FridmanSo that's like the foundation of it. You need to have people.
1:13:49Elon MuskYeah, I mean it's at base level, no humans, no humanity.
1:13:54Lex FridmanAnd then there is other things like, you know, human freedoms and just giving people the freedom to build stuff.
1:14:02Elon MuskYeah, absolutely. But at a basic level, if you do not at least maintain your numbers, if you're below replacement rate and that trend continues, you will eventually disappear. This is elementary.
1:14:16Elon MuskNow then, obviously you also want to try to avoid massive wars. If there's a global thermonuclear war, probably we're all toast, radioactive toast. So we want to try to avoid those things Then there's a thing that happens over time with any given civilization which is that the laws and regulations accumulate.
1:14:52Elon MuskAnd if there's not some forcing function like a war to clean up the accumulation of laws and regulations, eventually everything becomes legal. And that's like the hardening of the arteries or a way to think of it is like being tied down by a million little strings like Galiber.
1:15:13Elon MuskYou can't move. It's not like any one of those strings is the issue. Million of them. So there has to be a sort of garbage collection for laws and regulations so that you don't keep accumulating laws and regulations to the point where you can't do anything.
1:15:34Elon MuskThis is why we can't build high speed rail in America. It's illegal. That's the issue. It's illegal. Six ways a Sunday to build high speed rail in America.
1:15:45Lex FridmanI wish you could just like for a week go into Washington and like be the head of the committee for making. What is it for the garbage collection. Making government smaller, like removing stuff.
1:15:57Elon MuskI have discussed with Trump the idea of a government efficiency commission.
1:16:01Lex FridmanNice. Yeah.
1:16:03Elon MuskAnd I would be willing to be part of that commission.
1:16:08Lex FridmanI wonder how hard that is.
1:16:11Elon MuskThe antibody reaction would be very strong.
1:16:13Lex FridmanYeah.
1:16:14Elon MuskSo you really have to. You're attacking the matrix at that point. Matrix will fight back.
1:16:26Lex FridmanHow are you doing with that being attacked?
1:16:29Elon MuskMe attacked?
1:16:30Lex FridmanYeah, there's a lot of it.
1:16:34Elon MuskYeah, there is a lot. I mean, every day another psyop, you
1:16:38Lex Fridmanknow,
1:16:41Elon Muskmy tinfoil hat.
1:16:42Lex FridmanHow do you keep your just positivity? How do you optimism about the world, a clarity of thinking about the world. So just not become resentful or cynical or all that kind of stuff.
1:16:51Lex FridmanJust getting attacked by, you know, very large number of people misrepresented.
1:16:55Elon MuskOh yeah. That's like lifelong. That's a daily occurrence.
1:16:58Lex FridmanYes.
1:16:59Elon MuskSo, I mean, it does get me down at times. I mean, it makes me sad, but.
1:17:12Elon MuskI mean, at some point you have to sort of say, look, the, the attacks are by people that actually don't know me. They're. And they're trying to generate clicks.
1:17:22Elon MuskSo if you can sort of detach yourself somewhat emotionally, which is not easy, and say, okay, look, this is not actually from someone that knows me, or is. They're literally just writing to get impressions and clicks, then I guess it doesn't hurt as much.
1:17:48Elon MuskIt's not quite water off a duck's back. Maybe it's like acid off a duck's back.
1:17:53Lex FridmanAll right, well, that's good. Just about your own life. What do you as a measure of success in your life?
1:17:58Elon MuskMeasure of success? I'd say how many useful things can
1:18:02Lex FridmanI get done day to day basis? You wake up in the morning, how can I be useful today?
1:18:09Elon MuskYeah, maximize utility area under the curve of usefulness. Very difficult to be useful at scale.
1:18:15Lex FridmanAt scale. Can you speak to what it takes to be useful for somebody like you? Where there's so many amazing great teams like, how do you allocate your time to be the most useful?
1:18:28Elon MuskWell, time, time is the. Time is the true currency.
1:18:31Lex FridmanYeah.
1:18:32Elon MuskSo it is tough to say what, what is the best allocation time. I mean there are, you know, often say, if you look at say Tesla, I mean, Tesla this year we'll do over 100 billion in revenue, so that's $2 billion a week.
1:18:51Elon MuskIf I make slightly better decisions, I can affect the outcome by a billion dollars. So then I try to do the best decisions I can. And on balance, at least compared to the competition, pretty good decisions.
1:19:09Elon MuskBut the marginal value of, of a better decision can easily be in the course of an hour, $100 million.
1:19:18Lex FridmanGiven that, how do you take risks? How do you do the algorithm that you mentioned? I mean deleting, given a small thing can be a billion dollars. How do you decide to?
1:19:32Elon MuskWell, I think you have to look at it on a percentage basis because if you look at it in absolute terms, I would never get any sleep. I would just be like, I need to just keep working and work my brain harder.
1:19:45Elon MuskAnd I'm not trying to get as much as possible out of this meat computer. So it's pretty hard because you can just work all the time. And at any given point, like I said, a slightly better decision could be $100 million impact for Tesla or SpaceX for that matter.
1:20:07Elon MuskBut it is wild when considering the marginal value of, of time can be $100 million an hour at times or more.
1:20:17Lex FridmanIs your own happiness part of that equation of success?
1:20:22Elon MuskIt has to be to some degree other than sad. If I'm depressed, I make worse decisions. So I can't have like, if I have zero recreational time, then I make worse decisions.
1:20:34Elon MuskSo I don't have a lot, but it's above zero. I mean, my motivation, if I've got a religion of any kind, is a religion of curiosity, of trying to understand, you know, it's really the mission of understand the universe.
1:20:48Elon MuskI'm trying to understand the universe or at least set things in motion such that at some point civilization understands the universe far better than we do today. And even what questions to ask, as Douglas Adams pointed out in his book, sometimes the answer is arguably the easy part.
1:21:11Elon MuskTrying to frame the question correctly is the hard part. Once you frame the question correctly, the answer is often easy. So I'm trying to set things in motion such that we are at least at some point able to understand the universe.
1:21:30Elon MuskSo for SpaceX, the goal is to make life multi planetary,
1:21:40Elon MuskWhich is, if you go to the Fermi Paradox of where are the aliens? You've got these sort of great filters. Why have we not heard from the aliens? Now a lot of people think there are aliens among us.
1:21:55Elon MuskI often claim to be one. Nobody believes me. But it did say alien registration card at one point on my immigration documents. So I've not seen any evidence of aliens.
1:22:09Elon MuskSo it suggests that at least one of the explanations is that intelligent life is extremely rare. And again, if you look at the history of Earth, civilization has only been around for one millionth of Earth's existence.
1:22:27Elon MuskSo if, you know, if aliens had visited here say 100,000 years ago, they would be like, well, they don't even have writing, you know, just hunter gatherers basically. So.
1:22:43Elon MuskHow long does a civilization last? So for SpaceX, the goal is to establish a self sustaining city on Mars. Mars is the only viable planet for such a thing.
1:22:58Elon MuskThe moon is close, but it lacks resources. And I think it's probably vulnerable to any calamity that takes out Earth. The moon is too close, it's vulnerable to a calamity that takes that Earth.
1:23:16Elon MuskSo not saying we shouldn't have a moon base, but Mars will be far more resilient. The difficulty of getting to Mars is what makes it resilient.
1:23:30Elon MuskSo but in going through these various explanations of why don't we see the aliens, why one of them is that they failed to pass these, these great filters, these key hurdles.
1:23:48Elon MuskAnd one of those hurdles is being a multi planet species. So if you're a multi planet species, then if something were to happen, whether that was a natural catastrophe or a man made catastrophe, at least the other planet would probably still be around.
1:24:06Elon MuskSo you're not like you don't have all the eggs in one basket. And once you are sort of a two planet species, you can obviously extend life perhaps to the asteroid belt to maybe to the moons of Jupiter and Saturn and ultimately to other star systems.
1:24:24Elon MuskBut if you can't even get to another planet, you're definitely not getting to
1:24:29Lex Fridmanstar systems and the other possible great builders, super powerful technology like AGI for example. So you're basically trying to knock out one great filter at a time.
1:24:44Elon MuskDigital superintelligence is possibly a great filter. I hope it isn't, but it might be, you know, guys like say Geoff Hinton would say, you know, has he invented a number of the key principles and artificial intelligence?
1:25:00Elon MuskI think he puts the probability of AI annihilation around 10 to 20%, something like that. So it's not like, look on the right side, it's 80% likely to be great.
1:25:19Elon MuskBut I think AI risk mitigation is important. Being a multi planet species would be a massive risk mitigation. And I do want to sort of once again emphasize the importance of having enough children to sustain our numbers and not plummet into population collapse, which is currently happening.
1:25:46Elon MuskPopulation collapse is a real and current thing. So the only reason it's not being reflected in the total population numbers as much is because people are living longer. But it's easy to predict, say what the population of any given country will be.
1:26:07Elon MuskYou just take the birth rate last year, how many babies were born, multiply that by life expectancy and that's what the population will be. Steady state, unless, if the birth rate continues to that level.
1:26:18Elon MuskBut if it keeps declining, it will be even less and eventually dwindle to nothing. So I keep banging on the baby drum here for a reason. Because it has been the source of civilizational collapse over and over again throughout history.
1:26:34Elon MuskAnd so why don't we just not try to stave off that day?
1:26:41Lex FridmanWell, in that way, I have miserably failed civilization. And I'm trying, hoping to fix that. I would love to have many kids.
1:26:50Elon MuskGreat, Hope you do. No time like the present.
1:26:55Lex FridmanYeah, I gotta allocate more compute to the whole process, but apparently it's not that difficult.
1:27:02Elon MuskNo, it's like unskilled labor.
1:27:06Lex FridmanWell, if I. One of the things you do for me, for the world, is to inspire us with what the future could be. And so some of the things we've talked about, some of the things you're building alleviating human suffering with neuralink and expanding the capabilities of the human mind, trying to build a colony on Mars.
1:27:28Lex FridmanSo creating a backup for humanity on another planet and exploring the possibilities of what artificial intelligence could be in this world, especially in the real world. AI with hundreds of millions, maybe billions of robots walking around.
1:27:45Elon MuskThere will be billions of robots. That seems virtual certainty.
1:27:50Lex FridmanWell, thank you for building the future and thank you for inspiring so many of us to keep building and creating cool stuff, including kids.
1:28:00Elon MuskYou're welcome. Go forth and multiply.
1:28:04Lex FridmanGo forth, multiply. Thank you, Yuan. Thanks for talking, brother. Thanks for listening to this conversation with Elon Musk. And now, dear friends, here's DJ Sa, the co founder, president and COO of neuralink.
1:28:19Lex FridmanWhen did you first become fascinated by the human brain?
1:28:23Neuralink teamFor me, I was always interested in understanding the purpose of things and how it was engineered to serve that purpose, whether it's organic or inorganic. Like we were talking earlier about your curtain holders, they serve a clear purpose and they were engineered with that purpose in mind.
1:28:46Neuralink teamAnd growing up, I had a lot of interest in seeing things, touching things, feeling things, and trying to really understand the root of how it was designed to serve that purpose.
1:28:59Neuralink teamAnd obviously, brain is just a fascinating organ that we all carry. It's infinitely powerful machine that has intelligence and cognition that arise from it. And we haven't even scratched the surface in terms of how all of that occurs.
1:29:16Neuralink teamBut also at the same time, I think it took me a while to make that connection to really studying and building tech to understand the brain. Not until graduate school.
1:29:26Neuralink teamThere were a couple moments, key moments in My life, where some of those, I think, influence how the trajectory of
1:29:34Elon Muskmy life
1:29:36Neuralink teamgot me to studying what I'm doing right now. One was growing up both sides of my family. My grandparents had a very severe form of Alzheimer and it's incredibly debilitating conditions.
1:29:53Neuralink teamI mean, literally you're seeing someone's whole identity and their mind just losing over time. And I just remember thinking how both the power of the mind, but also how something like that could really lose your sense of identity.
1:30:09Lex FridmanIt's fascinating that that is one of the ways to reveal the power of a thing by watching it lose the power.
1:30:17Neuralink teamYeah. A lot of what we know about the brain actually comes from these cases where there are trauma to the brain or some parts of the brain that led someone to lose certain abilities.
1:30:29Neuralink teamAnd as a result there's some correlation and understanding of that part of the tissue being critical for that function. And it's an incredibly fragile organ, if you think about it that way.
1:30:42Neuralink teamBut also it's incredibly plastic and incredibly resilient in many different ways.
1:30:46Lex FridmanAnd by the way, the term plastic is, we'll use a bunch means that it's adaptable. So neuroplasticity refers to the adaptability of the human brain.
1:30:56Elon MuskCorrect.
1:30:58Neuralink teamAnother key moment that sort of influenced how the trajectory of my life have shaped towards the current focus of my life has been during my teenage year when I came to the us I didn't speak a word of English.
1:31:12Neuralink teamThere was a huge language barrier and there was a lot of struggled to kind of connect with my peers around me because I didn't understand the artificial construct that we have created called language, specifically English in this case.
1:31:27Neuralink teamAnd I remember feeling pretty isolated, not being able to connect with peers around me. So I spent a lot of time just on my own, reading books, watching movies.
1:31:37Neuralink teamAnd I naturally sort of gravitated towards sci fi books. I just found them really, really interesting. And also it was a great way for me to learn English. Some of the first set of books that I picked up are Ender's Game, the Whole Saga by Orson Scott Card and Neuromancer from William Gibson and Snow Crash from Neal Stephenson.
1:32:00Neuralink teamAnd movies like Matrix was coming out around that time point that really influence how I think about the potential impact that technology can have for our lives in general.
1:32:11Neuralink teamSo fast track to my college years. I was always fascinated by just physical stuff, building physical stuff, and especially physical things that had some sort of intelligence. And I studied electrical engineering during undergrad and I started out my research in mems, so microelectromechanical systems and really building these tiny nanostructures for temperature sensing.
1:32:37Neuralink teamAnd I just found that to be just incredibly rewarding and fascinating subject to just understand how you can build something miniature like that that again served a function and had a purpose.
1:32:48Neuralink teamAnd then I spent large majority of my college years basically building millimeter wave circuits for next gen telecommunication systems for imaging. And it was just something that I found very, very intellectually interesting.
1:33:04Neuralink teamPhase arrays, how the signal processing works for any modern as well as next gen telecommunication system. Wireless and wireline EM waves or electromagnetic waves are fascinating. How do you design antennas that are most efficient in a small footprint that you have?
1:33:23Neuralink teamHow do you make these things energy efficient? That was something that just consumed my intellectual curiosity. And that journey led me to actually apply to and find myself in PhD program at UC Berkeley at kind of this consortium called the Berkeley Wireless Research center that was precisely looking at building at the time, we called it XG, similar to 3G, 4G, 5G, but the next next generation G system and how you would design circuits around that to ultimately go on phones and basically any other devices that are wirelessly connected these days.
1:33:58Neuralink teamSo I was just absolutely just fascinated by how that entire system works and that infrastructure works. And then also during grad school I had sort of the fortune of having a couple research fellowships that led me to pursue whatever project that I want.
1:34:17Neuralink teamAnd that's one of the things that I really enjoyed about my graduate school career, where you got to kind of pursue your intellectual curiosity in the domain that may not matter at the end of the day, but is something that really allows you the opportunity to go as deeply as you want as well as widely as you want.
1:34:36Neuralink teamAnd at the time I was actually working on this project called the Smart Band Aid. And the idea was that when you get a wound, there's a lot of other kind of proliferation of signaling pathway that cells follow to close that wound.
1:34:51Neuralink teamAnd there were hypotheses that when you apply external electric field, you can actually accelerate the closing of that field by having basically electro taxing of the cells around that wound site.
1:35:06Neuralink teamAnd specifically not just for normal wound, there are chronic wounds that don't heal. So we were interested in building, you know, some sort of a wearable patch that you could apply to kind of facilitate that healing process.
1:35:20Neuralink teamAnd that was in collaboration with Professor Michelle Mahuravitz, which was a great addition to kind of my thesis committee and it really shaped rest of my PhD career.
1:35:33Lex FridmanSo this would be the first time you interacted with biology, I suppose.
1:35:36Neuralink teamCorrect, correct. I mean, there were some peripheral end application of the wireless imaging and telecommunication system that I was using for security and bioimaging. But this was a very clear direct application to biology and biological system and understanding the constraints around that and really designing and engineering electrical solutions around it.
1:36:02Neuralink teamSo that was my first introduction. And that's also kind of how I got introduced to Michel. He's sort of known for remote control of beetles in the early 2000s and then around 2013.
1:36:20Neuralink teamObviously kind of the holy grail when it comes to implantable system is to kind of understand how small of a thing you can make. And a lot of that is driven or how much power you can supply to it and how you extract data from it.
1:36:36Neuralink teamSo at the time at Berkeley, there was kind of this desire to kind of understand in the neural space
1:36:44Elon Muskwhat
1:36:44Neuralink teamsort of system you can build to really miniaturize these implantable systems. And I distinctively remember this one particular meeting where Michel came in and he's like, guys, I think I have a solution.
1:36:58Neuralink teamThe solution is ultrasound. And then he proceeded to kind of walk through why that is the case. And that really formed the basis for my thesis work called Neural Dust System that was looking at ways to use ultrasound as opposed to electromagnetic waves for powering as well as communication.
1:37:20Neuralink teamI guess I should step back and say the initial goal of the project was to build these tiny, about the size of a neuron implantable system that can be parked next to a neuron, being able to record its state and being able to ping that back to the outside world for doing something useful.
1:37:38Neuralink teamAnd as I mentioned, the size of the implantable system is limited by how you power the thing and get the data off of it. And at the end of the day, fundamentally, if you look at a human body were essentially a bag of salt water with some interesting proteins and chemicals, but it's mostly salt water that's very, very well temperature regulated at 37 degrees Celsius.
1:38:05Neuralink teamAnd we'll get into. And later why that's an extremely harsh environment for any electronics to survive. As I'm sure you've experienced, or maybe not experienced, dropping cell phone in a salt water in an ocean, it will instantly kill the device.
1:38:21Elon MuskRight.
1:38:23Neuralink teamBut anyways, just in general, electromagnetic waves don't penetrate through this environment well and just the speed of light. It is what it is, we can't change it. And based on the wavelength at which you are interfacing with the device, the device just needs to be big like these inductors.
1:38:45Neuralink teamNeeds to be quite big. And the general good rule of thumb is that you want the wavefront to be roughly on the order of the size of the thing that you're interfacing with.
1:38:56Neuralink teamSo an implantable system that is around 10 to 100 micron in dimension, in a volume which is about the size of a neuron that you see in a human body, you would have to operate at like hundreds of gigahertz, which, number one, not only is it difficult to build electronics operating at those frequencies, but also the body just attenuates that very, very significantly.
1:39:23Neuralink teamSo the interesting kind of insight of this ultrasound was the fact that ultrasound just travels a lot more effectively in the human body tissue compared to electromagnetic waves. And this is something that you encounter, and I'm sure most people have encountered in their lives when you go to hospitals that are medical ultrasound sonograph and they go into very, very deep depth without attenuating too much of the signal.
1:39:58Neuralink teamSo all in all, ultrasound, the fact that it travels through the body extremely well and the mechanism to which it travels to the body really well is that just the wavefront is very different.
1:40:12Neuralink teamElectromagnetic waves are transverse, whereas in ultrasound waves are compressive. So it's just a completely different mode of wavefront propagation. And as well as speed of sound is orders and orders of magnitude less than speed of light.
1:40:29Neuralink teamWhich means that even at 10 MHz ultrasound wave, your wavefront ultimately is a very, very small wavelength. So if you're talking about interfacing with the 10 micron or 100 micron type structure, you would have 150 micron wavefront at 10 MHz.
1:40:49Neuralink teamAnd building electronics at those frequencies are much, much easier and they're a lot more efficient. So the basic idea kind of was born out of using ultrasound as a mechanism for powering the device and then also getting data back.
1:41:06Neuralink teamSo now the question is, how do you get the data back? The mechanism to which we landed on is what's called backscattering. This is actually something that is very common and that we interface on a day to day basis with our RFID cards, radio frequency ID tags, where there's actually rarely in your ID a battery.
1:41:27Neuralink teamInside there's an antenna and there's some sort of coil that has your serial identification id. And then there's an external device called a reader that then sends a wavefront and then you reflect back that wavefront with some sort of modulation that's unique to your id.
1:41:47Neuralink teamThat's what's called backscattering, fundamentally. So the tag itself Actually doesn't have to consume that much energy. And that was a mechanism to which we were kind of thinking about sending the data back.
1:42:00Neuralink teamSo when you have an external ultrasonic transducer that's sending ultrasonic wave to your implant, the neural dust implant, and it records some information about its environment, whether it's a neuron firing or some other state of the tissue that it's interfacing with.
1:42:21Neuralink teamAnd then it just amplitude modulates the wavefront that comes back to the source.
1:42:27Lex FridmanAnd the recording step would be the only one that requires any energy. So what would require energy in that little step?
1:42:33Neuralink teamCorrect. So it is that initial kind of startup circuitry to get that recording, amplifying it, and then just modulating. And the mechanism to which that you can enable that is there is this specialized crystal called piezoelectric crystals that are able to convert sound energy into electrical energy and vice versa.
1:42:55Neuralink teamSo you can kind of have this interplay between the ultrasonic domain and electrical domain that is the biological tissue.
1:43:04Lex FridmanSo on the theme of parking very small computational devices next to neurons, that's the dream, the vision of brain computer interfaces. Maybe before we talk about neuralink, can you give a sense of the history of the field of bci?
1:43:21Lex FridmanWhat has been maybe the continued dream and also some of the milestones along the way with the different approaches and the amazing work done at the various labs.
1:43:33Neuralink teamI think a good starting point is going back to 1790s. I did not expect that where the concept of animal electricity or the fact that bodies electric was first discovered by Luigi Galbani, where he had this famous experiment where he connected set of electrodes to a frog leg and ran current through it.
1:43:59Neuralink teamAnd then it started twitching and he said, oh my goodness, body's electric.
1:44:03Elon MuskYeah.
1:44:04Neuralink teamSo fast forward many, many years to 1920s, where Hansberger, who is a German psychiatrist, discovered EEG or electroencephalography, which is still around. There are these electric arrays that you wear outside the skull that gives you some sort of neural recording.
1:44:23Neuralink teamThat was a very, very big milestone that you can record some sort of activities about the human mind. And then in the 1940s, there were these group of scientists, Renshaw, Forbes and Morrison, that inserted these glass microelectrodes into the cortex and recorded single neurons.
1:44:47Neuralink teamThe fact that there's signals that are a bit more high resolution and high fidelity as you get closer to the source, let's say. And in the 1950s, these two scientists, Hodgkin and Huxley, showed up and they built this beautiful, beautiful models of the cell Membrane and the ionic mechanism and had these circuit diagram.
1:45:12Neuralink teamAnd as someone who's an electrical engineer, it's a beautiful model that's built out of these partial differential equations talking about flow of ions and how that really leads to how neurons communicate.
1:45:25Neuralink teamAnd they won the Nobel prize for that 10 years later in the 1960s. So in 1969, Ed Fetz from University of Washington published this beautiful paper called operant conditioning of cortical unit activity, where he was able to record a single unit neuron from a monkey and was able to have the monkey modulated based on its activity and reward system.
1:45:52Neuralink teamSo I would say this is the very, very first example, as far as I'm aware, of closed loop brain computer interface, or bci.
1:46:01Lex FridmanThe abstract reads the activity of single neurons in pre central cortex of anesthetized monkeys was conditioned by reinforcing high rates of neuronal discharge with delivery of a food pellet.
1:46:15Lex FridmanAuditory and visual feedback of unit firing rates was usually provided in addition to food reinforcement. Cool. So they actually got it done.
1:46:24Neuralink teamThey got it done. This is back in 1969.
1:46:30Lex FridmanAfter several training sessions, Monkeys could increase the activity of newly isolated cells by 50 to 500% above rates before reinforcement. Fascinating.
1:46:41Neuralink teamBrain is very plastic.
1:46:44Lex FridmanAnd so. And so from here, the number of experiments grew. Yeah.
1:46:49Neuralink teamNumber of experiments, as well as set of tools to interface with the brain have just exploded. And also just understanding the neural code and how some of the cortical layers and the functions are organized.
1:47:03Neuralink teamSo the other paper that is pretty seminal, especially in the motor decoding, was this paper in the 1980s from Georgiaopoulos that discovered that there is this thing called motor tuning curve.
1:47:20Neuralink teamSo what are motor tuning curves? It's the fact that there are neurons in the motor cortex of mammals, including humans, that have a preferential direction that causes them to fire.
1:47:32Neuralink teamSo what that means is there are a set of neurons that would increase their spiking activities when you're thinking about moving to the left, right, up, down, and any of those vectors.
1:47:46Neuralink teamAnd based on that, you could start to think, well, if you can identify those essential eigenvectors, you can do a lot. And you can actually use that information for actually decoding someone's intended movement from the cortex.
1:48:00Neuralink teamSo that was a very, very seminal kind of paper that showed that there is some sort of code that you can extract, especially in the motor cortex.
1:48:11Lex FridmanSo there's signal there, and if you measure the electrical signal from the brain, that you could actually figure out what the intention was, correct?
1:48:21Neuralink teamYeah. Not only electrical signals, but electrical Signals from the right set of neurons that give you these preferential direction.
1:48:29Lex FridmanOkay, so going slowly towards neuralink. One interesting question is what do I understand on the BCI front on invasive versus non invasive from this line of work? How important is it to park next to the neuron?
1:48:47Lex FridmanWhat does that get you?
1:48:49Neuralink teamThat answer fundamentally depends on what you want to do with it.
1:48:52Elon MuskRight.
1:48:53Neuralink teamThere's actually incredible amount of stuff that you can do with EEG and electrocortiograph ecog, which actually doesn't penetrate the cortical layer or parenchyma, but you place a set of electrodes on the surface of the brain.
1:49:08Neuralink teamSo the thing that I'm personally very interested in is just actually understanding and being able to just really tap into the high resolution, high fidelity understanding of the activities that are happening at the local level.
1:49:23Neuralink teamAnd we can get into biophysics. But just to step back, to use analogy, because analogy here can be useful sometimes it's a little bit difficult to think about electricity.
1:49:34Neuralink teamAt the end of the day, we're doing electrical recording that's mediated by ionic currents, movements of these charged particles, which is really, really hard for most people to think about.
1:49:45Neuralink teamBut turns out a lot of the activities that are happening in the brain and the frequency band with which that's happening is actually very, very similar to sound waves and our normal conversation audible range.
1:50:01Neuralink teamSo the analogy that typically is used in the field is if you have a football stadium, there's game going on. If you stand outside the stadium, you maybe get a sense of how the game is going based on the cheers and the boos of the home crowd, whether the team is winning or not.
1:50:18Neuralink teamBut you have absolutely no idea what the score is. You have absolutely no idea what individual audience or the players are talking or saying to each other, what the next play is, what the next goal is.
1:50:32Neuralink teamSo what you have to do is you have to drop the microphone near into the stadium and then get near the source, like into the individual chatter. In this specific example, you would want to have it right next to where the huddle's happening.
1:50:47Neuralink teamSo I think that's kind of a good illustration of what we're trying to do when we say invasive or minimally invasive or implanted brain computer interfaces versus non invasive or non implanted brain interfaces.
1:51:02Neuralink teamIt's basically talking about where do you put that microphone and what can you do with that information.
1:51:07Lex FridmanSo what is the biophysics of the read and write communication that we're talking about here as we now step into the efforts at neuralink?
1:51:18Neuralink teamYeah, so brain is made up of these specialized cells called neurons. There's billions of them, tens of billions, sometimes people call it 100 billion that are connected in this complex yet dynamic network that are constantly remodeling, they're changing their synaptic weights and that's, you know, what we typically call neuroplasticity.
1:51:46Neuralink teamAnd the neurons are also bathed in this charged environment that is latent with many charged molecules like potassium ions, sodium ions, chlorine ions, and those actually facilitate these through ionic current communication between these different networks.
1:52:08Neuralink teamAnd when you look at the, look at a neuron as well, they have these membrane with a beautiful, beautiful protein structure called the voltage selective ion channels, which in my opinion is one of nature's best inventions in many ways.
1:52:27Neuralink teamIf you think about what they are, they're doing the job of a modern day transistors. Transistors are nothing more at the end of the day than a voltage gated conduction channel.
1:52:37Neuralink teamAnd nature found a way to have that very, very early on in its evolution. And as we all know with the transistor you can have many, many computation and a lot of amazing things that we have access to today.
1:52:52Neuralink teamSo I think it's one of those, just as a tangent, just a beautiful, beautiful invention that the nature came up with these voltage gated ion channels.
1:53:02Lex FridmanI mean, I suppose there is on the biological level, at every level of the complexity of the hierarchy of the, of the organism, there's going to be some mechanisms for storing information and for doing computation.
1:53:14Lex FridmanAnd this is just one such way. But to do that with biological and chemical components is interesting. Plus like when neurons, I mean it's not just electricity, it's chemical communication.
1:53:28Lex FridmanIt's also mechanical. I mean these are like actual objects that have like that vibrate, I mean they move.
1:53:36Neuralink teamYeah, they're actually, I mean there's a lot of really, really interesting physics that, that, that are involved. And you know, kind of going back to my work on ultrasound during grad school, there there are groups and there were groups and there are still groups looking at ways to cause neurons to actually fire an action potential using ultrasound wave.
1:53:59Neuralink teamAnd the mechanism to which that's happening is still unclear. As I understand. It may just be that you're imparting some sort of thermal energy and that causes cells to depolarize in some interesting ways.
1:54:11Neuralink teamBut there are also these ion channels or even membranes that actually just open up as pore as they're being mechanically like shook.
1:54:20Lex FridmanRight vibrated.
1:54:21Neuralink teamSo there's just a lot of, you know, elements of these like Move particles which again, like that's governed by diffusion physics. Right, Movements of particles. And there's also a lot of kind of interesting physics there also, not to
1:54:36Lex Fridmanmention, as Roger Penrose talks about the, there might be some beautiful weirdness in the quantum mechanical effects of this. And he, he actually believes that consciousness might emerge from the quantum mechanical effects there.
1:54:49Lex FridmanSo like there's physics, there's chemistry, there's biology, all of that is going on there.
1:54:54Neuralink teamOh yeah, yeah. I mean you can, yes, there's a lot of levels of physics that you can dive into. But yeah, in the end you have these membranes with these voltage gated ion channels that selectively let these charged molecules that are in the extracellular matrix like in and out.
1:55:15Neuralink teamAnd these neurons generally have these resting potential where there's a voltage difference between inside the cell and outside the cell. And when there's some sort of stimuli that changes the state such that they need to send information to the downstream network, you start to kind of see these orchestration of these different molecules going in and out of these channels.
1:55:44Neuralink teamThey also open up like more of them open up once it reaches some threshold to a point where you have a depolarizing cell that sends an action potential. So it's just a very beautiful kind of orchestration of these molecules.
1:55:59Lex FridmanAnd
1:56:01Neuralink teamwhat we're trying to do when we place an electrode or parking it next to a neuron is that you're trying to measure these local changes in the potential, again mediated by the movements of the ions.
1:56:17Neuralink teamAnd what's interesting, as I mentioned earlier, there's a lot of physics involved. And the two dominant physics for this electrical recording domain is diffusion physics and electromagnetism. And where one dominates, where Maxwell's equation dominates versus Fick's law dominates, depends on where your electrode is.
1:56:42Neuralink teamIf it's close to the source, mostly electromagnetic based, when you're farther away from it, it's more diffusion based. So essentially when you're able to park it next to it, you can listen in on those individual chatter and those local changes in the potential and the type of signal that you get are these canonical textbook neural spiking waveform.
1:57:08Neuralink teamThe moment you're further away. And based on some of the studies that people have done, Christophe Koch's lab and others, once you're away from that source by roughly around 100 micron, which is about width of a human hair, you no longer hear from that neuron, you're no longer able to kind of have the system sensitive enough to be able to record that particular local Membrane potential change in that neuron.
1:57:36Neuralink teamAnd just to kind of give you a sense of scale also when you look at a 100 micron voxel, so 100 micron by 100 micron by 100 micron box in a brain tissue, there's roughly around 40 neurons and whatever number of connections that they have.
1:57:51Neuralink teamSo there's a lot in that volume of tissue. So the moment you're outside of that, there's just no hope that you'll be able to detect that change from that one specific neuron that you may care about.
1:58:03Lex FridmanYeah, but as you're moving about this space, you'll be hearing other ones. So if you move another 100 micron, you'll be hearing chatter from another community.
1:58:12Neuralink teamCorrect.
1:58:14Lex FridmanAnd so the whole sense is you want to place as many as possible electrodes and then you're listening to the chatter.
1:58:20Neuralink teamYeah, you want to listen to the chatter. And at the end of the day you also want to, to basically let the software do the job of decoding and just to kind of go to why ECoG and EEG work at all when you have these local changes.
1:58:38Neuralink teamObviously it's not just this one neuron that's activating. There's many, many other networks that are activating all the time. And you do see sort of a general change in the potential of this electro, like this is charged medium and that's what you're recording when you're farther away.
1:58:54Neuralink teamI mean, you still have some reference electrode that's stable and the brain that's just electroactive organ and you're seeing some combination aggregate action potential changes and then you can pick it up.
1:59:07Lex FridmanRight.
1:59:07Neuralink teamIt's a much slower changing signals, but there are these canonical kind of oscillations and waves like gamma waves, beta waves, like when you sleep, that can be detected because there's sort of a synchronized kind of global effect of the brain that you can detect.
1:59:29Neuralink teamAnd I mean the physics of this go, if we really want to go down that rabbit hole, there's a lot that goes on in terms of why diffusion physics at some point dominates when you're further away from the source, it's just a charged medium.
1:59:45Neuralink teamSo similar to how when you have electromagnetic waves propagating in atmosphere or in a charged medium like a plasma, there's this weird shielding that happens that actually further attenuates the signal as you move away from it.
2:00:00Elon MuskSo, yeah, you see, if you do a really, really deep dive on kind of the signal attenuation over distance, you start to see kind of 1 over r squared in the beginning and then exponential drop off.
2:00:11Elon MuskAnd that's the knee at which you go from electromagnet magnetism dominating to diffusion physics dominating.
2:00:19Lex FridmanBut once again, with the electrodes, the biophysics that you need to understand is not as deep because no matter where you're placing that, you're listening to a small crowd of local neurons, correct?
2:00:32Elon MuskYeah. So once you penetrate the brain, you know, you're in the arena, so to
2:00:36Lex Fridmanspeak, and there's a lot of neurons.
2:00:38Elon MuskThere are many, many of them.
2:00:40Lex FridmanBut then again, there's like, there's a whole field of neuroscience that's studying, like, how the different groupings, the different sections of the seating in the arena, what they usually are responsible for, which is where the, the metaphor probably falls apart because the.
2:00:53Lex FridmanThe seating is not that organized in an arena.
2:00:56Elon MuskAlso, most of them are silent. They don't really do much, you know, or, or they, their activities are, you know, you have to hit it with just the right set of stimulus.
2:01:07Lex FridmanSo they're usually quiet.
2:01:08Elon MuskThey're usually very quiet. Quiet. There's, I mean, similar to dark energy and dark matter, there's dark neurons. What are they all doing? When you place these electrode, again, like within this 100 micron volume, you have 40 or so neurons.
2:01:21Elon MuskLike, why, why do you not see 40 neurons? Why do you see only a handful of what is happening there?
2:01:25Lex FridmanWell, they're mostly quiet, but, like, when they speak, they say profound. I think that's the way I'd like to think about it. Anyway, before we zoom in even more, let's zoom out.
2:01:35Lex FridmanSo how does neuralink work? From the surgery to the implant to the signal and the decoding process, and the human being able to use the implant actually affect the world outside.
2:01:56Lex FridmanAnd all of this I'm asking in the context of there's a gigantic historic milestone that neuralink just accomplished in January of this year. Putting a neuralink implant in the first human being, Noland.
2:02:11Lex FridmanAnd there's been a lot to talk about there, about his experience, because he's able to describe all the nuance and the beauty and the fascinating complexity of that experience, of everything involved.
2:02:22Lex FridmanBut on the technical level, how does neuralink work?
2:02:25Elon MuskYeah. So there are three major components to the technology that we're building. One is the device, the thing that's actually recording these neural chatters. We call it N1 implant, or the link.
2:02:40Elon MuskAnd we Have a surgical robot that's actually doing an implantation of these tiny, tiny wires that we call threads that are smaller than human hair. And once everything is surgerized, you have these neural signals, these spiking neurons that are coming out of the brain.
2:02:59Elon MuskAnd you need to have some sort of software to decode what the users intend to do with that. So there's what's called a NeuroLink application, or B1 app that's doing that translation.
2:03:12Elon MuskIt's running the very, very simple machine learning model that decodes these inputs that are neural signals and then convert it to a set of outputs that allows our participant, first participant Nolan, to be able to control a cursor.
2:03:30Lex FridmanAnd this is done wirelessly.
2:03:33Elon MuskAnd this is done wirelessly. So our implant is actually two part. The link has these flexible tiny wires called threads that have multiple electrodes along its length, and they're only inserted into the cortical layer, which is about 3 to 5 millimeters in a human brain in the motor cortex region.
2:03:59Elon MuskThat's where the kind of the intention for movement lies in. And we have 64 of these threads, each thread having 16 electrodes along the span of 3 to 4 millimeters separated by 200 microns.
2:04:13Elon MuskSo you can actually record along the depth of the insertion. And based on that signal, there's custom integrated circuit, or asic, that we built that amplifies the neural signals that you're recording and then digitizing it, and then has some mechanism for detecting whether there was an interesting event that is a spiking event and decide to send that or not send that through Bluetooth to an external device, whether it's a phone or a computer that's running this neuralink application.
2:04:50Lex FridmanSo there's onboard signal processing already just to decide whether this is an interesting event or not. So there is some computational power on board inside the. In addition to the human brain.
2:05:00Lex FridmanYeah.
2:05:00Elon MuskSo it does the signal processing to kind of really compress the amount of signal that you recording. So we have a total of thousand electrodes sampling at just under 20 kilohertz with 10 bit each.
2:05:14Elon MuskSo that's 200 megabits that's coming through to the chip from thousand channel simultaneous neural recording. And that's quite a bit of data. And there are technology available to send that off wirelessly.
2:05:31Elon MuskBut being able to do that in a very, very thermally constrained environment, that is a brain. So there has to be some amount of compression that happens to send off only the interesting data that you need, which in this particular case, for motor decoding, is occurrence of a spike or not.
2:05:50Elon MuskAnd then being able to use that to decode the intended cursor movement. So the implant itself processes it figures out whether a spike happened or not with our spike detection algorithm and then sends it off packages.
2:06:07Elon MuskIt sends it off through Bluetooth to an external device that then has the model to decode. Okay. Based on these spiking inputs, did Nolan wish to go up, down, left, right, or click or right click or whatever?
2:06:23Lex FridmanAll of this is really fascinating, but let's stick on the N1 implant itself. So the thing that's in the brain, so I'm looking at a picture of it, there's an enclosure, there's a charging coil.
2:06:34Lex FridmanSo we didn't talk about the charging, which is fascinating. The battery, the power electronics, the antenna. Then there's the signal processing electronics. I wonder if there's more kinds of signal processing.
2:06:48Lex FridmanYou can do it. That's, that's another, that's another question. And then there's the threads themselves with the enclosure on the bottom. So maybe to ask about the charging. There's an external charging device.
2:07:03Elon MuskYeah, there's an external charging device. So, yeah. The second part of the implant, the threads are the ones, again, just the last 3 to 5 millimeters are the ones that are actually penetrating the cortex.
2:07:16Elon MuskRest of it is actually most of the volume is occupied by the battery, rechargeable battery. And it's about a size of a quarter. I actually have a device here if you want to take a look at it.
2:07:32Elon MuskThis is the flexible thread component of it. And then this is the implant. So it's about a size of a U.S. quarter. It's about 9 millimeter thick. So basically this implant, once you have the craniectomy and the thurectomy threads are inserted and the hole that you created, this craniectomy gets replaced with that.
2:07:57Elon MuskSo basically that thing plugs that hole and you can screw in these self drilling cranial screws to hold it in place. And at the end of the day, once you have the skin flap over, there's only about 2 to 3 millimeters.
2:08:13Elon MuskThat's obviously transitioning off of the top of the implant to where the screws are. And that's the minor bump that you have.
2:08:22Lex FridmanThose threads look tiny. That's incredible. That is really incredible. That is really incredible. And also, as you're right, most of the volume, actual volume, is the battery.
2:08:35Elon MuskYeah.
2:08:35Lex FridmanWow. This is way smaller than I realized.
2:08:38Elon MuskThey are also the threads themselves are quite strong.
2:08:41Lex FridmanThey look strong.
2:08:42Elon MuskAnd the thread themselves also has a Very interesting feature at the end of it called the loop. And that's the mechanism to which the robot is able to interface and manipulate this tiny hair like structure.
2:08:55Lex FridmanAnd they're tiny. So what's the width of a thread?
2:08:58Elon MuskYeah, so the width of a thread starts from 16 micron and then tapers out to about 84 micron. So average human hair is about 80 to 100 micron in width.
2:09:13Lex FridmanThis thing is amazing. This thing is amazing.
2:09:16Elon MuskYes. Most of the volume is occupied by the, by the battery rechargeable lithium ion cell. And the charging is done through inductive charging, which is actually very commonly used.
2:09:30Elon MuskYou know your cell phone, most cell phones have that. The biggest difference is that, you know, for us, usually when you have a phone and you want to charge it on a charging pad, you don't really care how hot it gets.
2:09:42Elon MuskWhereas for us it matters. There's a very strict regulation and good reasons to not actually increase the surrounding tissue temperature by 2 degrees Celsius. So there's actually a lot of innovation that is packed into this to allow charging of this implant without causing that temperature threshold to reach.
2:10:03Elon MuskAnd even small things like you see this charging coil and what's called a ferrite shield.
2:10:08Lex FridmanRight.
2:10:09Elon MuskSo without that ferrite shield, what you end up having when you have resonant inductive charging is that the battery itself is a metallic can and you form these eddy currents from external charger and that causes heating and that actually contributes to inefficiency in charging.
2:10:32Elon MuskSo this ferrite shield, what it does is that it actually concentrate that field line away from the battery and then around the coil that's actually wrapped around it.
2:10:42Lex FridmanThere's a lot of really fascinating design here to make it. I mean, you're integrating a computer into a biological, a complex biological system.
2:10:52Elon MuskYeah, there's a lot of innovation here. I would say that part of what enabled this was just the innovations in the wearable. There's a lot of really, really powerful, tiny, low power microcontrollers, temperature sensors, or various different sensors and power electronics.
2:11:13Elon MuskA lot of innovation really came in the charging coil design. How this is packaged and how do you enable charging such that you don't really exceed that temperature limit, which is not a constraint for other devices out there.
2:11:27Lex FridmanSo let's talk about the threads themselves. Those tiny, tiny, tiny things. So how many of them are there? You mentioned 1,000 electrodes. How many threads are there? And what do the electrodes have to do with the threads?
2:11:41Elon MuskYeah. So the current instantiation of the device has 64 threads and each thread has 16 electrodes for a total of 1024 electrodes are capable of both recording and stimulating.
2:11:58Elon MuskAnd the thread is basically this polymer insulated wire. The metal conductor is the kind of a tiramisu cake of gold platai. And they're very, very tiny wires 2 micron in width.
2:12:21Elon MuskSo 2, 1 millionth of meter.
2:12:25Lex FridmanIt's crazy that that thing I'm looking at has the polymer insulation, has the conducting material and has 16 electrodes at the end of it.
2:12:34Elon MuskOn each of those thread.
2:12:35Lex FridmanYeah, on each of those threads.
2:12:36Elon MuskCorrect.
2:12:37Lex Fridman16. Each one of those.
2:12:38Elon MuskYou're not going to see it with naked eyes.
2:12:41Lex FridmanAnd I mean, to state the obvious, or maybe for people who are just listening, they're flexible.
2:12:47Elon MuskYes. That's also one element that was incredibly important for us. So each of these thread are as I mentioned, 16 micron in width and then they taper to 84 micron.
2:12:59Elon MuskBut in thickness they're less than 5 micron. And in thickness it's mostly polyimide at the bottom and this metal track and then another polyimide. So 2 micron of polyimide, 400 nanometer of this metal stack and 2 micron of polyimide sandwiched together to protect it from the environment that is 37 degrees C.
2:13:24Elon MuskBag of salt water.
2:13:25Lex FridmanSo what's some. Maybe can you speak to some interesting aspects of the material design here, like what does it take to design a thing like this and to be able to manufacture a thing like this for people who don't know anything about this kind of thing?
2:13:40Elon MuskYeah. So the material selection that we have is not. I don't think it was particularly unique. There were other labs and there are other labs that are kind of looking at similar material stack.
2:13:55Elon MuskThere's kind of a fundamental question and still needs to be answered around the longevity and reliability of these microelectrodes that we call compared to some of the other more conventional neural interfaces devices that are intracranial so penetrating the cortex, that are more rigid, you know, like the Utah ray that are these 4 by 4 millimeter kind of silicon shank that have exposed recording site at the end of it.
2:14:27Elon MuskAnd you know, that's been kind of the innovation from Richard Norman back in 1997. It's called the Youth Array because he was at University of Utah.
2:14:36Lex FridmanAnd what does the Utah Array look like? So it's a rigid type of.
2:14:40Elon MuskYeah, so we can actually look it up. Yeah, yeah. So it's a bed of needle. There's.
2:14:52Lex FridmanOkay, go Ahead. I'm sorry, those are rigid.
2:14:54Elon MuskRigid.
2:14:55Lex FridmanRigid. Rigid. Yeah, you weren't kidding.
2:14:56Elon MuskAnd the size and the number of shanks vary anywhere from 64 to 128. At the very tip of it is an exposed electrode that actually records neural signal. So the other thing that's interesting to note is that unlike neural link threads that have recording electrodes that are actually exposed iridium oxide recording sites along the depth, this is only at a single depth.
2:15:20Elon MuskSo these Utah array spokes can be anywhere between 0.5 millimeter to 1.5 millimeter. And they also have designs that are slanted, so you can have it inserted at different depth.
2:15:32Elon MuskBut that's one of the other big differences. And then, I mean, the main key difference is the fact that there's no active electronics. These are just electrodes. And then there's a bundle of a wire that you're seeing, and then that actually then exits the craniectomy that then has this port that you can connect to.
2:15:51Elon MuskFor any external electronic devices, they are working on a, or have the wireless telemetry device, but it still requires through the skin port. That actually is one of the biggest failure modes for infection for the system.
2:16:06Lex FridmanWhat are some of the challenges associated with flexible threads? Like for example, on the robotic side, R1 implanting those threads, how difficult is that task?
2:16:19Elon MuskYeah, so as you mentioned, they're very, very difficult to maneuver by hand. These youth arrays that you saw earlier, they're actually inserted by a neurosurgeon, actually positioning it near the site that they want.
2:16:33Elon MuskAnd then there's a pneumatic hammer that actually pushes them in. So it's a pretty simple process and they're easy to maneuver. But for these thin film arrays, they're very, very tiny and flexible.
2:16:50Elon MuskSo they're very difficult to maneuver. So that's why we built an entire robot to do that. There are other reasons for why we built the robot, and that is ultimately, we want this to help millions and millions of people that can benefit from this.
2:17:04Elon MuskAnd there just aren't that many neurosurgeons out there. And robots can be something that we hope can actually do large parts of the surgery. But the robot is this entire other sort of category of product that we're working on.
2:17:26Elon MuskAnd it's essentially this multi axis gantry system that has the specialized robot head that has all of the optics and this kind of a needle retracting mechanism that maneuvers these threads via this loop structure that you have on the thread.
2:17:52Lex FridmanSo the thread already has a loop structure by which you can grab it.
2:17:55Elon MuskCorrect, Correct.
2:17:56Lex FridmanSo this is fascinating. So you mentioned optics. So there's a robot R1. So for now there's a human that actually creates a hole in the skull. And then after that there's a computer vision component that's finding a way to avoid the blood vessels.
2:18:18Lex FridmanAnd then you're grabbing it by the loop each individual thread and placing it in a particular location to avoid the blood vessels and also choosing the depth of placement, all that so controlling Every like the 3D geometry of the placement.
2:18:31Elon MuskCorrect. So the, the aspect of this robot that is unique is that it's not surgeon assisted or human assisted. It's a semi automatic or automatic robot. Once you obviously there are human component to it when you're placing targets, you can always move it away from kind of major vessels that you see.
2:18:51Elon MuskBut we want to get to a point where one click and it just does the surgery within minutes.
2:18:57Lex FridmanSo the computer vision component finds great targets, candidates and the human kind of approves them. And the robot, does it do like one thread at a time or does it do one thread?
2:19:07Elon MuskIt does one thread at a time. And that's actually also one thing that
2:19:11Lex Fridmanwe
2:19:13Elon Muskare looking at ways to do multiple threads at a time. There's nothing stopping from it. You can have multiple kind of engagement mechanisms, but right now it's one by one.
2:19:24Elon MuskAnd we also still do quite a bit of just kind of verification to make sure that it got inserted. If so how deep did it actually match what was programmed in and so on and so forth.
2:19:36Lex FridmanAnd the actual electrodes are placed at differing depths in the like. I mean it's very small differences, but. Differences.
2:19:45Elon MuskYeah, yeah.
2:19:46Lex FridmanAnd so that there's some reasoning behind that, as you mentioned, like it gets more varied signal.
2:19:56Elon MuskYeah, we, I mean we try to place them all around 3 or 4 millimeter from the surface, just because the span of the electrode, those 16 electrodes that we currently have in this version spans roughly around 3 millimeters.
2:20:12Elon MuskSo we want to get all of those in the brain.
2:20:16Lex FridmanThis is fascinating. Okay, so there's a million questions here. If we zoom in specifically on the electrodes, what is your sense? How many neurons is each individual electrode listening to?
2:20:26Elon MuskYeah, each electrode can record from anywhere between 0 to 40, as I mentioned.
2:20:32Lex FridmanRight.
2:20:32Elon MuskEarlier. But practically speaking, we only see about at most like 2 to 3. And you can actually distinguish which neuron it's coming from by the shape of the spikes.
2:20:49Elon MuskSo I mentioned the spike detection algorithm that we have. It's called boss algorithm buffer online spike sorter Nice. It actually outputs, at the end of the day, six unique values which are kind of the amplitude of these negative going hump, middle hump, positive going hump, and then also the time at which these happen.
2:21:15Elon MuskAnd from that, you can have kind of a statistical probability estimation of. Is that a spike? Is it not a spike? And then based on that, you could also determine, oh, that spike looks different than that spike must come from a different neuron.
2:21:28Lex FridmanOkay. So that's a nice signal processing step from which you can then make much better predictions about if there's a spike, especially in this kind of context where there could be multiple neurons screaming and that.
2:21:41Lex FridmanThat also results in you being able to compress the data better. Yeah. Okay, that's.
2:21:46Elon MuskAnd just to be clear, I mean, the labs do this, what's called spike sorting. Usually once you have these, like, broadband, you know, like the fully digitized signals, and then you run a bunch of different set of algorithms to kind of tease apart.
2:22:03Elon MuskIt's just all of this for us is done on the device in a very low power, custom built ASIC digital processing unit.
2:22:14Lex FridmanHighly heat constrained.
2:22:15Elon MuskHighly heat constrained. And the processing time from signal going in and giving you the output is less than a microsecond, which is, you know, a very, very short amount of time.
2:22:25Lex FridmanOh, yeah. So the latency has to be super short.
2:22:27Elon MuskCorrect.
2:22:28Lex FridmanOh, wow. Oh, that's a pain in the ass. Yeah.
2:22:31Elon MuskLatency is this huge, huge thing that you have to deal with right now. The biggest source of latency comes from the Bluetooth, the way in which they're packetized and, you know, we bin them in 15 millisecond.
2:22:43Lex FridmanOh, interesting communication constraint. Is there some potential innovation there on the protocol used?
2:22:48Elon MuskAbsolutely.
2:22:49Lex FridmanOkay. Yeah.
2:22:49Elon MuskBluetooth is definitely not our final wireless communication protocol that we want to get to.
2:22:58Lex FridmanIt's a highly. Hence the N1 and the R1. I imagine that increases NXRX. Yeah, that's, you know, the communication protocol. Because Bluetooth allows you to communicate against farther distances than you need to, so you can go much shorter.
2:23:16Elon MuskYeah, the only. The primary motivation for choosing Bluetooth is that, I mean, everything has Bluetooth.
2:23:21Lex FridmanAll right. So you can talk about.
2:23:23Elon MuskInteroperability is just absolutely essential, especially in this early phase. And in many ways, if you can access a phone or a computer, you can do anything.
2:23:35Lex FridmanWell, it'll be interesting to step back and actually look at, again, the same pipeline that you mentioned for Nolan. So what does this whole process look like from finding and selecting a human being to the surgery to the first time he's able to use this thing.
2:23:55Elon MuskSo we have what's called a patient registry that people can sign up to hear more about the updates. And that was a route to which Nolan applied. And the process is that once the application comes in, it contains some medical records and we based on their medical eligibility, there's a lot of different inclusion exclusion criteria for them to meet.
2:24:22Elon MuskAnd we go through a pre screening interview process with someone from Neuralink and at some point we also go out to their homes to do a BCI home audit.
2:24:33Elon MuskBecause one of the most revolutionary part about having this N1 system that is completely wireless is that you can use it at home. You don't actually have to go to the lab and go to the clinic to get connectorized to these specialized equipment that you can't take home with you.
2:24:51Elon MuskSo that's one of the key elements of when we're designing the system that we wanted to keep in mind. People hopefully would want to be able to use this every day in the comfort of their home.
2:25:05Elon MuskPart of our engagement and what we're looking for during PCI home audit is to just kind of understand their situation, what other assistive technologies that they.
2:25:14Lex FridmanAnd we should also step back and kind of say that the estimate is 180,000 people live with quadriplegia in the United States. And each year an additional 18,000 suffer a paralyzing spinal cord injury.
2:25:30Lex FridmanSo these are folks who have a lot of challenges living a life in terms of accessibility, in terms of doing the things that many of us just take for granted day to day.
2:25:42Lex FridmanAnd one of the things, one of the goals of this initial study is to enable them to have sort of digital autonomy where they by themselves can interact with a digital device using just their mind.
2:25:55Lex FridmanSomething that you're calling telepathy, so digital telepathy, where a quadriplegic can communicate with a digital device in all the ways that we've been talking about. Control the mouse cursor enough to be able to do all kinds of stuff including play games and tweet and all that kind of stuff.
2:26:15Lex FridmanAnd there's, there's a lot of people for whom life, the basics of life are difficult because of the things that have happened to them.
2:26:23Elon MuskSo yeah, I mean, movement is so, so fundamental to our exist existence. I mean even, even speaking involves movement of mouth, lip, larynx. And without that it's, it's, it's extremely debilitating.
2:26:41Elon MuskAnd there are many people that we can help and I mean especially if you start to kind of look at Other forms of movement disorders that are not just from spinal cord injury, but from ALS, MS, or even stroke.
2:27:00Elon MuskThat leads you. Or just aging.
2:27:03Lex FridmanRight.
2:27:03Elon MuskThat leads you to lose some of that mobility, that independence. It's extremely debilitating.
2:27:09Lex FridmanAnd all of these are opportunities to help people, to help alleviate suffering, to help improve the quality of life. But each of the things you mentioned is its own little puzzle that needs to have increasing levels of capability from a device like a neuralink device.
2:27:24Lex FridmanAnd so the first one you're. You're focusing on is. It's just a beautiful word, telepathy. So being able to communicate using your mind wirelessly with a digital device. Can you just explain this exactly what we're talking about?
2:27:40Elon MuskYeah, I mean, it's exactly that. I mean, I think if you are able to control a cursor and able to click and be able to get access to computer or phone, the whole world opens up to you.
2:27:55Elon MuskAnd I guess the word telepathy, if you kind of think about that as, you know, just definitionally being able to transfer information from my brain to your brain without using some of the physical faculties that we have, you know, like voices.
2:28:13Lex FridmanBut the interesting thing here is, I think the thing that's not obviously clear is how exactly it works. So in order to move a cursor, there's at least a couple of ways of doing that.
2:28:27Lex FridmanSo one is you imagine yourself maybe moving a mouse with your hand, or you can then. Which no one talked about. Like, imagine moving the cursor with your mind.
2:28:42Lex FridmanLike, I don't. But it's like, there is a cognitive step here that's fascinating because you. You have to use the brain, and you have to learn how to use the brain, and you kind of have to figure it out dynamically, like, because you reward yourself if it works.
2:28:58Lex FridmanSo you. Like. I mean, there's a step that. This is just a fascinating step because you have to get the brain to start firing in the right way. Yeah.
2:29:06Lex FridmanAnd you do that by imagining, like, fake it till you make it. And all of a sudden it creates the right kind of signal that, if decoded correctly, can create the kind of effect.
2:29:20Lex FridmanAnd then there's, like, noise around that. You have to figure all of that out. But on the human side, imagine the cursor moving is what you have to do.
2:29:27Lex FridmanYeah.
2:29:27Elon MuskHe says using the force.
2:29:29Lex FridmanThe force. I mean, that's. Isn't that just, like, fascinating to you that it works? Like, to me, it's like, holy shit, that actually works. Like, you could move a cursor with your mind, you know, as much as
2:29:42Elon Muskyou're learning to use that thing, that thing's also learning about you. Like our, our model is constantly updating the weights to say, oh, if, if someone is thinking about this, sophisticated forms of spiking patterns, that actually means to do this.
2:30:01Lex FridmanRight. So the machine is learning about the human and the human is learning about the machine. So there is adaptability to the signal processing, the decoding step, and then there's the adaptation of Nolan, the human being.
2:30:15Lex FridmanLike the same way if you give me a new mouse and I move it, I learned very quickly about its sensitivity. So I'll learn to move it slower. And then there's other kind of signal drift and all that kind of stuff they have to adapt to.
2:30:30Lex FridmanSo both are adapting to each other.
2:30:32Elon MuskCorrect.
2:30:34Lex FridmanThat's a fascinating software challenge on both sides. The software on both on the human
2:30:40Elon Musksoftware and organic and the inorganic.
2:30:42Lex FridmanOrganic and inorganic. Anyway, so sorry to rudely interrupt. So there's the selection that Nolan has passed with flying colors. Um, so everything including that the. It's a BCI friendly home, all of that.
2:30:58Lex FridmanSo what is the process of the surgery? Implantation. The first moment when he gets to
2:31:04Elon Muskuse the system, the end to end. You know, we say patient in to patient out is anywhere between two to four hours. In particular case for Nolan, it was about three and a half hours.
2:31:16Elon MuskAnd there's many steps leading to the actual robot insertion.
2:31:20Lex FridmanRight.
2:31:20Elon MuskSo there's anesthesia induction and we do intra op CT imaging to make sure that we're drilling the hole in the right location. And this is also preplanned beforehand. Someone like Nolan would go through FMRI and then they can think about wiggling their hand.
2:31:40Elon MuskObviously due to their injury, it's not going to actually lead to any sort of intended output. But it's the same part of the brain that actually lights up when you're imagining moving your finger to actually moving your finger.
2:31:54Elon MuskAnd that's one of the ways in which we can actually know where to place our threads. Because we want to go into what's called the hand knob area in the motor cortex.
2:32:04Elon MuskAnd as much as possible, densely put our electrode threads. So yeah, we do intraoperate CT imaging to make sure and double check the location of the craniectomy. And surgeon comes in, does their thing in terms of like skin incision, craniectomy, so drilling of the skull.
2:32:28Elon MuskAnd then there's many different layers of the brain. There's what's called a dura, which is a very, very thick layer that Surrounds the brain, that gets actually resected in a process called durectomy, and that then exposed the PI and the brain that you want to insert.
2:32:43Elon MuskAnd by the time it's been around, anywhere between one to one and a half hours, robot comes in, does this thing. Placement of the targets, inserting of the thread, that takes anywhere between 20 to 40 minutes.
2:32:54Elon MuskIn the particular case for Nolan, it was just under or just over 30 minutes. And then after that, the surgeon comes in. There's a couple other steps of, like, actually inserting the dural substitute layer to protect the thread as well as the brain.
2:33:08Elon MuskAnd then screw in the implant, and then skin flap, and then suture, and then you're out.
2:33:18Lex FridmanSo when Nolan woke up, what was that like? Was the recovery like? And when was the first time he was able to use it?
2:33:27Elon MuskSo he was actually immediately after the surgery, like an hour after the surgery, as he was waking up, we did turn on the device, make sure that we are recording neural signals, and we actually did have a couple signals that we noticed that he can actually modulate.
2:33:46Elon MuskAnd what I mean by modulate is that he can think about crunching his fist, and you could see the spike disappear and appear.
2:33:56Lex FridmanThat's awesome.
2:33:57Elon MuskAnd that was immediate, right? Immediate after in the recovery room.
2:34:02Lex FridmanHow cool is that? Yeah, that's a human being. I mean, what did that feel like for you, this device and a human being, A first step of a gigantic journey.
2:34:15Lex FridmanI mean, it's a historic moment. Even just that spike, just to be able to modulate that.
2:34:22Elon MuskYou know, obviously there have been other. Other, you know, as you mentioned, pioneers that have participated in these groundbreaking BC
2:34:30Lex Fridmanby
2:34:34Elon Muskinvestigational, early feasibility studies. So we're obviously standing on the shoulders of the giants here. We're not the first ones to actually put electrodes in the human brain. But, I mean, just leading up to the surgery, I definitely could not sleep.
2:34:51Elon MuskIt's the first time that you're working in a completely new environment. We had a lot of confidence, based on our benchtop testing or preclinical R and D studies, that the mechanism, the threads, the insertion, all that stuff is very safe and that it's obviously ready for doing this in a human.
2:35:15Elon MuskBut there's still a lot of unknown, unknown about can the needle actually insert? I mean, we brought something like 40 needles just in case they break, and we ended up using only one.
2:35:28Elon MuskBut, I mean, that was a level of just complete unknown. Right, because it's a very, very different environment. And I mean, that's why we do clinical trial in the first place to be able to test these things out.
2:35:40Elon MuskSo extreme nervousness and just many, many sleepless night leading up to the surgery and definitely the day before the surgery. And it was an early morning surgery. Like we started at 7 in.
2:35:54Elon MuskAnd by the time it was around 10:30, everything was done. But I mean, first time seeing that. Well, number one, just huge relief that this thing is doing what it's supposed to do.
2:36:11Elon MuskAnd two, I mean, just immense amount of gratitude for Nolan and his family and then many others that have applied and that we've spoken to and will speak to are true pioneers in every war.
2:36:25Elon MuskAnd I sort of call them the neural astronauts or neural notes. These amazing. Just like in the 60s, right? These amazing. Just pioneers, right? Exploring the unknown outwards. In this case, it's inward.
2:36:43Elon MuskBut an incredible amount of gratitude for them to just participate and play a part. And it's a journey that we're embarking on together. But also, I think that was a very, very important milestone.
2:37:01Elon MuskBut our work was just starting, so a lot of just kind of anticipation for, okay, what needs to happen next? What are set of sequences of events that needs to happen for us to make it worthwhile for, you know, both Nolan as well as us.
2:37:17Lex FridmanJust a linger on that. Just a huge congratulation to you and the team for that milestone. I know there's a lot of work left, but that. That is. That's really exciting to see.
2:37:30Lex FridmanThere's. That's a source of hope to this first big step opportunity to help hundreds of thousands of people and then maybe expand the realm of the possible for the human mind for millions of people in the future.
2:37:48Lex FridmanSo it's really exciting. The opportunities are all ahead of us. And to do that safely and to do that effectively was really fun to see as an engineer, just watching other engineers come together and do an epic thing, that was awesome.
2:38:03Lex FridmanHuge congrats.
2:38:03Elon MuskThank you. Thank you. I could not have done it without the team. And yeah, I mean, that's the other thing that I told the team as well, of just this immense sense of optimism for the future.
2:38:16Elon MuskI mean, it's a very important moment for the company, needless to say, as well as hopefully for many others out there that we can help.
2:38:27Lex FridmanSo, speaking of challenges, Neuralink published a blog post describing that some of the threads are attracted. And so the performance as measured by bits per second, dropped at first, but then eventually was regained.
2:38:41Lex FridmanAnd the whole story of how it was regained is super interesting. That's definitely something. I'll talk to Bliss and to Nolan about. But in general, can you speak to this whole experience, how was the performance regained?
2:38:56Lex FridmanAnd just the technical aspects of the threads being attracted and moving.
2:39:03Elon MuskThe main takeaway is that in the end the performance have come back and it's actually gotten better than it was before. He's actually just beat the world record yet again last week to 8.5 bps.
2:39:18Elon MuskSo I mean, he's just cranking and he's just improving.
2:39:20Lex FridmanThe previous one that he said was 8.
2:39:23Elon MuskCorrect? He said 8.5. Yeah. The previous world record in human was 4.6, so it's almost double. And his goal is to try to get to 10, which is roughly around kind of the median neuralinker using mouse with the hand.
2:39:40Elon MuskSo it's getting there.
2:39:42Lex FridmanSo, yeah, so the performance was regained.
2:39:45Elon MuskYeah, better than before. So that's a story on its own of what took the BCI team to recover that performance. It was actually mostly on kind of the signal processing end.
2:39:58Elon MuskSo as I mentioned, we were kind of looking at these spike outputs from our electrodes. And what happened is that kind of four weeks into the surgery, we noticed that the threads have slowly come out of the brain.
2:40:14Elon MuskAnd the way in which we noticed this at first, obviously, is that I think Nolan was the first to notice that his performance was degrading. And I think at the time we were also trying to do a bunch of different experimentation, different algorithms, different sort of UI ux.
2:40:33Elon MuskSo it was expected that there will be variability in the performance, but we did see kind of a steady decline. And then also the way in which we measure the health of the electrodes or whether they're in the brain or not is the by measuring impedance of the electrode.
2:40:50Elon MuskSo we look at kind of the interfacial kind of the Randall circuit, they say, the capacitance and the resistance between the electrosurface and the medium. And if that changes in some dramatic ways, we have some indication, or if you're not seeing spikes on those channels, you have some indications that something's happening there.
2:41:11Elon MuskAnd what we notice is that looking at those impedance plot and spike rate plots, and also because we have those electrodes recording along the depth, you're seeing some sort of movement that indicated that the reservoir being pulled out.
2:41:25Elon MuskAnd that obviously will have an implication on the model side, because if you're the number of inputs that are going into the model is changing because you have less of them, that model needs to get updated.
2:41:38Elon MuskRight. And. But there were still signals. And as I mentioned, similar to how even when you Place the signals on the surface of the brain or farther away, like outside the skull, you still see some useful signals.
2:41:53Elon MuskWhat we started looking at is not just the spike occurrence through this BOSS algorithm that I mentioned, but we started looking at just the power of the frequency band that is interesting for Nolan to be able to modulate.
2:42:10Elon MuskSo once we kind of changed the algorithm for the implant to not just give you the bus output, but also these spike band power output, that helped us sort of refine the model with the new set of inputs.
2:42:25Elon MuskAnd that was the thing that really ultimately gave us the performance back in terms of. And obviously the thing that we want ultimately, and the thing that we are working towards is figuring out ways in which we can keep those threads intact for as long as possible so that we have many more channels going into the model.
2:42:49Elon MuskThat's by far the number one priority that the team is currently embarking on to understand how to prevent that from happening. The thing that I will say also
2:42:58Lex Fridmanis that,
2:43:00Elon Muskas I mentioned, this is the first time ever that we're putting these threats in a human brain. And human brain, just for size reference, is 10 times that of the monkey brain or the sheep brain.
2:43:12Elon MuskAnd it's just a very, very different environment. It moves a lot more. It actually moved a lot more than we expected when we did Nolan's surgery. It's just a very, very different environment than what we're used to.
2:43:27Elon MuskAnd this is why we do clinical trial.
2:43:29Lex FridmanRight.
2:43:30Elon MuskWe want to uncover some of these issues and failure modes earlier than later. So in many ways it's provided us with this enormous amount of data and information to be able to solve this.
2:43:47Elon MuskAnd this is something that neuralink is extremely good at. Once we have set of clear, objective and engineering problem, we have enormous amount of talents across many, many disciplines to be able to come together and fix the problem very, very quickly.
2:44:01Lex FridmanBut it sounds like one of the fascinating challenges here is for the system and the decoding side to be adaptable across different timescales. So whether it's movement of threads or different aspects of signal drift, sort of on the software of the human brain, something changing.
2:44:19Lex FridmanLike Nolan talks about cursor drift that could be corrected. And there's a whole UX challenge to how to do that. So it sounds like adaptability is like a fundamental property that has to be engineered in.
2:44:34Lex FridmanIt is.
2:44:35Elon MuskAnd. And I mean, I think, I mean, as a company, we're extremely vertically integrated. You know, we make these thin film arrays in our own microfab.
2:44:45Lex FridmanYeah, there's, like you said, Built in house. This whole paragraph here from this blog post is pretty gangster. Building the technology described above has been no small feat. And there's a bunch of links here that I recommend people click on.
2:44:59Lex FridmanWe constructed in house microfabrication capabilities to rapidly produce various iterations of thin film arrays that constitute our electrode threads. We created a custom femtosecond laser mill to manufacture components with micro level precision.
2:45:15Lex FridmanI think there's a tweet associated with
2:45:16Elon Muskthis whole thing that we can get into.
2:45:18Lex FridmanYeah, this, this. Okay, what are we, what are we looking at here? This thing. This is. So in less than one minute, our custom made femto second laser mill cuts this geometry in the tips of our needles.
2:45:33Lex FridmanSo we're looking at this weirdly shaped needle. The Tip is only 10 to 12 microns in width, only slightly larger than the diameter of a red blood cell. The small size allows threads to be inserted with minimal damage to the cortex.
2:45:48Lex FridmanOkay, so what's interesting about this geometry? So we'll look at this geometry of a needle.
2:45:53Elon MuskThis is the needle that's engaging with the loops in the thread. So they're the ones that
2:46:02Lex Fridmanthread the
2:46:02Elon Muskloop and then peel it from the silicon backing. And then this is the thing that gets inserted into the tissue. And then this pulls out, leaving the thread. And there's kind of a notch or the shark tooth that we used to call is the thing that actually is grasping the loop.
2:46:23Elon MuskAnd then it's designed in such way such that when you pull out, leaves the loop.
2:46:28Lex FridmanAnd the robot is controlling this needle.
2:46:30Elon MuskCorrect. So this is actually housed in a cannula. And basically the robot has a lot of the optics that look forward. The loop is. There's actually a 405 nanometer light that actually causes the polyimid to fluoresce so that you can locate the location of the loop.
2:46:48Elon MuskSo the list lights up. Yeah, yeah, they do. It's a micron precision process.
2:46:54Lex FridmanWhat's interesting about the robot that it takes to do that, that's pretty crazy. That's pretty crazy that a robot is able to get this kind of precision.
2:47:01Elon MuskYeah, our robot is quite heavy. Our current version of it, there's. I mean, it's like a giant granite slab that weighs about a ton because it needs to be sensitive to vibration, environmental vibration.
2:47:16Elon MuskAnd then as the head is moving at the speed that it's moving, you know, there's a lot of kind of motion control to make sure that you can achieve that level of precision.
2:47:28Elon MuskA lot of optics that kind of zoom in on that. You Know, we're working on next generation of the robot that is lighter, easier to transport. I mean, it is a feat to move the robot, and it's far superior
2:47:39Lex Fridmanto a human surgeon at this time for this particular task.
2:47:42Elon MuskAbsolutely. I mean, let alone you try to actually thread a loop in a. In a sewing kit. I mean, this is like. We're talking like fractions of human hair.
2:47:51Lex FridmanThese.
2:47:51Elon MuskThese things are. It's not visible.
2:47:54Lex FridmanSo continuing the paragraph, we developed novel hardware and software testing systems, such as our accelerated lifetime testing racks and simulated surgery environment, which is pretty cool. To stress test and validate the robustness of our technologies.
2:48:06Lex FridmanWe performed many rehearsals of our surgeries to refine our procedures and make them second nature. This is pretty cool. We practice surgeries on proxies with all the hardware and instruments needed in our mock or in the engineering space.
2:48:22Lex FridmanThis helps us rapidly test and measure. So there's like proxies.
2:48:25Elon MuskYeah, this proxy is super cool, actually. So there's a 3D printed skull from the images that is taken at Barrow, as well as this hydrogel mix, sort of synthetic polymer thing that actually mimics the mechanical properties of the brain.
2:48:44Elon MuskIt also has vasculature of the person. So basically what we're talking about here, and there's a lot of work that has gone into making this said proxy, that it's about finding the right concentration of these different synthetic polymers to get the right set of consistency for the needle dynamics, you know, as they're being inserted.
2:49:08Elon MuskBut we practice this surgery with the person, you know, Nolan's basically physiology and brain many, many times prior to actually doing the surgery. So to.
2:49:21Lex FridmanEvery. Every step.
2:49:22Elon MuskEvery step. Every step, yeah. Like, where does someone stand? Like, I mean, like, what you're looking at is the picture, this is in our office of this kind of corner of the robot engineering space that we have created this mock or space that looks exactly like what they would experience, all the staff would experience during their actual surgery.
2:49:42Elon MuskSo it's just kind of like any dance rehearsal where you know exactly where you're going to stand at what point, and you just practice that over and over and over again with an exact anatomy of someone that you're going to surgerize.
2:49:55Elon MuskAnd it got to a point where a lot of our engineers, when we created a craniectomy, they're like, oh, that looks very familiar. We've seen that before.
2:50:04Lex FridmanYeah, man. There's wisdom you can gain through doing the same thing over and over and over. It's like Euro Dreams of Sushi kind of thing. Because Then it's like Olympic athletes visualize the Olympics.
2:50:19Lex FridmanAnd then once you actually show up, it feels easy. It feels like any other day. It feels almost boring. Winning the gold medal, because you visualize this so many times, you've practiced this so many times that nothing embodies new.
2:50:34Lex FridmanIt's boring. You win the gold medal, it's boring. And the experience they talk about is mostly just relief, probably, that they don't have to visualize it anymore.
2:50:44Elon MuskYeah, the power of the mind to visualize. And where. I mean, there's a whole field that studies where muscle memory lies in cerebellum. Yeah, it's incredible.
2:50:56Lex FridmanI think this is a good place
2:50:57Elon Muskto actually ask sort of the big
2:51:00Lex Fridmanquestion that people might have is, how do we know every aspect of this that you described is safe?
2:51:05Elon MuskAt the end of the day, the gold standard is to look at the tissue. What sort of trauma did you cause the tissue? And does that correlate to whatever behavioral anomalies that you may have seen?
2:51:17Elon MuskAnd that's the language to which we can communicate about the safety of inserting something into the brain and what type of trauma that you can cause. So we actually have an entire department of pathology that looks at these tissue slices.
2:51:38Elon MuskThere are many steps that are involved in doing this. Once you have studies that are launched with particular endpoints in mind, at some point, you have to euthanize the animal.
2:51:50Elon MuskAnd then you go through necropsy to collect the brain tissue samples, you fix them in formalin, and you roast them, you section them, and you look at individual slices just to see what kind of reaction, or lack thereof, exists.
2:52:04Elon MuskSo that's kind of the language to which FDA speaks and as well for us to kind of evaluate the safety of the insertion mechanism as well as the threats at various different time points, you know, both acute.
2:52:18Elon MuskSo anywhere between, you know, zero to three months to beyond three months.
2:52:25Lex FridmanSo those are kind of the details of an extremely high standard of safety that has to be reached. Correct. FDA supervises this, but there's in general, just a very high standard.
2:52:37Lex FridmanEvery aspect of this, including the surgery. I think Matthew McDougall has mentioned that,
2:52:42Elon Musklike, the standard is,
2:52:47Lex Fridmanlet's say, how to put it politely, higher than maybe some other operations that we take for granted. So the standard for all the surgical stuff here is extremely high, very high.
2:52:58Elon MuskI mean, it's a highly, highly regulated environment with the governing agencies that scrutinize every medical device that gets marketed. And I think it's a good thing. It's good to have those high standards and we try to hold extremely high standards to kind of understand what sort of damage, if any, these innovative, emerging technologies and new technology that we're building are.
2:53:24Elon MuskAnd so far, we have been extremely impressed by lack of immune response from these threats.
2:53:34Lex FridmanSpeaking of which, you talk to me with excitement about the histology and some of the images that you're able to share. Can you explain to me what we're looking at?
2:53:46Lex FridmanYeah.
2:53:46Elon MuskSo what you're looking at is a stained tissue image. So this is a sectioned tissue slice from an animal that was implanted for seven months. So kind of a chronic time point.
2:53:58Elon MuskAnd you're seeing all these different colors. And each color indicates specific types of cell types. So purple and pink are astrocytes and microglia, respectively. They're type of glial cells.
2:54:12Elon MuskAnd the other thing that people may not be aware of is your brain is not just made up of soup of neurons and axons. There are other cells, like glial cells, that actually kind of is the glue and also react if there are any trauma or damage to the tissue.
2:54:32Lex FridmanBut the brown or the neurons, the
2:54:34Elon Muskbrown are the neurons. So what you're seeing is in this kind of macro image, you're seeing these circle highlighted in white, the insertion sites. And when you zoom into one of those, you see the threads.
2:54:49Elon MuskAnd then in this particular case, I think we're seeing about the 16 wires that are going into the page. And the incredible thing here is the fact that you have the neurons that are these brown structures or brown circular or elliptical thing that are actually touching and abutting the threads.
2:55:07Elon MuskSo what this is saying is that there's basically zero trauma that's caused during this insertion. And with these neural interfaces, these microelectrodes that you insert, that is one of the most common mode of failure.
2:55:19Elon MuskSo when you insert these threads, like the Utah array, it causes neuronal death around the site because you're inserting a foreign object, right? And that kind of elicit these immune response through microglia and astrocytes.
2:55:35Elon MuskThey form this protective layer around it. Not only are you killing the neuron cells, but you're also creating this protective layer that then basically prevents you from recording neural signals because you're getting farther and farther away from the neurons that you're trying to record.
2:55:48Elon MuskAnd that is the biggest mode of failure. And in this particular example, in that Insight, it's about 50 micron with that scale bar, the neurons just seem to be attracted to it.
2:55:59Lex FridmanAnd so there's certainly no trauma. That's such a beautiful image. By the way just a. So the brown of the neurons, for some reason I can't look away.
2:56:07Elon MuskYeah. And the way that these things like, I mean, your tissues generally don't have these beautiful colors. This is multiplex stain that uses these different proteins that are staining these at different colors.
2:56:21Elon MuskWe use very standard set of staining techniques with HE, EVA1 and NUAN and GFAB. So if you go to the next image, this also kind of illustrates the second point because you can make an argument.
2:56:34Elon MuskAnd initially when we saw the previous image, we said, oh, are the threads just floating? What is happening here? Are we actually looking at the right thing? So what we did is we did another stain and this is all done in house of this Mason's trichrome stain, which is in blue that shows these collagen layers.
2:56:53Elon MuskSo the blue, basically you don't want the blue around to the implant threads because that means that there is some sort of scarring that's happened. And what you're seeing if you look at individual threads is that you don't see any of the blue, which means that there has been absolutely or very, very minimal to a point where it's not detectable amount of trauma in these inserted threads.
2:57:16Lex FridmanSo that presumably is one of the big benefits of having this kind of flexible thread.
2:57:21Elon MuskYeah, so we think this is primarily due to the size as well as the flexibility of the threads. Also the fact that R1 is avoiding. That's for sure. So we're not disrupting or we're not causing damage to the vessels and not breaking any of the blood.
2:57:39Elon MuskBrain barrier has basically caused the immune response to be muted.
2:57:45Lex FridmanBut this is also a nice illustration of the size of things. So this is the tip of the thread.
2:57:51Elon MuskYeah, those are neurons.
2:57:52Lex FridmanThey're. They're. And they're neurons. And they're. And this is the thread listening. And the electrodes are positioned how.
2:57:59Elon MuskYeah, so this is. What you're looking at is not electrode themselves. Those are the conductive wires. So each of those should probably be 2 micron in width. So what we're looking at is we're looking at the coronal slice.
2:58:13Elon MuskSo we're looking at some slice of the tissue. So as you go deeper, you know, you'll obviously have less and less of the tapering of the thread. But yeah, the point basically being that there's just kind of cells around the inserted site, which is just an incredible thing to see.
2:58:31Elon MuskI've just never seen anything like this.
2:58:33Lex FridmanHow easy and safe is it to remove the implant?
2:58:37Elon MuskYeah, so it depends on when in the first three months or so after the surgery, there's a lot of kind of tissue modeling that's happening, similar to when you get a cut.
2:58:51Elon MuskYou obviously start over first couple weeks, or depending on the size of the wound, scar tissue forming. There are these contracted, and then in the end, they turn into scab, and you can scab it off.
2:59:06Elon MuskThe same thing happens in the brain, and it's a very dynamic environment. And before the scar tissue or the neomembrane or the new membrane that forms, it's quite easy to just pull them out, and there's minimal trauma that's caused during that.
2:59:22Elon MuskOnce the scar tissue forms, and with Nolan as well, we believe that that's the thing that's currently anchoring the thread. So we haven't seen any more movements since then.
2:59:33Elon MuskSo they're quite stable. It gets harder to actually completely extract the threads. So our current method for removing the device is cutting the thread, leaving the tissue intact, and then unscrewing and taking the implant out.
2:59:52Elon MuskAnd that hole is now going to be plugged with either another neuralink or. Just with kind of a peak based, plastic based cap.
3:00:05Lex FridmanIs it okay to leave the threads in there forever?
3:00:09Elon MuskYeah, we think so. We've done studies where we left them there, and one of the biggest concerns that we had is do they migrate and do they get to a point where they should not be?
3:00:19Elon MuskWe haven't seen that. Again, once the scar tissue forms, they get anchored in place. And I should also say that when we say upgrades, we're not just talking in theory here.
3:00:31Elon MuskWe've actually upgraded many, many times. Most of our monkeys or non human primates, nhp, have been upgraded. Pedro, who you saw playing mind pong, has the latest version of the device since two years ago and is seemingly very happy and healthy and fat.
3:00:51Lex FridmanSo what's designed for the future? The upgrade procedure. So maybe for Noland, what would the upgrade look like? It was essentially what you're mentioning. Is there a way to upgrade sort of the device internally?
3:01:10Elon MuskWill you take it apart, sort of
3:01:12Lex Fridmankeep the capsule and upgrade the internals?
3:01:14Elon MuskYeah, so there are a couple of different things here. So for Nolan, if we were to upgrade, what we would have to do is either cut the threads or extract the threads, depending on kind of the situation there in terms of how they're anchored or scarred in.
3:01:30Elon MuskIf you were to remove them with the dural substitute, you have an intact brain, so you can reinsert different threads. With the updated implant package, there are a couple different other ways that we're thinking about the future of what the upgradable system looks like.
3:01:50Elon MuskOne is at the moment, we currently remove the dura, this thick layer that protects the brain, but that actually is the thing that actually proliferates the scar tissue formation.
3:02:03Elon MuskTypically, general good rule of thumb is you want to leave the nature as is and not disrupt it as much. So we're looking at ways to insert the threads through the dura, which comes with different set of challenges, such as, you know, it's a pretty thick layer.
3:02:20Elon MuskSo how do you actually penetrate that without breaking the needle? So we're looking at different needle design for that, as well as the kind of the loop engagement. The other biggest challenges are it's quite opaque optically with white light illumination.
3:02:33Elon MuskSo how do you avoid. Still this biggest advantage that we have of avoiding vasculature. How do you image through that? How do you actually still mediate that? So there are other imaging techniques that we're looking at to enable that.
3:02:46Elon MuskBut the goal, our hypothesis is that, and based on some of the early evidence that we have, doing through the dura insertion, will Cause minimal scarring that causes them to be much easier to extract over time.
3:02:58Elon MuskAnd the other thing that we're also looking at, this is going to be a fundamental change in the implant architecture is at the moment, it's a monolithic single implant that comes with the thread that's bonded together, so you can't actually separate the thing out.
3:03:14Elon MuskBut you can imagine having two part implant, bottom part, that is the thread that are inserted, that has the chips and maybe a radio and some power source. And then you have another implant that has more of the computational heavy load and the bigger battery.
3:03:31Elon MuskAnd then one can be under the dura, one can be above the dura being the plug for the skull. They can talk to each other. But the thing that you want to upgrade the computer and not the threads.
3:03:40Elon MuskIf you want to upgrade that, you just go in there, remove the screws, and then put in the next version and you're off the. It's a very, very easy surgery too.
3:03:49Elon MuskLike you do a skin incision, slip this in screw, probably be able to do this in 10 minutes.
3:03:55Lex FridmanSo that would allow you to reuse the threads, sort of.
3:03:57Elon MuskCorrect.
3:03:59Lex FridmanSo, I mean, this leads to the natural question of what is the pathway to scaling the increase in the number of threads? Is that a priority? What's the technical challenge there?
3:04:11Elon MuskYeah, that is a priority. So for next versions of the implant, the key metrics that we're looking to improve are number of channels just recording from more and more neurons.
3:04:22Elon MuskWe have a pathway to actually go from currently 1000 to hopefully 3000, if not 6000 by end of this year, and then end of next year. We want to get to, you know, even more 16,000.
3:04:35Lex FridmanWow.
3:04:36Elon MuskThere's a couple of limitations to that. One is, you know, obviously being able to photolithographically print those wires. As I mentioned, it's 2 micron in width and spacing. Obviously, there are chips that are much more advanced than those types of resolution.
3:04:50Elon MuskAnd we have some of the tools that we have brought in house to be able to do that. So traces will be narrower just so that you have to have more of the wires coming up into the chip.
3:05:03Elon MuskChips also cannot linearly consume more energy as you have more and more channels. So there's a lot of innovations in the circuit architecture as well as the circuit design topology to make them lower power.
3:05:17Elon MuskYou need to also think about, if you have all of these spikes, how do you send that off to the end application? So you need to think about bandwidth limitation there and potentially innovations in signal processing physically One of the biggest challenges is going to be the interface.
3:05:34Elon MuskIt's always the interface that breaks bonding the Stin film array to the electronics. It starts to become very, very highly dense interconnects. So how do you connectorize that? There's a lot of innovations in kind of the 3D integrations in the recent years that we can take advantage of.
3:05:53Elon MuskOne of the biggest challenges that we do have is forming this hermetic barrier. This is an extremely harsh environment that we're in the brain. So how do you protect it from the brain?
3:06:07Elon MuskTrying to kill your electronics to also your electronics leaking things that you don't want into the brain. And forming that hermetic barrier is going to be a very, very big challenge that we I think are actually well suited to tackle.
3:06:20Lex FridmanHow do you test that? What's the development environment to simulate that kind of harshness?
3:06:25Elon MuskYeah, so this is where the accelerat life tester essentially is a brain in a vat. It literally is a vessel that is made up of. And again, for all intents and purpose, for this particular types of tests, your brain is a saltwater.
3:06:44Elon MuskAnd you can also put some other set of chemicals like reactive oxygen species that get at these interfaces and trying to cause a reaction to pull it apart. But you could also increase the rate at which these interfaces are aging by just increasing temperature.
3:07:06Elon MuskSo every 10 degrees Celsius that you increase, you're basically accelerating time by 2x. And there's limit as to how much temperature you want to increase. Because at some point there's some other nonlinear dynamics that causes you to have other nasty gases to form.
3:07:21Elon MuskThat just is not realistic in an environment. So what we do is we increase in our alt chamber by 20 degrees Celsius. That increases the aging by four times.
3:07:32Elon MuskSo essentially one day in alt chamber is four day in calendar year. And we look at whether the implants still are intact, including the threads and operation and all that, and operation and all of that.
3:07:46Elon MuskIt obviously is not an exact same environment as a brain because brain has mechanical, you know, other more biological goops that attack at it. But it is a good test environment.
3:07:59Elon MuskTesting environment for at least the enclosure and the strength of the enclosure. And I mean we've had implants, the current version of the implant that has been in there for, I mean, close to two and a half years, which is equivalent to a decade.
3:08:15Elon MuskAnd they seem to be fine.
3:08:17Lex FridmanSo it's interesting that the brain, so basically close approximation is warm salt water. Hot salt water is a good testing environment. By the way, I'M drinking element which is basically salt water, which is making me kind of.
3:08:36Lex FridmanIt doesn't have computational power the way the brain does, but maybe in terms of other characteristics it's quite similar. And I'm consuming it.
3:08:44Elon MuskYeah, you have to get it at the right ph too,
3:08:48Lex Fridmanand then consciousness will emerge. Yeah, no.
3:08:52Elon MuskBy the way, the other thing that also is interesting about our enclosure it's not your common looking medical implant that usually is encased in a titanium can that's laser welded.
3:09:08Elon MuskWe use this polymer called PCTFE polychlorotrifluoroethylene, which is actually commonly used in blister packs. So when you have a pill and you try to pop the pill, there's kind of that plastic membrane.
3:09:23Elon MuskThat's what this is. No one's actually ever used this except us. And the reason we wanted to do this is because it's electromagnetically transparent. So when we talked about the electromagnetic inductive charging with titanium can, usually if you want to do something like that, you have to have a sapphire window.
3:09:42Elon MuskAnd it's a very, very tough process to scale.
3:09:45Lex FridmanSo you're doing a lot of iteration here in every aspect of this. The materials, the software, the whole, whole shebang. So okay, so you mentioned scaling. Is it possible to have multiple neuralink devices as one of the ways of scaling, to have multiple neuralink devices implanted?
3:10:07Elon MuskThat's the goal. That's the goal, yeah. Our monkeys have had two neuralinks, one in each hemisphere. And then we're also looking at, you know, potential of having one in motor cortex, one in visual cortex and one in wherever other cortex.
3:10:24Lex FridmanSo focusing on a particular function. One neuralink device.
3:10:28Elon MuskCorrect.
3:10:28Lex FridmanI mean, I wonder if there's some level of customization that can be done on the compute side.
3:10:32Elon MuskSo for the motor cortex, absolutely, that's the goal. And you know, we talk about at neuralink building a generalized neural interface to the brain. And that also is strategically how we're approaching this with marketing and also with regulatory, which is, hey look, we have the robot and the robot can access any part of the cortex.
3:10:57Elon MuskRight now we're focused on motor cortex with current version of the N1 that's specialized for motor decoding tasks. But also at the end of the day, there is kind of a general compute available there.
3:11:12Elon MuskBut typically if you want to really get down to kind of hyper optimizing for power and efficiency, you do need to get to some specialized function.
3:11:19Lex FridmanRight.
3:11:21Elon MuskBut what we're saying is that, hey, you Are now used to this robotic insertion techniques, which took many, many years of showing data and conversation with the FDA and also internally convincing ourselves that this is safe.
3:11:38Lex FridmanAnd
3:11:41Elon Musknow the difference is if we go to other parts of the brain, like visual cortex, which we're interested in as our second product, obviously it's a completely different environment.
3:11:50Elon MuskThe cortex is laid out very, very differently. It's going to be more stimulation focused rather than recording, just kind of creating visual percepts. But in the end, we're using the same thin film array technology, we're using the same robot insertion technology, we're using the same packaging technology.
3:12:09Elon MuskNow it's more. The conversation is focused around what are the differences and what are the implications of those differences in safety and efficacy.
3:12:16Lex FridmanThe way you said second product is both hilarious and awesome to me. That product being restoring sight for blind people. So can you speak to stimulating the visual cortex?
3:12:35Lex FridmanI mean, the possibilities there are just incredible. To be able to give that gift back to people who don't have sight or even any aspect of that. Can you just speak to the challenges of.
3:12:48Lex FridmanThere's several challenges here.
3:12:50Elon MuskOh, many.
3:12:51Lex FridmanOne of which is, like you said, from recording to stimulation, Just any aspect of that that you're both excited and see the challenges of.
3:13:02Elon MuskYeah, I guess I'll start by saying that we actually have been capable of stimulating through our Dynam array as well as other electronics for years. You know, we. We have actually demonstrated some of that capabilities for reanimating the limb in the spinal cord.
3:13:21Elon MuskObviously for the current EFS study, we've hardware disabled that. So that's something that we wanted to embark as a separate journey. Obviously, there are many different ways to write information into the brain.
3:13:37Elon MuskThe way in which we're doing that is through electrical passing electrical current and causing that to really change the local environment so that you can sort of artificially cause kind of the neurons to depolarize in nearby areas for vision.
3:13:57Lex FridmanSpecifically,
3:13:59Elon Muskthe way our visual system works, it's both well understood. I mean, anything with kind of brain, there are aspects of it that's well understood, but in the end, we don't really know anything.
3:14:09Elon MuskBut the way visual system works is that you have photon hitting your eye. And in your eyes there are these specialized cells called photoreceptor cells that convert the photon energy into electrical signals.
3:14:25Elon MuskAnd then that then gets projected to your back of your head, your visual cortex. It goes through actually thalamic system called lgn that then projects it out. And then in the visual cortex, there's you know, visual area one or V1, and then there's a bunch of other higher level processing layers like V2, V3.
3:14:48Elon MuskAnd there are actually kind of interesting parallels. And when you study the behaviors of these convolutional neural networks, like what the different layers of the network is detecting, first they're detecting these edges and they're then detecting some more natural curves and then they start to detect objects.
3:15:08Lex FridmanRight.
3:15:08Elon MuskKind of similar thing happens in the brain and a lot of that has been inspired and also it's been kind of exciting to see some of the correlations there.
3:15:16Elon MuskBut things like from there, where does cognition arise and where is color encoded? There's just not a lot of understanding, fundamental understanding there. So in terms of kind of bringing sight back to those that are blind, there are many different forms of blindness.
3:15:36Elon MuskThere's actually 1 million people in the US that are legally blind. That means certain score below in kind of the visual test. I think it's something like if you can see something at 20ft distance that normal people can see at 200ft distance, if you're worse than that, you're legally blind.
3:15:57Lex FridmanSo fundamentally that means you can't function effectively using sight in the world.
3:16:02Elon MuskYeah, like to navigate your environment. And yeah, there are different forms of blindness. There are forms of blindness where there's some degeneration of your retina, these photoreceptor cells and rest of your visual processing that I described is intact for those types of individuals.
3:16:27Elon MuskYou may not need to maybe stick electrodes into the visual cortex. You can actually build retinal prosthetic devices that actually just replaces a function of that retinal cells that are degenerated.
3:16:41Elon MuskAnd there are many companies that are working that. But that's a very small slice, albeit significant, still smaller slice, of folks that are legally blind. If there's any damage along that circuitry, whether it's in the optic nerve or just the LGN circuitry, or any break in that circuit that's not going to work for you.
3:17:02Elon MuskAnd the source of where you need to actually cause that visual percept to happen, because your biological mechanism of doing that is by placing electrodes in the visual cortex in the back of your head.
3:17:17Elon MuskAnd the way in which this would work is that you would have an external camera, whether it's something as unsophisticated as a GoPro or some sort of wearable Ray Ban type glasses that Meta is working on, that captures a scene, and that scene is then converted to a set of electrical impulses or stimulation pulses.
3:17:41Elon MuskThat you would activate in your visual cortex through these thin film arrays. And by playing some concerted kind of orchestra of these stimulation patterns, you can create what's called phosphenes, which are these kind of white yellowish dots that you can also create by just pressing your eyes.
3:18:04Elon MuskYou can actually create those percepts by stimulating the visual cortex. And the name of the game is really have many of those and have those percepts be the phosphenes, be as small as possible so that you can start to tell apart like they're the individual pixels of the screen.
3:18:20Elon MuskRight. So if you have many of those, potentially you'll be able to in the long term be able to actually get naturalistic vision, but in the short term to maybe midterm.
3:18:32Elon MuskBeing able to at least be able to have object detection algorithms run on your glasses, the pre processing units, and then being able to at least see the edges of things so you don't bump into stuff.
3:18:46Lex FridmanIt's incredible. This is really incredible. So you basically will be adding pixels and your brain would start to figure out what those pixels mean. And with different kinds of assistant under signal processing on all fronts.
3:18:59Elon MuskYeah. The thing that actually, so a couple things. One is, you know, obviously if you're blind from birth, the way brain works, especially in the early age, neuroplasticity is really nothing other than, you know, kind of your brain and different parts of your brain fighting for the limited territory.
3:19:20Lex FridmanYeah.
3:19:21Elon MuskAnd I mean, very, very quickly you see, you see cases where, you know people that are. I mean, you also hear about people who are blind that have heightened sense of hearing or some other senses.
3:19:33Elon MuskAnd the reason for that is because that cortex that's not used just gets taken over by these different parts of the cortex. So for those types of individuals, I mean, I guess they're going to have to now map some other parts of their senses into what they call vision.
3:19:49Elon MuskBut it's going to be obviously a very, very different conscious experience
3:19:54Neuralink teambefore.
3:19:56Elon MuskSo I think that's an interesting caveat. The other thing that also is important to highlight is that we're currently limited by our biology in terms of the wavelength that we can see.
3:20:08Elon MuskThere's a very, very small wavelength that is a visible light wavelength that we can see with our eyes. But when you have an external camera with this PCI system, you're not limited to that.
3:20:19Elon MuskYou can have infrared, you can have uv, you can have whatever other spectrum that you want to see. to some sort of weird conscious experience, I have no idea.
3:20:28Elon MuskBut Oftentimes I talk to people about the goal of neuralink being going beyond the limits of our biology. That's sort of what I mean.
3:20:39Lex FridmanAnd if you're able to control the kind of raw signal is that when we use our site, we're getting the photons and there's not much processing on it. If you're being able to control that signal, maybe you can do some kind of processing.
3:20:54Lex FridmanMaybe you do object detection ahead of time. Yeah, you're doing some kind of pre processing, and there's a lot of possibilities to explore that. So it's not just increasing sort of thermal imaging, that kind of stuff, but it's also just doing some kind of interesting processing.
3:21:10Elon MuskYeah. My theory of how visual system works also is that, I mean, there's just so many things happening in the world and there's a lot of photons that are going into your eye and it's unclear exactly where some of the pre processing steps are happening.
3:21:29Elon MuskBut I mean, I actually think that just from a fundamental perspective, there's just so much. The reality that we're in, if it's a reality. So there's so much data, and I think humans are just unable to actually eat enough actually to process all that information.
3:21:49Elon MuskSo there's some sort of filtering that does happen. Whether that happens in the retina, whether that happens in different layers of the visual cortex, unclear. But the analogy that I sometimes think about is if your brain is a CCD camera and all of the information in the world is a sun, and when you try to actually look at the sun with the CCD camera, it's just going to saturate the sensors.
3:22:14Elon MuskRight. Because it's an enormous amount of energy. So what you do is you end up adding these filters to just kind of narrow the information that's coming to you and being captured.
3:22:25Elon MuskAnd I think things like our experiences or our.
3:22:36Elon MuskDrugs like propofol, that like anesthetic drug or psychedelics, what they're doing is they're kind of swapping out these filters and putting in new ones or removing older ones and kind of controlling our conscious experience.
3:22:49Lex FridmanYeah, man. Not to distract from the topic, but I just took a very high dose of ayahuasca in the Amazon jungle. So, yes, it's a nice way to think about it.
3:22:57Lex FridmanYou're swapping out different experiences and with neuralink, being able to control that primarily at first to improve function, not for entertainment purposes or enjoyment purposes, but yeah.
3:23:11Elon MuskGiving back lost functions.
3:23:13Lex FridmanGiving back lost functions. And they're. Especially when the function is completely Lost anything is a huge help. Would you implant a neuralink device in your own brain?
3:23:29Elon MuskAbsolutely. I mean, maybe not right now, but absolutely.
3:23:33Lex FridmanWhat kind of capability, once reached, you start getting real curious and almost get a little antsy, like, like jealous of people that get. As you watch them get implanted.
3:23:46Elon MuskYeah, I mean, I think, I mean, even, even with our early participants, if they start to do things that I, I can't do, which I think is in the realm of possibility for them to be able to get 15, 20, if not like 100bps.
3:24:01Elon MuskRight. There's nothing that fundamentally stops us from being able to achieve that type of performance. I mean, I would certainly get jealous that they can do that.
3:24:13Lex FridmanI should say that watching Nolan, I get a little jealous because he's having so much fun and it seems like such a chill way to play video games. Yeah.
3:24:21Elon MuskI mean, the thing that also is hard to appreciate sometimes is that he's doing these things while talking. I mean, it's multitasking.
3:24:31Lex FridmanRight.
3:24:31Elon MuskSo clearly it's obviously cognitively intensive, but similar to how when we talk, we move our hands, these things are multitasking. I mean, he's able to do that. And you won't be able to do that with other assistive technology.
3:24:49Elon MuskAs far as I'm aware. If you're obviously using an eye tracking device, you're very much fixated on that thing that you're trying to do. And if you're using voice control, I mean, if you say some other stuff, you don't get to use that.
3:25:02Lex FridmanYeah, the multitasking aspect of that is really interesting. So it's not just the BPs for the primary task, it's the parallelization of multiple tasks. If you measure the bps for the entirety of the human organism.
3:25:16Lex FridmanSo if you're talking and doing a thing with your mind and looking around also, I mean, there's just a lot of parallelization that can be happening.
3:25:28Elon MuskBut I think at some point for him, if he wants to really achieve those high level BPs, it does require full attention. Right. And that's a separate circuitry that is a big mystery.
3:25:39Elon MuskLike how attention works.
3:25:41Lex FridmanYeah, attention, like cognitive load. I've done, I've read a lot of literature on people doing two tasks. Like you have your primary task and a secondary task. And the secondary task is a source of distraction.
3:25:54Lex FridmanAnd how does that affect the performance of the primary task? And depending on the tasks, there's a lot of interesting. I mean, this is an interesting computational device. Right.
3:26:02Lex FridmanAnd I think there's to say the least a lot of novel insights that can be gained from everything. I mean, I personally am surprised that no one's able to do such incredible control of the cursor while talking.
3:26:15Lex FridmanAnd also being nervous at the same time because he's talking like all of us are. If you're talking in front of the camera, you get nervous. So all of those are coming into play and he's able to still achieve high performance.
3:26:27Lex FridmanSurprising. I mean, all of this is really amazing. And I think just after researching this really in depth, I kind of want it.
3:26:36Elon MuskYou're like, get in the line.
3:26:39Lex FridmanAnd also the safety mind. Well, we should say the registry is for people who have quadriplegia and all that kind of stuff, so.
3:26:46Elon MuskCorrect.
3:26:47Lex FridmanThere'll be a separate line for people they're just curious, like myself. So now that Nolan Patient P1 is part of the ongoing prime study, what's the high level vision for P2, P3, P4, P5, and just the expansion into other human beings that are getting to experience this implant?
3:27:14Elon MuskYeah, I mean, the primary goal is for our study in the first place is to achieve safety endpoints, just understand safety of this device as well as the implantation process, and also at the same time understand the efficacy and the impact that it could have on the potential users lives.
3:27:38Elon MuskAnd just because you're living with tetraplegia, it doesn't mean your situation is same as another person living with tetraplegia. It's wildly, wildly varying. It's something that we're hoping to also understand how our technology can serve not just a very small slice of those individuals, but, you know, broader group of individuals and being able to get the feedback to, you know, just really build just the best product for them.
3:28:11Elon MuskSo our, you know, there's, there's obviously also, you know, goals that we have. And the primary purpose of the early feasibility study is to learn from each and every participant to improve the device, improve the surgery.
3:28:27Elon MuskBefore we embark on what's called a pivotal study. That then is a much larger
3:28:35Lex Fridmantrial
3:28:36Elon Muskthat starts to look at statistical significance of your endpoints, and that's required before you can then market the device. And that's how it works in the US and just generally around the world.
3:28:48Elon MuskThat's the process you follow. So our goal is to really just understand from people like Nolan, P2, P3 future participants, what aspects of our device needs to improve. If it turns out that people are like, I really don't like the fact that it lasts only six hours, I want to be able to use this computer for 24 hours.
3:29:08Elon MuskThat is user needs and user requirements, which we can only find out from just being able to engage with them.
3:29:17Lex FridmanSo before the pivotal study, there's kind of like a rapid innovation based on individual experiences. You're learning from individual people, how they use it, the high resolution details in terms of cursor control and signal and all that kind of stuff to life experience.
3:29:33Elon MuskYeah. So there's hardware changes, but also just firmware updates. So even when we had that sort of recovery event for Nolan, he now has the new firmware that he has been updated with.
3:29:50Elon MuskAnd it's similar to how your phones get updated all the time with new firmwares for security patches, whatever new functionality, ui. And that's something that is possible with our implant.
3:30:00Elon MuskIt's not a static one time device that can only do the thing that it said it can do. I mean, similar to Tesla, you can do over the air firmware updates.
3:30:08Elon MuskAnd now you have completely new user interface and all these bells and whistles and improvements on everything like the latest. Right. When we say generalized platform, that's what we're talking about.
3:30:22Lex FridmanYeah, it's really cool how the, the app that Nolan is using, there's like calibration, all that, all that kind of stuff and then there's update, just. You just click and get an update.
3:30:35Lex FridmanWhat other future capabilities are you kind of looking to? You said Vision. That's a fascinating one. What about sort of accelerated typing or speech, this kind of stuff? Yeah.
3:30:48Lex FridmanWhat, and what else is there?
3:30:49Elon MuskYeah, those, those are still in the realm of movement program. So largely speaking we have two programs. We have the movement program and we have the vision program. The movement program currently is focused around the digital freedom.
3:31:03Elon MuskAs you can easily guess, if you can control 2D cursor in the digital space, you could move anything in the physical space. So robotic arms, wheelchair, your environment, or even really whether it's through the phone or just directly to those interfaces to those machines.
3:31:22Elon MuskSo we're looking at ways to kind of expand those types of capability. Even for Nolan, that requires conversation with the FDA and kind of showing safety data. For if there's a robotic arm or a wheelchair that we can guarantee that they're not going to hurt themselves accidentally.
3:31:42Elon Muskdomain versus in the physical space, you can actually potentially cause harm to the participants. So we're working through that right now. Speech does involve different areas of the brain.
3:31:54Elon MuskSpeech prosthetic is very, very fascinating. And there's actually been A lot of really amazing work that's been happening in academia. Sergei Stabitsky at UC Davis, Jamie Henderson and late Krishna Shinoi at Stanford are doing just some incredible amount of work in improving speech neuroprosthetics.
3:32:15Elon MuskAnd those are actually looking more at parts of the motor cortex that are controlling these focal articulators and being able to even by mouthing the word or imagine speech, you can pick up those signals.
3:32:31Elon MuskThe more sophisticated higher level processing areas like the Broca's area or Wernicke's area, those are still very, very big mystery in terms of the underlying mechanism of how all that stuff works.
3:32:45Elon MuskBut yeah, I think neuralink's eventual goal is to kind of understand those things and be able to provide a platform and tools to be able to understand that and study that.
3:32:58Lex FridmanThis is where I get to the pothead questions. Do you think we can start getting insight into things like thought? So speech is, there's a muscular component, like you said, there's like the act of producing sounds.
3:33:14Lex FridmanBut then what about the internal things like cognition like low level thoughts and high level thoughts? Do you think we'll start noticing kind of signals that could be picked up that could, they could be understood that could be maybe used in order to interact with the outside world?
3:33:35Elon MuskIn some ways like I guess this starts to kind of get into the hard problem of consciousness. And I mean on one hand all of these are at some point set of electrical signals that from there maybe it in itself is giving you the cognition or the meaning or somehow human mind is incredibly amazing storytelling machine.
3:34:07Elon MuskSo we're telling ourselves and fooling ourselves that there's some interesting meaning here. But I certainly think that PCI and really PCI at the end of the day is a set of tools that help you kind of study the underlying mechanisms in both local but also broader
3:34:28Neuralink teamsense
3:34:30Elon Muskand whether there's some interesting patterns of electrical signal that means you're thinking this versus and you can either learn from many, many sets of data to correlate some of that and be able to do mind reading or not, I'm not sure.
3:34:47Elon MuskI certainly would not kind of rule that out as a possibility. But I think BCI alone probably can't do that. There's probably additional set of tools and framework and also just hard problem of consciousness at the end of the day is rooted in this philosophical question of what is the meaning of it all?
3:35:07Elon MuskWhat's the nature of our exist? Where does the mind emerge from this complex network?
3:35:13Lex FridmanYeah, how does the subjective experience emerge from just A bunch of spikes. Electrical spikes.
3:35:21Elon MuskYeah, yeah. I mean we do really think about BCI and what we're building as a tool for understanding the mind, the brain. The only question that matters there actually is some biological existence proof of like what it would take to kind of start to form some of these experiences that may be unique.
3:35:47Elon MuskIf you actually look at every one of our brains, there are two hemispheres, there's a left sided brain, there's a right sided brain. And I mean unless you have some other conditions, you normally don't feel like left lex or right legs, you just feel like one legs.
3:36:06Elon MuskRight. So what is happening there? Right. If you actually look at the two hemispheres, there's a structure that kind of connectorize the two called the corpus callosum that is supposed to have around 200 to 300 million connections or axons.
3:36:27Elon MuskSo whether that means that's the number of interface and electrodes that we need to create some sort of mind meld or from that whatever new conscious experience that you can experience.
3:36:42Elon MuskBut I do think that there's kind of an interesting existence proof that we all have.
3:36:52Lex FridmanAnd that threshold is unknown at this time.
3:36:55Elon MuskOh yeah. Everything in this domain is speculation.
3:36:59Neuralink teamRight. And then there will be.
3:37:03Lex FridmanYou'd be continuously pleasantly surprised. Do you see a world where there's millions of people, like tens of millions, hundreds of millions of people walking around with the neuralink device or multiple neuralink devices in their brain?
3:37:20Elon MuskI do. First of all, there are like if you look at worldwide people suffering from movement disorders and visual deficits, I mean that's in the tens if not hundreds of millions of people.
3:37:35Elon MuskSo that alone I think there's a lot of benefit and potential good that we can do with this type of technology. And once you start to get into kind of neuro psychiatric application, depression, anxiety, hunger or you know, obesity.
3:37:56Lex FridmanRight.
3:37:57Elon MuskLike mood, control of appetite, I mean that starts to become, you know, very real to everyone.
3:38:06Lex FridmanNot to mention that every, most people on earth have a smartphone. And once BCI starts competing with a smartphone as a preferred methodology of interacting with the digital world, that also becomes an interesting thing.
3:38:24Elon MuskOh yeah, this is even before going to that. Right. I mean there's like almost the entire world that could benefit from these types of things. And then if we're talking about kind of next generation of how we interface with machines or even ourselves in many ways I think BCI can play a role in that.
3:38:47Elon MuskAnd some of the things that I also talk about is I do think that there is a real possibility that you could see 8 billion people walking around with Neuralink.
3:38:58Lex FridmanWell, thank you so much for pushing ahead, and I look forward to that exciting future.
3:39:04Elon MuskThanks for having me.
3:39:06Lex FridmanThanks for listening to this conversation with DJ Sam. And now, dear friends, here's Matthew McDougall, the head neurosurgeon at Neuralink. When did you first become fascinated with the human brain?
3:39:21Neuralink teamSince forever, as far back as I can remember, I've been interested in the human brain. I mean, I was, you know, a thoughtful kid and a bit of an outsider.
3:39:34Neuralink teamAnd you, you know, sit there thinking about what the most important things in the world are in your. In your little tiny adolescent brain. And the answer that I came to, that I converged on, was that all of the things you can possibly conceive of as things that are important for human beings to care about are literally contained, you know, in the skull.
3:40:00Neuralink teamBoth the perception of them and their relative values and, you know, the solutions to all our problems and all of our problems are all contained in the skull. And if we knew more about how that worked, how the brain encodes information and generates desires and generates agony and suffering, we could do more about it.
3:40:27Neuralink teamYou know, you think about all the. All the really great triumphs in human history. You think about all the really horrific tragedies. You know, you think about the Holocaust, you think about any prison full of human stories, and all of those problems boil down to neurochemistry.
3:40:50Neuralink teamSo if you get a little bit of control over that, you provide people the option to do better. In the way I read history, the way people have dealt with having better tools is that they most often in the end do better with huge asterisks.
3:41:08Neuralink teamBut I think it's an interesting, worthy and noble pursuit to give people more options, more tools.
3:41:15Lex FridmanYeah, that's a fascinating way to look at human history. You just imagine all these neurobiological mechanisms. Stalin, Hitler, all these Genghis Khan, all of them just had like a brain.
3:41:28Lex FridmanIt just a bunch of neurons, you know, like a few tens of billions of neurons gaining a bunch of information over a period of time. They have set a module that does language and memory and all that.
3:41:40Lex FridmanAnd from there, in. In the case of those people, they're able to murder millions of people.
3:41:44Neuralink teamYeah.
3:41:45Lex FridmanAnd all that coming from. There's not some glorified notion of a. A dictator of this enormous mind or something like this. It's just. It's just the brain.
3:41:59Neuralink teamYeah, yeah. I mean, a lot of that has to do with how well people like that can organize those around them.
3:42:08Lex FridmanOther brains. Yeah.
3:42:09Neuralink teamAnd so I always find it interesting to look to primatology, you know, look to our closest non human relatives for clues as to how humans are going to behave and, and what particular humans are able to achieve.
3:42:25Neuralink teamAnd so you look at chimpanzees and bonobos and, you know, they're similar, but different in their social structures particularly. And I went to Emory in Atlanta and studied under Franz de Waal, the great Franz de Waal, who was kind of the leading primatologist who recently died, and his work at looking at chimps through the lens of how you would watch an episode of Friends and understand the motivations of the characters interacting with each other.
3:42:58Neuralink teamHe would look at a chimp colony and basically apply that lens. I'm massively oversimplifying it. If you do that, instead of just saying Subject 473 through his feces at Subject 471, you talk about them in terms of their human struggles, accord them the dignity of themselves as actors with understandable goals and drives what they want out of life.
3:43:28Neuralink teamAnd primarily it's, you know, the things we want out of life. Food, sex, companionship, power. You can understand chimp and bonobo behavior in the same lights much more easily.
3:43:45Neuralink teamAnd I think doing so gives you the tools you need to reduce human behavior from that kind of false complexity that we layer onto it with language and look at it in terms of, oh, well, these humans are looking for companionship, sex, food, power.
3:44:06Neuralink teamAnd I think that that's a pretty powerful tool to have in understanding human behavior.
3:44:10Lex FridmanAnd I just went to the Amazon jungle for a few weeks, and it's a very visceral reminder that a lot of life on Earth is just trying to get laid.
3:44:20Lex FridmanYeah, they're all screaming at each other like, I saw a lot of monkeys and they're just trying to impress each other. Or maybe there's a battle for power. But a lot of the battle for power has to do with them getting laid.
3:44:32Neuralink teamRight. Reading rights often go with alpha status, and so if you can get a piece of that, then you're going to do okay.
3:44:40Lex FridmanAnd we'd like to think that we're somehow fundamentally different, but especially when it comes to primates where really are. You know, we can use fancier, poetic language, but maybe some of the underlying drives that motivate us are similar.
3:44:57Neuralink teamYeah, I think that's true.
3:44:58Lex FridmanAnd all of that is coming from this, the brain.
3:45:01Elon MuskYeah.
3:45:02Lex FridmanSo when did you first start studying the brain as a biological mechanism?
3:45:07Neuralink teamBasically, the moment I got to college, I started looking around for labs that I could do neuroscience work in. I originally approached that from the angle of looking at interactions between the brain and the immune system, which isn't the most obvious place to start.
3:45:23Neuralink teamBut I had this idea at the time that the contents of your thoughts would have an impact, a direct impact, maybe a powerful one, on non conscious systems in your body.
3:45:41Neuralink teamThe systems we think of as, you know, homeostatic automatic mechanisms like fighting off a virus, like repairing a wound. And sure enough, there are big crossovers between the two.
3:45:55Neuralink teamI mean, it gets to kind of a key point that I think goes under recognized. One of the things people don't recognize or appreciate about the human brain enough, and that is that it basically controls or has a huge role in almost everything that your body does.
3:46:16Neuralink teamLike, you try to try to name an example of something in your body that isn't directly controlled or massively influenced by the brain. And it's pretty hard. I mean, you might say like bone healing or something, but even those systems, the hypothalamus and pituitary, end up playing a role in coordinating the endocrine system that does have a direct influence on say, the calcium level in your blood that goes to bone healing.
3:46:44Neuralink teamSo non obvious connections between those things implicate the brain as really a potent prime mover in all of health.
3:46:55Lex FridmanOne of the things I realized in the other direction too, how most of the systems in the body are integrated with the human brain. Like they affect the brain also, like the immune system.
3:47:07Lex FridmanI think there's just, you know, people who study Alzheimer's and those kinds of things. It's just surprising how much you can understand of that from the immune system, from the other systems that don't obviously seem to have anything to do with sort of the nervous system.
3:47:27Lex FridmanThey all play together.
3:47:28Neuralink teamYeah, you could understand how that would be driven by evolution too. Just in some simple examples, if you get sick, if you get a communicable disease, you get the flu, it's pretty advantageous for your immune system to tell your brain, hey now, be antisocial for a few days.
3:47:50Neuralink teamDon't go be the life of the party tonight. In fact, maybe just cuddle up somewhere warm under a blanket and just stay there for a day or two. And sure enough, that tends to be the behavior that you see both in animals and in humans.
3:48:03Neuralink teamIf you get sick, elevated levels of interleukins in your blood and TNF alpha in your blood ask the brain to cut back on social activity. And even moving around, you have lower locomotor activity in animals that are infected with viruses.
3:48:25Lex FridmanSo from there, the early days in neuroscience to surgery, when did that step happen? It's a leap.
3:48:34Neuralink teamYou know, it was sort of an evolution of thought. I wanted to study the brain. I started studying the brain in undergrad in this neuroimmunology lab. I from there realized at some point that I didn't want to just generate knowledge.
3:48:54Neuralink teamI wanted to affect real changes in the actual world, in actual people's lives. And so after having not really thought about going into medical school, I was on a track to go into a PhD program.
3:49:09Neuralink teamI said, well, I'd like that option. I'd like to actually potentially help tangible people. In front of me and doing a little digging, found that there exists these MD PhD programs where you can choose not to choose between them and do both.
3:49:30Neuralink teamAnd so I went to USC for medical school and had a joint PhD program with Caltech, where I met. Actually chose that program particularly because of a researcher at Caltech named Richard Anderson, who's one of the godfathers of primate neuroscience, has a macaque lab where Utah rays and other electrodes were being inserted into the brains of monkeys to try to understand how intentions were being encoded in the brain.
3:50:03Neuralink teamSo, you know, I ended up there with the idea that maybe I would be a neurologist and study the brain on the side and then discovered that neurology. Again, I'm gonna make enemies by saying this, but neurology predominantly, and distressingly to me, is the practice of diagnosing a thing and then saying, good luck with that when there's not much we can do.
3:50:32Neuralink teamAnd neurosurgery very differently, is a. It's a powerful lever on taking people that are headed in a bad direction and changing their course in the sense of brain tumors that are potentially treatable or curable with surgery, you know, even aneurysms in the brain, blood vessels that are going to rupture, you can save lives, really, is, at the end of the day, what mattered to me.
3:50:59Neuralink teamAnd so I was at usc, as I mentioned, that happens to be one of the great neurosurgery programs. And so I met these truly epic neurosurgeons, Alex Khalessi and Mike Apuzzo and Steve Giannotta and Marty Weiss, these sort of epic people that were just human beings in front of me.
3:51:22Neuralink teamAnd so it kind of changed my thinking from neurosurgeons are distant gods that live on another planet and occasionally come and visit us. To these are humans that have problems and are people.
3:51:36Neuralink teamAnd there's nothing fundamentally preventing me from being one of them. And so at the last minute in medical school, I changed gears from going into a different specialty and switched into neurosurgery, which cost me a year.
3:51:52Neuralink teamI had to do another year of research because I was so far along in the process that to switch into neurosurgery, the deadlines had already passed. It was a decision that cost time, but absolutely worth it.
3:52:08Lex FridmanWhat was the hardest part of the training on the neurosurgeon track?
3:52:14Neuralink teamYeah, two things. I think that, you know, residency in neurosurgery is sort of a competition of pain. Of, like, how much pain can you eat and smile.
3:52:24Lex FridmanYeah.
3:52:26Neuralink teamAnd so there's workout restrictions that are not really. They're viewed at, I think, internally among the residents as weakness. And so most neurosurgery residents try to work as hard as they can.
3:52:43Neuralink teamAnd that, I think necessarily means working long hours and sometimes over the work hour limits. And, you know, we care about being compliant with whatever regulations are in front of us.
3:52:54Neuralink teamBut I think more important than that, people want to give all. Give their all in becoming a better neurosurgeon because the. The stakes are so high. And so it's a real fight to get residents to, say, go home at the end of their shift and not stay and do more surgery.
3:53:12Lex FridmanAre you seriously saying, like, one of the hardest things is literally, like, getting. Forcing them to get sleep and rest and all this kind of stuff?
3:53:20Neuralink teamHistorically, that was the case, I think. I think the next generation. I think the next generation is more compliant and more weaker is what you mean.
3:53:30Lex FridmanAll right, I'm just. I'm just kidding. I'm just kidding.
3:53:32Neuralink teamI didn't say it.
3:53:33Lex FridmanNow I'm making enemies.
3:53:34Neuralink teamNo.
3:53:35Lex FridmanOkay, I get it. Wow, that's fascinating. So what was the second thing?
3:53:38Neuralink teamThe personalities. And maybe the two are connected.
3:53:42Lex FridmanBut was it pretty competitive?
3:53:45Elon MuskCompetitive.
3:53:45Neuralink teamAnd it's also, you know, as we touched on earlier, primates like power. And I think neurosurgery has long had this aura of mystique and excellence and whatever about it.
3:54:02Neuralink teamAnd so it's an invitation, I think, for people that are cloaked in that authority. You know, a board certified neurosurgeon is basically a walking, fallacious appeal to authority. Right.
3:54:14Neuralink teamYou have license to walk into any room and act like you're, you know, an expert on whatever. And fighting that tendency is not something that most neurosurgeons do. Well, humility isn't the forte.
3:54:28Lex FridmanYeah, one of the. So I have friends who know you, and whenever they speak about you, that Yours have the surprising quality for a neurosurgeon of humility, which I think indicates that it's not.
3:54:43Lex FridmanIt's not as common as perhaps in other professions, because there is a kind of gigantic sort of heroic aspect to neurosurgery, and I think it gets to people's head a little bit.
3:54:54Neuralink teamYeah, well, that. I think that, you know, that allows me to play well at an Elon company, because Elon, one of his strengths, I think, is to just instantly see through fallacy from authority.
3:55:13Neuralink teamSo nobody walks into a room that he's in and says, well, God damn it, you have to trust me. I'm the guy that built the last 10 rockets or something.
3:55:22Neuralink teamAnd he says, well, you did it wrong and we can do it better. Or I'm the guy that kept Ford alive for the last 50 years. You listen to me on how to build cars.
3:55:30Neuralink teamAnd he says, no. And so you don't walk into a room that he's in and say, well, I'm a neurosurgeon. Let me tell you how to do it. He's going to say, well, I'm a human being that has a brain.
3:55:43Neuralink teamI can think from first principles myself, thank you very much. And here's how I think it ought to be done. Let's go try it and see who's right. And that's proven, I think, over and over in his case, to be a very powerful approach.
3:55:56Lex FridmanIf we just take that tangent, there's a fascinating interdisciplinary team at Neuralink that you get to interact with, including Elon. What do you think is the secret to a successful team?
3:56:12Lex FridmanWhat have you learned from just getting to observe these folks? Yeah, world experts in different disciplines work together.
3:56:20Neuralink teamYeah. There's a sweet spot where people disagree and forcefully speak their mind and passionately defend their position and yet are still able to accept information from others and change their ideas when they're wrong.
3:56:40Neuralink teamAnd so I like the analogy of sort of how you Polish rocks. You put hard things in a hard container and spin it. People bash against each other, and out comes, you know, a more refined product.
3:56:57Neuralink teamAnd so to make a good team at Neuralink, we've tried to find, you know, people that are not afraid to defend their ideas passionately and, you know, occasionally strongly disagree with people that they're.
3:57:14Neuralink teamThat they're working with and have the best idea come out on top of. It's not an easy balance, again, to refer back to the primate brain. It's not something that is inherently built into the primate brain to say, I passionately put all my chips on this position.
3:57:36Neuralink teamAnd now I'm just going to walk away from it. Admit you were right. You know, part of our brains tell us that that is a power loss. That is a loss of face, loss of standing in the community.
3:57:47Neuralink teamAnd now you're a Zeta chump because your idea got trounced. And you just have to recognize that little voice in the back of your head is maladaptive, and it's not helping the team win.
3:58:04Lex FridmanYeah. You have to have the confidence to be able to walk away from an idea that you hold on to. And if you do that often enough, you're actually going to become the best in the world at your thing.
3:58:16Lex FridmanI mean, that kind of. That rapid iteration. Yeah.
3:58:19Neuralink teamYou'll at least be a member of a winning team.
3:58:22Lex FridmanRide the wave. What did you learn? You mentioned there's a lot of amazing neurosurgeons at usc. What lessons about surgery and life have you learned from those folks?
3:58:35Neuralink teamYeah, I think working your ass off, working hard while functioning as a member of a team, getting a job done that is incredibly difficult. Working incredibly long hours, being up all night, taking care of someone that you think probably won't survive no matter what you do, working hard to make people that you passionately dislike look good the next morning.
3:59:06Neuralink teamThese folks were relentless in their pursuit of excellent neurosurgical technique, decade over decade, and I think we're well recognized for that excellence. So it's, you know, especially Marty Weiss, Steve Giannotta, Mike Capuzzo.
3:59:25Neuralink teamThey made huge contributions not only to surgical technique, but they built training programs that trained dozens or hundreds of amazing neurosurgeons. I was just lucky to kind of be in their wake.
3:59:42Lex FridmanWhat's that? Like? You mentioned doing a surgery where the person is likely not to survive. Does that wear on you?
3:59:54Neuralink teamYeah.
4:00:02Elon MuskYou know, it's especially challenging when you, with all respect to our elders, it doesn't hit so much when you're taking care of an 80 year old and something was going to get them pretty soon anyway.
4:00:23Elon MuskAnd so you lose a patient like that and it, it was part of the natural course of what is expected of them in the coming years. Regardless, taking care of, you know, a father of two or three, four young kids, someone in their 30s that didn't have it coming and they show up in your ER having their first seizure of their life and lo and behold, they've got a huge, malignant, inoperable or incurable brain tumor.
4:01:01Elon MuskYou can only do that I think a handful of times before it really starts eating away at your armor. Or a young mother that shows up that has a giant hemorrhage in her brain that she's not going to survive from.
4:01:19Elon MuskAnd you know, they bring her four year old daughter in to say goodbye one last time before they turn the ventilator off.
4:01:26Lex FridmanThat,
4:01:30Elon Muskyou know, the great Henry Marsh is an English neurosurgeon who said it best. I think he says every neurosurgeon carries with them a private graveyard. And I definitely feel that especially with young parents that, that kills me.
4:01:47Elon MuskThey, they had a lot more to give. The, the loss of those people specifically has a, you know, knock on effect that's going to make the world worse for people for a long time.
4:02:03Elon MuskAnd it's just hard to feel powerless in the face of that, you know, and that's where I, I think you have to be borderline evil to fight against a company like neuralink or to constantly be taking potshots at us.
4:02:21Elon MuskBecause what we're doing is to try to fix that stuff. We're trying to give people options to reduce suffering. We're trying to take the pain out of life that broken brains brings in.
4:02:43Elon MuskAnd yeah, this is just our, our little way that we're fighting back against entropy, I guess.
4:02:52Lex FridmanYeah, that's the, the amount of suffering that's endured when some of the things that we take for granted that our brain is able to do is taken away is immense.
4:03:02Lex FridmanAnd to be able to restore some of that functionality is a real gift.
4:03:06Elon MuskYeah, we're just starting. We're going to do so much more.
4:03:11Lex FridmanWell, can you take me through the full procedure for implanting say the N1 chip in Neuralink?
4:03:18Elon MuskYeah, it's a really simple, really simple, straightforward procedure. The human part of the surgery that I do is dead simple. It's one of the most basic neurosurgery procedures imaginable.
4:03:34Elon MuskAnd I think there's evidence that it, some version of it has been done for thousands of years. There are examples, I think from ancient Egypt of healed or partially healed trephinations.
4:03:47Elon MuskAnd from Peru or, you know, ancient times in South America, where these proto surgeons would drill holes in people's skulls, you know, presumably to let out the evil spirits, but maybe to drain blood clots.
4:04:04Elon MuskAnd there's evidence of bone healing around the edge, meaning the people at least survive some months after a procedure. And so what we're doing is that we are making a cut in the skin on the top of the head over the area of the brain that is the most potent representation of hand intentions.
4:04:25Elon MuskAnd so if you are an expert concert pianist, this part of your brain is lighting up the entire time you're playing. We call it the hand knob.
4:04:36Lex FridmanThe hand knob. So it's all the finger movements, all of that is just firing away?
4:04:43Elon MuskYep. There's a little squiggle in the cortex right there. One of the folds in the brain is kind of doubly folded right on that spot. And so you can look at it on an MRI and say that's the hand knob.
4:04:55Elon MuskAnd then you do a functional test in a special kind of MRI called a functional MRI fmri. And this part of the brain lights up when people, even quadriplegic people whose brains aren't connected to their finger movements anymore, they imagine finger movements and this part of the brain still lights up.
4:05:13Elon MuskSo we can ID that part of the brain in anyone who's preparing to enter our trial and say, okay, that part of the brain we confirm is your hand intention area.
4:05:27Elon MuskAnd so I'll make a little cut in the skin, we'll flap the skin open just like kind of opening the hood of a car, only a lot smaller. Make a perfectly round 1 inch diameter hole in the skull, remove that bit of skull, open the lining of the brain, the covering of the brain.
4:05:49Elon MuskIt's like a, like a little bag of water that the brain floats in and then show that part of the brain to our robot. And then this is where the robot shines.
4:06:00Elon MuskIt can come in and take these tiny, you know, much smaller than human hair electrodes and precisely insert them into, into the cortex, into the surface of the brain to a very precise depth in a very precise spot that avoids all the blood vessels that are coating the surface of the brain.
4:06:22Elon MuskAnd after the robot's done with its part, then the human comes back in and puts the implant into that hole in the skull and covers it up, screwing it down to the skull and sewing the skin back together.
4:06:37Elon MuskSo the whole thing is a few hours long. It's extremely low risk compared to the average neurosurgery involving the brain that might, say, open up a deep part of the brain or manipulate blood vessels in the brain.
4:06:53Elon MuskThis opening on the surface of the brain with only cortical microinsertions carries significantly less risk than a lot of the tumor or aneurysm surgeries that are routinely done.
4:07:10Lex FridmanSo cortical microinsertions that are, via robot and computer vision, are designed to avoid the blood vessels.
4:07:18Elon MuskExactly.
4:07:19Lex FridmanSo I know you're a bit biased here, but let's compare human and machine.
4:07:23Elon MuskSure.
4:07:24Lex FridmanSo what are human surgeons able to do well, and what are robot surgeons able to do well at this stage of our human civilization development?
4:07:37Elon MuskYeah, yeah, that's a good question. Humans are general purpose machines. We're able to adapt to unusual situations. We're able to change the plan on the fly. I remember, well, a surgery that I was doing many years ago down in San Diego where the plan was to open a small hole behind the ear and go reposition a blood vessel that had come to lay on the facial nerve, the trigeminal nerve, the nerve that goes to the face.
4:08:14Elon MuskWhen that blood vessel lays on the nerve, it can cause just intolerable, horrific shooting pain that people describe like being zapped with a cattle prod. And so the beautiful, elegant surgery is to go move this blood vessel off the.
4:08:29Elon MuskOff the nerve. The surgery team, we went in there and started moving this blood vessel and then found that there was a giant aneurysm on that blood vessel that was not easily visible on the pre op scans.
4:08:41Elon MuskAnd so the plan had to dynamically change. And the human surgeons had no problem with that, were trained for all those things. Robots wouldn't do so well in that situation, at least in their current incarnation.
4:08:56Elon MuskFully robotic surgery, like, you know, the, the electrode insertion portion of, of the neuralink surgery, it goes according to a set plan. And so the humans can interrupt the flow and change the plan, but the robot can't really change the plan midway through.
4:09:14Elon MuskIt operates according to how it was programmed and how it was asked to run. It does its job very precisely, but not with a wide degree of latitude and how to react to changing conditions.
4:09:29Lex FridmanSo there could be just a very large number of ways that you could be surprised as a surgeon when you enter a situation. There could be subtle things that you have to dynamically adjust to correct and Robots are not good at that.
4:09:42Elon MuskCurrently, currently I think we are at the dawn of a new era with AI of the parameters for robot responsiveness to be dramatically broadened. Right. I mean you can't look at a self driving car and say that it's operating under very narrow parameters.
4:10:04Elon MuskYou know, if a chicken runs across the road, it wasn't necessarily programmed to deal with that specifically, but it, a Waymo or a self driving Tesla would have no problem reacting to that appropriately.
4:10:17Elon MuskAnd so surgical robots aren't there yet, but give it time and then there
4:10:24Lex Fridmancould be a lot of sort of semi autonomous possibilities of maybe a robotic surgeon could say this situation is perfectly familiar or the situation is not familiar. And in the not familiar over, but basically like be very conservative and saying, okay, this for sure has no issues, no surprises and let the humans deal with the surprises.
4:10:48Lex FridmanWith the edge cases, all that. Yeah, that's one possibility. So you think eventually you'll be out of the job? Well, you being neurosurgeon, your job being neurosurgeon, humans, there will not be many neurosurgeons left on this earth.
4:11:06Elon MuskI'm not worried about my job. In my, in the course of my professional life, I think I, I would tell my, my kids not necessarily to go in this line of work.
4:11:18Elon MuskDepending on, depending on how things look in 20 years.
4:11:24Lex FridmanIt's so fascinating because I, I mean I, if I have a line of work, I would say it's programming. And if you ask me, like for the last, I don't know, 20 years, what I would recommend for people, I would tell them, yeah, go.
4:11:37Lex FridmanYou will always have a job if you're a programmer because there's more and more computers and all this kind of stuff and it pays well. But then you realize these large language models come along and they're really damn good at generating code.
4:11:50Lex FridmanSo overnight you could be surprised, like, wow, what is the contribution of the human really? But then you start to think, okay, it does seem like humans have ability, like you said, to deal with novel situations.
4:12:03Lex FridmanIn the case of programming, it's the ability to kind of come up with novel ideas to solve problems. It seems like machines aren't quite yet able to do that.
4:12:16Lex FridmanAnd when the stakes are very high, when it's life critical, as it is in surgery, especially in neurosurgery, then it starts the stakes are very high for a robot to actually replace a human.
4:12:28Lex FridmanBut it's fascinating in this case of neuralink, there's a human robot collaboration.
4:12:34Elon MuskYeah, yeah. It's I do the parts it can't do, and it does the parts I can't do. And we, we are friends.
4:12:45Lex FridmanI saw that there's a lot of practice going on, so, I mean, everything in Neuralink is tested extremely rigorously. But one of the things I saw that there's a proxy on which the surgeries are performed.
4:12:58Lex FridmanYeah. So this is both for the robot and for the human, for everybody involved in the entire pipeline. Yep. What's that like practicing the surgery?
4:13:07Elon MuskIt's pretty intense. So there's no analog to this in human surgery. Human surgery is sort of this artisanal craft that's handed down directly from master to pupil over the generations.
4:13:22Lex FridmanYes.
4:13:23Elon MuskI mean, literally, the way you learn to be a surgeon on humans is by doing surgery on humans. I mean, first you watch your professors do a bunch of surgery, and then finally they put, you know, the trivial parts of the surgery into your hands and then the more complex parts.
4:13:43Elon MuskAnd as your understanding of the point and the purposes of the surgery increases, you get more responsibility in the perfect condition. Doesn't always go well. In Neuralink's case, the approach is a bit different.
4:13:59Elon MuskWe, of course, practiced as far as we could on animals. We did hundreds of animal surgeries. And when it came time to do the first human, we had just an amazing team of engineers build incredibly lifelike models.
4:14:18Elon MuskOne of the engineers, Brian Romano in particular, built a pulsating brain in a custom 3D printed skull that matches exactly the the patient's anatomy, including their face and scalp characteristics.
4:14:35Elon MuskAnd so when I was able to practice that, I mean, it's as close as it really reasonably should get to, to being the real thing and all the details, including having a mannequin body attached to this custom head.
4:14:54Elon MuskAnd so when we were doing the practice surgeries, we'd wheel that body into the CT scanner and take a mock CT scan and wheel it back in and conduct all the normal safety checks verbally.
4:15:09Elon MuskStop this patient. We're confirming his identification is mannequin number, blah, blah, blah, and then opening the brain in exactly the right spot using standard operative neuronavigation equipment, standard surgical drills in the same.
4:15:25Elon MuskOr that we do all of our practice surgeries in at neuralink, and having the skull open and have the brain pulse, which adds a degree of difficulty for the robot to perfectly precisely plan and insert those electrodes to the right depth and location.
4:15:44Elon MuskAnd so, yeah, we. We kind of broke new ground on how extensively we practiced for this surgery.
4:15:52Lex FridmanSo there was a historic moment, a big milestone for Neuralink, in part for humanity with the first human getting a neuralink implant in January of this year. Take me through the surgery on Noland.
4:16:11Lex FridmanWhat did it feel like to be part of this?
4:16:12Elon MuskYeah, well, we, we're lucky to have just incredible partners at the Barrow Neurologic Institute. They are, I think, the premier neurosurgical hospital in the world. They, they made everything as easy as possible for the trial to get going and helped us immensely with their expertise on how to, how to arrange the details.
4:16:41Elon MuskIt was a much more high pressure surgery in some ways. I mean, even though the, you know, the outcome wasn't particularly in question in terms of our participants safety, the number of observers, you know, the number of people, there's conference rooms full of people watching live streams in the hospital, rooting for this to go perfectly.
4:17:06Elon MuskAnd that just adds pressure that is not typical for even the most intense production Neurosurgery, say removing a tumor or placing deep brain stimulation electrodes. And it had never been done on a human before.
4:17:23Elon MuskThere were unknowns and so definitely a moderate pucker factor there for the whole team. Not knowing if we were going to encounter, say, a degree of brain movement that was unanticipated or a degree of brain sag that took the brain far away from the skull and made it difficult to insert or some other unknown, unknown problem.
4:17:54Elon MuskFortunately, everything went well and that, that surgery was one of the smoothest outcomes we could have imagined.
4:18:03Lex FridmanWere you nervous? I mean, you're extremely quarterback in the super bowl kind of situation.
4:18:07Elon MuskExtremely nervous. Extremely. I was very pleased when it went well and then and when it was over. Looking forward to number two. Yeah.
4:18:17Lex FridmanEven with all that practice, all of that, just. You've never been in a situation that's so high stakes in terms of people watching. Yeah. And we should also probably mention, given how the media works, a lot of people, you know, maybe in a dark kind of way, hoping it doesn't go well.
4:18:35Elon MuskWell, I think wealth is easy to hate or envy or whatever. And I think there's a whole industry around driving clicks and bad news is great for clicks. And so any way to take an event and turn it into bad news is going to be really good for clicks.
4:19:00Lex FridmanIt just sucks because I think it puts pressure on people, it discourages people from trying to solve really hard problems. Because to solve hard problems, you have to go into the unknown, you have to do things that haven't been done before and you have to take risks, calculated risks.
4:19:16Lex FridmanYou have to do all kinds of safety precautions, but risks nevertheless. And Uh, I just wish there would be more celebration of that, of the risk taking versus like people just waiting on the, on, on the sidelines.
4:19:29Lex FridmanLike waiting for failure.
4:19:30Elon MuskYeah.
4:19:30Lex FridmanAnd then pointing out the failure. Yeah, it sucks. But you know, in this case it's, it's really great that everything went just flawlessly, but it's unnecessary pressure.
4:19:40Elon MuskI would say now that there's a human with literal skin in the game, you know, there's a participant who, whose well being rides on this doing well. You have to be a pretty bad person to be rooting for that to go wrong.
4:19:55Elon MuskAnd so, you know, hopefully people look in the mirror and realize that at some point.
4:20:01Lex FridmanSo did you get to actually front row seat, like watch the robot work? Like what, you get to see the whole thing?
4:20:08Elon MuskYeah, I mean, I, you know, because an MD needs to be in charge of all of the medical decision making throughout the process. I unscrubbed from the surgery after exposing the brain and presenting it to the robot and placed the targets on the robot software interface that tells the robot where it's going to insert each thread.
4:20:34Elon MuskThat was done with my hand on the mouse, for whatever that's worth.
4:20:39Lex FridmanSo you were the one placing the targets. Oh, cool. So the robot with a computer vision provides a bunch of candidates and you kind of finalize the decision.
4:20:52Elon MuskRight. The software engineers are amazing on this team and so they actually provided an interface where you can essentially use a lasso tool and select a prime area of brain real estate and it will automatically avoid the blood vessels in that region and automatically place a bunch of targets.
4:21:14Elon MuskSo, you know, that allows, you know, the human robot operator to select really good areas of brain and make dense applications of targets in that in those regions, the regions we think are going to have the most high fidelity representations of finger movements and arm movement intentions.
4:21:38Lex FridmanI've seen images of this and for me with ocd, it's for some reason a really pleasant. I think there's a subreddit called oddly satisfying.
4:21:46Elon MuskYeah, love that subreddit.
4:21:49Lex FridmanIt's oddly satisfying to see the different target sites avoiding the blood vessels and also maximizing the usefulness of those locations for the signal. It just feels good. It's like, ah.
4:22:02Elon MuskAs a person who has a visceral reaction to the brain bleeding, I can tell you, yes, it's extremely satisfying watching the electrodes go into the brain and not cause bleeding.
4:22:12Lex FridmanYeah, yeah. So you said the feeling was of relief when everything went perfectly.
4:22:18Elon MuskYeah.
4:22:20Lex FridmanHow deep in the brain can you currently go? And eventually go, let's say on the neuralink side, it seems the deeper you go in the brain, the more challenging it becomes.
4:22:34Elon MuskYeah. So talking broadly about neurosurgery, we can get anywhere. It's routine for me to put deep brain stimulating electrodes near the very bottom of the brain, entering from the top and passing about a 2 millimeter wire all the way into the bottom of the brain.
4:22:55Elon MuskAnd that's not revolutionary. A lot of people do that and we can do that with very high precision. I use a robot from Globus to do that surgery, you know, several times a month.
4:23:10Elon MuskIt's, it's pretty routine.
4:23:12Lex FridmanWhat are your eyes in that situation? What, what are you seeing? What's, what kind of technology can you use to visualize are, to light your way?
4:23:20Elon MuskYeah, so it's cool process. On the software side, you take a preoperative mri, that's extremely high resolution data of the entire brain, and you put the patient to sleep, put their head in a frame that holds the skull very rigidly, and then you take a CT scan of their head while they're asleep with that frame on, and then merge the MRI and the CT in software.
4:23:47Elon MuskYou have a plan based on the MRI where you can see these nuclei deep in the brain. You can't see them on ct, but if you trust the merging of the two images, then you indirectly know on the CT where that is and therefore indirectly know where in reference to the titanium frame screwed to their head those targets are.
4:24:11Elon MuskAnd so this is 60s technology to manually compute trajectories given the entry point and target and dial in some goofy looking titanium actuators with manually manual actuators with little tick marks on them.
4:24:32Elon MuskThe modern version of that is to use a robot, you know, just like a little Kuka arm. You might see it building cars at the Tesla factory. This small robot arm can show you the trajectory that you intended from the pre op MRI and establish a very rigid holder through which you can drill a small hole in the skull and pass a small rigid wire deep into that area of the brain that's hollow and put your electrode through that hollow wire and then remove all of that except the electrode.
4:25:06Elon MuskSo you end up with the electrode very, very precisely placed far from the skull surface. Now that's standard technology that's already been out in the world for a while.
4:25:21Elon MuskNeuralink right now is focused entirely on cortical targets, surface targets, because there's no trivial way to get, say, hundreds of wires deep inside the brain without doing a lot of damage.
4:25:36Elon MuskSo your question, what do you see Well, I see an MRI on a screen, I can't see everything that that DBS electrode is passing through on its way to that deep target.
4:25:48Elon MuskAnd so it's accepted with this approach that there's going to be about 1 in 100 patients who have a bleed somewhere in the brain as a result of passing that wire blindly into the deep part of the brain.
4:26:05Elon MuskThat's not an acceptable safety profile for neuralink. We start from the position that we want this to be dramatically, maybe two or three orders of magnitude safer than that.
4:26:19Elon MuskSafe enough really that you or I, without a profound medical problem, might on our lunch break someday say, yeah, sure, I'll get that. I'd be meaning to upgrade to the latest version.
4:26:31Elon MuskAnd so the safety constraints given the, that are high. And so we haven't settled on a final solution for arbitrarily approaching deep targets in the brain.
4:26:46Lex FridmanIt's interesting because, like, you have to avoid blood vessels somehow. You have to. Maybe there's creative ways of doing the same thing, like mapping out high resolution geometry of blood vessels and then you can go in blind.
4:26:58Lex FridmanBut like, how do you map out that in a way that's like super stable? There's a lot of interesting challenges there, right?
4:27:05Elon MuskYeah.
4:27:05Lex FridmanBut there's a lot to do on the surface.
4:27:07Elon MuskExactly. So we've got vision on the surface. You know, we actually have made a huge amount of progress sewing electrodes into the spinal cord as a potential workaround for a spinal cord injury.
4:27:23Elon MuskThat would allow a brain mounted implant to translate motor intentions to a spine mounted implant that can affect muscle contractions in previously paralyzed arms and legs.
4:27:36Lex FridmanThat's just incredible. So like, the effort there is to try to bridge the brain to the spinal cord, to the periphery peripheral nervous system. So how hard is that to do?
4:27:47Elon MuskWe have that working in very crude forms in animals.
4:27:52Lex FridmanThat's amazing. Yeah. We've done so similar to like with Nolan, where he's able to digitally move the cursor. Here you're doing the same kind of communication but with the actual effectors that you have.
4:28:06Lex FridmanYeah, that's fascinating. Yeah.
4:28:09Elon MuskSo we have anesthetized animals doing grasp and moving their legs in a sort of walking pattern. Again, early days, but the future is bright for this kind of thing and people with paralysis should look forward to that bright future.
4:28:28Elon MuskThey're going to have options.
4:28:30Lex FridmanYeah. And there's a lot of sort of intermediate or extra options where you take like an optimus robot, like the, the arm and to be able to control the arm.
4:28:42Lex FridmanYeah, the, the fingers, the Hands of the arm, sure.
4:28:46Elon MuskAs a prosthetic are getting better too.
4:28:49Lex FridmanSo skeletons. Yeah. So that, that goes hand in hand. Although I didn't quite understand until thinking about it deeply and doing more research about neuralink how much you can do on the digital side.
4:29:02Lex FridmanSo this digital telepathy, I didn't quite understand that you can really map the intention as you described in the hand knob area, that you can map the intention. Just imagine it, think about it.
4:29:20Lex FridmanThat intention can be mapped to actual action in the digital world.
4:29:24Elon MuskRight.
4:29:24Lex FridmanAnd now more and more, so much can be done in the digital world that can reconnect you to. To the outside world. It can allow you to have freedom, have independence.
4:29:35Lex FridmanIf you're a quadriplegic. Yeah. That's really powerful. Like, you can go really far with that.
4:29:40Elon MuskYeah. Our first participant is. He's incredible. He's breaking world records left and right
4:29:46Lex Fridmanand he's having fun with it. It's great. Just going back to the surgery, your whole journey. You mentioned to me offline you have surgery on Monday, so you're like, you're doing surgery all the time.
4:30:00Elon MuskYeah.
4:30:01Lex FridmanMaybe the ridiculous question, what does it take to get good at surgery?
4:30:04Elon MuskPractice repetitions. You just. Same with anything else. You know, there's a million ways of people saying the same thing and selling books saying it, but you call it 10,000 hours, you call it, you know, spend some chunk of your life, some percentage of your life, focusing on this, obsessing about getting better at it, repetitions, humility, recognizing that you aren't perfect at any stage along the way, recognizing you've got improvements to make in your technique, being open to feedback and coaching from people with a different perspective on how
4:30:42Lex Fridmanto do it,
4:30:44Elon Muskand then just the constant will to do better that fortunately, you know, if you're not a sociopath, I think your patients bring that with them to the office visits every day.
4:30:58Elon MuskThey, you know, force you to want to do better all the time.
4:31:01Lex FridmanYeah. Just step up. I mean, it's a real human being. A real human being that you can help. Yeah. So every surgery, even if it's the same exact surgery, is there a lot of variability between that surgeon and a different person?
4:31:15Elon MuskYeah, a fair bit. I mean, a good example for us is that the angle of the skull relative to the normal plane of the body axis of the skull over hand knob is pretty wide variation.
4:31:31Elon MuskI mean, some people have really flat skulls and some people have really steeply angled skulls over that area. And that has, you know, consequences for how their head can be fixed.
4:31:44Elon MuskIn, in, in sort of the frame that we use and how the robot has to approach the skull. And yeah, people's, people's bodies are built as differently as the people you see walking down the street.
4:31:59Elon MuskAs much variability in body shape and size as you see there. We see in brain anatomy and skull anatomy, there are some people who we've had to kind of exclude from our trial for having skulls that are too thick or too thin, or scalp that's too thick or too thin.
4:32:19Elon MuskI think we have the middle 97% or so of people, but you can't account for all human anatomy variability.
4:32:29Lex FridmanHow much like mushiness and mess is there? Because I, you know, taking biology classes, the diagrams are always really clean and crisp. Neuroscience, the pictures of neurons are always really nice and very.
4:32:45Lex FridmanBut whenever I look at pictures of like real brains, they're all, I don't know what is going on.
4:32:52Elon MuskYeah.
4:32:52Lex FridmanSo how much are biological systems in reality? Like, how hard is it to figure out what's going on?
4:32:58Elon MuskNot too bad. Once you really get used to this. That's where experience and skill and education really come into play is if you stare at a thousand brains, it becomes easier to kind of mentally peel back the, say for instance, blood vessels that are obscuring the sulci and gyri, you know, kind of the wrinkle pattern of the surface of the brain.
4:33:26Elon MuskOccasionally when you're, when you're first starting to do this and you open the skull, it doesn't match what you thought you were going to see based on the mri.
4:33:37Elon MuskAnd with more experience, you learn to kind of peel back that layer of blood vessels and see the underlying pattern of wrinkles in the brain and use that as a landmark for where you are.
4:33:51Lex FridmanThe wrinkles are a landmark. So, like.
4:33:53Elon MuskYeah, so I was describing hand knob earlier. That's a pattern of the wrinkles in the brain. It's sort of this sort of Greek letter omega shaped area of the brain.
4:34:04Lex FridmanSo you could recognize the hand knob area. Like if I show you a thousand brains and give you like one minute with each, you'd be like, yep, that's that.
4:34:12Lex FridmanSure. And so there is some uniqueness to that area of the brain, like in terms of the geometry, the topology of the thing.
4:34:19Elon MuskYeah.
4:34:21Lex FridmanWhere is it? About in the.
4:34:24Elon MuskSo you have this strip of brain running down the top called the primary motor area. And I'm sure you've seen this picture of the homunculus laid over the surface of the brain.
4:34:34Elon MuskThe weird little guy with huge lips and giant hands. That guy sort of lays with his legs up at the top of the brain and face, arm areas farther down, and then some kind of mouth, lip, tongue areas farther down.
4:34:54Elon MuskAnd so the hand is right in there. And then the areas that control speech, at least on the left side of the brain in most people, are just below that.
4:35:05Elon MuskAnd so any muscle that you voluntarily move in your body, the vast majority of that references that strip or those intentions come from that strip of brain. And the wrinkle for hand knob is right in the middle of that.
4:35:22Lex FridmanAnd vision is back here.
4:35:24Elon MuskYep.
4:35:25Lex FridmanAlso close to the surface.
4:35:27Elon MuskVision's a little deeper. And so, you know, this gets to your question about how deep can you
4:35:32Lex Fridmanget
4:35:35Elon Muskto do vision? We can't just do the surface of the brain. We have to be able to go in not. Not as deep as we have to go for DBs, but maybe a centimeter deeper we're used to for hand insertions.
4:35:50Elon MuskAnd so that's, you know, work in progress. That's a new set of challenges to overcome.
4:35:55Lex FridmanBy the way, you mentioned the Utah array, and I just saw a picture of that, and that thing looks terrifying because it's rigid. And then if you look at the threads, they're flexible.
4:36:09Lex FridmanWhat can you say that's interesting to you about the flexible. That kind of approach of the flexible threads to deliver the electrodes next to the neurons?
4:36:18Elon MuskYeah, I mean, the goal there comes from experience. I mean, we stand on the shoulders of people that made Utah arrays and used Utah arrays for decades before we ever even came along.
4:36:32Elon MuskNeuralink arose partly this approach to technology arose out of a need recognized after Utah rays would fail routinely because the rigid electrodes, those spikes that are literally hammered using an air hammer into the
4:36:50Lex Fridmanbrain,
4:36:53Elon Muskthose spikes generate a bad immune response that encapsulates the electrode spikes in scar tissue, essentially. And so one of the projects that was being worked on in the Anderson lab at Caltech when I got there was to see if you could use chemotherapy to prevent the formation of scars.
4:37:16Elon MuskLike, you know, things are pretty bad when you're jamming a bed of nails into the brain and then treating that with chemotherapy to try to prevent scar tissue. It's like, you know, maybe we've gotten off track here, guys.
4:37:29Elon MuskMaybe there's a fundamental redesign necessary. And so neuralink's approach of using highly flexible, tiny electrodes avoids a lot of the bleeding, avoids a lot of the immune response that ends up happening when rigid electrodes are pounded into the brain.
4:37:47Elon MuskAnd so what we see is our electrode longevity and functionality and the health of the brain tissue immediately surrounding the electrode is excellent. I mean, it goes on for years now in our animal models.
4:38:03Lex FridmanWhat do most people not understand about the biology of the brain? We'll mention the vasculature. That's really interesting.
4:38:10Elon MuskI think the most interesting, maybe underappreciated fact is that it really does control almost everything. I mean, I don't know. For out of the blue example, imagine you want a lever on fertility.
4:38:25Elon MuskYou want to be able to turn fertility on and off. I mean there are legitimate targets in the brain itself to modulate fertility, say blood pressure. You want to modulate blood pressure.
4:38:40Elon MuskThere are legitimate targets in the brain for doing that. Things that aren't immediately obvious as brain problems are potentially solvable in the brain. And so I think it's an under explored area for primary treatments of of all the things that bother people.
4:39:04Lex FridmanThat's a really fascinating way to look at it. Like there's a lot of conditions we might think have nothing to do with the brain, but they might just be symptoms of something that actually started in the brain.
4:39:15Lex FridmanThe actual source of the problem, the primary source is something in the brain.
4:39:19Elon MuskYeah. Not always. I mean kidney disease is real, but there are levers you can pull in the brain that affect all of these systems.
4:39:29Lex FridmanThere's knobs. Yeah. On, off switches and knobs in the brain from which this all originates. Would you have a neuralink chip implanted in your brain? Yeah,
4:39:45Elon MuskI think use case right now is use a mouse. Right. I can already do that. And so there's no value proposition on safety grounds alone. Sure. I would do it tomorrow.
4:39:59Lex FridmanYou know, you say the use case of the mouse is it after like researching all this. And part of it is just watching Owen have so much fun if you can get that bits per second, like really high with the mouse, like being able to interact.
4:40:14Lex FridmanBecause if you think about the way the, on the smartphone, the way you swipe, that was transformational.
4:40:20Elon MuskYeah.
4:40:20Lex FridmanHow we interact with the thing, it's subtle, you don't realize it. But to be able to touch a phone and to scroll with your finger, that's like. That changed everything.
4:40:31Lex FridmanPeople were sure you need a keyboard to type and that there's a lot of HCI aspects to that that changed how we interact with computers. So there could be a certain rate of speed with the mouse that would change everything.
4:40:48Lex FridmanYes. Like you might be able to just click around a screen extremely fast and that if it. I can see myself getting a neural link for much more rapid interaction with digital devices.
4:41:03Elon MuskYeah. I think recording Speech intentions from the brain might, might change things as well. You know, the value proposition for the average person a keyboard is a pretty clunky human interface requires a lot of training.
4:41:18Elon MuskIt's highly variable in the maximum performance that the average person can achieve. I think taking that out of the equation and just having a natural word to computer interface might change things for a lot of people.
4:41:40Lex FridmanIt'd be hilarious if that is the reason people do it. Even if you have speech to text that's extremely accurate. It currently isn't, but it's say gotten super accurate.
4:41:49Lex FridmanIt'd be hilarious if people went for neuralink just so you avoid the embarrassing aspect of speaking, like looking like a douchebag speaking to your phone in public, which is a real, like, that's a real constraint.
4:42:02Elon MuskYeah. I mean with a bone conducting case that can be an invisible headphone, say and the ability to think words into software and have it respond to you, you know, that starts to sound sort of like embedded super intelligence.
4:42:24Elon MuskYou know, if you can silently ask for the Wikipedia article on any subject and have it read to you without any observable change happen in the outside world. You know, for one thing, standardized testing is obsolete.
4:42:43Lex FridmanYeah. If it's done well on the UX side it could change. I don't know if it transforms society, but it really can create a kind of shift in the way we interact with digital devices in the way that a smartphone did.
4:42:57Lex FridmanNow I would just having to look into the safety of everything involved. I would totally try it. So it doesn't have to go to some like incredible thing where you have.
4:43:09Lex FridmanIt connects your vision or to some other like it connects all over your brain. That could be like just connecting to the hand knob. You might have a lot of interesting interaction, human computer interaction possibilities.
4:43:21Elon MuskYeah, that's really interesting. Yeah. And the technology on the academic side is progressing at light speed here. I think there was a really amazing paper out of UC Davis, Sergey Stavisky's lab that basically made a initial solve of speech decode.
4:43:39Elon MuskIt was something like 125,000 words that they were getting with, you know, very high accuracy, which is.
4:43:46Lex FridmanSo you're just thinking the word. Yeah, thinking the word and you're able to get it. Yeah. Oh boy. Like you have to have the intention of speaking it.
4:43:56Elon MuskRight.
4:43:56Lex FridmanSo like do the inner voice, man. It's so amazing to me that you can do the intention, the signal mapping. All you have to do is just imagine yourself doing it and if, if you get the feedback that it actually worked.
4:44:14Lex FridmanYou can get really good at that. Like your brain will first of all adjust and you develop like any other skill. Yeah, like touch typing, you develop in that same kind of way.
4:44:23Lex FridmanThat is, that is to me, it's just really fascinating to be able to. Even to play with that. Honestly, like I would get a knurling just to be able to play with that.
4:44:32Lex FridmanJust to play with. The capacity, the capability of my mind to learn this skill. It's like learning the skill of typing and learning the skill of moving a mouse.
4:44:40Lex FridmanIt's another skill of moving the mouse not with my physical body, but with my mind.
4:44:47Elon MuskI can't wait to see what people do with it. I feel like we're caveman right now. We're like banging rocks with a stick and thinking that we're making music.
4:44:57Elon MuskAt some point when these are more widespread, there's going to be the equivalent of a piano that, you know, someone, someone can make art with their brain in a way that we didn't even anticipate.
4:45:10Elon MuskI'm looking forward to it.
4:45:12Lex FridmanGive it to like a teenager, like anytime I think I'm good at something, I'll always go to like, I don't know. Even with the bits per second of playing a video game, you realize you give it to a teenager, you give in your link to a teenager.
4:45:24Lex FridmanJust a large number of them. The kind of stuff they get good at, stuff they're going to get like hundreds of bits per second even just with the current technology, probably because it's also addicting the number go up aspect of it of improving and training because it's almost like a skill.
4:45:50Lex FridmanAnd plus there's a software on the other end that adapts to you. And especially if the adapting procedure algorithm becomes better and better and better. You like learning together.
4:45:59Elon MuskYeah, we're scratching the surface on that right now. There's so much more to do.
4:46:03Lex FridmanSo on the complete other side of it, you have an RFID chip implanted in you. Yeah, So I hear. Nice.
4:46:12Elon MuskSo this is subtle thing.
4:46:14Lex FridmanIt's a passive device that you use for unlocking like a safe with top secret. So what do you use it for? What's the story behind it?
4:46:23Elon MuskI'm not the first one. There's. There's this whole community of weirdo biohackers that have done this stuff. And I think one of the early use cases was storing, you know, private crypto wallet keys and whatever.
4:46:38Elon MuskI dabbled in that a bit and had some fun with it.
4:46:43Lex FridmanYou have some bitcoin implanted in your body somewhere you can't tell where.
4:46:46Elon MuskYeah, yeah, actually, yeah, it was, you know, the modern day equivalent of finding change in the sofa cushions. After I put some orphan crypto on there that I thought was worthless and forgot about it for a few years, went back and found that some community of people loved it and had propped up the value of it, and so it had gone up 50 fold.
4:47:09Elon MuskSo there was a lot of change in those cushions.
4:47:13Lex FridmanThat's hilarious.
4:47:14Elon MuskBut the, the primary use case is mostly as a, as a tech demonstrator. You know, it has my business card on it. You can scan that and by touching it to your phone, it opens the front door to my house, you know, whatever.
4:47:29Elon MuskSimple stuff.
4:47:30Lex FridmanIt's a cool step, it's a cool leap to implant something in your body. I mean, it has perhaps that's, it's a similar leap to a neuralink because for a lot of people, that kind of notion of putting something electronic, inside a biological system, is a big leap.
4:47:45Elon MuskYeah, we have a kind of a mysticism around the barrier of our skin. We're completely fine with knee replacements, hip replacements, you know, dental implants. But, you know, there's a mysticism still around the inviolable barrier that the skull represents.
4:48:07Elon MuskAnd I think that needs to be treated like any other pragmatic barrier. You know, it's. The question isn't how, how incredible is it to open the skull. The question is, you know, what benefit can we provide?
4:48:21Lex FridmanSo from all the surgeries you've done, from everything you understand the brain, how much does neuroplasticity come into play? How adaptable is the brain? For example, just even in the case of healing from surgery or adapting to the post surgery situation, the answer that
4:48:37Elon Muskis sad for me and other people of my demographic is that, you know, plasticity decreases with age, healing decreases with age. I have too much gray hair to, to be optimistic about that.
4:48:52Elon MuskThere are theoretical ways to increase plasticity using electrical stimulation. Nothing that is, you know, totally proven out as a robust enough mechanism to offer widely to people.
4:49:06Lex FridmanBut
4:49:08Elon Muskyeah, I think there's cause for optimism that we might find something useful in terms of, say, an implanted electrode that improves learning. Certainly there's been some really amazing work recently from Nicholas Schiff, Jonathan Baker and others who have a cohort of patients with moderate traumatic brain injury who have had electrodes placed in the deep nucleus in the brain called the centromedian nucleus, or just near the centromedian nucleus.
4:49:38Elon MuskAnd when they apply small amounts of electricity to that part of the brain, it's almost like electronic caffeine. They're able to improve people's attention and focus. They're able to improve how well people can perform a task.
4:49:54Elon MuskI think in one case, someone who was unable to work after the device was turned on, they were able to get a job. And that's sort of, you know, one of the holy grails for me with neuralink and other technologies like this is from a purely utilitarian standpoint.
4:50:15Elon MuskCan we. Can we make people able to take care of themselves and their families economically again? Can we make it so someone who's fully dependent and even maybe requires a lot of caregiver resources?
4:50:28Elon MuskCan we put them in a position to be fully independent, taking care of themselves, giving back to their communities?
4:50:36Lex FridmanI think.
4:50:36Elon MuskI think that's a very compelling proposition. And what motivates a lot of what I do and what a lot of the people at neuralink are working for.
4:50:44Lex FridmanIt's just a cool possibility that if you put a neuralink in there, that the brain adapts like the other part of the brain adapts too. Yeah. And integrates it.
4:50:54Lex FridmanThe, the capacity of the brain to do that is really interesting. Probably unknown to the degree to which you can do that, but you're now connecting an external thing to it, especially once it's doing stimulation, like the.
4:51:12Lex FridmanThe biological brain and the, the electronic brain outside of it working together. Like, the possibilities there are really interesting. It's still unknown, but interesting. It feels like the brain is really good at adapting to whatever.
4:51:28Lex FridmanYeah, but of course, it is a system that by itself is already like, everything serves a purpose, and so you don't want to mess with it too much.
4:51:39Elon MuskYeah, it's like eliminating a species from an ecology. You don't know what the delicate interconnections and dependencies are. The brain is certainly a delicate, complex beast. And we don't know, you know, every potential downstream consequence of a single change that we make.
4:52:04Lex FridmanDo you see yourself doing so mentioned P1 surgeries of P2, P3, P4, P5, just. Well, more and more and more humans,
4:52:14Elon MuskI think, you know, it's a certain kind of brittleness or, you know, a failure on the company's side. If we need me to do all the surgeries, I think something that I would very much like to work towards is a process that is so simple and so robust on the surgery side that literally anyone could do it.
4:52:38Elon MuskWe want to get away from requiring intense expertise or intense experience to have this successfully done and make it as simple and translatable as possible. I Mean, I would love it if every neurosurgeon on the planet had no problem doing this.
4:52:58Elon MuskI think we're probably far from a regulatory environment that would allow people that aren't neurosurgeons to do this. But not impossible.
4:53:08Lex FridmanAll right, I'll sign up for that. Did you ever anthropomorphize the, the robot? R1 like, do you, do you give it a name? Do you see it as like a friend?
4:53:18Lex FridmanThat's like working together with you.
4:53:20Elon MuskI mean, to a certain degree it's.
4:53:21Lex FridmanOr an enemy who's gonna get the job.
4:53:25Elon MuskTo a certain degree it's, it's. Yeah, it's complex relationship.
4:53:31Lex FridmanAll the good relationships are.
4:53:32Elon MuskIt's funny when in the middle of the surgery, there's a part of it where I stand should basically shoulder to shoulder with the robot. And so, you know, if you're in the room reading the body language, you know, that's, it's my brother in arms there.
4:53:46Elon MuskWe're working together on the same problem. Yeah, I'm not threatened by it.
4:53:55Lex FridmanKeep telling yourself that. How have all the surgeries that you've done over the years, the people you've helped, and the, the stakes, the high stakes that you've mentioned, how does it change your understanding of life and death?
4:54:13Elon MuskYeah, You know, it gives you a very visceral sense, and this may sound trite, but it gives you a very visceral sense that death is inevitable. You know, on one hand, you know, you, you are as a neurosurgeon, you're deeply involved in these like, just hard to fathom tragedies, you know, young parents dying, leaving, you know, a four year old behind, say, and, and on the other hand, you know, it takes the sting out of it a bit because you see how just mind numbingly universal death is.
4:55:00Elon MuskThere is zero chance that I'm going to avoid it. I know, you know, techno optimists right now and longevity buffs right now would disagree on that 0.000% estimate. But I don't see any chance that our generation is going to avoid it.
4:55:24Elon MuskEntropy is a powerful force and we are very ornate, delicate, brittle DNA machines that aren't up to the cosmic ray bombardment that we're subjected to. So on the one hand, every human that has ever lived, died, or will die.
4:55:44Elon MuskOn the other hand, it's just one of the hardest things to imagine inflicting on anyone that you love is having them gone. I mean, I'm sure you've had friends that aren't living anymore.
4:55:58Elon MuskAnd it's. It's hard to even think about them. And so I wish I had, you know, arrived at the point of nirvana where, you know, death doesn't have a sting.
4:56:14Elon MuskI'm not worried about it, but I can at least say that I'm comfortable with the certainty of it, if not having found out how to take the tragedy out of it.
4:56:27Elon MuskWhen I think about my kids, either not having me or me not having them or my wife, maybe I've come
4:56:36Lex Fridmanto accept the intellectual certainty of it, but. And maybe the pain that comes with losing the people you love. I don't think I've come to understand the existential aspect of it, like, that this is gonna end.
4:56:53Lex FridmanAnd I don't mean, like, in some trite way. I mean, like, it certainly feels like it's not going to end. Like, you live life like it's not going to end.
4:57:08Lex FridmanRight. And the fact that this light that's shining, this consciousness, is going to no longer be in one moment, maybe today, it's like it fills me when I really am able to load all that in with Ernest Becker's terror.
4:57:27Lex FridmanLike it's a real fear. I think people aren't always honest with how terrifying it is.
4:57:32Elon MuskYeah.
4:57:33Lex FridmanI think the more you are able to really think through it, the more terrifying it is. It's not such a simple thing. Oh, well, that's the way life is.
4:57:41Lex FridmanAnd if you really can load that in, it's hard. But I think that's why the Stoics did it, because it, like, helps you get your. Together and be like this.
4:57:53Lex FridmanWell, they were like. The moment every single moment you're alive is just beautiful.
4:57:58Elon MuskYeah.
4:57:59Lex FridmanAnd it's terrifying that it's gonna end. It's. It's like. Like almost like you're shivering in the cold. A child helpless. This kind of feeling.
4:58:10Elon MuskYeah.
4:58:10Lex FridmanAnd then it makes you. When you have warmth, when you have the safety, when you have the love to really appreciate it. I feel like sometimes in your position, we mentioned armor just to see death, it might make you not be able to see that, the.
4:58:30Lex FridmanThe finiteness of life. Because if you kept looking at that, it might break you. So it's good to know that you're kind of still struggling with that. There's the neurosurgeon and then there's a human.
4:58:45Elon MuskYeah.
4:58:45Lex FridmanAnd the human is still able to struggle that and feel the. The fear of that and the pain of that.
4:58:51Elon MuskYeah. You know, it definitely makes you ask the question of how long, how many times, how many of these can you see and, and not say I can't do this anymore.
4:59:06Elon MuskBut I mean, you said it. Well, I think it gives you an opportunity to just appreciate that you're alive today. And you know, I've got, I've got three kids and an amazing wife and I'm really happy things are good.
4:59:24Elon MuskI get to help on a project that I think matters. I think it moves us forward. I'm a very lucky person.
4:59:30Lex FridmanIt's the early steps of a potentially gigantic leap for humanity. It's a really interesting one and it's cool because like you, you read about all this stuff in history where it's like the early days I've been reading before going to the Amazon, I would read about explorers.
4:59:48Lex FridmanThey will go and explore even the Amazon jungle for the first time. It's just those are the early steps or early steps into space, early steps in any discipline in physics and mathematics and.
5:00:01Elon MuskAnd it's cool because this is like the. On the grand scale, these are the early steps into delving deep into the human brain. So not just observing the brain, but be able to interact with the human brain.
5:00:13Elon MuskYeah, it's going to help a lot of people, but it also might help us understand what the hell's going on in there.
5:00:20Lex FridmanYeah, I think ultimately we want to give people more levers that they can pull.
5:00:26Elon MuskRight.
5:00:26Lex FridmanLike you want to give people options. If you can give someone a dial that they can turn on how happy they are, I think that makes people really uncomfortable.
5:00:40Elon MuskBut
5:00:43Lex Fridmannow talk about major depressive disorder. Talk about people that are committing suicide at an alarming rate in this country and try to justify that queasiness in those. In that light of.
5:00:59Lex FridmanYou can give people a knob to take away suicidal ideation, suicidal intention, I would give them that knob. I don't know how you justify not doing that.
5:01:11Elon MuskYou can think about all the suffering that's going on in the world. Every single human being that's suffering right now. It'd be a glowing red dot. The more suffering, the more it's glowing.
5:01:20Elon MuskAnd you just see the map of human suffering. And any technology that allows you to dim that light of suffering on a grand scale is pretty exciting because there's a lot of people suffering, and most of them suffer quietly.
5:01:33Elon MuskAnd we turn our. We look away too often, and we should remember those that are suffering because once again, most of them are suffering quietly.
5:01:46Lex FridmanWell, and, you know, on a grander scale, the fabric of society, you know, people have a lot of complaints about how our social fabric is working or not working, how our politics is working or not working.
5:02:01Lex FridmanThose things are made of neurochemistry, too, in. In aggregate.
5:02:06Elon MuskRight.
5:02:07Lex FridmanLike, our politics is composed of individuals with human brains. And the way it works or doesn't work is potentially tunable in the sense that, I don't know, say, remove our addictive behaviors or tune our addictive behaviors for social media or our addiction to outrage, our addiction to sharing the most angry political tweet we can find.
5:02:38Lex FridmanI don't think that leads to a functional society. And if you had options for people to moderate that maladaptive behavior, there could be huge benefits to society. Maybe we could all work together a little more harmoniously toward useful ends.
5:02:59Elon MuskThere's a sweet spot. Like you mentioned, you don't want to completely remove all the dark sides of human nature because those kind of are somehow necessary to make the whole thing work.
5:03:09Elon MuskBut there's a sweet spot.
5:03:11Lex FridmanYeah, I agree. We gotta you gotta suffer a little, just not so much that you lose hope.
5:03:16Elon MuskYeah. When you. All the surgeries you've done, have you seen consciousness in there? Ever. Was there like a glowing light?
5:03:22Lex FridmanYou know, I have this sense that I never found it, never removed it, you know, like, Like a dementor in Harry Potter. I have this sense that consciousness is a lot less magical than our instincts want to claim it is.
5:03:41Lex FridmanIt seems to me like a useful analog for thinking about what consciousness is in the brain, you know, is that we, we have a really good intuitive understanding of what it means to say, touch your skin and know what's being touched.
5:04:02Lex FridmanI think consciousness is just that level of sensory mapping applied to the. The thought processes in the brain itself. So what I'm saying is consciousness is the sensation of some part of your brain being active.
5:04:17Lex FridmanSo you, you feel it working. You feel the part of your brain that thinks of red things or winged creatures or the taste of coffee. You feel those parts of your brain being active the way that I'm feeling my palm being touched.
5:04:36Elon MuskRight.
5:04:36Lex FridmanAnd that sensory system that feels the brain working is consciousness.
5:04:43Elon MuskIt's so brilliant. It's the same way. It's a sensation of touch when you're touching a thing. Consciousness is the sensation of you feeling your brain working, your brain thinking, your brain perceiving, which isn't, which isn't like
5:05:01Lex Fridmana warping of space time or some quantum field effect.
5:05:05Neuralink teamRight.
5:05:06Lex FridmanIt's nothing magical. People always want to ascribe to consciousness something truly different. And there's this awesome long history of people looking at whatever the latest discovery in physics is to explain consciousness because it's the most magical, the most out there thing that you can think of.
5:05:27Lex FridmanAnd people always, you know, want to do that with consciousness. I don't think that's necessary. It's just a, you know, a very useful and gratifying way of feeling your brain work.
5:05:38Elon MuskAnd as we said, it's one heck of a brain. Yeah. Everything we see around us, everything we love, everything that's beautiful came from brains like these.
5:05:48Lex FridmanIt's all electrical activity happening inside your skull.
5:05:52Elon MuskAnd I, for one, am grateful. There's people like you that are exploring all the ways that it works and all the ways it can be made better. Thank you so much for talking today.
5:06:06Lex FridmanIt's been a joy.
5:06:07Elon MuskThanks for listening to this conversation with Matthew McDougall. And now, dear friends, here's Bliss Chapman, brain interface software lead at neuralink. You told me that you've met hundreds of people with spinal cord injuries or with als, and that your motivation for helping at Neuralink is grounded in wanting to help them.
5:06:30Elon MuskCan you describe this motivation? Yeah.
5:06:32Neuralink teamFirst, just a thank you to all the people I've gotten a chance to speak with for sharing their stories with me. I don't think there's any world really in which I can share their stories as powerful a way as they can.
5:06:44Neuralink teamBut just I think, to summarize at a very high level, what I hear over and over again is that people with ALS or severe spinal cord injury in a place where they basically can't move physically anymore, really, at the end of the day, are looking for independence.
5:06:59Neuralink teamAnd that can mean different things for different people. For some folks, it can mean the ability just to be able to communicate again independently, without needing to wear something on their face, without needing a caretaker, to be able to put something in their mouth.
5:07:11Neuralink teamFor some folks, it can mean independence to be able to work again, to be able to navigate a computer digitally efficiently enough, to be able to get a job, to be able to support themselves, to be able to move out and ultimately be able to support themselves after their family maybe isn't there anymore to take care of them.
5:07:27Neuralink teamAnd for some folks, it's as simple as just being able to respond to their kid in time before they run away or get interested in something else. And these are deeply personal and sort of very human problems.
5:07:42Neuralink teamAnd what strikes me again and again when talking with these folks is that this is actually an engineering problem. This is a problem that with the right resources, with the right team, we can make a lot of progress on.
5:07:54Neuralink teamAnd at the end of the day, I think that's a deeply inspiring message and something that makes me excited to get up every day.
5:08:01Elon MuskSo it's both an engineering problem in terms of a bci, for example, that can give them capabilities where they can interact with the world. But also on the other side, it's an engineering problem for the rest of the world to make it more accessible for people living with quadriplegia.
5:08:15Elon MuskYeah.
5:08:16Neuralink teamAnd actually, I'll take a broad view sort of lens on this for a second. I think I'm very in favor of anyone working in this problem space. So beyond bci, I'm happy and excited and willing to support any way I can folks working on eye tracking systems, working on, you know, speech to text systems, working on head trackers or mouth sticks or quad sticks.
5:08:35Neuralink teamI've met many engineers and folks in the community that do exactly those things. And I think for the people we're trying to help, it doesn't matter what the complexity of the solution is, as long as the problem is solved.
5:08:45Neuralink teamAnd I want to emphasize that there can be many solutions out there that can help with these problems. And BCI is one of a collection of such solutions. So BCI in particular, I think offers several advantages here.
5:08:58Neuralink teamAnd I think the folks at recognize this immediately are usually the people who have spinal cord injury or some form of paralysis. Usually you don't have to explain to them why this might be something that could be helpful.
5:09:06Neuralink teamIt's usually pretty self evident. But for the rest of us folks that don't live with severe spinal cord injury or who don't know somebody with als, it's not often obvious why you would want a brain implant to be able to connect and navigate a computer.
5:09:18Neuralink teamAnd it's surprisingly nuanced to the degree that I've learned a huge amount just working with Noland in the first neuralink clinical trial and understanding from him, in his words, why this device is impactful for him.
5:09:30Neuralink teamAnd it's a nuanced topic. It can be the case that even if he can achieve the same thing, for example, with a mouse stick, when navigating a computer, he doesn't have access to that mouse stick every single minute of the day.
5:09:39Neuralink teamHe only has access when someone is available to put it in front of him. And so a BCI can really offer a level of independence and autonomy that if it wasn't literally physically part of your body, would be hard to achieve in any other way.
5:09:52Elon MuskSo there's a lot of fascinating aspects to what it takes to get Nolan to be able to control a cursor on the screen with his mind. You texted me something that I just love.
5:10:02Elon MuskYou said. I was part of the team that interviewed and selected P1. I was in the operating room during the first human surgery, monitoring live signals coming out of the brain.
5:10:10Elon MuskI work with the user basically every day to develop new UX paradigms, decoding strategies. And I was part of the team that figured out how to recover useful BCI to new world record levels when the signal quality degraded.
5:10:23Elon MuskAnd we'll talk about, I think, every aspect of that, but just zooming out, what was it like to be part of that part of that team and part of that historic, I would say historic first?
5:10:38Neuralink teamYeah, I think for me, this is something I've been excited about for close to 10 years now. And so to be able to be even just some small part of making it a reality is extremely exciting.
5:10:49Neuralink teamA couple, maybe special moments during that whole process that I'll Never really truly forget. One of them is during the actual surgery. You know, at that point in time, I.
5:11:01Neuralink teamI know Nolan quite well. I know his family. And so I think the. The initial reaction when Nolan is rolled into the operating room is just a oh, shit kind of reaction.
5:11:11Neuralink teamBut at that point, muscle memory kicks in, and you sort of go into. You let your body just do all the talking. And I have the lucky job in that particular procedure to just be in charge of monitoring the implant.
5:11:24Neuralink teamSo my job is to sit there, to look at the signals coming off the implant, to look at the live brain data streaming off the device as threads are being inserted into the brain, and just to basically observe and make sure that nothing is going wrong or that there's no red flags or fault conditions that we need to go and investigate the surgery to debug.
5:11:41Neuralink teamAnd because I had that sort of spectator view of the surgery, I had a slightly removed perspective than I think most folks in the room. I got to sit there and think to myself, wow, that brain is moving a lot.
5:11:52Neuralink teamWhen you look inside craniectomy that we stick the threads in, one thing that most people don't realize is the brain moves. The brain moves a lot when you breathe, when your heart beats, and you can see it visibly.
5:12:05Neuralink teamSo that's something that I think was a surprise to me and very, very exciting to be able to see someone's brain who you physically know and have talked with that length actually pulsing and moving inside their skull, and they used
5:12:16Elon Muskthat brain to talk to you previously, and now it's right there moving.
5:12:19Neuralink teamYep.
5:12:21Elon MuskActually, I didn't realize that in terms of the thread sending. So the. The neuralink implant is active during surgery.
5:12:28Lex FridmanSo.
5:12:28Elon MuskAnd one thread at a time, you're able to start seeing the signal.
5:12:32Neuralink teamYeah, so.
5:12:32Elon MuskSo that's part of the way you test that the thing is working. Yeah.
5:12:35Neuralink teamSo actually, in the operating room, right after we sort of finished all the thread insertions, I started collecting what's called broadband data. So broadband is basically the most raw form of signal you can collect from a neuralink electrode.
5:12:49Neuralink teamIt's essentially a measurement of the local field potential, or the voltage essentially measured by that electrode. And we have a certain mode in our application that allows us to visualize where detected spikes are.
5:13:02Neuralink teamSo it visualizes sort of where in the broadband signal, and it's very, very raw form of the data, a neuron is actually spiking. And so one of these moments that I'll never forget as part of this whole clinical trial is seeing live in the operating room while he's still under anesthesia.
5:13:17Neuralink teamBeautiful spikes being shown in the application, just streaming live to a device I'm holding in my hand.
5:13:22Elon MuskSo this is no signal processing. The raw data and then the signals processing is on top of it. You're seeing the spikes detected, right?
5:13:28Neuralink teamYeah.
5:13:30Elon MuskAnd that's a UX too, because that looks beautiful as well.
5:13:35Neuralink teamDuring that procedure, there was actually a lot of cameramen in the room, so they also were curious and wanted to see. There's several neurosurgeons in the room who are all just excited to see robots taking their job.
5:13:44Neuralink teamAnd they're all, you know, crowded around a small little iPhone, watching this live brain data stream out of his brain.
5:13:51Elon MuskWhat was that like seeing the robot do some of the surgery? So the computer vision aspect, where it detects all the. All the spots that avoid the blood vessels, and then, obviously, with human supervision, then actually doing the really high precision connection of the threads to the brain.
5:14:10Neuralink teamThat's a good question. My answer is going to be pretty lame here, but it was boring. I've seen it so many times. Yeah, that's exactly how you want surgery to be.
5:14:19Neuralink teamYou want it to be boring. Yeah, because I've seen it so many times. I've seen the. The robot do the surgery literally hundreds of times. And so it was just one more time.
5:14:29Elon MuskYeah. All the practice surgeries and the proxies, and this is just another day.
5:14:33Neuralink teamYeah.
5:14:35Elon MuskSo what about when Nolan woke up? Well, do you remember a moment where he was able to move the cursor? Not move the cursor, but get signal from the brain such that it was able to show that there's a connection?
5:14:49Elon MuskYeah.
5:14:50Neuralink teamYeah. So we are quite excited to move as quickly as we can. And Nolan was really, really excited to get started. He wanted to get started actually the day of surgery, but we waited till the next morning very patiently.
5:15:02Neuralink teamIt's a long night. And the next morning in the ICU where he was recovering, he wanted to get started and actually start to understand what kind of signal we can measure from his brain.
5:15:14Neuralink teamAnd maybe for folks who are not familiar with the neuralink system, we implant the neuralink system, or the neuralink implant in the motor cortex. So the motor cortex is responsible for representing things like motor intent.
5:15:25Neuralink teamSo if you imagine closing and opening your hand, that kind of signal representation would be present in the motor cortex. If you imagine moving your arm back and forth or wiggling a pinky, this sort of signal can be present in the motor cortex.
5:15:37Neuralink teamSo one of the ways we start to Sort of map out what kind of signal do we actually have access to in any particular individual's brain is through this task called body mapping.
5:15:44Neuralink teamAnd body mapping is where you essentially present a visual to the user, and you say, hey, imagine doing this. And that Visual is a 3D hand opening, closing, or index finger modulating up and down.
5:15:55Neuralink teamAnd you ask the user to imagine that. And obviously, you can't see them do this because they're paralyzed, so you can't see them actually move their arm. But while they do this task, you can record neural activity, and you can basically offline model and check.
5:16:07Neuralink teamCan I predict or can I detect the modulation corresponding with those different actions? And so we did that task, and we realized, hey, there's actually some modulation associated with some of his hand motion, which was the first indication that, okay, we can potentially use that modulation to do useful things in the world.
5:16:22Neuralink teamFor example, control a computer cursor. And he started playing with it, you know, the first time we showed him it. And we actually just took the same live view of his brain activity and put it in front of him, and we said, hey, you tell us what's going on.
5:16:32Neuralink teamYou know, we're not you. You're able to imagine different things. And we know that it's modulating some of these neurons, so you figure out for us what that is actually representing.
5:16:41Neuralink teamAnd so he played with it for a bit. He was like, I don't quite get it yet. He played for a bit longer, and he said, oh, when I move this finger, I see this particular neuron start to fire more.
5:16:51Neuralink teamAnd I said, okay, prove it. Do it again. And so he said, okay, three, two, one, boom. And the minute he moved, you can see, like, instantaneously this neuron is firing.
5:17:00Neuralink teamSingle neuron. I can tell you the exact channel number, if you're interested. It's stuck in my brain now forever. But that single channel firing was a beautiful indication that it was behaviorally modulated neural activity that could then be used for downstream tasks, like decoding a computer cursor.
5:17:15Elon MuskAnd when you say single channel, is that associated with a single electrode?
5:17:18Neuralink teamYeah.
5:17:18Elon MuskSo channel electrode are interchangeable, and there's 1024 of those.
5:17:23Neuralink team1024? Yeah.
5:17:25Elon MuskIt's incredible that that works. That really, when I was learning about all this and, like, loading it in, it was just blowing my mind, that the intention. You can visualize yourself moving the finger, that can turn into a signal.
5:17:41Elon MuskAnd the fact that you can then skip that step and visualize the cursor moving or have the intention of the cursor moving and that leading to a signal that can then be used to move the cursor.
5:17:53Elon MuskThere is so many exciting things there to learn about the brain, about the way the brain works. The very fact of their existing signal that can be used is really powerful.
5:18:03Elon MuskBut it feels like that's just like the beginning of figuring out how that signal could be used really, really effectively. I should also just. There's so many fascinating details here, but you mentioned the body mapping step.
5:18:16Elon MuskAt least in the version I saw that Nolan was showing off. There's like a super nice interface, like a graphical interface. It just felt like I was like in the future, because it, like, you know, I guess it visualizes you moving the hand and there's a very like.
5:18:34Elon MuskLike a sexy, polished interface that. Hello?
5:18:38Neuralink teamYeah.
5:18:39Elon MuskI don't know if there's a voice component, but it just felt like it's like when you wake up in a really nice video game and this is a tutorial at the beginning of that video game.
5:18:48Elon MuskYeah, this is what you're supposed to do. It's cool.
5:18:50Neuralink teamNo, I mean, the future should feel
5:18:51Elon Musklike the future, but it's not easy to pull that off. I mean, it needs to be simple, but not too simple.
5:18:57Neuralink teamYeah, I think the UX design component here is underrated for BCI development in general. There's a whole interaction effect between the ways in which you visualize an instruction to the user and the kinds of signal you can get back.
5:19:11Neuralink teamAnd that quality of sort of your behavioral alignment to the neural signal is a function of how good you are at expressing to the user what you want them to do.
5:19:18Neuralink teamAnd so, yeah, we spend a lot of time thinking about the UX of how we build our applications, of how the decoder actually functions, the control surfaces it provides to the user.
5:19:25Neuralink teamAll these little details matter a lot.
5:19:27Elon MuskSo maybe it'd be nice to get into a little bit more detail of what the signal looks like and what the decoding looks like. So there's a N1 implant that has, like we mentioned, 10, 24 electrodes and that's collecting raw data, raw signal.
5:19:46Elon MuskWhat does that signal look like? And what are the different steps along the way before it's transmitted and what is transmitted. All that kind of stuff.
5:19:55Neuralink teamYeah. Yep, this is going to be a fun one. Let's go. So maybe before diving into what we do, it's worth understanding what we're trying to measure, because that dictates a lot of the requirements for the system that we build and what we're trying to Measure is really individual neurons producing action potentials.
5:20:12Neuralink teamAction potential is, you can think of it like a little electrical impulse that you can detect if you're close enough. And by being close enough, I mean like within, let's say, 100 microns of that cell.
5:20:24Neuralink teamAnd 100 microns is a very, very tiny distance. And so the number of neurons that you're going to pick up with any given electrode is just a small radius around that electrode.
5:20:33Neuralink teamAnd the other thing worth understanding about the underlying biology here is that when neurons produce an action potential, the width of that action potential is about 1 millise. So from the start of the spike to the end of the spike, that whole width of that sort of characteristic feature of a neuron firing is 1 millisecond wide.
5:20:50Neuralink teamAnd if you want to detect that an individual spike is occurring or not, you need to sample that signal or sample the local field potential nearby that neuron much more frequently than once a millisecond.
5:21:00Neuralink teamYou need to sample many, many times per millisecond to be able to detect that this is actually the characteristic waveform of a neuron producing an action potential. And so we sample across all 10, 24 electrodes about 20,000 times a second.
5:21:13Neuralink team20,000 times a second means for any given one millisecond window, we have about 20 samples that tell us what that exact shape of that action potential looks like. And once we've sort of sampled at super high rate the underlying electrical field nearby these cells, we can process that signal into just where do we detect a spike or where do we not, sort of a binary signal, 1 or 0.
5:21:36Neuralink teamDo we detect a spike in this one millisecond or not? And we do that because the actual information carrying sort of subspace of neural activity is just when are spikes occurring?
5:21:49Neuralink teamEssentially everything that we care about for decoding can be captured or represented in the frequency characteristics of spike trains, meaning how often are spikes firing in any given window of time?
5:21:59Neuralink teamAnd so that allows us to do sort of a crazy amount of compression from this very rich, high density signal to something that's much, much more sparse and compressible, that can be sent out over a wireless radio, like a Bluetooth communication, for example.
5:22:14Elon MuskQuick tangents here. You mentioned electrode neuron. There's a local neighborhood of neurons nearby. How difficult is it to isolate from where the spike came from?
5:22:30Neuralink teamYeah, so there's a whole field of sort of academic neuroscience work on exactly this problem of bas given a single electrode or given a set of electrodes measuring a set of neurons.
5:22:40Neuralink teamHow can you sort of sort, spike, sort, which spikes are coming from what neuron. And this is a problem that's pursued in academic work because you care about it for understanding what's going on in the underlying sort of neuroscience of the brain.
5:22:55Neuralink teamIf you care about understanding how the brain's representing information, how that's evolving through time, then that's a very, very important question to understand for sort of the engineering side of things, at least at the current scale, if the number of neurons per electrode is relatively small, you can get away with basically ignoring that problem completely.
5:23:12Neuralink teamYou can think of it like sort of a random projection of neurons to electrodes. And there may be, in some cases, more than one neuron per electrode. But if that number is small enough, those signals can be thought of as sort of a union of the two.
5:23:25Neuralink teamAnd for many applications, that's a totally reasonable trade off to make and can simplify the problem a lot. And as you sort of scale out channel count, the relevance of distinguishing individual neurons becomes less important because you have more overall signal, and you can start to rely on sort of correlations or covariance structure in the data to help understand when that channel is firing, what is that?
5:23:43Neuralink teamWhat does that actually represent? Because you know that when that channel is firing in concert with these other 50 channels, that means move left. But when that same channel is firing with concert with these other 10 channels, that means move right.
5:23:54Elon MuskOkay. So you have to do this kind of spike detection on board, and you have to do that super efficiently so fast and not use too much power because you don't want to be generating too much heat.
5:24:05Elon MuskSo it has to be a super simple signal processing step. Yeah. Is there some wisdom you can share about what it takes to overcome that challenge?
5:24:17Neuralink teamYeah. So we've tried many different versions of basically turning this raw signal into sort of a feature that you might want to send off the device. And I'll say that I don't think we're at the final step of this process.
5:24:28Neuralink teamThis is a long journey. We have something that works clearly today, but there can be many approaches that we find in the future that are much better than what we do right now.
5:24:36Neuralink teamSo some versions of what we do right now, and there's a lot of academic heritage to these ideas, so I don't want to claim that these are original neuralink ideas or anything like that, but one of these ideas is basically to build sort of like a convolutional filter almost, if you will, that slides across the signal and looks for a certain template to be matched.
5:24:54Neuralink teamThat template Consists of sort of how deep the spike modulates, how much it recovers, and what the duration and window of time is that the whole process takes. And if you can see in the signal that that template is matched within certain bounds, then you can say, okay, that's a spike.
5:25:08Neuralink teamOne reason that approach is super convenient is that you can actually implement that extremely efficiently in hardware, which means that you can run it in Low power across 10, 24 channels all at once.
5:25:20Neuralink teamAnother approach that we've recently started exploring, and this can be combined with the spike detection approach, is something called spike band power. And the benefits of that approach are that you may be able to pick up some signal from neurons that are maybe too far away to be detected as a spike, because the farther away you are from an electrode, the weaker that actual spike waveform will look like on that electrode.
5:25:40Neuralink teamSo you might be able to pick up population level activity of things that are maybe slightly outside the normal recording radius. What neuroscientists sometimes refer to as the hash of activity.
5:25:51Neuralink teamThe other stuff that's going on. And you can look at, sort of across many channels, how that sort of background noise is behaving. And you might be able to get more juice out of the signal that way, but it comes at a cost.
5:26:00Neuralink teamThat signal is now a floating point representation, which means it's more expensive to send out over power. It means you have to find different ways to compress it that are different than what you can apply to binary signals.
5:26:09Neuralink teamSo there's a lot of different challenges associated with these different modalities.
5:26:12Elon MuskSo also in terms of communication, you're limited by the amount of data you can send.
5:26:17Neuralink teamYeah.
5:26:18Elon MuskSo, and also because you're currently using the Bluetooth protocol, you have to batch stuff together, but you have to also do this keeping the latency crazy low. Like crazy low.
5:26:30Elon MuskAnything to say about the latency?
5:26:32Neuralink teamYeah, this is a passion project of mine. So I want to build the best mouse in the world. Yeah, I don't want to build like the, you know, the Chevrolet Spark or whatever of electric cars.
5:26:43Neuralink teamI want to build like the Tesla Roadster version of a mouse. And I really do think it's quite possible that within five to 10 years that most esports competitions are dominated by people with paralysis.
5:26:54Neuralink teamThis is like a very real possibility for a number of reasons. One is that they'll have access to the best technology to play video games effectively. The second is they have the time to do so.
5:27:02Neuralink teamSo those two factors together are particularly potent for esport competitors, unless people without
5:27:10Elon Muskparalysis are also allowed to implant, which is it is another way to interact with a digital device. And there's something to that. If it's a fundamentally different experience, more efficient experience, even if it's not like some kind of full on high bandwidth communication, if it's just the ability to move the mouse 10x faster, like the bits per second.
5:27:37Elon MuskIf I can achieve a bits per second at 10x what I can do with the mouse, that's a really interesting possibility, what they can do, especially as you get really good at it with
5:27:47Neuralink teamtraining, it's definitely the case that you have a higher ceiling performance like you, because you don't have to buffer your intention through your arm, through your muscle. You get just by nature of having a brain implant at all, like 75 millisecond lead time on any action that you're actually trying to take.
5:28:01Neuralink teamAnd there's some nuance to this. Like there's evidence that the motor cortex, you can sort of plan out sequences of actions. So you may not get that whole benefit all the time.
5:28:08Neuralink teamBut for sort of like reaction time style games where you just want to, somebody's over here, snipe them, you know, that kind of thing, you actually do have just an inherent advantage because you don't need to go through muscle.
5:28:18Neuralink teamSo the question is just how much faster can you make it? And we're already, you know, faster than, you know what you would do. If you're going through muscle from a latency point of view, and we're in the early stages of that, I think we can push it sort of our end to end latency right now from brain spike to cursor movement is about 22 milliseconds.
5:28:33Neuralink teamIf you think about the best mice in the world, the best gaming mice, that's about 5 milliseconds ish of latency. Depending on how you measure, depending how fast your screen refreshes.
5:28:41Neuralink teamThere's a lot of characteristics that matter there, but yeah, and the rough time for a neuron in the brain to actually impact your command of your hand is about 75 milliseconds.
5:28:50Neuralink teamSo if you look at those numbers, you can see that we're already competitive and slightly faster than what you'd get by actually moving your, moving your hand. And this is something that, you know, if you ask Nolan about it, when he moved the cursor for the first time, we asked him about this.
5:29:03Neuralink teamThis was something I was super curious about. Like, what does it feel like when you're modulating, you know, a click intention or when you're trying to Just move the cursor to the right.
5:29:10Neuralink teamHe said it moves before he is like actually intending it to, which is kind of a surreal thing and something that, you know, I would love to experience myself one day.
5:29:18Neuralink teamWhat is that like to have the thing just be so immediate, so fluid, that it feels like it's happening before you're actually intending it to move?
5:29:25Elon MuskYeah, I suppose we've gotten used to that latency, that natural latency that happens. So is the currently the bottleneck, the communication? So, like the Bluetooth communication, is that. What's the actual bottleneck?
5:29:35Elon MuskI mean, there's always going to be a bottleneck, but what's the current bottleneck?
5:29:38Neuralink teamYeah, a couple things. So, kind of hilariously, Bluetooth low energy protocol has some restrictions on how fast you can communicate. So the protocol itself establishes a standard of, you know, the most frequent sort of updates you can send are on the order of 7.5 milliseconds.
5:29:54Neuralink teamAnd as we push latency down to the level of sort of individual spikes impacting control, that level of resolution, that kind of protocol is going to become a limiting factor at some scale.
5:30:06Neuralink teamAnother sort of important nuance to this is that it's not just the neuralink itself that's part of this equation. If you start pushing latency sort of below the level of how fast screens refresh, then you have another problem.
5:30:18Neuralink teamYou need your whole system to be able to be as reactive as the sort of limits of what the technology can offer. Like, you need the screen, like 120Hz just doesn't work anymore.
5:30:28Neuralink teamIf you're trying to have something respond at something that's at the level of
5:30:31Elon Muskone millisecond, that's a really cool challenge. I also like that for a T shirt. The best mouse in the world. Tell me on the receiving end. So the decoding step.
5:30:40Elon MuskNow we figured out what the spikes are. Got them all together. Now we're sending that over to the app. What's the decoding step look like?
5:30:49Neuralink teamYeah, so maybe first, what is decoding? I think there's probably a lot of folks listening that just have no clue what. What it means to decode brain activity.
5:30:56Elon MuskActually, even if we zoom out beyond that, what is the app? So there's a. There's an implant that's wirelessly communicating with any digital device that has an app installed.
5:31:08Neuralink teamYep.
5:31:08Elon MuskSo maybe can you tell me a high level, what the app is, what the software is outside of the. The brain?
5:31:14Neuralink teamYeah. So maybe working backwards from the goal. The goal is to help someone with paralysis. In this case, Noland be able to navigate his computer independently. And we think the best way to do that is to offer them the same tools that we have to navigate our software, because we don't want to have to rebuild an entire software ecosystem for the brain, at least not yet.
5:31:33Neuralink teamMaybe someday you can imagine there's UXs that are built natively for BCI, but in terms of what's useful for people today, I think most people would prefer to be able to just control mouse and keyboard inputs to all the applications that they want to use for their daily jobs, for communicating with their friends, et cetera.
5:31:47Neuralink teamAnd so the job of the application is really to translate this wireless stream of brain data coming off the implant into control of the computer. And we do that by essentially building a mapping from brain activity to sort of the HID inputs to the actual hardware.
5:32:02Neuralink teamSo HID is just the protocol for communicating, like input device events. So, for example, move mouse to this position or press this key down. And so that mapping is fundamentally what the app is responsible for.
5:32:13Neuralink teamBut there's a lot of nuance of how that mapping works that we spend a lot of time to try to get right, and we're still in the early stages of a long journey to figure out how to do that optimally.
5:32:21Neuralink teamSo one part of that process is decoding. So decoding is this process of taking the statistical patterns of brain data that's being channeled across this Bluetooth connection to the application and turning it into, for example, a mouse movement.
5:32:33Neuralink teamAnd that decoding step, you can think of it in a couple different parts. So similar to any machine learning problem, there's a training step and there's an inference step.
5:32:40Neuralink teamThe training step in our case is a very intricate behavioral process where the user has to imagine doing different actions. So, for example, they'll be presented a screen with a cursor on it, and they'll be asked to push that cursor to the right.
5:32:54Neuralink teamThen imagine pushing that cursor to the left, push it up, push it down. We can basically build up a pattern or using any sort of modern ML method of mapping, of given this brain data and that imagined behavior map one to the other.
5:33:07Neuralink teamAnd then at test time, you take that same pattern matching system, in our case, it's a deep neural network, and you run it and you take the live stream of brain data coming off their implant, you decode it by pattern matching to what you saw at calibration time, and you use that for control of the computer.
5:33:20Neuralink teamNow, a couple sort of rabbit holes that I think are quite Interesting. One of them has to do with how you build that fast template matching system, because there's a variety of behavioral challenges and also debugging challenges when you're working with someone who's paralyzed, because again, fundamentally, you don't observe what they're trying to do.
5:33:37Neuralink teamYou can't see them attempt to move their hand. And so you have to figure out a way to instruct the user to do something and validate that they're doing it correctly, such that then you can downstream build with confidence the mapping between the neural spikes and the intended action.
5:33:53Neuralink teamAnd by doing the action correctly, what I really mean is at the level of resolution of what neurons are doing. So if in ideal world you could get a signal of behavioral intent that is ground truth accurate at the scale of 1 millisecond resolution, then with high confidence, I could build a mapping from my neural spikes to that behavioral intention.
5:34:13Neuralink teamBut the challenge is again, that you don't observe what they're actually doing. And so there's a lot of nuance to how you build user experiences that give you more than just sort of a course, on average, correct representation of what the user is intending to do.
5:34:24Neuralink teamIf you want to build the world's best mouse, you really want it to be as responsive as possible. You want it to be able to do exactly what the user is intending at every sort of step along the way, not just on average be correct when you're trying to move it from left to right.
5:34:36Neuralink teamAnd building a behavioral sort of calibration game or sort of software experience that gives you that level of resolution is what we spent a lot of time working on.
5:34:44Elon MuskSo the calibration process, the interface, has to encourage precision, meaning, like, whatever it does, it should be super intuitive that the next thing the human is going to likely do is exactly that intention that you need and only that intention.
5:35:03Neuralink teamYeah.
5:35:03Elon MuskAnd you don't have any feedback, except that may be speaking to you afterwards what they actually did. You can't. Oh, yeah, right. So that's a. That's fundamentally. That is a really exciting UX challenge.
5:35:17Elon MuskBecause that's all on the ux. It's not just about being friendly or nice or usable.
5:35:22Neuralink teamYeah. It's like user experience is how it works.
5:35:25Elon MuskIt's how it works.
5:35:26Neuralink teamYeah.
5:35:26Elon MuskFor the calibration. And calibration, at least at this stage of neuralink, is like fundamental to the operation of the thing. And not just calibration, but continued calibration, essentially.
5:35:39Neuralink teamYeah. And maybe you said something that I think is worth exploring there a little bit you said it's primarily a UX challenge, and I think a large component of it is.
5:35:46Neuralink teamBut there is also a very interesting machine learning challenge here, which is, given some data set, including some on average correct behavior of asking the user to move up or move down, move right, move left, and given a data set of neural spikes, is there a way to infer in some kind of semi supervised or entirely unsupervised way what that high resolution version of their intention is?
5:36:10Neuralink teamAnd if you think about it, there probably is, because there are enough data points in the data set, enough constraints on your model, that there should be a way with the right sort of formulation to let the model figure out itself.
5:36:20Neuralink teamFor example, at this millisecond, this is exactly how hard they're pushing upwards. And at this millisecond, this is how hard they're trying to push upwards.
5:36:27Elon MuskIt's really important to have very clean labels. Yes. So the problem becomes much harder from the machine learning perspective. The labels are noisy, that's correct. And then to get the clean labels,
5:36:38Neuralink teamthat's a UX challenge, correct, although clean labels. I think maybe it's worth exploring what that exactly means. I think any given labeling strategy will have some number of assumptions it makes about what the user is attempting to do.
5:36:50Neuralink teamThose assumptions can be formulated in a loss function, or they can be formulated in terms of heuristics that you might use to just try to estimate or guesstimate what the user is trying to do.
5:36:58Neuralink teamAnd what really matters is how accurate are those assumptions. For example, you might say, hey, user, push upwards and follow the speed of this cursor. And your heuristic might be that they're trying to do exactly what that cursor is trying to do.
5:37:10Neuralink teamAnother competing heuristic might be they're actually trying to go slightly faster at the beginning of the movement and slightly slower at the end. And those competing heuristics may or may not be accurate reflections of what the user is trying to do.
5:37:20Neuralink teamAnother version of the task might be, hey, user, imagine moving this cursor, a fixed offset. So rather than follow the cursor, just try to move it exactly 200 pixels to the right.
5:37:29Neuralink teamSo here's the cursor, here's the target. Okay, cursor disappears. Try to move that now invisible cursor 200 pixels to the right. And the assumption in that case would be that the user can actually modulate correctly that position offset.
5:37:41Neuralink teamBut that position offset assumption might be a weaker assumption and therefore potentially you can make it more accurate than these heuristics that are trying to guesstimate at each millisecond what the user is trying to do.
5:37:51Neuralink teamSo you can imagine different tasks that make different assumptions about the. The nature of the user intention. And those assumptions being correct is what I would think of as a clean
5:37:59Elon Musklabel for that step. What are we supposed to be visualizing? There's a cursor, and you want to move that cursor to the right or the left, up and down, or maybe move them by a certain offset.
5:38:10Elon MuskSo that's one way. Is that the best way to do calibration? So, for example, an alternative crazy way that probably is playing a role here is a game like Web Grid, where you're just getting a very large amount of data.
5:38:23Elon MuskThe person playing a game where if they are in the state of flow, maybe you can get clean signal as a side effect.
5:38:33Neuralink teamYep.
5:38:34Elon MuskIs that, or is it. Is that not an effective way for initial calibration?
5:38:38Neuralink teamYeah, great question. There's a lot to unpack there. So the first thing I would draw a distinction between a sort of open loop versus closed loop. So, open loop, what I mean by that is the user is sort of going from 0 to 1.
5:38:49Neuralink teamThey have no model at all, and they're trying to get to the place where they have some level of control at all. In that setup, you really need to have some task that gives the user a hint of what you want them to do, such that you can build its mapping again from brain data to output.
5:39:03Neuralink teamThen once they have a model, you could imagine them using that model and actually adapting to it and figuring out the right way to use it themselves and then retraining on that data to give you sort of a boost in performance.
5:39:14Neuralink teamThere's a lot of challenges associated with both of these techniques, and we can sort of rabbit hole into both of them, if you're interested. But the sort of challenge with the open loop task is that the user themselves doesn't get proprioceptive feedback about what they're doing.
5:39:26Neuralink teamThey don't necessarily perceive themselves or feel the mouse under their hand when they're using an open loop. When they're trying to do an open loop calibration, they're being asked to perform something like, imagine if you sort of had your whole right arm numbed and you stuck it in a box and you couldn't see it.
5:39:41Neuralink teamSo you had no visual feedback and you had no proprioceptive feedback about what the position or activity of your arm was. And now you're asked, okay, given this thing on the screen that's moving from left to right.
5:39:50Neuralink teamMatch that speed and you basically can try your best to invoke whatever that imagined action is in your brain that's moving the cursor from left to right. But in any situation, you're going to be inaccurate and maybe inconsistent in how you do that task.
5:40:04Neuralink teamAnd so that's sort of the fundamental challenge of open loop. The challenge with closed loop is that once the user's given a model and they're able to start moving the mouse on their own, they're going to very naturally adapt to that model.
5:40:18Neuralink teamAnd that co adaptation between the model learning what they're doing and the user learning how to use the model may not find you the best global minima. It may be that your first model was noisy in some ways or maybe just had some quirk.
5:40:31Neuralink teamThere's some part of the data distribution it didn't cover super well. And the user now figures out, because they're a brilliant user like Nolan, they figure out the right sequence of imagined motions or the right angle they have to hold their hand at to get it to work.
5:40:43Neuralink teamAnd they'll get it to work great. But then the next day they come back to their device and maybe they don't remember exactly all the tricks that they used the previous day.
5:40:49Neuralink teamAnd so there's a complicated sort of feedback cycle here that can emerge and can make it a very, very difficult debugging process.
5:40:56Elon MuskOkay. There's a lot of really fascinating things there. Yeah. Actually, just to stay on the closed loop, I, I've, I've seen situations. This actually happened watching psychology grad grad students, they use piece of software when they don't know how to program themselves.
5:41:15Elon MuskThey use piece of software that somebody else wrote and it has a bunch of bugs and they figure out like. And they've been using it for years. Yeah, they figure out ways to work around.
5:41:24Elon MuskOh, that just happens. Like nobody has. Nobody like considers, maybe we should fix this. They just adapt. And that's a really interesting notion that we just, we're really good at adapting, but you need to still.
5:41:37Elon MuskThat might not be the optimal. Yeah, okay, so how do you solve that problem? Do you have to restart from scratch every once in a while kind of thing?
5:41:44Neuralink teamYeah, it's a good question. First and foremost, I would say this is not a solved problem. And for anyone who's, you know, listening in academia who works on bcis, I would also say this is not a problem that's solved by simply scaling channel count.
5:41:56Neuralink teamSo this is, you know, maybe that can help. And you can get sort of richer covariance structures that you can use to exploit when trying to come up with good labeling strategies.
5:42:02Neuralink teamBut if you're interested in problems that aren't going to be solved inherently by just scaling channel count, this is one of them. Yeah. So how do you solve it?
5:42:09Neuralink teamIt's not a solved problem. That's the first thing I want to make sure it gets across. The second thing is any solution that involves closed loop is going to become a very difficult debugging problem.
5:42:18Neuralink teamAnd one of my general heuristics for choosing what problems to tackle is that you want to choose the one that's going to be the easiest to debug. Because if you can do that, even if the ceiling is lower, you're going to be able to move faster because you have a tighter iteration loop debugging the problem.
5:42:34Neuralink teamAnd in the open loop setting, there's not a feedback cycle to debug with the user in the loop. And so there's some reason to think that that should be an easier debugging problem.
5:42:43Neuralink teamThe other thing that's worth understanding is that even in a closed loop setting, there's no special soft or magic of how to infer what the user is truly attempting to do.
5:42:50Neuralink teamIn a closed loop setting, although they're moving the cursor on the screen, they may be attempting something different than what your model is outputting. So what the model is outputting is not a signal that you can use to retrain.
5:42:59Neuralink teamIf you want to be able to improve the model further. You still have this very complicated guesstimation or unsupervised problem of figuring out what is the true user intention underlying that signal.
5:43:09Neuralink teamAnd so the open loop problem has the nice property of being easy to debug, and the second nice property of it has all the same information content as the close up scenario.
5:43:19Neuralink teamAnother thing I want to mention and call out is that this problem doesn't need to be solved in order to give useful control to people. Even today, with the solutions we have now, and that academia has built up over decades, the level of control that can be given to a user today is quite useful.
5:43:35Neuralink teamIt doesn't need to be solved to get to that level of control. But again, I want to build the world's best mouse. I want to make it so good that it's not even a question that you want it.
5:43:44Neuralink teamAnd to build the world's best mouse, the superhuman version, you really need to nail that problem. And a couple maybe details of previous studies that we've done internally that I Think are very interesting to understand when thinking about how to solve this problem.
5:43:58Neuralink teamThe first is that even when you have ground truth data of what the user is trying to do, and you can get this with an able bodied monkey, a monkey that has a neuralink device implanted and moving a mouse to control a computer, even with that ground truth data set, it turns out that the optimal thing to predict to produce high performance BCI is not just the direct control of the mouse.
5:44:18Neuralink teamYou can imagine building data set of what's going on in the brain and what is the mouse exactly doing on the table. And it turns out that if you build the mapping from neural spikes to predict exactly what the mouse is doing, that model will perform worse than a model that is trained to predict higher level assumptions about what the user might be trying to do.
5:44:34Neuralink teamFor example, assuming that the monkey is trying to go in a straight line to the target, it turns out that making those assumptions is actually more effective in producing a model than actually predicting the underlying hand movement.
5:44:45Elon MuskSo the intention, not like the physical movement or whatever. Yeah, there's obviously a really strong correlation between the two, but the intention is a more powerful thing to be chasing.
5:44:54Elon MuskRight, well that's also super interesting. I mean the intention itself is fascinating because yes, with the BCI here, in this case with a digital telepathy, you're acting on the intention, not the action.
5:45:08Elon MuskWhich is why there's an experience of like feeling like it's happening before you meant for it to happen. That is so cool. And that is why you could achieve like superhuman performance problem in terms of the control of the mouth.
5:45:22Elon MuskSo the for open loop. Just to clarify, so whenever the person is tasked to like move the mouse to the right, you said there's not feedback, so they don't get to get that satisfaction of like actually getting it to move.
5:45:37Elon MuskRight.
5:45:38Neuralink teamSo you could imagine giving the user feedback on a screen, but it's difficult because at this point you don't know what they're attempting to do. So what can you show them that would basically give them a signal of I'm doing this correctly or not correctly.
5:45:49Neuralink teamSo let's take a very specific example. Like maybe your calibration task looks like you're trying to move the cursor a certain position offset. So your instructions to the user are, hey, the cursor is here.
5:45:59Neuralink teamNow when the cursor disappears, imagine moving it 200 pixels from where it was to the right to be over this target. In that kind of scenario, you could imagine coming up with some sort of consistency Metric that you could display to the user of okay, I know what the spike train looks like on average when you do this action to the right, maybe I can produce some sort of probabilistic estimate of how likely is that to be the action you took, given the latest trial or trajectory that you imagined.
5:46:23Neuralink teamAnd that could give the user some sort of feedback of how consistent are they across different trials. You could also imagine that if the user is prompted with that kind of consistency metric, that maybe they just become more behaviorally engaged to begin with, because the task is kind of boring when you don't have any feedback at all.
5:46:38Neuralink teamAnd so there may be benefits user experience of showing something on the screen, even if it's not accurate, just because it keeps the user motivated to try to increase that number or push it upwards.
5:46:48Elon MuskSo there's a psychology element here.
5:46:50Neuralink teamYeah, absolutely.
5:46:52Elon MuskAnd again, all of that is UX challenge. How much signal drift is there? Hour to hour, day to day, week to week, month to month? How often do you have to recalibrate because of the signal drift?
5:47:06Neuralink teamYeah, so this is a problem we've worked on both with NHP non human primates before our clinical trial, and then also with Noland during the clinical trial. Maybe the first thing that's worth stating is what the goal is here.
5:47:19Neuralink teamSo the goal is really to enable the user to have a plug and play experience where I guess they don't have to plug anything in, but a play experience where they can use the device whenever they want to, however they want to.
5:47:29Neuralink teamAnd that's really what we're aiming for. And so there can be a set of solutions that get to that state without considering this non stationarity problem. So maybe the first solution here that's important is that they can recalibrate whenever they want.
5:47:42Neuralink teamThis is something that Nolan has the ability to do today. So he can recalibrate the system at 2am in the middle of the night without his caretaker or parents or friends around to help push a button for him.
5:47:53Neuralink teamThe other important part of the solution is that when you have a good model calibrated that you can continue using that without needing to recalibrate it. So how often he has to do this recalibration depends really on his appetite for performance.
5:48:06Neuralink teamWe observe a degradation through time of how well any individual model works. But this can be mitigated behaviorally by the user adapting their control strategy. It can also be mitigated through a combination of sort of software features that we provide to the user.
5:48:18Neuralink teamFor example, we Let the user adjust exactly how fast the cursor is moving. We call that the gain, for example, the gain of how fast the cursor reacts to any given input intention.
5:48:27Neuralink teamThey can also adjust the smoothing how smooth the output of that cursor intention actually is. They can also adjust the friction, which is how easy is it to stop and hold still.
5:48:36Neuralink teamAnd all these software tools allow the user a great deal of flexibility and troubleshooting mechanisms to be able to solve this problem for themselves.
5:48:42Elon MuskBy the way, all this is done by looking to the right side of the screen, selecting the mixer. And the mixer you have.
5:48:48Neuralink teamIt's like DJ mode, DJ mode for your vci.
5:48:52Elon MuskI mean it's a really well done interface. It's really, really well done. And so yeah, there's that bias that there's a cursor drift that Nolan talked about in a stream, although he said that you guys were just playing around with it with him and they're constantly improving.
5:49:08Elon MuskSo that could have been just a snapshot of that particular moment, a particular day. But he said that there was this cursor drift in his bias that could be removed by him, I guess, looking to the right side of the screen or left side of the screen to kind of adjust the bias.
5:49:25Elon MuskYeah, that's one interface action, I guess, to adjust the bias. Yeah.
5:49:28Neuralink teamSo this is actually an idea that comes out of academia. There is some prior work with sort of brain gate clinical trial participants where they pioneered this idea of bias correction.
5:49:39Neuralink teamThe way we've done it I think is very productized, very beautiful user experience where the user can essentially flash the cursor over to the side of the screen and it opens up a window where they can actually sort of adjust or tune exactly the bias of the cursor.
5:49:54Neuralink teamSo bias, maybe for people who aren't familiar, is just sort of what is the default motion of the cursor if you're imagining nothing? And it turns out that that's one of the first, first sort of qualia of the cursor control experience that's impacted by neural non stationarity quality of the cursor.
5:50:08Neuralink teamI don't know how else to describe it like, you know, I'm not the, I'm not the guy move everything.
5:50:12Elon MuskI love it. The quality of the cursor experience. Yeah, I mean it's, it sounds poetic, but it is deeply true. There is an experience when it works well, it is a joyful, a really pleasant experience.
5:50:27Elon MuskAnd when it doesn't work well, it's
5:50:28Neuralink teama very frustrating experience.
5:50:30Elon MuskThat's actually the art of ux, it's like you have the possibility to frustrate people or the possibility to give them joy.
5:50:39Neuralink teamAnd at the end of the day, it really is truly the case that UX is how the thing works. And so it's not just like what's shown on the screen.
5:50:45Neuralink teamIt's also what control surfaces does a decoder provide the user. We want them to feel like they're in the F1 car, not like some minivan, right? And that really, truly is how we think about it.
5:50:57Neuralink teamNo one himself is an F1 fan, so we refer to ourselves as a pit crew. He really is truly the F1 driver. And there's different control surfaces that different kinds of cars and airplanes provide the user.
5:51:08Neuralink teamAnd we take a lot of inspiration from that when designing how the cursor should behave. And maybe one nuance of this is, you know, even details like when you move a mouse on a MacBook trackpad, the sort of response curve of how that input that you give the trackpad translates to cursor movement is different than how it works with the mouse when you move it on the trackpad.
5:51:27Neuralink teamThere's a different response function, a different curve to how much a movement translates to input to the computer than when you do it physically with a mouse. And that's because somebody sat down a long time ago when they designed the initial input systems to any computer, and they thought through exactly how it feels to use these different systems.
5:51:42Neuralink teamAnd now we're designing sort of the next generation of this input system to a computer, which is entirely done via the brain. And there's no proprioceptive feedback. Again, you don't feel the mouse in your hand, you don't feel the keys under your fingertips, and you want a control surface that still makes it easy and intuitive for the user to understand the state of the system and how to achieve what they want to achieve.
5:52:00Neuralink teamAnd ultimately, the end goal is that that UX is completely fades in the background. It becomes something that's so natural and intuitive that it's subconscious to the user. And they just should feel like they have basically direct control over the cursor.
5:52:12Neuralink teamIt just does what they want it to do. They're not thinking about the implementation of how to make it do what they want it to do, it's just doing what they want it to do.
5:52:17Elon MuskIs there some kind of things along the lines of like Fitt's Law, where you should move the mouse in a certain kind of way that maximizes your chance to hit the target?
5:52:29Elon MuskI don't even know what I'm asking, but I'm hoping the intention of my question will land on on a profound answer. No. Is there some kind of understanding of the laws of UX when it comes to the context of somebody using their brain to control it?
5:52:52Elon MuskLike that's different than actual with a mouse?
5:52:55Neuralink teamI think we're in the early stages of discovering those laws, so I wouldn't claim to have solved that problem yet, but there's definitely some things we've learned that make it easier for the user to get stuff done.
5:53:08Neuralink teamAnd it's pretty straightforward when you verbalize it, but it takes a while to actually get to that point when you're in the process of debugging this stuff in the trenches.
5:53:14Neuralink teamOne of those things is that any machine learning system you build has some number of errors, and it matters how those errors translate to the downstream user experience. For example, if you're developing a search algorithm in your photos, if you search for your friend Joe and it pulls up a photo of your friend Josephine, maybe that's not a big deal because the cost of an error is not that high.
5:53:38Neuralink teamIn a different scenario where you're trying to detect insurance fraud or something like this, and you're directly sending someone to court because of some machine learning model output, then the errors make a lot more sense to be careful about.
5:53:50Neuralink teamYou want to be very thoughtful about how those errors translate to downstream effects. The same is true in bci. So, for example, if you're building a model that's decoding a velocity output from the brain versus an output where you're trying to modulate the left click, for example, these have sort of different trade offs of how precise you need to be before it becomes useful to the end user.
5:54:08Neuralink teamFor velocity, it's okay to be on average correct because the output of the model is integrated through time. So if the user is trying to click at position A and they're currently position B, they're trying to navigate over time to get between those two points.
5:54:20Neuralink teamAnd as long as the output of the model is on average correct, they can sort of steer it through time. With the user control loop in the mix, they can get to the point they want to get to.
5:54:29Neuralink teamThe same is not true of a click. For a click, you're performing it almost instantly at the scale of neurons firing. And so you want to be very sure that that click is correct, because a false click can be very destructive to the user.
5:54:40Neuralink teamThey might accidentally close the tab that they're trying to do something in or lose all their Progress, they might accidentally, you know, hit some send button on some text that is only like half composed and reads funny after.
5:54:52Neuralink teamSo, you know, there's different sort of cost functions associated with errors in this space. And part of the UX design is understanding how to build a solution that is when it's wrong, still useful to the end user.
5:55:02Elon MuskThat's so fascinating that assigning cost to every action when an error occurs. So every action, if an error occurs, has a certain cost. And incorporating that into how you interpret the intention, mapping it to the action is really important.
5:55:23Elon MuskI didn't quite until you said it realized there's a cost to like sending the text early. It's like a very expensive cost.
5:55:32Neuralink teamIt's super annoying if you accidentally, your cursor misclicked every once in a while. That's like super obnoxious. And the worst part of it is usually when the user's trying to click, they're also holding still because they're over the target they want to hit and they're getting ready to click.
5:55:45Neuralink teamWhich means that in the data sets that we build, on average, it's the case that sort of low speeds or desire to hold still is correlated with when the user's attempting to click.
5:55:54Elon MuskWow, that is really fascinating.
5:55:56Neuralink teamIt's also not the case, you know, people think that, oh, a click is a binary signal. This must be super easy to decode. Well, yes, it is, but the bar is so much higher for it to become a useful thing for the user.
5:56:06Neuralink teamAnd there's ways to solve this. I mean, you can sort of take the compound approach of, well, let's just give the like, let's take five seconds to click, let's take a huge window of time so we can be very confident about the answer.
5:56:15Neuralink teamBut again, world's best mouse. The world's best mouse doesn't take a second to click or 500 milliseconds to click. It takes 5 milliseconds to click or less. And so if you're aiming for that kind of high bar, then you really want to solve the underlying problem.
5:56:26Elon MuskSo maybe this is a good place to ask about how to measure performance. This whole bits per second. What can you like explain what you mean by that? Maybe a good place to start is to talk about Web Grid as a game, as a good illustration of the measurement of performance.
5:56:43Neuralink teamYeah, maybe I'll take one zoom out step there, which is just explaining why we care to measure this at all. So again, our goal is to Provide the user the ability to control the computer as well as I can, and hopefully better.
5:56:54Neuralink teamAnd that means that they can do it at the same speed as what I can do. It means that they have access to all the same functionality that I have, including all those little details like command tab, command space, all this stuff.
5:57:03Neuralink teamThey need to be able to do it with their brain and with the same level of reliability as what I can do with my muscles. And that's a high bar.
5:57:08Neuralink teamAnd so we intend to measure and quantify every aspect of that to understand how we're progressing towards that goal. There's many ways to measure bps, by the way. This isn't the only way, but we present the user a grid of targets and basically we compute a score, which is dependent on how fast and accurately they can select, and then how small are the targets.
5:57:24Neuralink teamAnd the more targets that are on the screen, the smaller they are, the more information you present per click. And so if you think about it from an information theory point of view, you can communicate across different information theoretic channels.
5:57:35Neuralink teamAnd one such channel is a typing interface you could imagine that's built out of a grid, just like a software keyboard on the screen. And bits per second is a measure that's computed by taking the log of the number of targets on the screen.
5:57:47Neuralink teamYou can subtract one if you care to model a keyboard, because you have to subtract one for the delete key on the keyboard, but log the number of targets on the screen times the number of correct selections minus incorrect, divided by some time window, for example, 60 seconds.
5:57:59Neuralink teamAnd that's sort of the standard way to measure a cursor control task in academia. And all credit in the world goes to this great professor, Dr. Shenoy of Stanford, who came up with that task.
5:58:08Neuralink teamAnd he's also one of my inspirations for being in the field. So all the credit in the world to him for coming up with a standardized metric to facilitate this kind of bragging rights that we have now to say that Nolan is the best in the world at this task with his pci.
5:58:18Neuralink teamIt's very important for progress that you have standardized metrics that people can compare across different techniques and approaches. How well does this do? So, yeah, big kudos to him and to all the team at Stanford.
5:58:29Neuralink teamYeah. So for Noland and for me playing this task, there's also different modes that you can configure this task. So the web grid task can be presented as just sort of a left click on the screen, or you could have, you know, targets that you just dwell over, or you could have targets that you left, right click on.
5:58:43Neuralink teamYou could have targets that are left, right click, middle click, scrolling, clicking and dragging. You can do all sorts of things within this general framework, but the simplest, purest form is just blue targets show up on screen.
5:58:52Neuralink teamBlue means left click. That's the simplest form of the game. And the sort of prior records here in academic work and at neuralink internally with sort of NHPs have all been matched or beaten by Noland with his neuralink device.
5:59:09Neuralink teamSo sort of prior to neuralink, the sort of world record for a human using device is somewhere between 4.2 to 4.6 bps, depending on exactly what paper you read and how you interpret it.
5:59:19Neuralink teamNolan's current record is 8.5 bps. And again, this sort of median Neuralinker performance is 10 bps. So you can think of it roughly as he's 85% the level of control of a median neuralinker using their cursor to select blue targets on the screen.
5:59:33Neuralink teamAnd yeah, I think there's a very interesting journey ahead to get us to that same level of 10bps performance. It's not the case that sort of the tricks that got us from 4 to 6bps and then 6 to 8bps are going to be the ones that get us from 8 to 10.
5:59:49Neuralink teamAnd in my view, the core challenge here is really the labeling problem. It's how do you understand at a very, very fine resolution what the user is attempting to do?
5:59:57Neuralink teamAnd yeah, I highly encourage folks in academia to.
6:00:00Elon MuskTo work on this problem.
6:00:01Lex FridmanWhat's the journey with Nolan on that quest of increasing the bps on web grid? In March, you said that he selected 89,285 targets in web grid.
6:00:12Elon MuskYep.
6:00:13Lex FridmanSo he loves this game. He's really serious about improving his performance in this game. So what is that journey of trying to figure out how to improve that performance?
6:00:21Lex FridmanHow much can that be done on the decoding side? How much can that be done on the calibration side? How much can that be done on the Nolan side of, like, figuring out how to convey his intention more cleanly?
6:00:36Elon MuskYeah, no, this is a great question. So in my view, one of the primary reasons why Nolan's performance is so good is because of Noland. Noland is extremely focused and very energetic.
6:00:47Elon MuskHe'll play web grid sometimes for like, four hours in the middle of the night. Like, from 2am to 6am he'll be playing web grid just because he wants to push it to the limits of what he can do.
6:00:56Elon MuskAnd, you know, this is not us, like, asking him to do that. I want to be clear, like, we're not saying, hey, you should play webgood tonight. We just gave him the game as part of our research, and he is able to play independently and practice whenever he wants.
6:01:07Elon MuskAnd he really pushes hard to push it. The technology is the absolute limit, and he views that as his job, really, to make us be the bottleneck. And, boy, has he done that well.
6:01:16Elon MuskAnd so the first thing to acknowledge is that he is extremely motivated to make this work. I've also had the privilege to meet other clinical trial participants from Braingate and other trials, and they very much share the same attitude of, like, they view this as their life's work to advance the technology as much as they can.
6:01:33Elon MuskAnd if that means selecting targets on the screen for four hours from 2am to 6am then so be it. And there's something extremely admirable about that that's worth calling out.
6:01:42Elon MuskOkay, so now how do you sort of get from where he started, which is no cursor control to apps? So, I mean, when he started, there's a huge amount of learning to do on his side and our side to figure out what's the most intuitive control for him?
6:01:55Elon MuskAnd the most intuitive control for him is you have to find the set intersection of what do we have the signal to decode. So we don't pick up every single neuron in the motor cortex, which means we don't have representation for every part of the body.
6:02:07Elon MuskSo there may be some Signals that we have better decode performance on than others. For example, on his left hand, we have a lot of difficulty distinguishing his left ring finger from his left middle finger.
6:02:17Elon MuskBut on his right hand, we have a good, you know, good control and good modulation detected from the neurons that we're able to record for his pinky and his thumb and his index finger.
6:02:24Elon MuskSo you can imagine how these different subspaces of modulated activity intersect with what's the most intuitive for him. And this has evolved over time. So once we gave him the ability to calibrate models on his own, he was able to go and explore various different ways to imagine controlling the cursor.
6:02:40Elon MuskFor example, he could imagine controlling the cursor by wiggling his wrist side to side or by moving his entire arm, but had to get one pointed to his feet.
6:02:46Elon MuskYou know, he tried, like whole bunch of stuff to explore the space of what is the most natural way for him to control the cursor that at the same time, is easy for us to decode.
6:02:54Elon MuskRelax.
6:02:54Lex FridmanJust to clarify, it's through the body mapping procedure that you're able to figure out which finger he can move?
6:03:02Elon MuskYes. Yes. That's one way to do it. Maybe one nuance of the. When he's doing it, he can imagine many more things than we represent in that visual on the screen.
6:03:11Elon MuskSo we show him sort of abstractly. Here's a cursor. You figure out what works the best for you, and we obviously have hints about what will work best from that body mapping procedure of, you know, we know that this particular action can represent well, but it's really up to him to go and explore and figure out what works the best.
6:03:27Lex FridmanBut at which point does he no longer visualize the movement of his body and is just visualizing the movement of the cursor?
6:03:33Elon MuskYeah.
6:03:34Lex FridmanHow quickly does he go from. How quickly does he get there?
6:03:37Elon MuskSo this happened on our Tuesday. I remember this day very clearly because at some point during the. During the day, it looked like he wasn't doing super well. It looked like the model wasn't performing super well, and he was getting distracted, but it wasn't the case.
6:03:49Elon MuskWhat actually happened was he was trying something new where he was just controlling the cursor. So he wasn't imagining moving his hand anymore. He was just imagining, I don't know what it is, some abstract intention to move the cursor on the screen.
6:04:02Elon MuskAnd I cannot tell you what the difference between those two things are. I really, truly cannot. He's tried to explain it to me Before, I cannot give a first person account of what that's like, but the expletives that he uttered in that moment were enough to suggest that it was a very qualitatively different experience for him to just have direct neural control over a cursor.
6:04:23Lex FridmanI wonder if there's a way through UX to encourage a human being to discover that. Because he discovered it, like you said to me, that he's a pioneer. So he discovered that on his own through all of this.
6:04:38Lex FridmanThe process of trying to try to move the cursor with different kinds of intentions. But that is clearly a really powerful thing to arrive at, which is to let go of trying to control the fingers and the hand and control the actual digital device with your mind.
6:04:56Elon MuskThat's right. UX is how it works. And the ideal UX is one that it's. The user doesn't have to think about what they need to do in order to get it done.
6:05:03Elon MuskThey just. It just does it.
6:05:06Lex FridmanThat is so fascinating. But I wonder on the biological side how long it takes for the brain to adapt. So is it just simply learning high level software or is there a neuroplasticity component where the brain is adjusting slowly?
6:05:24Elon MuskYeah, the truth is, I don't know. I'm very excited to see with the second participant that we implant what the, you know, what the journey is like for them because we'll have learned a lot more potentially.
6:05:36Elon MuskWe can help them understand and explore that direction more quickly. This is something I didn't, you know, this wasn't me prompting Nolan to go try this. He was just exploring how to use his device and figured it out himself.
6:05:46Elon MuskBut now that we know that that's a possibility, that maybe there's a way to, you know, for example, hint the user, don't try super hard during calibration, just do something that feels natural or just directly control the cursor.
6:05:55Elon MuskYou know, don't imagine explicit action. And from there we should be able to hopefully understand how this is for somebody who has not experienced that before. Maybe that's the default mode of operation for them.
6:06:04Elon MuskYou don't have to go through this intermediate phase of explicit motions.
6:06:07Lex FridmanOr maybe if that naturally happens for people, you can just occasionally encourage them to allow themselves to move the cursor. Actually sometimes just like with a four minute mile, just the knowledge that that's
6:06:18Elon Muskpossible pushes you to do it.
6:06:20Lex FridmanYeah. Enables you to do it. And then it becomes trivial. And then it also makes you wonder. This is the cool thing about humans. Once there's a Lot more human participants.
6:06:30Lex FridmanThey will discover things that are possible.
6:06:32Elon MuskYes.
6:06:33Lex FridmanAnd share their experiences and that because of them sharing it, they'll be able to do it. All of a sudden that's unlocked for everybody because just the knowledge sometimes is the thing that enables it to do it.
6:06:46Elon MuskYeah, just to comment on that too. We've probably tried like a thousand different ways to do various aspects of decoding, and now we know what the right subspace is to continue exploring further.
6:06:56Elon MuskAgain, thanks to Nolan and the many hours he's put into this. And so even just that help, like, help constrain sort of the beam search of different approaches that we could explore really helps accelerate for the next person, you know, the set of things that we'll get to try on day one, how fast we hope to get them the useful control, how fast we can enable them to use it independently and to get value out of the system.
6:07:14Elon MuskSo, yeah, massive hats off to Noland and all the participants that came before him to make this technology a reality.
6:07:20Lex FridmanSo how often are the updates to the decoder? Because Nolan mentioned, like, okay, there's a new update that we're working on and that in the stream, he said he plays the Snake game because it's like super hard.
6:07:33Lex FridmanIt's a good way for him to test like, how good the update is. So, and he says, like, sometimes the update is a step backwards. It's like it's a constant, like iteration.
6:07:43Lex FridmanSo how often, like, what does the update entail? Is it most on the decoder side? Yeah.
6:07:49Elon MuskCouple comments. So, one is it's probably worth trying distinction between sort of research sessions where we're actively trying different things to understand what the best approach is, versus sort of independent use where we wanted to have ability to just go use the device, how anybody would want to use their MacBook.
6:08:02Elon MuskAnd so what he's referring to is, I think usually in the context of a research session where we're trying many, many different approaches to even unsupervised approaches like we talked about earlier, to try to come up with better ways to estimate his true intention and more accurately decode in.
6:08:15Elon MuskAnd in those scenarios, I mean, we try in any given session, he'll sometimes work for like eight hours a day. And so that can be hundreds of different models that we would try in that day, like a lot of different things.
6:08:27Elon MuskNow it's also worth noting that we update the application he uses quite frequently. I think sometimes up to like four or five times a day, we'll update his application with different features or bug fixes.
6:08:36Elon MuskOr feedback that he's given us. So he's been able to. He's a very articulate person who is part of the solution. He's not a complaining person. He says, hey, here's this thing that I've.
6:08:45Elon MuskI've discovered is not optimal in my flow. Here's some ideas how to fix it. Let me know what your thoughts are. Let's figure out how to solve it. And it often happens that those things are addressed within a couple hours of him giving us his feedback, because that's the kind of iteration cycle we'll have.
6:08:58Elon MuskAnd so sometimes at the beginning of the session he'll give us feedback and at the end of the session he's giving us feedback on the next iteration of that process or that setup.
6:09:06Lex FridmanThat's fascinating because one of the things you mentioned that there was 271 pages of notes taken from the BCI sessions and this was just in March. So one of the amazing things about human beings that they can provide, especially ones who are smart and excited and all positive and good vibes like Nolan, that they can provide feedback, continuous feedback.
6:09:28Elon MuskIt also requires just to brag on the team a little bit. I work with a lot of exceptional people and it requires the team being absolutely laser focused on the user and what will be the best for them.
6:09:38Elon MuskAnd it requires level of commitment of okay, this is what the user feedback was. I have all these meetings, we're going to skip that today and we're going to do this.
6:09:45Elon MuskYou know, that level of focus commitment is I would say under underappreciated in the world. And also, you know, you obviously have to have the talent to be able to execute on these things effectively.
6:09:56Elon MuskAnd yeah, we have that in loads.
6:10:00Lex FridmanYeah. And this is such a interesting space of UX design because you have. There's so many unknowns here. And I can tell UX is difficult because of how many people do it poorly.
6:10:17Lex FridmanIt's just not a trivial thing.
6:10:19Elon MuskYeah, it's also, you know, UX is not something that you can always solve by just constant iterating on different things. Like sometimes you really need to step back and think globally.
6:10:28Elon MuskAm I even in like the right sort of minima to be chasing down for a solution? There's a lot of problems in which sort of fast iteration cycle is the predictor of how successful you will be.
6:10:37Elon MuskAs a good example, in an RL simulation, for example, the more frequently you get reward, the faster you can progress. It's just an easier learning problem the more frequently you get feedback.
6:10:46Elon MuskBut UX is not that way. Users are actually quite often wrong about what the right solution is. And it requires a deep understanding of the technical system and what's possible combined with what the problem is you're trying to solve.
6:10:58Elon MuskNot just how the user expressed it, but what the true underlying problem is to actually get to the right place.
6:11:04Lex FridmanYeah, that's the old stories of Steve Jobs like rolling in there. The user is a useful signal, but it's not a perfect signal. And sometimes you have to remove the floppy disk drive or whatever the.
6:11:16Lex FridmanI forgot all the crazy stories of Steve Jobs like making wild design decisions, but there's some. Some of his aesthetic that. Some of it is about the love you put into the design, which is very much a Steve Jobs Johnny I've type thing.
6:11:38Lex FridmanBut when you have a human being using their brain to interact with it there it also is deeply about function. It's not just aesthetic. And that you have to empathize with a human being before you while not always listening to them directly.
6:11:55Lex FridmanThey get to deeply empathize. It's fascinating. It's really, really fascinating. And at the same time iterate. Right. But not iterate in small ways. Sometimes a complete. Like rebuilding the design.
6:12:08Lex FridmanHe said that Nolan said in the early days the UX sucked, but you improved quickly. What was that journey like?
6:12:16Elon MuskYeah, I mean, I'll give one concrete example. So he really wanted to be able to read manga. This is something that he. I mean, it sounds like a simple thing, but it's actually a really big deal for him.
6:12:26Elon MuskAnd he couldn't do it with this mouse stick.
6:12:28Lex FridmanIt just.
6:12:28Elon MuskIt wasn't accessible. You can't scroll with the mouse stick. On his iPad, on the website that he wanted to be able to use to read the newest manga and so
6:12:36Lex Fridmanmight be a good quick pause to say the mouth stick is the thing he's using holding a stick in his mouth to scroll on a tablet.
6:12:44Elon MuskRight? Yeah. It's basically. You can imagine, it's a stylus that you hold between your teeth.
6:12:47Lex FridmanYeah. It's basically a very long stylus and it's exhausting. It hurts and it's inefficient.
6:12:54Elon MuskYeah. And maybe it's also worth calling out. There are other alternative resistive technologies. But that particular situation Nolan's in, and this is not uncommon and I think it's also not well understood by folks, is that he's relatively spastic, so he'll have muscle spasms from time to time.
6:13:07Elon MuskAnd so any assistive technology that requires him to be positioned directly in Front of a camera, for example, an eye tracker, or anything that requires him to put something in his mouth just is a no go because he'll either be shifted out of frame when he has a spasm, or if he has something in his mouth, it'll stab him in the face, you know, if he spasms too hard.
6:13:23Elon MuskSo these kind of considerations are important when thinking about what advantages a PCI has in someone's life. If it fits ergonomically into your life in a way that you can use it independently when your caretaker is not there, wherever you want to, either in the bed or in the chair, depending on, you know, your comfort level and your desire to have pressure sores.
6:13:39Elon MuskYou know, all these factors matter a lot in how good the solution is in that user's. In that user's life. So one of these very fun examples is scroll.
6:13:48Elon MuskSo again, manga is something he wanted to be able to read. And there's many ways to do scroll with the bci. You can imagine different gestures, for example, the user could do that would move the page.
6:14:00Elon MuskBut scroll is a very fascinating control surface because it's a huge thing on the screen in front of you. So any sort of jitter in the model output, any sort of error in the model output causes like an earthquake on the screen.
6:14:11Elon MuskLike, you really don't want to have your manga page that you're trying to read shifted up and down a few pixels just because your scroll decoder is not completely accurate.
6:14:19Elon MuskAnd so this was an example where we had to figure out how to formulate the problem in a way that the errors of the system, whenever they do occur, and we'll do our best to minimize them, but whenever those errors do occur, that it doesn't interrupt the qualia again of the experience that the user is having.
6:14:34Elon MuskIt doesn't interrupt their flow of reading their book. And so what we ended up building is this really brilliant. This is a teammate named Bruce who worked on this really brilliant work called Quick Scroll.
6:14:45Elon MuskAnd Quick scroll basically looks at the screen and it identifies where on the screen are scroll bars. And it does this by deeply integrating with macOS to understand where are the scroll bars actively present on the screen, using the sort of accessibility tree that's available to macOS apps.
6:15:00Elon MuskAnd we identified where those scroll bars are and provided a BCI scroll bar. And the BCI scroll bar looks similar to a normal scroll bar, but it behaves very differently in that once you sort of move over to it, your cursor sort of morphs onto it.
6:15:12Elon MuskIt sort of attaches or latches onto it. And then once you push up or down in the same way that you'd use a push to control the normal cursor, it actually moves the screen for you.
6:15:22Elon MuskSo it's basically like remapping the velocity to a scroll action. And the reason that feels so natural and intuitive is that when you move over to attach to it, it feels like magnetic.
6:15:31Elon MuskSo you're sort of stuck onto it. And then it's one continuous action. You don't have to switch your imagined movement. You sort of snap onto it and then you're good to go.
6:15:37Elon MuskYou just immediately can start pulling the page down or pushing it up. And even once you get that right, there's so many little nuances of how the scroll behavior works to make it natural and intuitive.
6:15:47Elon MuskSo one example is momentum. Like when you scroll a page with your fingers on the screen, you actually have some flow. Like it doesn't just stop right when you lift your finger up.
6:15:56Elon MuskThe same is true with BCI scroll. So we had to spend some time to figure out what are the right nuances when you don't feel the screen under your fingertip anymore.
6:16:03Elon MuskWhat is the right sort of dynamic or what's the right amount of page give, if you will, when you push it to make it flow the right amount for the user to have a natural experience reading their book.
6:16:14Elon MuskAnd there's a million. I mean, there's. I could tell you, like, there's so many little minutiae of how exactly that scroll works that we spent probably like a month getting.
6:16:21Elon MuskRight. To make that feel extremely natural and easy for the user to navigate.
6:16:25Lex FridmanI mean, even a scroll on a smartphone with your finger feels extremely natural and pleasant and it probably takes an extremely long time to get that right. And actually the same kind of visionary UX design that we're talking about don't always listen to the users, but also listen to them and also have like visionary big, like throw everything out, think from first principles, but also not.
6:16:53Lex FridmanYeah, yeah. By the way, just makes me think that scroll bars on the desktop probably have stagnated and never taken that. Like, because the snap. Same as it's like snap to grid, snap to scroll bar action you're talking about is something that could potentially be extremely useful in the desktop setting, even just for users to just improve the experience.
6:17:16Lex FridmanBecause the current scroll bar experience and the desktop is horrible.
6:17:19Elon MuskYeah.
6:17:20Lex FridmanIt's hard to find, hard to control. There's not a momentum, there's. And the intention should be clear when I start moving towards the scroll bar, there should be a snapping to the scroll bar action.
6:17:31Lex FridmanBut of course, you know, maybe I'm okay paying that cost, but there's hundreds of millions of people paying that cost non stop anyway. But in this case this is necessary because there's an extra cost paid by Nolan for the jitteriness.
6:17:48Lex FridmanSo you have to switch between the scrolling and the reading. There has to be a phase shift between the two. Like when you're scrolling. You're scrolling.
6:17:58Elon MuskRight, right. So that is one drawback of the current approach, maybe one other just sort of case study here. So again, UX is how it works and we think about that holistically from like the.
6:18:08Elon MuskEven the feature detection level of what we detect in the brain to how we design the decoder, what we choose to decode to, then how it works once it's being used by the user.
6:18:15Elon MuskSo another good example in that sort of how it works once they're actually using the decoder, the output that's displayed on the screen is not just what the decoder says, it's also a function of what's going on on the screen.
6:18:25Elon MuskSo we can understand, for example, that when you're trying to close a tab, that very small stupid little X that's extremely tiny, which is hard to get precisely hit if you're dealing with a noisy output of the decoder, we can understand that that is a small little X you might be trying to hit and actually make it a bigger target for you, similar to how when you're typing on your phone, if you're used to the iOS keyboard, for example, it actually adapts the target size of individual keys based on an underlying language model.
6:18:50Elon MuskSo it'll actually understand if I'm typing, hey, I'm going to see L, it'll make the E key bigger because it knows Lex is the person I'm going to go see.
6:18:58Elon MuskAnd so that kind of predictiveness can make the experience much more smooth, even without improvements to the underlying decoder or feature detection part of the stack. So we do that with a feature called magnetic targets, where we actually index the screen and we understand, okay, these are the places that are very small targets that might be difficult to hit.
6:19:15Elon MuskHere's the kind of cursor dynamics around that location that might be indicative of the user trying to select it. Let's make it easier, let's blow up the size of it in a way that makes it easier for the user to sort of snap onto that target.
6:19:24Elon MuskSo all these little details, they matter a lot in helping the user Be independent in their day to day living.
6:19:29Lex FridmanSo how much of the work on the decoder is generalizable to P2, P3, P4, P5, PN? How do you improve the decoder in a way that's generalizable?
6:19:41Elon MuskYeah, great question. So the underlying signal we're trying to decode is going to look very different in P2 than in P1. For example, channel number 345 is going to mean something different in user one than it will in user two.
6:19:51Elon MuskJust because that electrode that corresponds with channel 345 is going to be next to a different neuron in user1 person, user2. But the approaches, the methods, the user experience of how do you get the right sort of behavioral pattern from the user to associate with that neural signal?
6:20:04Elon MuskWe hoped it will translate over multiple generations of users. And beyond that, it's very, very possible in fact quite likely that we've overfit to sort of Nolan's user experience desires and preferences.
6:20:14Elon MuskAnd so what I hope to see is that, you know, when we get a second, third, fourth participant that we find sort of what the right wide minimums are that cover all the cases that make it more intuitive for everyone.
6:20:24Elon MuskAnd hopefully there's a cross pollination of things where, oh, we didn't think about that with this user because you know, they can speak. But with this user who just can fundamentally not speak at all, this user experience is not optimal.
6:20:34Elon MuskAnd that will actually those improvements that we make there should hopefully translate then to even people who can speak but don't feel comfortable doing so because we're in a public setting like their doctor's office.
6:20:42Lex FridmanSo the actual mechanism of open loop labeling and then closed loop labeling will be the same and hopefully can generalize across the different users as they're doing the calibration step.
6:20:56Lex FridmanAnd the calibration step is pretty cool. I mean that in itself the interesting thing about web grid, which is like closed loop, it's like fun. I love it when there's like there used to be kind of idea of human computation which is using actions a human would want to do anyway to get a lot of signal from.
6:21:15Lex FridmanYeah. And like what grid is that? Like a nice video game that also serves as great calibration.
6:21:20Elon MuskIt's so funny. This is, I've heard this reaction so many times before. Sort of the first user was implanted, we had an internal perception that the first user would not find this fun.
6:21:30Elon MuskAnd so we thought really quite a bit actually about should we build other games that are more interesting for the User so we can get this kind of data and help facilitate research that's for long duration stuff like this.
6:21:40Elon MuskTurns out that people love this game. I always loved it, but I didn't know that that was a shared perception.
6:21:45Lex FridmanYeah. Just in case it's not clear, Web grid is, there's a grid of, let's say 35 by 35 cells. And one of them lights up blue and you have to move your mouse over that and click on it.
6:21:58Lex FridmanAnd if you miss it and it's red.
6:22:00Elon MuskAnd I played this game for so many hours. So many hours.
6:22:04Lex FridmanAnd what's your record?
6:22:05Elon MuskYou said my. I think I have the highest at neuralink right now. My record's 17bps.
6:22:10Lex Fridman17bps.
6:22:11Elon MuskIf you imagine that 35 by 35 grid, you're hitting about 100 trials per minute. So 100 correct selections in that one minute window. So you're averaging about between 500, 600 milliseconds per selection.
6:22:21Lex FridmanSo one of the reasons I think I struggle with that game is I'm such a keyboard person. So everything is done with your keyboard. If I can avoid touching the mouse, it's great.
6:22:33Lex FridmanSo how can you explain your high performance?
6:22:36Elon MuskI have like a whole ritual I go through when I play WebKit. So it's actually like a diet plan associated with this. It's a whole thing. So the first thing you have to
6:22:44Lex Fridmanfast for five days. I have to go up to the mountain.
6:22:46Elon MuskActually. It's kind. I mean, the fasting thing is important. So this is like, you know, focuses the mind. Yeah, yeah, it's true. So what I do is I actually, I don't eat for a little bit beforehand.
6:22:55Elon MuskAnd then I'll actually eat like a ton of peanut butter right before I. And I get like, this is a real thing. This is a real thing. Yeah. And then it has to be really late at night.
6:23:02Elon MuskThis is again a night owl thing. I think we share, but it has to be like, you know, midnight, 2am kind of time window. And I have a very specific, like, physical position I'll sit in, which is I used to be.
6:23:12Elon MuskI was homeschooled growing up. And so I did most of my work like on the floor, just like in my bedroom or whatever. And so I have a very specific situation on the floor.
6:23:19Elon MuskOn the floor that I sit and play. And then you have to make sure like there's not a lot of weight on your elbow when you're playing so that you can move quickly.
6:23:25Elon MuskAnd then I turn the gain of the cursor so the Speed of the cursor way, way up. So it's like small motions that actually move the cursor.
6:23:30Lex FridmanAre you moving with your wrist or you. You're never.
6:23:32Elon MuskI move my fingers so my wrist is almost completely still. I'm just moving my fingers. Yeah.
6:23:37Lex FridmanYou know those. Just on a small tangent.
6:23:39Elon MuskYeah, the.
6:23:40Lex FridmanWhich I've been meaning to go down this rabbit hole of people that set the world record in Tetris. Those folks, they're playing. There's a. There's a way to. Did you see this?
6:23:51Elon MuskLike all the fingers are moving.
6:23:52Lex FridmanYeah.
6:23:52Elon MuskYou.
6:23:53Lex FridmanYou could. You could find a way to do it where, like it's using a loophole, like a bug, that you can do some incredibly fast stuff. So it's. It's along that line, but not quite.
6:24:04Lex FridmanBut you do realize there'll be like a few programmers right now listening to this cool, fast and eat peanut butter.
6:24:09Elon MuskYeah, please, please track my record. I mean, the reason I did this literally was just because I wanted the bar to be high for the team. Like, I wanted the.
6:24:15Elon MuskThe number that we aim for should not be like the median performance. It should be like, it should be able to beat all of us at least. Like, that should be the minimum bar.
6:24:21Lex FridmanWhat do you think is possible? Like 20.
6:24:23Elon MuskYeah. I don't know what the limits. I mean, the limits you can calculate just in terms of like screen refresh rate and like cursor immediately jumping to the next target.
6:24:30Elon MuskBut there's. I mean, I'm sure there's limits before that with just sort of reaction time and visual perception and things like this. I would guess it's in the below 40, but above 20, somewhere in there, it's probably the right there.
6:24:41Elon MuskI never be thinking about. It also matters like, how difficult the task is. You could imagine like some people might be able to do like 10,000 targets on a screen and maybe they can do better that way.
6:24:50Elon MuskSo there's some like, task optimizations you could do to try to boost your performance as well.
6:24:55Lex FridmanWhat do you think it takes for Nolan to be able to do above 8,5 to keep increasing that number? You said like every increase in the number might require different improvements in the system.
6:25:08Elon MuskYeah, I think the nature of this work is the first answer that's important to say is, I don't know. This is edge of the research. So again, nobody's gotten to that number before.
6:25:18Elon MuskSo what's next is going to be heuristic? A guess from my part. What we've seen historically is that different parts of the stack become bottlenecks at different time points.
6:25:28Elon MuskSo when I first joined Neuralink three years ago or so, one of the major problems was just the latency of the Bluetooth connection. It wasn't just like the radio in the device wasn't super good, it was an early revision of the implant.
6:25:38Elon MuskAnd it just like no matter how good your decoder was, if your thing is updating every 30 milliseconds or 50 milliseconds, it's just going to be choppy. And no matter how good you are, that's going to be frustrating and lead to challenges.
6:25:49Elon MuskSo at that point it was very clear that the main challenge is just get the data off the device in a very reliable way such that you can enable the next challenge to be tackled.
6:25:59Elon MuskAnd then at some point it was actually the modeling challenge of how do you just build a good mapping. Like the supervised learning problem of you have a bunch of data and you have a label, you're trying to predict just what is the right neural decoder architecture and hyperparameters to optimize that.
6:26:15Elon MuskThat was a problem for a bit, and once you solved that, it became a different bottleneck. I think the next bottleneck after that was actually just sort of software stability and reliability.
6:26:24Elon MuskIf you have widely varying inference latency in your system or your app just lags out every once in a while, it decreases your ability to maintain and get in a state of flow and it basically just disrupts your control experience.
6:26:38Elon MuskAnd so there's a variety of different software bugs and improvements we made that basically increased the performance of the system, made it much more reliable, much more stable, and led to a state where we could reliably collect data to build better models with.
6:26:49Elon MuskSo that was a bottleneck for a while. It's just sort of like the software stack itself. If I were to guess right now, there's sort of two major directions you could think about for improving BPS further.
6:27:00Elon MuskThe first major direction is labeling. So labeling is again this fundamental challenge of given a window of time where the user is expressing some behavioral intent, what are they really trying to do at the granularity of every millisecond.
6:27:12Elon MuskAnd that again is a task design problem. It's a UX problem, it's a machine learning problem, it's a software problem sort of touches all those different domains. The second thing you can think about to improve BPS further is either completely changing the thing you're decoding or just extending the number of things that you're decoding.
6:27:29Elon MuskSo this is sort of in the direction of functionality. Basically, you can imagine giving more clicks, for example, a left click, a right click, a middle click, different actions like click and drag, for example.
6:27:37Elon MuskAnd that can improve the effective bit rate of your communication prosthesis. If you're trying to allow the user to express themselves through any given communication channel, you can measure that with bits per second.
6:27:46Elon MuskBut. But what actually matters at the end of the day is how effective are they at navigating their computer. And so from the perspective of the downstream tasks that you care about, functionality and extending functionality is something we're very interested in, because not only can it improve the sort of number of VPs, but it can also improve the downstream sort of independence that the user has and the skill and efficiency with which they can operate their computer.
6:28:05Lex FridmanWould the number of threads increasing also potentially help?
6:28:10Elon MuskYes. Short answer is yes. It's a bit nuanced how that curve or how that manifests in the numbers. So what you'll see is that if you sort of plot a curve of number of channels that you're using for decode versus either the offline metric of how good you are at decoding or the online metric of sort of in practice, how good is the user at using this device?
6:28:34Elon MuskYou see roughly a log curve. So as you move further out in number of channels, you get a corresponding sort of logarithmic improvement in control quality and offline validation metrics.
6:28:45Elon MuskThe important nuance here is that each channel corresponds with a specific represented intention in the brain. So, for example, if you have a channel 254, it might correspond with moving to the right.
6:28:57Elon MuskChannel 256 might mean move to the left. If you want to expand the number of functions you want to control, you really want to have a broader set of channels that covers a broader set of imagined movements.
6:29:09Elon MuskYou can think of it kind of like Mr. Potato man, actually. Like, if you had a bunch of different imagined movements you could do, how would you map those imagined movements to input to a computer?
6:29:17Elon MuskYou could imagine, you know, handwriting to output characters on the screen. You could imagine just typing with your fingers and have that output text on the screen. You could imagine different finger modulations for different clicks.
6:29:25Elon MuskYou can imagine wiggling your big nose for opening some menu, or wiggling your big toe to have like command tab occur or something like this. So it's really the amount of different actions you can take in the world depends on how many channels you have and the information content that they carry.
6:29:41Lex FridmanRight? So that's more about the number of actions. So actually, as you increase the number of threads, that's more about increasing the number of actions you're able to perform.
6:29:52Elon Musknuance there that is worth mentioning. So again, our goal is really to enable a user with paralysis to control the computer as fast as I can. So that's BPS with all the same functionality I have.
6:30:00Elon MuskSo we just talked about. But then also as reliably as I can. Yeah, and that last point is very related to channel count discussion. So as you scale out number of channels, the relative importance of any particular feature of your model input to the output control of the user diminishes.
6:30:15Elon MuskWhich means that if the sort of neural non stationary effect is per channel, or if the noise is independent, such that more channels means on average less output effect, then your reliability of your system will improve.
6:30:28Elon MuskSo one sort of core thesis that at least I have is that scaling channel count should improve the reliability of the system without any work on the decoder itself.
6:30:37Lex FridmanCan you linger on the reliability here? So first of all, when you say non stationarity of the signal, which aspect are you referring to?
6:30:46Elon MuskYeah, so maybe let's talk briefly what the actual underlying signal looks like. So again, I spoke very briefly at the beginning about how when you imagine moving to the right or imagine moving to the left, neurons might fire more or less.
6:30:56Elon MuskAnd the frequency content of that signal, at least in the motor cortex, it's very correlated with the output intention, the behavioral task that the user is doing. You can imagine actually this is not obvious, that rate coding, which is the name of that phenomenon, is like the only way the brain could represent information.
6:31:09Elon MuskYou can imagine many different ways in which the brain could encode intention. And there's actually evidence, like in bats for example, that there's temporal codes. So timing codes of exactly when particular neurons fire is the mechanism of information representation.
6:31:23Elon MuskBut at least in the motor cortex, there's substantial evidence that it's rate coding, or at least one first order effect is that it's rate coding. So then if the brain is representing information by changing the frequency of a neuron firing, what really matters is sort of the delta between the baseline state of the neuron and what it looks like when it's modulated.
6:31:43Elon MuskAnd what we've observed and what has also been observed in academic work is that that baseline rate, sort of the, if you were to target the scale, if you imagine that analogy for like measuring flour or something when you're baking, that baseline state of how much the pot weighs is actually different day to day.
6:31:59Elon MuskAnd so if what you're trying to measure is how much rice is in the pot. You're going to get a different measurement, different days, because you're measuring with different pots.
6:32:05Elon MuskSo that baseline rate shifting is really the thing that at least from a first order description of the problem, is what's causing this downstream bias. There can be other effects, nonlinear effects on top of that.
6:32:15Elon MuskBut at least at a very first order description of the problem, that's what we observed here today, is that the baseline firing rate of any particular neuron or observed on a particular channel is changing.
6:32:23Lex FridmanSo can you just adjust to the baseline to make it relative to the baseline non stop?
6:32:29Elon MuskYeah, this is a great question. So with monkeys, we have found various ways to do this. One example way to do this is you ask them to do some behavioral task like play the game with a joystick.
6:32:41Elon MuskYou measure what's going on in the brain, you compute some mean of what's going on across all the input features and you subtract that in the input when you're doing your BCI session.
6:32:49Elon MuskWorks super well. For whatever reason, that doesn't work super well with Noland. I actually don't know the full reason why, but I can imagine several explanations. One such explanation could be that the context effect difference between some open loop task and some closed loop task is much more significant with Nolan than it is with the monkey.
6:33:07Elon MuskMaybe in this open loop task, he's watching the Lex Freeman podcast while he's doing the task, or he's whistling and listening to music and talking with his friend and ask his mom what's for dinner while he's doing this task.
6:33:16Elon MuskAnd so the, the exact sort of difference in context between those two states may be much larger and thus leads to a bigger generalization gap between the features that you're normalizing at open loop time and what you're trying to use at closed loop time.
6:33:29Lex FridmanThat's interesting. Just on that point, it's kind of incredible to watch Nolan be able to do, to multitask, to do multiple tasks at the same time, to be able to move the mouse cursor effectively while talking and while being nervous because he's talking.
6:33:44Elon MuskKicking my ass and chest too.
6:33:45Lex FridmanYeah, kicking your ass. And now we're and talk trash while doing it. So all at the same time. And yes, if you're trying to normalize to the baseline, that might throw everything off.
6:33:58Lex FridmanBoy, is that interesting.
6:33:59Elon MuskMaybe one comment on that too. For folks that aren't familiar with assistive technology, I think there's a common belief that, you know, well, why can't you just use an eye tracker or something like this for helping somebody move a mouse on the screen.
6:34:09Elon MuskAnd it's a really a fair question and one that I actually was not confident before Sir Noland that this was going to be a profoundly transformative technology for people like him.
6:34:19Elon MuskAnd I'm very confident now that it will be. But the reasons are subtle. It really has to do with ergonomically how it fits into their life. Even if you can just offer the same level of control as what they would have with an eye tracker or with a mouth stick.
6:34:31Elon MuskBut you don't need to have that thing in your face. You don't need to be positioned a certain way. You don't need your caretaker to be around to set it up for you.
6:34:37Elon MuskYou can activate it when you want, how you want, wherever you want. That level of independence is so game changing for people. It means that they can text a friend at night privately without their mom needing to be in the loop.
6:34:47Elon MuskIt means that they can open up and browse the Internet at 2am when nobody's around to set their iPad up for them. This is a profoundly game changing thing for folks in that situation.
6:34:58Elon MuskAnd this is even before we start talking about folks that may not be able to communicate at all or ask for help when they want to. This can be potentially the only link that they have to the outside world.
6:35:07Elon MuskAnd yeah, that one doesn't, I think, need explanation of why that's so impactful.
6:35:10Lex FridmanYou mentioned neural decoder. How much machine learning is in the decoder, how much magic, how much science, how much art, how difficult is it to come up with a decoder that figures out what these sequence of spikes mean?
6:35:28Elon MuskYeah, good question. There's a couple different ways to answer this. So maybe I'll zoom out briefly first and then I'll go down one of the rabbit holes. So the zoomed out view is that building the decoder is really the process of building the data set plus compiling it into the weights.
6:35:42Elon MuskAnd each of those steps is important. The direction I think of further improvement is primarily going to be in the dataset side of how do you construct the optimal labels for the model.
6:35:50Elon MuskBut there's an entirely separate challenge of then how do you compile it into the best model? And so I'll go briefly down the second one, down the second rabbit hole.
6:35:57Elon MuskOne of the main challenges with designing the optimal model for BCI is that offline metrics don't necessarily correspond to online metrics. It's fundamentally a control problem. The user is trying to Control something on the screen and the exact user experience of how you output the intention impacts their ability to control.
6:36:19Elon MuskSo, for example, if you just look at validation loss as predicted by your model, there can be multiple ways to achieve the same validation loss. Not all of them are equally controllable by the end user.
6:36:29Elon MuskAnd so it might be as simple as saying, oh, you could just add auxiliary loss terms that help you capture the thing that actually matters. But this is a very complex nuanced process.
6:36:37Elon MuskSo how you turn the labels into the model is more of a nuanced process than just a standard supervised learning problem. One very fascinating anecdote here. We've tried many different neural network architectures that translate brain data to velocity outputs, for example.
6:36:55Elon MuskAnd one example that stuck in my brain from a couple years ago now is at one point we were using just fully connected networks to decode the brain activity.
6:37:03Elon MuskWe tried AB test, where we were measuring the relative performance in online control sessions of one deconvolution over the input signal. So if you imagine per channel, you have a sliding window that's producing some convolute feature for each of those input sequences for every single channel simultaneously, you can actually get better validation metrics, meaning you're fitting the data better and it's generalizing better.
6:37:27Elon MuskOn offline data, if you use this convolutional architecture, you're reducing parameters. It's sort of a standard procedure when you're dealing with time series data. Now, it turns out that when using that model online, the controllability was worse, was far worse, even though the offline metrics were better.
6:37:42Elon MuskAnd there can be many ways to interpret that. But what that taught me at least, was that, hey, it's at least the case right now that if you were to just throw a bunch of compute at this problem and you were trying to sort of hyperparameter optimize or let some GPT model hard code, or come up with or invent many different solutions.
6:37:58Elon MuskIf you were just optimizing for loss, it would not be sufficient. Which means that there's still some inherent modeling gap here. There's still some artistry left to be uncovered here of how to get your model to scale with more compute.
6:38:08Elon MuskAnd that may be fundamentally a labeling problem, but there may be other components to this as well.
6:38:12Lex FridmanIs it data constraint at this time? Like, which is what it sounds like. How do you get a lot of good labels?
6:38:22Elon MuskYeah, I think it's data quality constrained, not necessarily data quantity constrained, but even,
6:38:28Lex Fridmanlike even just the quantity. I mean, because it has to be trained on the interactions. I guess there's not that many interactions.
6:38:37Elon MuskYeah. So it depends what version of this you're talking about. So if you're talking about like let's say the simplest example of just 2D velocity, then I think, yeah, data quality is the main thing.
6:38:44Elon MuskIf you're talking about how to build a sort of multifunction output that lets you do all the inputs to the computer that you and I can do, then it's actually a much more sophisticated, nuanced modeling challenge.
6:38:53Elon MuskBecause now you need to think about not just when the user is left clicking, but when you're building the left click model. You also need to be thinking about how to make sure it doesn't fire when they're trying to right click or when they're trying to move the mouse.
6:39:02Elon MuskSo one example of an interesting bug from like sort of week one of a PCI with Noland was when he moved the mouse, the click signal sort of dropped off a cliff and when he stopped, the click signal went up.
6:39:13Elon MuskSo again, there's contamination between the two inputs. Another good example was at one point he was trying to do sort of a left click and drag and the minute he started moving, the left click signal dropped off a cliff.
6:39:25Elon MuskSo again, because there's some contamination between the two signals, you need to come up with some way to, either in the data set or in the model, build robustness against this kind of, you can be overfitting, but really it's just that the model has not seen this kind of variability before.
6:39:39Elon MuskSo you need to find some way to help the model with that.
6:39:42Lex FridmanThis is super cool because it feels like all of this is very solvable, but it's hard.
6:39:46Elon MuskYes, it is fundamentally an engineering challenge. This is important to emphasize and it's also important to emphasize that it may not need fundamentally new techniques, which means that people who work on, let's say unsupervised speech classification using CTC loss, for example, with internal Siri, they could potentially have very applicable skills to this.
6:40:04Lex FridmanSo what things are you excited about in the future development of the software stack on the neuralink? So everything we've been talking about, the decoding, the ux, I think there's some
6:40:15Elon MuskI'm excited about, like something I'm excited about from the technology side and some I'm excited about for understanding how this technology is going to be best situated for entering the world.
6:40:22Elon MuskSo I'll work backwards on the technology entering the world side of things. I'm really excited to understand how this Device works for folks that cannot speak at all, that have no ability to sort of bootstrap themselves into useful control by voice command, for example, and are extremely limited in their current capabilities.
6:40:40Elon MuskI think that will be an incredibly useful signal for us to understand really what is an existential threat for all startups, which is product market fit. Does this device have the capacity and potential to transform people's lives in the current state?
6:40:50Elon MuskAnd if not, what are the gaps? And if there are gaps, how do we solve them most efficiently? So that's what I'm very excited about for the next year or so of clinical trial operations.
6:41:00Elon MuskOn the technology side, I'm quite excited about basically everything we're doing. I think it's going to be awesome. The most prominent one I would say is scaling channel count.
6:41:10Elon MuskSo right now we have a thousand channel device. The next version will have between three and six thousand channels and I expect that curve to continue in the future.
6:41:17Elon MuskAnd it's unclear what set of problems will just disappear completely at that scale and what set of problems will remain and require further focus. And so I'm excited about the clarity of gradient that that gives us in terms of the user experience that we choose to focus our time and resources on.
6:41:30Elon MuskAnd also in terms of the even things as simple as non stationarity, like does that problem just completely go away at that scale or do we need to come up with new creative UXs still even at that point?
6:41:40Elon MuskAnd also when we get to that time point when we start expanding out dramatically the set of functions that you can output from one brain, how to deal with all the nuances of both the user experience of not being able to feel the different keys under your fingertips, but still need to be able to modulate all of them in synchrony to achieve the thing you want.
6:41:56Elon MuskAnd again, you don't have that properly set to feedback loop. So how can you make that intuitive for users to control a high dimensional control surface without feeling the thing physically?
6:42:04Elon MuskI think that's going to be a super interesting problem. I'm also quite excited to understand do these scaling laws continue as you scale channel count? How much further out do you go before that saturation point is truly hit and it's not obvious today?
6:42:18Elon MuskI think we only know what's in the interpolation space, we only know what's between 0 and 1024, but we don't know what's beyond that. Then there's a whole range of interesting neuroscience and brain questions, which is when you stick more stuff in the brain in more places, you get to learn much more quickly about what those brain regions represent.
6:42:34Elon MuskAnd so I'm excited about that fundamental neuroscience learning, which is also important for figuring out how to most efficiently insert electrodes in the future. So, yeah, I think all those dimensions I'm really, really excited about, and that doesn't even get close to touching the SoR software stack that we work on every single day and what we're working on right now.
6:42:49Lex FridmanYeah, it seems virtually impossible to me that a thousand electrodes is where it saturates. It feels like this would be one of those silly notions in the future where obviously you should have millions of electrodes and this is where like the true breakthroughs happen.
6:43:11Lex FridmanYou tweeted. Some thoughts are most precisely described in poetry. Why do you think that is?
6:43:20Elon MuskI think it's because the information bottleneck of language is pretty steep and yet you're able to reconstruct on the other person's. In the other person's brain more effectively without being literal.
6:43:35Elon MuskLike, if you can express the sentiment such that in their brain they can reconstruct the. The actual true underlying meaning and beauty of the thing that you're trying to get across.
6:43:45Elon MuskThe generator function in their brain is more powerful than what language can express. And so the mechanism, poetry is really just to feed or seed that generator function.
6:43:56Lex FridmanSo being literal sometimes is a suboptimal compression for the thing you're trying to convey.
6:44:03Elon MuskAnd it's actually in the process of the user going through that generation that they understand what you mean. Like, that's the beautiful part. It's also like when you look at a beautiful painting, it's not the pixels of the painting that are beautiful.
6:44:14Elon MuskIt's the thought process that occurs when you see that the experience of that, that actually is the thing that matters.
6:44:19Lex FridmanYeah, it's resonating with some deep thing within you that the artist also experienced and was able to convey that through the pixels. And that's actually going to be relevant for full on telepathy.
6:44:34Lex FridmanYou know, it's like if you just read the poetry literally, that doesn't say much of anything interesting. It requires a human to interpret it. So it's the combination of the human mind and all the experiences the human being has within the context of the collective intelligence of the human species that makes that poem make sense and they load that in.
6:44:58Lex FridmanAnd so in that same way, the signal that carries from human to human meaning might not may seem trivial, but may actually carry a lot of power because of the complexity of the human mind and the Receiving end.
6:45:16Lex FridmanYeah, that's interesting. Poetry still doesn't. Who was it? I think Yoshibako first was said something
6:45:26Neuralink teamabout
6:45:29Lex Fridmanall the people that think we've achieved AGI. Explain why humans like music.
6:45:37Elon MuskOh, yeah.
6:45:37Lex FridmanAnd until. Until the AGI likes music, you haven't achieved AGI or something like that.
6:45:45Elon MuskDo you guys think that, like some next token entropy surprise kind of thing going on there?
6:45:49Lex FridmanI don't know.
6:45:49Elon MuskI don't know either. I listen to a lot of classical music and also read a lot of poetry. And. Yeah, I do wonder if there is some element of the next token surprise factor going on there.
6:45:59Lex FridmanYeah, maybe.
6:46:00Elon MuskBecause, I mean, a lot of the tricks in both poetry and music are basically, you have some repeated structure and then you do like a twist. Like, it's like, okay, verse.
6:46:07Elon MuskOr like, clause 1, 2, 3 is one thing, and then clause 4 is like, okay, now we're onto the next theme.
6:46:11Lex FridmanYeah.
6:46:12Elon MuskAnd they kind of play with exactly when the surprise happens and expectation of the user. And that's even true, like through history, as musicians evolve music, they take some known structure that people are familiar with and they just tweak it a little bit.
6:46:24Elon MuskThey tweak it and add a surprising element. This is especially true in classical music heritage. So that's what I'm wondering. Is it all just entropy?
6:46:32Lex FridmanSo breaking structure or breaking symmetry is something that humans seem to like, Maybe as simple as that.
6:46:37Elon MuskYeah. And I mean, great artists copy, and knowing which rules to break is the important part. And fundamentally it must be about the listener of the piece. Which rule is the right one to break?
6:46:49Elon MuskIt's about the user or the audience member perceiving that as interesting.
6:46:54Lex FridmanWhat do you think is the meaning of human existence?
6:47:00Elon MuskThere's a TV show I really like called the West Wing. And in the West Wing, there's a character, he's the President of the United States, who's having a discussion about the Bible with one of their colleagues.
6:47:11Elon MuskAnd the colleague says something about, you know, the Bible says X, Y, and Z. And the President says, yeah, but it also says abc. And person says, well, do you believe the Bible to be literally true?
6:47:25Elon MuskAnd the President says, yes, but I also think that neither of us are smart enough to understand it. I think to like the analogy here for the meaning of life is that largely we don't know the right question to ask.
6:47:37Elon MuskAnd so I think I'm very aligned
6:47:39Lex Fridmanwith
6:47:41Elon Musksort of the Hitchhiker's Guide, the Galaxy version of this question, which is basically, if we can ask the right questions it's much more likely we find the meaning of human existence.
6:47:52Elon MuskAnd so in the short term, as a heuristic, in the sort of search policy space, we should try to increase the diversity of people asking such questions or generally of consciousness and conscious beings asking such questions.
6:48:05Elon MuskSo, again, I think I'll take the I don't know card here, but say I do think there are meaningful things we can do that improve the likelihood of answering that question.
6:48:13Lex FridmanIt's interesting how much value you assign to the task of asking the right questions. That's the main thing, is not the answers, it's the questions.
6:48:24Elon MuskThis point, by the way, is driven home in a very painful way when you try to communicate with someone who cannot speak, because a lot of the time, the last thing to go is they have the ability to somehow, you know, wiggle a lip or move something that allows them to say yes or no.
6:48:38Elon MuskAnd in that situation, it's very obvious that what matters is, are you asking them the right question to be able to say yes or no to?
6:48:45Lex FridmanWow, that's powerful. Well, Bliss, thank you for everything you do, and thank you for being you, and thank you for talking today.
6:48:54Elon MuskThank you.
6:48:56Lex FridmanThanks for listening to this conversation with Bliss Chapman. And now, dear friends, here's Noland Arbaugh, the first human being to have a neuralink device implanted in his brain. You had a diving accident in 2016 that left you paralyzed with no feeling from the shoulders down.
6:49:16Lex FridmanHow did that accident change your life?
6:49:18Neuralink teamIt was sort of a freak thing that happened. Imagine you're running into the ocean. All this is a lake, but you're running into the ocean, and you get to about waist high, and then you kind of like, dive in, take the rest of the plunge under the wave or something.
6:49:34Neuralink teamThat's what I did. And then I just never came back up. Not sure what happened. I did it running into the water with a couple of guys. And so my idea of what happened is really just that I took, like, a stray fist, elbow, knee, foot, something to the side of my head.
6:49:57Neuralink teamThe left side of my head was sore for about a month afterwards, so must have taken a pretty big knock. And then they both came up and I didn't.
6:50:06Neuralink teamAnd so I was face down in the water for a while. I was conscious. And then eventually just, you know, realized I couldn't hold my breath any longer. And I keep saying, took a big drink.
6:50:20Neuralink teamPeople, I don't know if they like that. I say, that seems like I'm making light of it all, but this is kind of how I am and I don't know, like, I'm a very relaxed sort of stress free person.
6:50:39Neuralink teamI rolled with the punches for a lot of this. I kind of took it in stride. It's like, all right, well, what can I do next? How can I improve my life even a little bit on a day to day basis?
6:50:52Neuralink teamAt first, just trying to find some way to heal as much of my body as possible, to try to get healed, to try to get off a ventilator, learn as much as I could so I could somehow survive once I left the hospital.
6:51:12Neuralink teamAnd then thank God I had like my family around me. If I didn't have my parents, my siblings, then I would have never made it this far. They've done so much for me, more than I can ever thank them for, honestly.
6:51:31Neuralink teamAnd a lot of people don't have that. A lot of people in my situation, their families either aren't capable of providing for them or honestly just don't want to.
6:51:41Neuralink teamAnd so they get placed somewhere and you know, in some sort of home. So thankfully I had my family. I have a great group of friends, a great group of buddies from college who have all rallied around me and we're all still incredibly close.
6:51:56Neuralink teamPeople always say, you know, if you're lucky, you'll end up with one or two friends from high school that you keep throughout your life. I have about 10 or 12 from high school that have all stuck around and we still get together, all of us, twice a year.
6:52:14Neuralink teamWe call it the spring series and the fall series. This last one we all did. We dressed up like X Men. So I did a Professor Xavier and it was freaking awesome.
6:52:25Neuralink teamIt was so good. So, yeah, I have such a great support system around me. And so, you know, being a quadriplegic isn't that bad. I get waited on all the time.
6:52:37Neuralink teamPeople bring me food and drinks and I get to sit around and watch as much TV and movies and anime as I want. I get to read as much as I want.
6:52:49Neuralink teamI mean it's, it's great.
6:52:51Lex FridmanIt's beautiful to see that. You see the silver lining in all of this was just going back. Do you remember the moment when you first realized you were paralyzed from the neck down?
6:53:03Neuralink teamYep. I was face down in the water right when I, whatever something hit my head. I tried to get up and I realized I couldn't move and it just sort of clicked.
6:53:16Neuralink teamI'm like, all right, I'm paralyzed, can't move. What do I do if I can't get up? I can't flip over, can't do anything. Then I'm going to drown eventually.
6:53:27Neuralink teamAnd I knew I couldn't hold my breath forever. So I just held my breath and thought about it for maybe 10, 15 seconds. I've heard from other people that, like, onlookers, I guess.
6:53:41Neuralink teamThe two girls that pulled me out of the water were two of my best friends. They are lifeguards. And one of them said that it looked like my body was sort of shaking in the water, like I was trying to flip over and stuff.
6:53:57Neuralink teamBut I knew. I knew immediately. And I just kind of. I realized that that's what my situation was from here on out. Maybe if I got to the hospital, they'd be able to do something.
6:54:11Neuralink teamWhen I was in the hospital, like, right before surgery, I was trying to calm one of my friends down. I had, like, brought her with me from college to camp, and she was just bawling over me.
6:54:22Neuralink teamAnd I was like, hey, it's going to be fine. Like, don't worry. I was cracking some jokes to try to lighten the mood. The nurse had called my mom, and I was like, don't tell my mom.
6:54:32Neuralink teamShe's just going to be stressed out. Call her after I'm out of surgery, because at least she'll have some answers then, like, whether I live or not, really. And I didn't want her to be stressed through the whole thing, but I knew.
6:54:44Neuralink teamAnd then when I first woke up after surgery, I was super drugged up. They had me on fentanyl, like, three ways, which was awesome. I don't recommend it, but I saw some crazy stuff on that fentanyl, and it was still the best I've ever felt.
6:55:05Neuralink teamOn drugs. Medication. Sorry. On medication. And I remember the first time I saw my mom in the hospital, I was just bawling. I had, like, ventilator in. Like, I couldn't talk or anything.
6:55:22Neuralink teamAnd I just started crying because it was more like seeing her. Not that. I mean, the whole situation obviously was pretty rough, but it was just like, seeing her face for the first time was pretty hard.
6:55:35Neuralink teamBut, yeah, I just. I never had, like, a moment of, you know, man, I'm paralyzed. This sucks. I don't want to, like, be around anymore. It was always just.
6:55:51Neuralink teamI hate that I have to do this, but, like, sitting here and wallowing isn't going to help.
6:55:57Lex FridmanSo immediate acceptance.
6:55:58Neuralink teamYeah. Yeah.
6:56:01Lex FridmanHas there been low points along the way?
6:56:03Neuralink teamYeah, yeah, sure. I mean, there are days when I don't really feel like doing anything. Not so much anymore. Like, not for the last couple years. I don't really feel that way.
6:56:14Neuralink teamI've more so just wanted to try to do anything possible to make my life better at this point. But at the beginning there were some ups and downs. There were some really hard things to adjust to.
6:56:30Neuralink teamFirst off, just like the first couple months, the amount of pain I was in was really, really hard. I mean, I remember screaming at the top of my lungs in the hospital because I thought my legs were on fire.
6:56:42Neuralink teamAnd obviously I can't feel anything, but it's all nerve pain. And so that was a really hard night. I asked them to give me as much pain meds as possible.
6:56:50Neuralink teamThey're like, you've had as much as you can have, so just kind of deal with it, go to a happy place sort of thing. So that was a pretty low point.
6:56:58Neuralink teamUm, and then every now and again it's hard, like realizing things that I wanted to do in my life that I won't be able to do anymore. You know, I always wanted to be a husband and father and I just don't think that I could do it now.
6:57:13Neuralink teamAs a quadriplegic, maybe it's possible, but I'm not sure I would ever put, you know, someone I love through that. Like having to take care of me and stuff, not being able to, you know, go out and play sports.
6:57:29Neuralink teamI was a huge athlete growing up, so that was pretty hard. Just little things too, when I realized I can't do them anymore. Like there's something really special about being able to hold a book and smell a book.
6:57:44Neuralink teamLike the feel, the texture, the smell, like as you turn the pages. Like, I just love it. I can't do it anymore. And it's little things like that. The two year mark was pretty rough.
6:57:55Neuralink teamTwo years is when they say you will get back basically as much as you're ever going to get back as far as movement and sensation goes. And so for the first two years, that was the only thing on my mind was like, try as much as I can to move my fingers, my hands, my feet, everything possible to try to get sensation and movement back.
6:58:19Neuralink teamAnd then when the two year mark hit so, June 30, 2018, I was, I was really sad that that's kind of where I was and then just randomly here and there.
6:58:35Neuralink teamBut I was never like depressed for long periods of time. Just. It never seemed worthwhile to me.
6:58:46Lex FridmanWhat gave you strength?
6:58:47Neuralink teamMy faith. My faith in God was a big one. My understanding that it was all for a purpose. And even if that purpose wasn't anything involving neuralink even if that purpose was, you know, there's a story in the Bible about Job and I think it's a really, really popular story about how Job, you know, has all of these terrible things happen to him and he praises God throughout the whole situation.
6:59:14Neuralink teamI thought, and I think a lot of people think for most of their lives that they are Job, that they're the ones going through something terrible and they just need to, you know, praise God through the whole thing and everything will work out.
6:59:28Neuralink teamAt some point after my accident, I realized that I might not be Job, that I might be, you know, one of his children that gets killed or kidnapped or taken from him.
6:59:40Neuralink teamAnd so it's about terrible things that happen to those around you who you love. So maybe, you know, in this case, my mom would be Job and she has to get through something extraordinarily hard and I just need to try and make it as best as possible for her because.
7:00:01Elon MuskShe's the one that's really going through this massive trial and that gave me a lot of strength and obviously my family, my family and my friends, they give me all the strength that I need on a day to day basis.
7:00:15Elon MuskSo makes things a lot easier having that great support system around me.
7:00:19Lex FridmanFrom everything I've seen of you online, your streams and the way you are today, I really admire, say, your unwavering positive outlook on life. Has that always been this way?
7:00:32Elon MuskYeah, yeah, I've, I mean, I've just always thought I could do anything I ever wanted to do. There was never anything too big, like whatever I set my mind to, I felt like I could do it.
7:00:49Elon MuskI didn't want to do a lot. I wanted to travel around and be sort of like a gypsy and go work odd jobs. I had this dream of traveling around Europe and being like, I don't know, a shepherd in Wales or Ireland and then going and being a fisherman in Italy, doing all these things for like a year.
7:01:10Elon MuskIt's such cliche things, but I just thought it would be so much fun to go and travel and do different things. And so I've always just seen the best in people around me too.
7:01:25Elon MuskAnd I've always tried to be good to people. And growing up with my mom too, she's like the most positive, energetic person in the world and we're all just people, people.
7:01:37Elon MuskLike, I just get along great with people. I really enjoy meeting new people and so I just wanted to do everything. Um, this is kind of just how I've been.
7:01:50Lex FridmanIt's just great to see that cynicism didn't take over given everything you've been through.
7:01:55Elon MuskYeah, that's.
7:01:56Lex FridmanWas that like a deliberate choice you made that you're not going to let this keep you down?
7:02:01Elon MuskYeah, a bit. Also, like, I just, it's just kind of how I am. I just, like I said, I roll with the punches with everything. I always used to tell people, like, I don't stress about things much and whenever I'd see people getting stressed, just say, you know, it's not hard, just don't stress about it.
7:02:21Elon MuskAnd that's all you need to do. And they're like, that's not how that works. It works for me. Just don't stress and everything will be fine, everything will work out.
7:02:31Elon MuskObviously not everything always goes well and it's not like it all works out for the best all the time. But I just don't think stress has had any place in my life since I was a kid.
7:02:44Lex FridmanWhat was the experience, like, of you being selected to be the first human being to have a neuralink device implanted in your brain. Were you scared? Excited?
7:02:54Elon MuskNo, no, it was cool. Like, I was never afraid of it. I had to think through a lot. Should I. Should I do this? Like, be the first person?
7:03:09Elon MuskI could wait until number two or three and get a better version of the neuralink. The first one might not work. Maybe it's actually going to kind of suck.
7:03:21Elon MuskIt's going to be the worst version ever in a person. So why would I do the first one? Like, I've already kind of been selected. I could just tell them, you know, like, okay, find someone else, and then I'll do number two or three.
7:03:31Elon MuskLike, I'm sure they would let me. They're looking for a few people anyways. But ultimately I was like, I don't know. There's something about being the first one to do something.
7:03:39Elon MuskIt's pretty cool. I always thought that if I had the chance, that I would like to do something for the first time. This seemed like a pretty good opportunity.
7:03:50Elon MuskAnd I was. I was never scared. I think my, like, faith had a huge part in that. I always felt like God was preparing me for something. I almost wish it wasn't this, because I had many conversations with God about not wanting to do any of this.
7:04:11Elon MuskAs a quadriplegic. I told him, you know, I'll go out and talk to people. I'll go out and travel the world and talk to, you know, stadiums, thousands of people, give my testimony.
7:04:22Elon MuskI'll do all of it. But, like, heal me first. Don't make me do all this in a chair. That sucks. And I guess he won that argument. I didn't really have much of a choice.
7:04:33Elon MuskI always felt like there was something going on. And to see how. I guess easily I made it through the interview process and how quickly everything happened, how the star sort of aligned with all this.
7:04:54Elon MuskIt just told me, like, as the surgery was getting closer, it just told me that, you know, it was all meant to happen, it was all meant to be, and so I shouldn't be afraid of anything that's to come.
7:05:07Elon MuskAnd so I wasn't. I kept telling myself, like, you know, you say that now, but as soon as the surgery comes, you're probably going to be freaking out, like, you're about to have brain surgery.
7:05:17Elon MuskAnd brain surgery is a big deal for a lot of people, but it's a even bigger deal for me. Like, it's all I have left. The amount of times I've been like, thank you, God, that you didn't take my brain and my personality and my ability to think, my love of learning, my character, everything.
7:05:34Elon MuskThank you so much. As long as you left me that, then I think I can get by. And I was about to let people go root around in there, like, hey, we're gonna go put some stuff in your brain.
7:05:46Elon MuskHopefully it works out. And so it was something that gave me pause. But like I said how smoothly everything went. I never expected for a second that anything would go wrong.
7:05:58Elon MuskPlus, the more people I met on the Borrows side and on the knurling side, they're just the most impressive people in the world. Like, I can't speak enough to how much I trust these people with my life and how impressed I am with all of them.
7:06:16Elon MuskAnd to see the excitement on their faces, to like walk into a room and roll into a room and see all of these people looking at me like, we're just.
7:06:27Elon MuskWe're so excited. Like, we've been working so hard on this and it's finally happening. It's super infectious and it just makes me want to do it even more and to help them achieve their dreams.
7:06:40Elon MuskLike, I don't know. It's so. It's so rewarding and I'm so happy for all of them, honestly.
7:06:45Lex FridmanWhat was the day of surgery like? What's. When did you wake up? What did you feel minute by minute?
7:06:53Elon MuskYeah.
7:06:53Lex FridmanWere you freaking out?
7:06:54Elon MuskNo, no, I thought I was going to, but a surgery approach the night before, the morning of, I was just excited. Like, I was like, let's make this happen.
7:07:03Elon MuskI think I said that, something like that to Elon on the phone beforehand. We were like FaceTiming and I was like, let's rock and roll. And he's like, let's do it.
7:07:14Elon MuskI don't know, I just. I wasn't scared. So we woke up, I think we had to be at the hospital at like 5:30am I think surgery was at like 7:00am so we woke up pretty early.
7:07:24Elon MuskI'm not sure much of us slept that night. Got to the hospital 5:30, went through like all the pre op stuff. Everyone was super nice. Elon was supposed to be there in the morning, but something went wrong with his plane.
7:07:41Elon MuskSo we ended up FaceTiming. That was cool. Had one of the greatest one liners of my life. After that phone call, hung up with him. There were like 20 people around me and I was like, I just hope he wasn't too starstruck talking to me.
7:07:54Lex FridmanNice. Yeah, well, Done. Yeah.
7:07:57Elon MuskYeah.
7:07:57Lex FridmanDid you write that ahead of time?
7:07:58Elon MuskNo. Did you just do it? Just came to me and I was like, this is. This seems right. You know, Went into surgery. I asked if I could pray right beforehand.
7:08:09Elon MuskSo I, like, prayed over the room. I asked God if you would, like, be with my mom in case anything happened to me and just, like, calm her nerves out there.
7:08:18Elon MuskWoke up, played a bit of a prank on my mom. I don't know if you've heard about it. Yeah, I read about it. Yeah, she was. She was not happy.
7:08:27Lex FridmanCan you take me through the prank?
7:08:29Elon MuskYeah. This is something.
7:08:30Lex FridmanYou regret doing that now?
7:08:31Elon MuskNo, no, not one bit. It was something. It was something I. I had talked about ahead of time with my buddy Bain. I was like, I would really like to play a prank on my mom.
7:08:44Elon MuskVery specifically, my mom, she's very gullible. I think she had knee surgery once, even. And after she came out of knee surgery, she was super groggy. She's like, I can't feel my legs.
7:08:59Elon MuskAnd my dad looked at her. He was like, you don't have any legs. They had to amputate both your legs. And we just do very mean things to her all the time.
7:09:10Elon MuskI'm so surprised that she still loves us. But right after surgery, I was really worried that I was going to be too, like, groggy. Like, not all there. I had had anesthesia once before and messed me up.
7:09:27Elon MuskLike, I could not function for a while afterwards. And I. I, like, said a lot of things that I was like. I was really worried that I was going to start, I don't know, like, dropping.
7:09:40Elon MuskDropping some bombs, and I wouldn't even know. I wouldn't remember. So I was like, like, please, God, don't let that happen. And please let me be there enough to do this to my mom.
7:09:54Elon MuskAnd so she walked in after surgery. It was, like, the first time they had been able to see me after surgery. And she just looked at me. She said, hi, how are you?
7:10:05Elon MuskHow are you doing? How do you feel? And I looked at her, and this very. I think the anesthesia helped. Very groggy, sort of confused look on my face.
7:10:13Elon MuskIt's like, who are you? And she just started looking around the room at the surgeons or the doctors. Like, what did you do to my son? Like, you need to fix this right now.
7:10:25Elon MuskTears started streaming. I saw how much she was freaking out. I was like, I can't let this go on. And so I was like, mom, Mom, I'm fine. Like, it's all right.
7:10:34Elon MuskAnd still she was not happy about it. She still says she's going to get me back someday, but, I mean, I don't know. I don't know what that's going to look like.
7:10:44Lex FridmanIt's a lifelong battle.
7:10:46Neuralink teamYeah.
7:10:46Lex FridmanYeah. But it was good in some sense. It was a demonstration that you still got.
7:10:51Elon MuskThat's. That's all I wanted to be. That's all I wanted it to be. And I knew that doing something super mean to her like that would show her. Yeah.
7:11:00Lex FridmanTo show that you're still there, that you love her.
7:11:02Elon MuskYeah, exactly.
7:11:03Lex FridmanExactly. It's a dark way to do it, but I love it.
7:11:05Elon MuskYeah.
7:11:06Lex FridmanWhat was the first time you were able to feel that you can use the neuralink device to affect the world around you?
7:11:16Elon MuskYeah. The first little taste I got of it was actually not too long after surgery. Some of the Neuralink team had brought in, like, a little iPad, a little tablet screen, and they had put up eight different channels that were recording some of my neuron spikes.
7:11:38Elon MuskAnd they put it in front of me. They're like, this is like real time. You're brain firing. Like, that's super cool. My first thought was, I mean, if they're firing now, let's see if I can affect them in some way.
7:11:51Elon MuskSo I started trying to wiggle my fingers, and I just started scanning through the channels, and one of the things I was doing was moving my index finger up and down, and I just saw this yellow spike on top row, third box over or something.
7:12:06Elon MuskI saw this yellow spike every time I did it, and I was like, oh, that's cool. And everyone around me was just like, what? What are you seeing? I was like, look.
7:12:13Elon MuskLook at this one. Look at, like, this, top row, third box over. This yellow spike. Like, that's me right there. There, there. And everyone was freaking out. They started, like, clapping.
7:12:24Elon MuskI was like, that's super unnecessary. Like, this is what's supposed to happen.
7:12:28Lex FridmanRight. So you're imagining yourself moving each individual finger one at a time.
7:12:34Elon MuskYeah.
7:12:34Lex FridmanAnd then seeing, like, that, you can notice something. And then when you did the index finger, you're like, oh, yeah.
7:12:40Elon MuskI was wiggling kind of all of my fingers to see if anything would happen. There was a lot of other things going on, but that big yellow spike was the one that stood out to me.
7:12:50Elon MuskLike, I'm sure that if I would have stared at it long enough, I could have mapped out maybe a hundred different things. But the big yellow spike was the one that I noticed.
7:13:00Lex FridmanMaybe you could speak to what it's like to sort of wiggle your fingers, to, like to imagine that the mental. The cognitive effort required to sort of wiggle your index finger, for example.
7:13:11Lex FridmanHow easy is that to do?
7:13:13Elon MuskPretty easy for me. It's something that at the very beginning, after my accident, they told me to try and move my body as much as possible. Even if you can't, just keep trying, because that's going to create new neural pathways or pathways in my spinal cord to reconnect these things to hopefully regain some movement someday.
7:13:39Lex FridmanThat's fascinating.
7:13:40Elon MuskYeah, I know, it's bizarre, but that's
7:13:43Lex Fridmanpart of the recovery process, is to keep trying to move your body every
7:13:48Elon Muskday as much as you can.
7:13:49Lex FridmanAnd the nervous system does its thing. It starts reconnecting.
7:13:52Elon MuskIt'll start reconnecting. For some people. Some people, it never works. Some people, they'll do it. Like, for me, I got some bicep control back, and that's about it. I can.
7:14:05Elon MuskIf I try enough, I can wiggle some of my fingers. Not like on command. It's more like if I try to move, say, my right pinky, and I just keep trying to move it, after a few seconds, it'll wiggle.
7:14:20Elon MuskSo I know there's stuff there, like, I know, like. And that happens with, you know, a few different of my fingers and stuff. But, yeah, that's what they tell you to do.
7:14:31Elon MuskOne of the people at the time when I was in the hospital came in and told me, for one guy who had recovered most of his control, what he thought about every day was actually walking.
7:14:43Elon MuskLike, the act of walking just over and over again. So I tried that for years. I tried just imagining walking, which is. It's hard. It's hard to imagine, like, all of the steps that go into, well, taking a step.
7:15:01Elon MuskLike, all of the things that have to move, like all of the activations that have to happen along your leg in order for one step to occur.
7:15:09Lex FridmanBut you're not just imagining you're doing it.
7:15:12Elon MuskI'm trying. Yeah. So it's like it's imagining over again what I had to do to take a step. Because it's not something any of us think about. We just.
7:15:24Elon MuskYou want to walk and you take a step. You don't think about all of the different things that are going on in your body. So I had to recreate that in my head as much as I could.
7:15:34Elon MuskAnd then I practice it over and over and over.
7:15:37Lex FridmanSo it's not like a third person perspective. It's a first person perspective. You're like, it's not like you're imagining yourself walking. You're, like, literally doing this, everything, all the same stuff as you're walking.
7:15:49Elon MuskWhich. Which was hard. It was hard at the beginning.
7:15:53Lex FridmanLike, frustrating hard or, like, actually cognitively hard?
7:15:56Elon MuskLike, it was both. There's a. There's a scene in one of the Kill Bill movies, actually, oddly enough, where she is, like, paralyzed. I don't know, from, like, a drug that was in her system.
7:16:12Elon MuskAnd then she, like, finds some way to get into the back of a truck or something. And she stares at her toe and she says, move. Like, move your big toe.
7:16:22Elon MuskAnd after, you know, a few seconds on screen, she does it. And she did that with every one of her, like, body parts until she can move again. I did that for years, just stared at my body and said, move your index finger.
7:16:38Elon MuskMove your big toe. Sometimes vocalizing it, like, out loud, sometimes just thinking it. I tried every different way to do this, to try to get some movement back. And it's hard because it.
7:16:50Elon MuskIt actually is, like, taxing, like, physically taxing on my body, which is something I would have never expected because it's not like I'm moving. But it feels like there's a buildup of.
7:17:04Lex FridmanI don't know.
7:17:05Elon MuskThe. The only way I can describe it is there are, like, signals that aren't getting through from my brain down because of my. There's that gap in my spinal cord, so brain down, and then from my hand back up to the brain.
7:17:21Elon MuskAnd so it feels like those signals get stuck in whatever body part that I'm trying to move, and they just build up and build up and build up until they burst.
7:17:32Elon MuskAnd then once they burst, I get, like, this really weird sensation of everything sort of, like, dissipating back out to level, and then I do it again. It's also just, like, a fatigue thing, like a muscle fatigue, but without actually moving your muscles.
7:17:49Elon MuskIt's very, very bizarre. And then, you know, if you try to stare at a body part or think about a body part and move for two, three, four, sometimes eight hours, it's very taxing on your mind.
7:18:04Elon MuskIt takes a lot of focus. It was a lot easier at the beginning because I wasn't able to, like, control a TV in my room or anything. I wasn't able to control any of my environment.
7:18:18Elon MuskSo for the first few years, a lot of what I was doing was staring at walls. And so obviously, I did a lot of thinking and I tried to move a lot, just over and over and over again.
7:18:32Lex FridmanDo you never give up? Sort of hope there. No training hard, essentially.
7:18:37Elon MuskYep. And I still do it. I do it, like, subconsciously. And I think that that helped a lot with things with Neuralink. Honestly, it's something that I talked about the other day at the All Hands that I did at Neuralink's Austin facility.
7:18:53Lex FridmanWelcome to Austin, by the way.
7:18:54Elon MuskYeah. Hey, thanks, man. I would just say nice hat.
7:18:57Lex FridmanHey, thanks.
7:18:57Elon MuskThanks, man. The gigafactory was super cool. I went to school at Texas A and M, so I've been around for.
7:19:03Lex FridmanSo you should be saying welcome to me.
7:19:05Elon MuskWelcome to Texas Lights. I get you. But, yeah, I was talking about how a lot of what they've had me do, especially at the beginning. Well, I still do it now is body mapping.
7:19:17Elon MuskSo there will be a visualization of a hand or an arm on the screen, and I have to do that motion. And that's how they sort of train the algorithm to, like, understand what I'm trying to do.
7:19:31Elon MuskAnd so it made things very seamless for me.
7:19:37Lex FridmanI think that's really, really cool. So it's amazing to know because I've learned a lot about the body mapping procedure. Yeah. With the interface and everything like that. It's cool to know that you've been essentially, like, training to be, like, world class at that task.
7:19:52Neuralink teamYeah.
7:19:55Elon MuskI don't know if other quadriplegics, like, other paralyzed people, give up. I hope they don't. I hope they keep trying, because I've heard other paralyzed people say, like, don't ever stop.
7:20:10Elon MuskThey tell you two years, but you just never know. The human body's capable of amazing things, so I've heard other people say, don't give up. Like, I think one girl had spoken to me through some family members and said that she had been paralyzed, you know, for 18 years, and she'd been trying to, like, wiggle her index finger for all that time, and she finally got it back, like, 18 years later.
7:20:37Elon MuskSo, like, I know that it's possible, and I'll never give up doing it. I just. I do it when I'm lying down, like, watching tv. I'll find myself doing it kind of just almost like, on its own.
7:20:48Elon MuskIt's just something I've gotten so used to doing that I don't know, I. I don't think I'll ever stop.
7:20:53Lex FridmanThat's really awesome to hear because I think it's one of those things that can really pay off in the long term because, like, it is training. You're not visibly seeing the results of that training at the moment, but like there's that like Olympic level nervous system
7:21:06Elon Muskgetting, getting ready for something, which honestly was like something that I think neuralink gave me that I can't, I can't thank them enough for. Like, I can't show my appreciation for it enough was being able to visually see that what I'm doing is actually having some effect.
7:21:31Elon MuskIt's a huge part of the reason why I know now that I'm going to keep doing it forever, because before neuralink, I was doing it every day and I was just assuming that things were happening.
7:21:46Elon MuskIt's not like I knew I wasn't getting back anything, mobility or sensation or anything. So I could have been running up against a brick wall for all I knew.
7:21:56Elon MuskAnd with Neuralink, I get to see all the signals happening real time and I get to see that what I'm doing can actually be mapped. When we started doing click calibrations and stuff, when I go to click my index finger for a left click, that it actually recognizes that, like, it, it changed how I think about what's possible with like retraining my body to move.
7:22:25Elon MuskAnd so, yeah, I'll, I'll never give up now.
7:22:28Lex FridmanAnd also just the signal that there's still a powerhouse of a brain there that's like.
7:22:32Elon MuskExactly.
7:22:33Lex FridmanAnd as the technology develops, that brain is, I mean, that's the most important thing about the human body is the brain. And it can do a lot of the control.
7:22:40Lex FridmanSo what did it feel like when you first got, could wiggle the index finger and saw the environment respond like that, where everybody is being way too dramatic, according to you?
7:22:51Elon MuskYeah, it was very cool. I mean, it was cool, but it, I keep telling this to people. It made sense to me. Like, it made sense that, you know, like, there are signals still happening in my brain and that as long as you had something near it that could measure those, that could record those, then you should be able to visualize it in some way, see it happen.
7:23:14Elon MuskAnd so that was not very surprising to me. I was like, oh, cool, we found one, we found something that works. It was cool to see that their technology worked and that everything that they had worked so hard for was going to pay off.
7:23:30Elon MuskBut I hadn't moved a cursor or anything at that point. I hadn't interacted with the computer or anything at that point. Um, so just made sense. It was cool.
7:23:41Elon MuskLike, like, I, I, I didn't really know much about BCI at that point either. So I didn't know like, what sort of step this was actually making. Like I didn't know if this was, like, a huge deal or if this was just like, okay, this is.
7:23:56Elon MuskYou know, it's cool that we got this far, but we're actually hoping for something, like, much better down the road. It's like, okay. I just thought that they knew that it turned on, so I was like, cool.
7:24:07Elon MuskLike, this is. This is cool.
7:24:08Lex FridmanWell, did you, like, read up on the specs of the hardware you get installed? Like, the number of threads?
7:24:13Elon MuskYeah, yeah, I do all of that, but it's all, like. It's all Greek to me. I was like, okay, threads, 64 threads, 16 electrodes, 1024 channels. Okay. Like, that math checks out.
7:24:30Lex FridmanSounds right.
7:24:31Elon MuskYeah.
7:24:32Lex FridmanWhen was the first time you were able to move a mouse cursor?
7:24:34Elon MuskI know. It must have been within the first maybe week, a week or two weeks that I was able to, like, first move the cursor. And again, like, it kind of made sense to me.
7:24:46Elon MuskLike, it. It didn't seem like that big of a deal. Like, was like, okay, well, how do I explain this? When everyone around you starts clapping for something that you've done, it's.
7:24:59Elon MuskIt's easy to say, okay, like, I did something cool. Like, that was. That was impressive in some way. What exactly that meant. What it was hadn't really, like, set in for me.
7:25:15Elon MuskSo again, I knew that me trying to move a body part and then that being mapped in some sort of machine learning algorithm to be able to identify my brain signals and then take that and give me cursor control, that all kind of made sense to me.
7:25:38Elon MuskI don't know all the ins and outs of it, but I was like, there are still signals in my brain firing. They just can't get through because there's a gap in my spinal cord.
7:25:49Elon MuskAnd so they can't get all the way down and back up, but they're still there. So when I move the cursor for the first time, I was like, that's cool.
7:25:57Elon MuskBut I expected that that should happen. Like, it made sense to me when I moved the cursor for the first time with just my mind without, like, physically trying to move.
7:26:10Elon MuskSo I guess I can get into that just a little bit. Like, the difference between attempted movement and imagined movement.
7:26:16Lex FridmanYeah, that's a fascinating difference.
7:26:18Elon MuskYeah.
7:26:18Lex FridmanFrom one to the other.
7:26:19Elon MuskYeah, yeah, yeah. So, like, attempted movement is me physically trying to attempt to move, say, my hand. I try to attempt to move my hand to the right, to the left, forward and back, and that's all.
7:26:33Elon MuskAttempted attempt to, you know, like, lift my finger up and down, attempt to kick or something. I'm physically trying to do all of those things. Even if you can't see it.
7:26:44Elon MuskLike, I'm. This would be like, me attempting to, like, shrug my shoulders or something. That's all attempted movement. That all. That's what I was doing for the first couple of weeks when they were going to give me cursor control when I was doing body mapping, it was attempt to do this, attempt to do that.
7:27:04Elon MuskWhen near was telling me to, like, imagine doing it, it, like, kind of made sense to me. But it's not something that people practice. Like, if you started school as a child and they said, okay, write your name with this pencil.
7:27:28Elon MuskAnd so you do that. Like, okay, now imagine writing your name with that pencil. Kids would think, like, I guess, like, that kind of makes sense, and they would do it.
7:27:39Elon MuskBut that's not something we're taught. It's all, like, how to do things physically. We think about, like, thought experiments and things, but that's not like. That's not like a physical action of doing things.
7:27:50Elon MuskIt's more like what you would do in certain situations. So imagine movement. It never really connected with me. Like, I guess you could maybe describe it as like a professional athlete, like swinging a baseball bat or swinging, like a golf club.
7:28:04Elon MuskLike, imagine what you're supposed to do, but then you go right to that and physically do it. Like you. Then you get a bat in your hand, and then you do what you've been imagining.
7:28:15Elon MuskAnd so I don't have connection. So telling me to imagine something versus attempting it. There wasn't a lot that I could do there mentally. I just kind of had to accept what was going on and try.
7:28:30Elon MuskBut the attempted moving thing, it all made sense to me. Like, if I try to move, then there's a signal being sent in my brain. And as long as they can pick that up, then they should be able to map it to what I'm trying to do.
7:28:42Elon MuskAnd so when I first move the cursor like that, it was. It was like, yes, this should happen. Like, I'm. I'm not surprised by that.
7:28:50Lex FridmanBut can you clarify, is there supposed to be a difference between imagined movement and attempted movement?
7:28:55Elon MuskYeah, just that in imagined movement, you're not attempting to move at all. So it's.
7:29:00Lex FridmanYou're, like, visualizing yourself doing. And then theoretically. Is that supposed to be a different part of the brain that lights up in those two different situations?
7:29:09Neuralink teamYeah, not necessarily. I think all these signals can still be represented in motor Cortex. But the difference, I think, has to do with the naturalness of imagining something, verse attempting it, and sort of the fatigue of that over time.
7:29:20Lex FridmanAnd by the way, on the mic is bliss. So, like, this is just different ways to prompt you to kind of get to the thing that you arrived at.
7:29:31Lex FridmanYeah, attempted movement does sound like the right thing. Try.
7:29:35Elon MuskYeah, I mean, it makes sense to
7:29:37Lex Fridmanme because imagine for me, I'll be. I would start visualizing, like, in my mind, visualizing attempted. I would actually start trying to, like. Yeah, there's a. I mean, I.
7:29:46Lex FridmanYou know, I did, like, combat express my whole life, like, wrestling. When I'm imagining a move, see, I'm, like, moving my muscle exactly. Like, there's a. There is a bit of an activation almost versus, like, visualizing yourself like a picture doing it.
7:30:01Elon MuskYeah, it's something that I feel like naturally anyone would do. If you try to tell someone to imagine doing something, they might close their eyes and. And then start physically doing it, but it's just.
7:30:13Lex FridmanIt didn't click.
7:30:14Elon MuskYeah, it's hard. It was very hard at the beginning.
7:30:18Lex FridmanBut attempted worked.
7:30:20Elon MuskAttempted worked. It worked just like it should work. Like, worked like a charm.
7:30:26Neuralink teamRemember, there was, like, one Tuesday we were messing around and I think. I forget what swear word you used, but there's a swear word that came out of your mouth when you figured out you could just do the direct cursor control.
7:30:35Elon MuskYeah, that. It. It blew my mind. Like, no pun intended, blew my mind when I first moved the cursor just with my thoughts and not attempting to move. It's something that I found, like, over the couple of weeks, like, building up to that, that as I get better cursor controls, like, the model gets better, then it gets easier for me to, like.
7:31:12Elon MuskLike, I don't have to attempt as much to move it. And part of that is something that I'd even talked with them about when I was watching the signals of my brain one day.
7:31:25Elon MuskI was watching when I, like, attempted to move to the right and I watched the screen as, like, I saw the spikes. Like, I was seeing the spike. The signal was being sent before I was actually attempting to move.
7:31:39Elon MuskI imagine just because, you know, when you go to, say, move your hand or any body part, that signal gets sent before you're actually moving has to make it all the way down and back up before you actually do any sort of movement.
7:31:52Elon MuskSo there's a delay there. And I noticed that there was something going on in my brain before I was actually attempting to move that my brain Was like, anticipating what I wanted to do.
7:32:06Elon MuskAnd that all started sort of, I don't know, like, percolating in my brain. Like, it just. It was just sort of there, like, always in the back. Like, that's so weird that it could do that.
7:32:20Elon MuskIt kind of makes sense. But I wonder what that means as far as, like, using the neuralink and, you know, and then as I was playing around with the attempted movement and playing around with the cursor, and I saw that, like, as the cursor control got better, that it was anticipating my movements and what I wanted it to do, like, cursor movements, what I wanted to do a bit better and a bit better.
7:32:48Elon MuskAnd then one day I just randomly, as I was playing web grid, I, like, looked at a target before I had started attempting to move. I was just trying to get over, train my eyes to start looking ahead, like, okay, this is the target I'm on, but if I look over here to this target, I know I can maybe be a bit quicker getting there.
7:33:11Elon MuskAnd I looked over and the cursor just shot over. It was wild. I had to take a step back. I was like, this should not be happening all day.
7:33:21Elon MuskI was just smiling. I was so giddy. I. I was like, guys, do you know that this works? Like, I can just think it and it happens. Which, like, they'd all been saying this entire time, like, I can't believe, like, you're doing all this with your mind.
7:33:34Elon MuskI'm like, yeah, but is it really with my mind? Like, I'm attempting to move and it's just picking that up so it doesn't feel like it's with my mind, but when I moved it for the first time like that it was.
7:33:44Elon MuskOh, man, it, like it made me think that this technology, that what I'm doing is actually way, way more impressive than I ever thought. It was way cooler than I ever thought.
7:33:58Elon MuskAnd it just opened up a whole new world of possibilities of, like, what could possibly happen with this technology and what I might be able to be capable of with it.
7:34:08Lex FridmanBecause to you, it felt for the first time like this was digital telepathy. Like you're controlling a digital device with your mind.
7:34:15Elon MuskYep.
7:34:16Lex FridmanI mean, this is. That's a real moment of discovery. That's really cool. Like you've discovered something seen. Like scientists talk about, like a big aha moment, you know, like Nobel Prize winning.
7:34:27Lex FridmanThey'll have this like, holy crap.
7:34:30Elon MuskYeah. Like, that's what it felt like. Like, I didn't feel like. Like I felt like I had discovered something. But for me, maybe not necessarily for like the world at large or like this field at large, it just felt like an aha moment for me.
7:34:46Elon MuskLike, oh, this works. Like, obviously it works. And so that's what I do like all the time now. I kind of intermix the attempted movement and imagine movement. I do it all together because I've found that there is some interplay with it that maximizes efficiency with the cursor.
7:35:10Elon MuskSo it's not all one or the other. It's not all, just I only use attempted or I only use like imagined movements. It's more I use them in parallel and I can do one or the other.
7:35:23Elon MuskI can just completely think about whatever I'm doing. But I don't know, I like to play around with it. I also like to just experiment with these things. Like every now and again I'll get this idea in my head, like, I wonder if this works and I'll just start doing it and then afterwards I'll tell them, by the way, I wasn't doing that like you guys wanted me to.
7:35:44Elon MuskI was. I thought of something and I wanted to try it and so I did. It seems like it works. So maybe we should like explore that a little bit.
7:35:51Lex FridmanSo I think that discovery is not just for you, at least from my perspective, that's a discovery for everyone else. Whoever uses a neuralink that this is possible. Like, I don't think there's an obvious thing that this is even possible.
7:36:05Lex FridmanIt's like I was saying to Bliss earlier, it's like the four minute mile. People thought it was impossible to run a mile in four minutes. And once the first person did it, then everyone just started doing it.
7:36:16Lex FridmanSo just to show that it's possible that paves the way to like, anyone cannot do it. That's the thing that's actually possible. You don't need to do the attempted movement.
7:36:24Lex FridmanYou can just go direct. That's crazy.
7:36:27Elon MuskIt is crazy
7:36:30Lex Fridmanfor people who don't know. Can you explain how the link app works? You have an amazing stream on the topic. Your first stream, I think on X describing the app.
7:36:41Lex FridmanCan you just describe how it works?
7:36:43Elon MuskYeah, so it's just an app that neuralink created to help me interact with the computer. So on the link app there are a few different settings and different modes and things I can do on it.
7:37:00Elon MuskSo there's like the body mapping we kind of touched on. There's a calibration. Calibration is how I actually get cursor control. So calibrating what's going on in my brain to translate that into cursor control.
7:37:18Elon MuskSo it will pop out models. What they use, I think is, like, time. So it would be five minutes. And calibration will give me so good of a model.
7:37:31Elon MuskAnd then if I'm in it for 10 minutes and 15 minutes, the models will progressively get better. And so the longer I'm in it, generally, the better the models will get.
7:37:43Lex FridmanThat's really cool because you often refer to the models. The model is the thing that's constructed once you go through the calibration step. And then you also talked about sometimes you'll play, like, a really difficult game, like Snake, just to see how good the model is.
7:37:57Elon MuskYeah, yeah. So Snake is kind of like my litmus test for models. If I can control Snake decently well, then I know I have a pretty good model. So, yeah, the Link app has all of those.
7:38:07Elon MuskIt has web grid in it now. It's also how I, like, connect to the computer, just in general. So they've given me a lot of, like, voice controls with it at this point.
7:38:18Elon MuskSo I can say, like, connect or implant disconnect.
7:38:22Lex FridmanAnd.
7:38:22Elon MuskAnd as long as I have that charger handy, then I can connect to it. So the charger is also how I connect to the Link app. To connect to the computer, I have to have the implant charger over my head when I want to connect to have it wake up because the implant's in hibernation mode like always when I'm not using it.
7:38:43Elon MuskI think there's a setting to, like, wake it up every, you know, so long. So we could set it to half an hour, five hours or something if I just want it to wake up periodically.
7:38:56Elon MuskSo, yeah, I'll, like, connect to the Link app and then go through all sorts of things. Calibration for the day, maybe body mapping. I have, like. I made them give me, like, a little homework tab because I am very forgetful and I forget to do things a lot.
7:39:14Elon MuskSo I have, like, a lot of data collection things that they want me to do.
7:39:18Lex FridmanIs the body mapping part of the data collection or is that also part of the.
7:39:21Elon MuskYeah, it is. It's something that they want me to do daily, which I've been slacking on because I've been doing so much media and traveling and so much. So I've been super famous.
7:39:31Elon MuskYeah, I've. I've been a terrible first candidate for how much I've been slacking on my homework. But, yeah, it's just something that they want me to do. Every day to, you know, track how well the neuralink is performing over time and have something to give, I imagine, to give to the FDA to, you know, create all sorts of fancy charts and stuff and show like, hey, this is what the neuralink is, how it's performing.
7:39:58Elon MuskYou know, day one versus day 90 versus day 180 and things like that.
7:40:02Lex FridmanWhat's the calibration step like?
7:40:03Elon MuskIs it.
7:40:04Lex FridmanIs it like move left, move right.
7:40:06Elon MuskIt's a bubble game. So there will be like yellow bubbles that pop up on the screen. At first it is open loop. So open loop. This is something that I still don't fully understand, the open loop and closed loop thing.
7:40:21Lex FridmanMe and Bliz talked for a long time about the difference between the two on the technical side.
7:40:25Neuralink teamOkay.
7:40:25Lex FridmanSo it'd be great to hear your
7:40:27Elon Muskside of the story. Open loop is basically, I have no control over the cursor. The cursor will be moving on its own across the screen, and I am following by intention the cursor to different bubbles.
7:40:43Elon MuskAnd then my. The algorithm is training off of what, like the signals it's getting are as I'm doing this. There are a couple different ways that they've done it.
7:40:52Elon MuskThey call it center out target. So there will be a bubble in the middle and then eight bubbles around that. And the cursor will go from the middle to one side.
7:41:02Elon MuskSo say middle to left, back to middle to up to middle, like up right. And they'll do that all the way around the circle. And I will follow that cursor the whole time.
7:41:13Elon MuskAnd then it will train off of my intentions, what it is expecting my intentions to be throughout the whole process.
7:41:22Lex FridmanCan you actually speak to when you say follow?
7:41:25Neuralink teamYes.
7:41:25Lex FridmanYou don't mean with your eyes, you mean with your intentions.
7:41:28Elon MuskYeah. So generally for calibration, I'm doing attempted movements because I think it works better. I think the better models, as I progress through calibration, make it easier to use imagined movements.
7:41:45Lex FridmanWait, wait. So calibrated unattempted movement will create a model that makes it really effective for you to then use the force.
7:41:55Elon MuskYes. I've tried doing calibration with imagined movement and it just doesn't work as well for some reason. So that was the center out targets. There's also one where, you know, a random target will pop up on the screen.
7:42:11Elon MuskAnd it's the same. I just like move. I follow along wherever the cursor is to that target all across the screen. I've tried those with imagine movement and for some reason the models just, they don't give this high level as quality.
7:42:31Elon MuskWhen we get into closed loop, I haven't played around with it a ton. So maybe like the different ways that we're doing calibration now might make it a bit better.
7:42:41Elon MuskBut what I've found is there will be a point in calibration where I can use Imagine Movement before that point. It doesn't really work. So if I do calibration for 45 minutes, the first 15 minutes, I can't use Imagine movement.
7:43:02Elon MuskIt just like doesn't work for some reason. And after a certain point, I, I can just sort of feel it. I can tell it moves different. That's the best way I can, I can describe it.
7:43:16Elon MuskLike, it's almost as if it is anticipating what I am going to do again before I go to do it. And so using attempted movement for 15 minutes, at some point, I can kind of tell when I like move my eyes to the next target that the cursor is starting to like pick up.
7:43:37Elon MuskLike, it's starting to understand it's learning like what I'm going to do.
7:43:40Lex FridmanSo first of all, it's really cool that, I mean, you are a true pioneer in all of this. You're like exploring how to do every aspect of this most effectively.
7:43:49Lex FridmanAnd there's just, I imagine so many lessons learned from this. So thank you for being a pioneer and all these kinds of different, like super technical ways. And it's also cool to hear that there's like a different like, feeling to the experience when it's calibrated in different ways.
7:44:07Lex FridmanLike just because I imagine your brain is doing something different and that's why there's a different feeling to it. And then trying to find the words and the measurements to those feelings would be also interesting.
7:44:19Lex FridmanBut at the end of the day, you can also measure that your actual performance on whether it's snake And you're saying for the open loop calibration, the attempted movement works best for now?
7:44:34Elon MuskYep, yep.
7:44:36Lex FridmanSo that's the open loop. You don't get the feedback that something. That you did something.
7:44:41Elon MuskYeah. Is that frustrating? No, no, it makes sense to me. Like we've done it with a cursor and without a cursor in open loop. So sometimes it's just say for like the center out the.
7:44:55Elon MuskYou'll start calibration with a bubble lighting up and I push towards that bubble. And then when that bubble, you know, when it's push towards that bubble for Say three seconds, the bubble will pop and then I come back to the middle.
7:45:09Elon MuskSo I'm doing it all just by my intentions. Like that's what it's learning anyway. So it makes sense that as long as I follow what they want me to do, you know, like, follow the yellow brick road, that it'll all work out.
7:45:22Lex FridmanYou're full of great references. Is the bubble game fun? Like, yeah.
7:45:26Elon MuskThey always feel so bad making me do calibration. Like, oh, we're about to do a 40 minute calibration. I'm like, all right, do you guys want to do two of them?
7:45:36Elon MuskI'm always asking. Whatever they need, I'm more than happy to do. And it's not bad. I get to lie there or sit in my chair and do these things with some great people.
7:45:50Elon MuskI get to have great conversations. I can give them feedback. I can talk about all sorts of things. I could throw something on on my TV in the background and kind of like split my attention between them.
7:46:03Elon MuskLike, it's not bad at all.
7:46:05Lex FridmanI don't know, is there a score that you get? Like, can you do better on the bubble game?
7:46:08Elon MuskNo, I would love that. I would love writing down suggestions from Nolan.
7:46:17Lex FridmanThat's make it more fun, gamified.
7:46:20Elon MuskYeah, that's one thing that I really, really enjoy about Web grid is because I'm so competitive. Like, the higher the bps, the higher the score I know, the better I'm doing.
7:46:33Elon MuskAnd so if I, I think I've asked at one point one of the guys, like, if he could give me some sort of numerical feedback for calibration, like, I would like to know what they're looking at.
7:46:42Elon MuskLike, oh, you know, it is. We see like this number while you're doing calibration. And that means, at least on our end, that we think calibration is going well.
7:46:53Elon MuskAnd I would love that because I would like to know if what I'm doing is going well or not. But then they've also told me, like, yeah, not necessarily like one to one.
7:47:01Elon MuskIt doesn't actually mean that calibration is going well in some ways. So it's not like 100%. And they don't want to like skew what I'm experiencing or want me to change things based on that.
7:47:12Elon MuskIf that number isn't always accurate to like, how the model will turn out or how like the end result. That's at least what I got from it. One thing I do, I have asked them and something that I really enjoy striving for is towards the end of calibration, there is, like, a time between targets.
7:47:31Elon MuskAnd so I like to keep, like, at the end, that number as low as possible. So at the beginning, it can be, you know, four, five, six seconds between me popping bubbles, but towards the end, I like to keep it below, like, 1.5, or if I could get it to, like, one second between, like, bubbles.
7:47:47Elon MuskBecause in my mind, that translates really nicely to something like web grid, where I know if I can hit a target one every second that I'm doing real, real well.
7:47:58Lex FridmanThere you go. That's a way to get a score on the calibrations, like the speed. How quickly can you get from bubble to bubble?
7:48:03Elon MuskYeah.
7:48:05Lex FridmanSo there's the open loop, and then it goes to the closed loop. The closed loop can already start giving you a sense because you're getting feedback of how good the model is.
7:48:13Neuralink teamYeah.
7:48:14Elon MuskSo closed loop is when I first get cursor control and how they've described it to me. Someone who does not understand this stuff. I am the dumbest person in the room.
7:48:25Elon MuskEvery time I'm with any of the humility is that I am closing the loop. So I am actually now the one that is, like, finishing the loop of whatever this loop is.
7:48:37Elon MuskI don't even know what the loop is. They've never told me. They just say there is a loop, and at one point it's open and I can't control. And then I get control and it's closed.
7:48:47Elon MuskSo I'm finishing the loop.
7:48:48Lex FridmanSo how long the calibration usually takes? You said like, 10, 15 minutes?
7:48:52Elon MuskWell, yeah, they're trying to get that number down pretty low. That's what we've been working on a lot recently, is getting that down as low as possible. So that way, if this is something that people need to do on a daily basis, or if some people need to do on a, like, every other daily basis or once a week, they don't want people to be sitting in calibration for long periods of time.
7:49:15Elon MuskI think they wanted to get it down seven minutes or below, at least where we're at right now. It'd be nice if they. You never had to do calibration.
7:49:23Elon MuskSo we'll get there at some point. I'm sure the more we learn about the brain and, like, I think that's the dream. I think right now for me to get, like, really, really good models.
7:49:36Elon MuskI'm in calibration 40 or 45 minutes. And I don't mind. Like I said, they always feel really bad. But if it's going to get me a model that can break these records on web grid.
7:49:47Elon MuskI'll stay in it for flipping two hours.
7:49:50Lex FridmanLet's talk business. So, web grid, I saw a presentation where Bliss said by March you selected 89,000 targets in web Grid. Can you explain this game? What is web grid and what does it take to be a world class performer in web grid as you continue to break world records?
7:50:09Elon MuskYeah,
7:50:13Lex Fridmanit's like a gold medalist. Like.
7:50:15Elon MuskWell, yeah, you know, I'd like to thank, I'd like to thank everyone who's helped me get here, my coaches, my parents for driving me to practice every day at 5 in the morning.
7:50:24Elon MuskI'd like to thank God and just overall my dedication to my craft.
7:50:30Lex FridmanThe interviews with athletes are always like that exact. It's like that template.
7:50:34Elon MuskYeah. So, so, so Web grid, Web grid is a grid. Cells, it's, it's literally just a grid. They can make it as big or small as you can make a grid.
7:50:48Elon MuskA single box on that grid will light up and you go and click it. And it is a way for them to benchmark how good a BCI is. So it's, you know, pretty straightforward.
7:51:00Elon MuskYou just click targets.
7:51:01Lex FridmanOnly one blue cell appears and you're supposed to move the mouse to there and click on it.
7:51:06Elon MuskSo I like playing on like bigger grids because it, the bigger the grid, the like more bps. It's bits per second that you get every time you click one.
7:51:18Elon MuskSo I'll say I'll play on like a 35 by 35 grid and then one of those little squares cell, call it target, whatever will light up and you move the cursor there and you click it and then you do that forever.
7:51:34Lex FridmanAnd you've been able to achieve at first eight bits per second. And you recently broke that.
7:51:40Elon MuskYeah, I'm at 8.5 right now. I would have beaten that literally the day before I came to Austin. But I had like a, I don't know like a five second lag right at the end and I just had to wait until the latency calm down.
7:51:56Elon MuskAnd then I kept clicking but I was at like 8.01 and then 5 seconds of lag and then the next like 3 targets I clicked all stayed at 8.01.
7:52:07Elon MuskSo if I would have been able to click during that time of lag, I probably would have hit, I don't know, I might have hit nine. So I'm there, I'm like, I'm really close.
7:52:16Elon MuskAnd then this whole Austin trip has really gotten in the Way of my Web grid playing ability.
7:52:22Lex FridmanYeah. So that's all you think about right now.
7:52:24Elon MuskYeah, I know.
7:52:24Neuralink teamI just.
7:52:25Elon MuskI just want. I want to do better. 9 I want to do better. I want to hit 9, I think. Well, I know 9 is very, very achievable. I'm right there.
7:52:35Elon MuskI think 10 I could hit maybe in the next month. Like, I could do it probably in the next few weeks if I really push.
7:52:41Lex FridmanI think you and Elon are basically the same person, because last time I did a podcast with them, he came in extremely frustrated that he can't beat Uber Lilith as a droid.
7:52:50Lex FridmanThat was like, a year ago, I think. I forget, like, solo.
7:52:54Elon MuskYeah.
7:52:55Lex FridmanAnd I could just tell there's some percentage of his brain the entire time was thinking, like, I wish I was right now attempting.
7:53:02Elon MuskI think he did it that night.
7:53:03Lex FridmanHe did it that night.
7:53:04Elon MuskYeah.
7:53:04Lex FridmanHe stayed up and did it that night. Yeah. It's just crazy to me. I mean, in a fundamental way, it's really inspirational, and what you're doing is inspiring in that way, because, I mean, it's not just about the game.
7:53:17Lex FridmanEverything you're doing there has impact. By striving to do well on Web Grid, you're helping everybody figure out how to create the system all along. Like the decoding, the software, the hardware, the calibration, all of it.
7:53:32Lex FridmanHow to make all of that work so you can do everything else really well.
7:53:36Elon MuskYeah. It's just really fun.
7:53:38Lex FridmanWell, that's also. That's part of the thing is making it fun.
7:53:42Elon MuskYeah. It's addicting. I'm. I've joked about, like, what they actually did when they went in and put this thing in my brain. They must have flipped a switch to make me more susceptible to these kinds of games, to make me addicted to, like, web grid or something.
7:53:58Lex FridmanYeah.
7:53:58Elon MuskDo you know Bliss's high score?
7:54:00Neuralink teamYeah.
7:54:00Lex FridmanHe said, like, 14 or something.
7:54:02Elon Musk17.
7:54:02Lex FridmanOh, boy.
7:54:03Elon Musk17.1 or something. 17 on the dot.
7:54:06Neuralink team17.01.
7:54:07Elon MuskYeah.
7:54:07Lex FridmanHe told me he, like, does it on the floor with peanut butter and he, like, fasts. It's. It's. It's weird. That sounds like cheating. Sounds like performance enhancing.
7:54:16Neuralink teamNolan, like, the first time Nolan played this game, he asked, you know, how could you be at this game? And I think you told me right then, you're gonna.
7:54:23Neuralink teamYou're gonna try to beat me.
7:54:24Elon MuskI'm gonna get there someday.
7:54:25Neuralink teamYeah.
7:54:25Elon MuskI think I can.
7:54:25Neuralink teamI fully believe you.
7:54:26Elon MuskI think I can. I'm excited for that. Yeah. So I've been playing first off, with the dwell cursor, which really hampers my web grid playing ability. Basically, I have to wait 0.3 seconds for every click.
7:54:40Lex FridmanOh, so you can't do the click. So you have to. You have to. So you click by dwelling.
7:54:44Elon MuskYou said 0.3, 0.3 seconds, which. Which sucks. It really slows down how much I'm able to, like, how high I'm able to get. I still hit like 50. I think I hit like 50 something trials.
7:55:00Elon MuskNet trials per minute in that. Which was pretty good because I'm able to like there's one of the settings is also like how slow you need to be moving in order to initiate a click to start a click.
7:55:13Elon MuskSo I can tell sort of when I'm on that threshold to start initiating a click just a bit early. So I'm not fully stopped over the target when I go to click.
7:55:25Elon MuskI'm doing it like on my way to the targets a little bit to try to time it just right.
7:55:30Lex FridmanSo you're slowing down.
7:55:31Elon MuskYeah, just. Just a hair right before the circuits.
7:55:34Lex FridmanThis is like elite performance. Okay. But that's still.
7:55:38Elon MuskIt's.
7:55:38Lex FridmanIt sucks that there's a ceiling of the 0.3.
7:55:41Elon MuskWell there I can get down to 0.2 and 0.1. 0.1. Yeah. And I've played with that a little bit too. I have to adjust a ton of different parameters in order to play with 0.1, and I don't have control over all that on my end yet.
7:55:55Elon MuskIt also changes how the models are trained. Like if I train a model like in web grid, like a bootstrap on a model, which basically is them training models.
7:56:04Elon MuskAs I'm playing web grid based off of the web grid data that I'm. So like, if I play web grid for 10 minutes, they can train off that data specifically in order to get me a better model.
7:56:15Elon MuskIf I do that with 0.3 versus 0.1, the models come out different. The way that they interact, it's just much, much different. So I have to be really careful.
7:56:26Elon MuskI found that doing it with 0.3 is actually better in some ways. Unless I can do it with point one and change all of the different parameters, then that's more ideal because obviously 0.3 is faster than point one.
7:56:37Elon MuskSo I could get there. I can get there.
7:56:42Lex FridmanCan you click using your brain for
7:56:46Elon Muskright now, it's the hover clicking with the dwell cursor.
7:56:49Neuralink teamWe.
7:56:50Elon MuskBefore all the thread retraction stuff happened, we were calibrating clicks. Left click, right click. That was my previous Ceiling before I broke the record again with the dwell cursor was, I think on a 35 by 35 grid with left and right click.
7:57:05Elon MuskAnd you get more bps, more bits per second using multiple clicks because it's more difficult.
7:57:12Lex FridmanOh, because what is it you're supposed to do either a left click or, like, right click. Is it different color places?
7:57:19Elon MuskYeah. Blue targets for left click, orange targets for right click is what they had done. So my previous record of 7.5 was with the blue and the orange targets.
7:57:28Elon MuskYeah. Which I think if I went back to that now doing the click calibration, I would be able to. And being able to, like, initiate clicks on my own, I think I would break that 10 ceiling, like, in a couple days, max.
7:57:43Neuralink teamYeah.
7:57:44Lex FridmanYou start making Bliss nervous about his 17.
7:57:47Neuralink teamWhy do you think we haven't given him the.
7:57:48Elon MuskYeah, exactly.
7:57:52Lex FridmanSo what did it feel like with the retractions that there is? Some of the threads retracted.
7:57:57Elon MuskIt sucked. It was really, really hard. The day they told me was the day of my big neuralink tour at their Fremont facility. They told me, like, right before we went over there.
7:58:11Elon MuskIt was really hard to hear. My initial reaction was, all right, go in, fix it. Like, go and take it out and fix it. The first surgery was so easy.
7:58:20Elon MuskLike, Like I went to sleep. A couple hours later, I woke up and here we are. I didn't feel any pain, didn't take, like, any pain pills or anything.
7:58:29Elon MuskSo I just knew that if they wanted to, they could go in and put in a new one, like, next day if that's what it took. Because I just wanted.
7:58:39Elon MuskI wanted it to be better and I wanted not to lose the capability. I had so much fun playing with it for a few weeks, for a month. I had, like.
7:58:52Elon MuskIt had opened up so many doors for me. It opened up so many more possibilities that I didn't want to lose it. After a month. I thought it would have been a cruel twist of fate and if I had gotten to see the view from the top of this mountain and then have it all come crashing down after a month.
7:59:10Elon MuskAnd I knew, say, the top of the mountain, but how I saw it was I was just now starting to climb the mountain and I was like, there was so much more that I knew was possible.
7:59:23Elon MuskAnd so to have all of that be taken away was really, really hard. But then on the drive over to the facility, I don't know, like, five minute drive, whatever it is, I talked with my parents about it.
7:59:39Elon MuskI prayed about it. I was just like, you know, I'm not going to let this ruin my day. I'm not going to let this ruin this amazing, like, tour that they have set up for me.
7:59:49Elon MuskLike, I want to go show everyone how much I appreciate all the work they're doing. I want to go meet all of the people who have made this possible, and I want to go have one of the best.
8:00:00Elon MuskMy life. And I did. And it was amazing. And it absolutely was one of the best days I've ever been privileged to experience. And then for a few days I was pretty down in the dumps.
8:00:13Elon MuskBut for like the first few days afterwards, I was just like. I didn't know if it was ever going to work again. And then I just, I made the decision that it.
8:00:27Elon MuskEven if I lost the ability to use the neuralink, even if I lost, Even if I lost out on everything to come, if I could keep giving them data in any way, then I would do that.
8:00:40Elon MuskIf I needed to just do some of the data collection every day or body mapping every day for a year, then I would do it because I know that everything I'm doing helps everyone to come after me.
8:00:54Elon MuskAnd that's all I wanted. I guess the whole reason that I did this was to help people. And I knew that anything I could do to help, I would continue to do.
8:01:03Elon MuskEven if I never got to use the cursor again, then, you know, I was just happy to be a part of it. And everything that I'd done was just a perk.
8:01:12Elon MuskIt was something that I got to experience. And I know how amazing it's going to be for everyone to come after me, so might as well just keep truck him along, you know.
8:01:22Lex FridmanThat said, you were able to get. To work your way up to get the performance back. So this is like going from Rocky 1 to Rocky 2. So when did you first realize that this is possible and what gave you sort of the strength, the motivation, the determination to do it, to increase back up and beat your previous record?
8:01:42Elon MuskYeah, it was within a couple weeks.
8:01:43Lex FridmanLike again, this feels like I'm interviewing an athlete.
8:01:47Elon MuskThis is great.
8:01:48Lex FridmanI like the thing.
8:01:49Elon MuskApparently road. The road back was long and hard from many difficulties. There were dark days. It was a couple weeks, I think. And then there was just a turning point.
8:02:04Elon MuskI think they had switched how they were measuring the neuron spikes in my brain. Like the bliss. Help me out.
8:02:14Neuralink teamYeah, the way in which we were measuring the behavior of individual neurons.
8:02:17Elon MuskYeah.
8:02:18Lex FridmanSo.
8:02:18Neuralink teamSo we were switching from sort of individual spike detection to something called spike band power, which if you watch the previous segments with either me or dj, you probably have some confidence.
8:02:26Elon MuskYeah. Okay. So when they did that, it was kind of like, you know, light over the head, like light bulb moment. Like, oh, this works. And this seems like we can run with this.
8:02:38Elon MuskAnd I saw the uptick in performance immediately. Like I could feel it when they switched over. I was like, this is better. Like this is good. Like everything up till this point for the last few weeks, last, like whatever, three or four weeks.
8:02:52Elon MuskBecause it was before they even told me, like everything before this sucked. Like, let's keep doing what we're doing now. And at that point it was not like, oh, I know I'm still only at like say in web grid terms, like 4 or 5bps compared to my 7.5 before.
8:03:09Elon MuskBut I know that if we keep doing this then like I can, I can get back there. And then they gave me the dwell cursor and the dwell cursor sucked at first.
8:03:19Elon MuskIt's not obviously not what I want, but it gave me a path forward to be able to continue using it and hopefully to continue to help out. And so I just ran with it, never looked back.
8:03:33Elon MuskLike I said, I'm just kind of person, I roll with the punches.
8:03:36Lex FridmanAnyway, so what was the process? What was the feedback loop on the figuring out how to do the spike detection in a way that would actually work well for no one?
8:03:44Neuralink teamYeah, it's a great question. So maybe just describe first how the actual update worked. It was basically an update to your implant. So we just did an over the air software update to his implant.
8:03:53Neuralink teamSome way you'd update your Tesla or your iPhone. And that firmware change enabled us to record sort of averages of populations of neurons nearby individual electrodes. So we have less resolution about which individual neuron is doing what.
8:04:06Neuralink teamBut we have a broader picture of what's going on nearby an electrode overall. And that feedback loop, I mean, basically as no one described it was immediate. When we flipped that switch, I think the first day we did that, you had three or four VPs right out of the box.
8:04:18Neuralink teamAnd that was a light bulb moment for, okay, this is the right path to go down. And from there there's a lot of feedback around like how to make this useful for independent use.
8:04:26Neuralink teamSo what we care about ultimately is that you can use it independently to do whatever you want. And to get to that point it required us to re engineer the UX as you talked about, the dwell cursor, to make it something that you can use independently without us needing to be involved all the time.
8:04:39Neuralink teamAnd yeah, this is obviously the start of this journey still. Hopefully we get back to the places where you're doing multiple clicks and using that to control much more fluidly everything and much more naturally the applications that you're trying to interface with.
8:04:50Lex FridmanAnd most importantly, get that web grid number up.
8:04:55Elon MuskYeah, yeah.
8:04:56Lex FridmanSo how is the on the hover click do you accidentally click stuff sometimes?
8:05:02Elon MuskYep.
8:05:02Lex FridmanLike, what's. How hard is it to avoid accidentally clicking?
8:05:05Elon MuskI have to continuously keep it moving, basically. So like I said, there's a threshold where it will initiate a click. So if I ever drop below that, it'll start and I have 0.3 seconds to move it before it clicks anything.
8:05:20Elon MuskAnd if I don't want it to ever get there, I just keep it moving at a certain speed and like, just constantly, like doing circles on screen, moving it back and forth to keep it from clicking stuff.
8:05:31Elon MuskI actually noticed a couple weeks back that I was. When I was not using the implant, I was just moving my hand back and forth or in circles, like I was trying to keep the cursor from clicking and I was just doing it, like while I was trying to go to sleep.
8:05:49Elon MuskAnd I was like, okay, this is a problem
8:05:52Lex Fridmanto avoid the clicking, I guess.
8:05:54Elon MuskDoes that create problems?
8:05:55Lex FridmanLike when you're gaming, accidentally click a thing? Like.
8:05:58Elon MuskYeah, yeah, it happens in chess. I've lost a number of games because I'll accidentally click something.
8:06:06Neuralink teamI think the first time I ever beat you was because of an accidental.
8:06:10Lex FridmanIt's a nice excuse, right?
8:06:11Elon MuskYeah.
8:06:12Lex FridmanAnytime you lose, you could just say that was accidental.
8:06:15Elon MuskYeah.
8:06:16Lex FridmanYou said the app improved a lot from version one. When you first started using it, it was very different. So can you just talk about the trial and error that you went through with the team?
8:06:27Lex FridmanLike 200 plus pages of notes, like, what's process like of going back and forth and working together to improve the thing?
8:06:35Elon MuskIt's a lot of me just using it, like day in and day out and saying like, hey, can you guys do this for me? Like, give me this. I want to be able to do that.
8:06:48Elon MuskI need this. I think a lot of it just doesn't occur to them. Maybe until someone is actually using the app, using the implant, it's just something that they just never would have thought of or it's very specific to even like me, maybe what I want.
8:07:09Elon MuskIt's something I'm a little worried about with the next people that come is, you know, maybe they will want things much different than how I set it up or what the advice I've given the team and they're going to look at some of the things they've added for me.
8:07:25Elon MuskI'm like, that's a dumb idea. Like, why would he ask for that? And so I'm really looking forward to get the next people on because I guarantee that they're going to think of things that I've never thought of.
8:07:37Elon MuskThey're going to think of improvements. I'm like, wow, that's a really good idea. Like I wish I would have thought of that. And then they're also going to give me some pushback about like, yeah, what you are asking them to do here, that's a bad idea.
8:07:50Elon MuskLet's do it this way. And I'm more than happy to have that happen. But it's just a lot of like, you know, different interactions with different games or applications.
8:08:02Elon MuskThe Internet, just with the computer in general, there's tons of bugs that end up popping up left, right, center. So it's just me trying to use it as much as possible and showing them what works and what doesn't work and what I would like to be better.
8:08:18Elon MuskAnd then they take that feedback and they usually create amazing things for me. They solve these problems in ways I would have never imagined. They're so good at everything they do.
8:08:31Elon MuskAnd so I'm just really thankful that I'm able to give them feedback and they can make something of it because a lot of my feedback is like really dumb.
8:08:39Elon MuskIt's just like, I want this. Please do something about it and we'll come back super well thought out and it's way better than anything I could have ever thought of or implemented myself.
8:08:51Elon MuskSo they're just great. They're really, really cool.
8:08:53Lex FridmanAs the BCI community grows, would you like to hang out with the other folks with neuralinks? Like what, what relationship, if any, would you want to have with them?
8:09:03Lex FridmanBecause you said like they might have a different set of like ideas of how to use the thing.
8:09:09Elon MuskYeah.
8:09:10Lex FridmanWould you be intimidated by their web grade performance? No.
8:09:13Elon MuskNo.
8:09:13Lex FridmanI hope compete.
8:09:14Elon MuskI hope day one they like wipe the floor with me. I hope they beat it and they crush it. You know, double it if they can. Just because on one hand it's only going to push me to be better because I'm super competitive.
8:09:31Elon MuskI want other people to push me. I think that is important for anyone trying to achieve greatness is they need other people around them who are going to push them to be better.
8:09:43Elon MuskAnd I even made a joke about it on X once. Like once the next people get chosen, like cue buddy cop music Like I'm just excited to have other people to do this with and to like share experiences with.
8:09:55Elon MuskI'm more than happy to interact with them as much as they want. More than happy to give them advice. I don't know what kind of advice I could give them, but if they have questions, I'm more than happy.
8:10:05Lex FridmanWhat advice would you have for the next participant in the clinical trial?
8:10:10Elon MuskThat they should have fun with this because it is a lot of fun. And that I hope they work really, really hard, because it's not just for us. It's for everyone that comes after us.
8:10:24Elon MuskAnd, you know, come to me if they need anything and to go to Neuralink if they need anything. Man, Neuralink moves mountains like they do. Absolutely anything for me that they can.
8:10:36Elon MuskAnd it's an amazing support system to have. It puts my mind at ease for, like, so many things that I have had, like, questions about so many things I want to do, and they're always there, and that's really, really nice.
8:10:54Elon MuskAnd so I just. I would tell them not to be afraid to go to Neuralink with any questions that they have, any concerns, Anything that, you know, they're looking to do with this and any help that Neuralink is capable of providing, I know they will, and I don't know.
8:11:11Elon MuskI don't know. Just work your ass off because it's really important that we try to give our all to this.
8:11:19Lex FridmanSo have fun and work hard.
8:11:21Elon MuskYeah. Yeah. There we go. Maybe that's what I'll just start saying to people. Have fun, work hard.
8:11:26Lex FridmanNow you're a real pro athlete. Just keep it short. Maybe it's good to talk about what you've been able to do now that you have a Neuralink implant. Like the.
8:11:39Lex FridmanThe freedom you gain from this way of interacting with the outside world. Like, you play video games all night and you do that by yourself.
8:11:49Elon MuskYeah.
8:11:49Lex FridmanAnd that's a kind of freedom. Can you speak to that freedom that you gain?
8:11:53Elon MuskYeah, it's what all, I don't know, people in my position want. They just want more independence. The more load that I can take away from people around me, the better.
8:12:03Elon MuskIf I'm able to interact with the world without using my family, without going through any of my friends, like, needing them to help me with things, the better. If I'm able to sit up on my computer all night and not need someone to sit me up, say, on my iPad, in a position where I can use it, and then have to have them wait up for me all night until I'm ready to be done using it like that, it takes a load off of all of us, and it's really, like, all I can ask for.
8:12:40Elon MuskIt's something that I could never thank Neuralink enough for. I know my family feels the same way. Just being able to have the freedom to do things on my own at Any hour of the day or night, it means the world to me.
8:12:57Elon MuskAnd I don't know, when you're up
8:13:03Lex Fridmanat 2am playing Web Grid by yourself. Yeah, I just imagine like it's darkness and there's just a light glowing and you're just focused what's going through your mind or you're like in a state of flow where it's like the mind is empty.
8:13:20Lex FridmanLike those like Zen masters.
8:13:22Neuralink teamYeah.
8:13:23Elon MuskGenerally it is me playing music of some sort. I have a massive playlist and so I'm just like rocking out to music. And then it's also just like a race against time because I'm constantly looking at how much battery percentage I have left on my implant.
8:13:41Elon MuskLike, all right, I have 30%, which equates to, you know, X amount of time, which means I have to break this record in the next, you know, hour and a half or else it's not happening tonight.
8:13:53Elon MuskAnd so it's, it's a little stressful when that happens. When it's like when it's above 50%, I'm like, okay, like I got time. It's like getting down to 30 and then 20.
8:14:03Elon MuskIt's like, all right, 10%. A little pop up is going to pop up right here and it's going to really screw my web grid flow. It's going to tell me that, you know, like there's a, like a low battery, low battery pop up comes up and I'm like, it's really going to screw me over.
8:14:16Elon MuskSo if I have to, if I'm going to break this record, I have to do it in the next like 30 seconds or else that pop up is going to get in the way, like cover my web grid.
8:14:25Elon MuskAnd then it, after that I go click on it, go back into web grid and I'm like, all right, that means I have, you know, 10 minutes left before this thing's dead.
8:14:33Elon MuskThat's what's going on in my head generally. That and whatever songs playing. And I just, I just want, I want to break those records so bad. Like, it's all I want.
8:14:43Elon MuskWhen I'm playing web grid, it has become less of like, oh, this is just a leisurely activity. Like, I just enjoy doing this because it just feels so nice and it puts me at ease.
8:14:54Elon MuskIt is. No, once I'm in web grid, you better break this record or you're going to waste like five hours of your life right now. And I don't know, it's just fun.
8:15:04Elon MuskIt's fun, man.
8:15:05Lex FridmanHave you ever tried web grid with, like, two targets and three targets. Can you get higher bps with that?
8:15:10Elon MuskCan you do that?
8:15:12Neuralink teamYou mean like different color targets or
8:15:13Lex Fridmanyou mean, oh, multiple targets. Does that change the thing?
8:15:16Neuralink teamYeah. So bps is log of number of targets, times correct minus incorrect divided by time. And so you can think of like, different clicks as basically doubling the number of active targets.
8:15:25Lex FridmanGot it.
8:15:26Neuralink teamSo, you know, basically, higher bps, the more options there are, the more difficult the task. And there's also, like, Zen mode you've played in before, which is like infinite candy.
8:15:34Elon MuskIt covers the whole screen with a grid and I don't know what.
8:15:40Lex FridmanYeah. And so you can go like, that's. That's insane.
8:15:44Neuralink teamYeah, he doesn't like it because it didn't show BPs. So, like, you know.
8:15:47Lex FridmanOh, yeah, I have them.
8:15:49Elon MuskI had them put in a giant bps in the background. So now it's like the opposite of Zen mode. It's like. It's like super hard mode. Like, just metal mode.
8:15:59Elon MuskIf it's just like a giant number in the back count, we should be named that. Metal mode is much better than that.
8:16:05Lex FridmanSo you also play Civilization 6.
8:16:07Elon MuskI love Civ 6. Yeah.
8:16:09Lex FridmanUsually go with Korea.
8:16:11Elon MuskI do, yeah. So the great part about Korea is they focus on, like, science tech victories, which was not planned. Like, I've been playing Korea for years, and then all of the knurling stuff happened, so it kind of aligns.
8:16:28Elon MuskBut what I've noticed with tech victories is if you can just rush tech, rush science, then you can do anything. Like, at one point in the game, you will be so far ahead of everyone technologically that you will have, like, musket men, and people will still be fighting with, like, bows and arrows.
8:16:52Elon MuskAnd so if you want to win a domination victory, you just get to a certain point with the science and then go and wipe out the rest of the world.
8:17:01Elon MuskOr you can just take science all the way and win that way. And you're going to be so far ahead of everyone because you're producing so much science that it's not even close.
8:17:12Elon MuskI've accidentally won in different ways just by focusing on science.
8:17:18Lex FridmanAccidentally won by focusing on science.
8:17:20Elon MuskI was. Yeah, I, like, I was playing only science, obviously. Like, just science all the way. Just tech. And I was trying to get, like, every tech in the tech tree and stuff.
8:17:31Elon MuskAnd then I accidentally won through a diplomatic victory. And I was so mad. I was so mad because it just, like, ends the game one turn. It was like, oh, you won.
8:17:41Elon MuskYou're so diplomatic. I'm like, I don't want to do this. I should have declared war on more people or something. It was terrible. But you don't need, like, giant civilizations with tech, especially with Korea, you can keep it pretty small.
8:17:54Elon MuskSo I generally just, you know, get to a certain military unit and put them all around my border to keep everyone out, and then I will just build up.
8:18:03Elon MuskSo very isolationist.
8:18:05Neuralink teamNice.
8:18:05Lex FridmanYeah, Just work on the science.
8:18:07Elon MuskThat's it.
8:18:08Lex FridmanYou're making it sound so fun.
8:18:10Elon MuskIt's so much fun.
8:18:11Lex FridmanAnd I also saw a Civilization 7 trailer.
8:18:13Elon MuskOh, man, I'm so pumped.
8:18:14Lex FridmanAnd that's probably coming out.
8:18:15Elon MuskCome on, Sim 7, hit me up all alpha beta tests, whatever.
8:18:19Lex FridmanWait, when is it coming out?
8:18:21Elon Musk2025.
8:18:21Lex FridmanYeah, yeah. Next year. Yeah. What other stuff would you like to see improved about the Neuralink app and just the entire experience?
8:18:29Elon MuskI would like to, like I said, get back to the, like, click on demand, like the regular clicks. That would be great. I would like to be able to connect to.
8:18:40Elon MuskTo more devices. Right now, it's just the computer. I'd like to be able to use it on my phone or use it on different consoles, different platforms. I'd like to be able to control as much stuff as possible.
8:18:54Elon MuskHonestly, like, an optimus robot would be pretty cool. That would be sick if I could control an optimus robot. The link app itself, it seems like we are getting pretty dialed in to what it might look like down the road.
8:19:16Elon MuskSeems like we've gotten through a lot of what I want from it, at least. The only other thing I would say is, like, more control over all the parameters that I can tweak with my cursor and stuff.
8:19:32Elon MuskThere's a lot of things that, you know, go into how the cursor moves in certain ways. And I have, I don't know, like, three or four of those parameters, and
8:19:41Lex Fridmanthey're like gain and friction.
8:19:43Elon MuskGain friction. Yeah. And there's maybe double the amount of those with just like velocity and then with the actual dwell cursor. So I would like all of it. I want as much control over my environment as possible, especially if you want,
8:19:58Lex Fridmanlike, advanced mode, you know, like in, like, there's menus, usually there's basic mode and you're like one of those folks, like the power user.
8:20:06Elon MuskYeah, that's, that's. That's what I want. I want as much control over this as possible. So, yeah, that's. That's really all I can ask for. Just give me. Give me everything.
8:20:18Lex FridmanHas speech been useful? Like Just being able to talk also. In addition to everything else?
8:20:23Elon MuskYeah. You mean, like, while I'm using it.
8:20:25Lex FridmanWhile you're using it, like speech to text?
8:20:27Elon MuskOh, yeah.
8:20:28Lex FridmanOr do you type or, like. Because there's also a keyboard.
8:20:30Elon MuskYeah, yeah. So there's a virtual keyboard. That's another thing I would like to work more on is finding some way to type or text in a different way. Right now it is like a dictation, basically, and a virtual keyboard that I can use with the cursor, but we've played around with, like, fingerspelling, like sign language fingerspelling, and that seems really promising.
8:20:55Elon MuskSo I have this thought in my head that it's going to be a very similar learning curve that I had with the cursor, where I went from attempted movement to imagine movement at one point.
8:21:08Elon MuskI have a feeling, this is just my intuition, that at some point I'm going to be doing fingerspelling and I won't need to actually attempt to fingerspell anymore. That I'll just be able to think the letter that I want and it'll pop up.
8:21:23Lex FridmanThat would be epic. Yeah, that's challenging. That's hard. That's a lot of work for you to kind of take that leap. But that would be awesome.
8:21:30Elon MuskAnd then, like, going from letters to words is another step. Like, you would go from. You know, right now, it's fingerspelling of, like, just the sign language Alphabet. But if it's able to pick that up, then it should be able to pick up, like, the whole sign language, like, language.
8:21:45Elon MuskAnd so then if I could do something along those lines, or just the sign language spelled word, and if I can spell it at a reasonable speed and it can pick that up, then I would just be able to think that through and it would do the same thing.
8:22:01Elon MuskI don't see why not. After what I saw with the cursor control, I don't see why it wouldn't work. But we'd have to play around with it more.
8:22:10Lex FridmanWhat was the process in terms of training yourself to go from attempted movement to imagine movement? How long does that take? So how long would this kind of process take?
8:22:18Elon MuskWell, it was a couple weeks before it just happened upon me. But now that I know that that was possible, I think I could make it happen with other things.
8:22:29Elon MuskI think it would be much, much simpler.
8:22:31Lex FridmanWould you get an upgraded implant device?
8:22:34Elon MuskSure. Absolutely. Whenever. Whenever they'll let me see.
8:22:39Lex FridmanYou don't have any concerns for you, the surgery experience, all of it was like, no regrets?
8:22:45Elon MuskNo.
8:22:45Lex FridmanSo Everything's been good so far.
8:22:47Elon MuskYep.
8:22:48Lex FridmanYou just keep getting upgrades.
8:22:50Elon MuskYeah. I mean, why not? I've seen how much it's impacted my life already, and I know that everything from here on out is going to get better and better.
8:22:58Elon MuskSo I would love to. I would love to get the upgrade.
8:23:01Lex FridmanWhat future capabilities are you excited about? Sort of beyond this kind of telepathy is vision. Interesting. So for folks who, for example, who are blind. So you're like enabling people to see or for speech?
8:23:19Elon MuskYeah, there's a lot that's very, very cool about this. I mean, we're talking about the brain, so there's like, this is just motor cortex stuff. There's so much more that can be done.
8:23:27Elon MuskThe vision one is fascinating to me. I think that is going to be very, very cool. To give someone the ability to see for the first time in their life would just be.
8:23:37Elon MuskI mean, it might be more amazing than even helping someone like me. Like, that just sounds incredible. The speech thing is really interesting. Being able to have some sort of like real time translation and cut away that language barrier would be really cool.
8:23:53Elon MuskAny sort of, like actual impairments that it could solve, like with speech, would be very, very cool. And then also there are a lot of different disabilities that all originate in the brain, and you would be able to, hopefully be able to solve a lot of those.
8:24:11Elon MuskI know there's already stuff to help people with seizures that can be implanted in the brain. This would do, I imagine, the same thing. And so you could do something like that.
8:24:22Elon MuskI know that even someone like Joe Rogan has talked about the possibilities with being able to stimulate the brain in different ways. I'm not sure. I'm not sure what, you know, like how ethical a lot of that would be.
8:24:41Elon MuskThat's beyond me, honestly. But I know that there's a lot that can be done when we're talking about the brain and being able to go in and physically make changes to help people or to improve their lives.
8:24:55Elon MuskSo I'm really looking forward to everything that comes from this, and I don't think it's all that far off. I think a lot of this can be implemented within my lifetime, assuming that I live a long life.
8:25:07Lex FridmanWhat you were referring to is things like people suffering from depression or things of that nature potentially getting help.
8:25:14Elon MuskYeah. Flip a switch, like that. Make someone happy. I know. I think Joe has talked about it more in terms of, like, you want to experience, like, what a drug trip feels like.
8:25:26Elon MuskLike, you want to experience what you like to be on.
8:25:29Lex FridmanOf Course.
8:25:29Elon MuskOh, yeah, Mushrooms or something like that. Dmt. Like you can just flip that switch in the brain. My buddy Bane has talked about being able to like, wipe parts of your memory and re experience things that, like, for the first time, like your favorite movie or your favorite book, like, just wipe that out real quick and then refall in love with Harry Potter or something.
8:25:49Elon MuskI told him. I was like, I don't know how I feel about, like, people being able to just wipe parts of your memory. That seems a little sketchy to me.
8:25:56Elon MuskHe's like, they're already doing it, so.
8:25:59Lex FridmanSounds legit. I would love memory replay, just like, actually, like high resolution replayable memories.
8:26:06Elon MuskYeah. I saw an episode of Black Mirror about that one, so I don't think I want it.
8:26:10Lex FridmanYeah. So Black Mirror always kind of considers the worst case, which is important. I think people don't consider the best case or the average case enough. I don't know what it is about us humans.
8:26:21Lex FridmanWe want to think about the worst possible thing. We love drama.
8:26:25Elon MuskYeah.
8:26:26Lex FridmanLike, how is this new technology going to kill everybody? We just love that. Like, yes. Let's watch.
8:26:32Elon MuskHopefully people don't think about that too much of me. It'll ruin a lot of my plans.
8:26:36Lex FridmanYeah, yeah. I assume you're going to have to take over the world. I mean, you're. I love your Twitter. You. You tweeted. I'd like to make jokes about hearing voices in my head since getting the neuralink, but I feel like people would take it the wrong way.
8:26:48Lex FridmanPlus, the voices in my head told me not to.
8:26:51Elon MuskYeah, yeah, yeah.
8:26:52Lex FridmanPlease never stop. So you're talking about Optimus. Is that something you would love to be able to do to control the robotic arm of the entirety of Optimus?
8:27:05Elon MuskOh, yeah, for sure, for sure. Absolutely.
8:27:07Lex FridmanYou think there's something, like, fundamentally different about just being able to physically interact with the world?
8:27:12Elon MuskYeah. Oh, 100%. This. I know. Another thing with being able to give people the ability to feel sensation and stuff too, by going in with the brain and having the neuralink maybe do that.
8:27:27Elon MuskThat could be something that could be translated through. Transferred through the optimist as well. Like, there's all sorts of really cool interplay between that. And then also, like you said, just physically interacting.
8:27:41Elon MuskI mean, 99% of the things that I can't do myself obviously need. I need a caretaker for someone to physically do things for me. If an Optimus robot could do that, like, I could live an incredibly independent life and not be such a burden on those around me.
8:28:02Elon MuskAnd that would. It would change the way people like me live, at least until whatever this is gets cured. But being able to interact with the world physically like, that would just be amazing.
8:28:18Elon MuskAnd they're not just, like, for being. For having to be a caretaker or something, but something like, I talked about just being able to read a book. Imagine, optimist, robot, just being able to hold a book open in front of me, like, get that smell again.
8:28:31Elon MuskI might not be able to feel it at that point, or maybe I could again with the sensation and stuff, but being. There's something different about reading, like, a physical book than staring at a screen or listening to an audiobook.
8:28:43Elon MuskI actually don't like audiobooks. I've listened to a ton of them at this point, but I don't really like them. I would much rather, like, read a physical copy.
8:28:51Lex FridmanSo one of the things you would love to be able to experience is opening the book, bringing it up to you.
8:28:59Elon MuskYeah.
8:28:59Lex FridmanAnd to feel the touch of the paper.
8:29:01Elon MuskYeah. Oh, man. The touch, the smell. I mean, it's just like. Just something about the words on the page and, you know, they've. They've replicated, you know, that page color on, like, the Kindle and stuff.
8:29:13Elon MuskYeah. It's just not the same. Yeah. So just something as simple as that.
8:29:18Lex FridmanSo one of the things you miss is touch?
8:29:20Elon MuskI do, Yeah. A lot of. A lot of things that I interact with in the world, like clothes or literally any physical thing that I interact with in the world.
8:29:30Elon MuskA lot of times what people around me will do is they'll just come, like, rub it on my face. They'll, like, lay something on me so I can feel the weight.
8:29:38Elon MuskThey will rub, you know, a shirt on me so I can feel fabric. Like, there's something very profound about touch. And it is. It's something that I miss a lot and something I would love to do again.
8:29:55Elon MuskWe'll see.
8:29:56Lex FridmanWhat would be the first thing you do with a. With a hand that can touch your mom? A hug after that, Right?
8:30:02Neuralink teamYeah.
8:30:02Elon MuskYeah, I know that's. It's one thing that I've. That I've asked, like, God, for basically every day since my accident, was just being able to, like, one day move, even if it was only, like, my hand.
8:30:17Elon MuskSo that way, like, I could squeeze my mom's hand or something, just to, like, show her that, you know, like, how much I care and how much I love her and everything.
8:30:25Elon MuskSomething along those lines. Being able to just interact with the people around me. Handshake, give someone a hug. I Don't know anything like that. Being able to help me eat.
8:30:37Elon MuskLike, I'd probably get really fat, which would be a terrible, terrible thing.
8:30:44Lex FridmanAlso be Bliss and chess on a physical chessboard.
8:30:47Elon MuskYeah. Yeah. I mean, there are just so many upsides, you know, any. Any way to find some way to feel like I'm bringing Bliss down to my level.
8:30:58Lex FridmanYeah.
8:30:58Elon MuskBecause, yeah, he's just such an amazing guy and everything about him is just so above and beyond that. Anything I can do to take him down a notch?
8:31:10Lex FridmanYeah. Humble him a bit. He needs it.
8:31:12Elon MuskYeah.
8:31:13Lex FridmanOkay. As he's sitting next to me, did you ever make sense of why God puts good people through such hardship?
8:31:23Elon MuskOh, man.
8:31:29Elon MuskI think it's all about understanding how much we need God. And I don't think that there's any light without the dark. I think that if all of us were happy all the time, there would be, you know, no reason to turn to God ever.
8:31:50Elon MuskI feel like there would be no concept of, you know, good or bad. And I think that as much of, like, the darkness and the evil that's in the world, it makes us all appreciate the good and the things we have so much more.
8:32:08Elon MuskAnd I think, you know, like, when I had my accident, the first. One of the first things I said to one of my best friends was, and this was within, like, the first month or two after my accident, I said, you know, everything about this accident has just made me understand and believe that, like, God is real and that there really is a God, basically.
8:32:27Elon MuskAnd that, like, my interactions with him have all been, you know, real and worthwhile. And he said, if anything, seeing me go through this accident, he believes that there isn't a God.
8:32:39Elon MuskAnd it's a very different reaction. But I believe that it is. It is a way for God to test us, to build our character, to send us through trials and tribulations, to make sure that we understand how precious, you know, he is and the things that he's given us and the time that he's given us and then to hopefully grow from all of that.
8:33:05Elon MuskI think that's a huge part of being here, is to not just, you know, have an easy life and do everything that's easy, but to step out of our comfort zones and really challenge ourselves and because I think that's how we grow.
8:33:21Lex FridmanWhat gives you hope about this whole thing we have going on? Human civilization?
8:33:26Elon MuskOh, man. I think people are my biggest inspiration. Even just being at Neuralink for a few months, looking people in the eyes and hearing their motivations for why they're doing this.
8:33:44Elon MuskIt's. It's so inspiring. And I know that they could be other places at cushier jobs, working somewhere else, doing X, Y or Z. That doesn't really mean that much.
8:33:58Elon MuskBut instead, they're here, and they want to better humanity, and they want to better just the people around them, the people that they've interacted with in their life. They want to make better lives for their own family members who might have disabilities, or they look at someone like me and they say, you know, I can do something about that.
8:34:16Elon MuskSo I'm going to. And it's always been what I've connected with most in the world are people. I've always been a people person. And I love learning about people, and I love learning how people developed and where they came from, and to see how much people are willing to do for someone like me when they don't have to.
8:34:36Elon MuskAnd they're going out of their way to make my life better. It gives me a lot of hope for just humanity in general, how much we care and how much we're capable of when we all kind of get together and try to make a difference.
8:34:50Elon MuskAnd I know there's a lot of bad out there in the world, but there always has been and there always will be. And I think that that is. It shows human resiliency and it shows what we're able to endure and how much.
8:35:11Elon MuskHow much we just want to be there and help each other and how much satisfaction we get from that. Because I think that's one of the reasons that we're here, is just to help each other.
8:35:21Elon MuskAnd I don't know that that always gives me hope, is just realizing that there are people out there who still care and who want to help.
8:35:31Lex FridmanAnd thank you for being one such human being and continuing to be a great human being through everything you've been through and being an inspiration to many people, to myself, for many reasons, including your epic, unbelievably great performance on Web Grid.
8:35:47Lex FridmanI will be training all night tonight to try to catch up.
8:35:51Elon MuskYou can do it.
8:35:52Lex FridmanAnd I believe in you, that you can. Once you come back. So sorry to interrupt with the Austin trip. Once you come back, eventually. Beat blood.
8:36:00Elon MuskYeah, yeah, for sure. Absolutely.
8:36:02Lex FridmanI'm rooting for you. The whole world is rooting for you. Thank you for everything you've done, man.
8:36:06Elon MuskThanks. Thanks, man.
8:36:08Lex FridmanThanks for listening to this conversation with Nolan Arbaugh and before that, with Elon Musk. DJ Saw, Matthew McDougal and Bliss Chapman. To support this podcast, please check out our sponsors in the Description.
8:36:21Lex FridmanAnd now let me leave you with some words from Aldous Huxley in the Doors of Perception. We live together, we act on and react to one another, but always and in all circumstances we are by ourselves.
8:36:38Lex FridmanThe martyrs go hand in hand into the arena. They are crucified, alone, embraced. The lovers desperately try to fuse their insulated ecstasies into a single self. Transcendence in vain but its very nature.
8:36:53Lex FridmanEvery embodied spirit is doomed to suffer and enjoy its solitude, sensations, feelings, insights, fancies. All these are private and except through symbols and at second hand, incommunicable. We can pull information about experiences, but never the experiences themselves.
8:37:14Lex FridmanFrom family to nation, every human group is a society of island universes. Thank you for listening and hope to see you next time.