10 years of AI reporting | 60 Minutes Marathon

Car accidents cost us much more than Car accidents cost us much more than time and money. They also take a time and money. They also take a time and money. They also take a staggering number of lives. Every year staggering number of lives. Every year staggering number of lives. Every year on American roads, nearly 33,000 people on American roads, nearly 33,000 people on American roads, nearly 33,000 people die, almost all because of driver error. die, almost all because of driver error. die, almost all because of driver error. That's the equivalent of a 747 full of That's the equivalent of a 747 full of That's the equivalent of a 747 full of passengers crashing once a week for a passengers crashing once a week for a passengers crashing once a week for a year. Self-driving cars could save more year. Self-driving cars could save more year. Self-driving cars could save more than twothirds of those lives. That's than twothirds of those lives. That's than twothirds of those lives. That's what the nation's top auto regulator what the nation's top auto regulator what the nation's top auto regulator told us. It's no wonder the biggest told us. It's no wonder the biggest told us. It's no wonder the biggest names in the auto industry and high-tech names in the auto industry and high-tech names in the auto industry and high-tech are racing to develop driverless cars are racing to develop driverless cars are racing to develop driverless cars powered by a form of artificial powered by a form of artificial powered by a form of artificial intelligence. Six years ago, Google intelligence. Six years ago, Google intelligence. Six years ago, Google rolled out a prototype that jumpstarted rolled out a prototype that jumpstarted rolled out a prototype that jumpstarted the competition. Today, Apple and Uber the competition. Today, Apple and Uber the competition. Today, Apple and Uber are experimenting, too. We wanted to see are experimenting, too. We wanted to see are experimenting, too. We wanted to see how far the technology has come. So, we how far the technology has come. So, we how far the technology has come. So, we hit the road in Silicon Valley, the new hit the road in Silicon Valley, the new hit the road in Silicon Valley, the new Detroit for self-driving cars. Detroit for self-driving cars. Detroit for self-driving cars. >> Now, what do you have to do to make the >> Now, what do you have to do to make the >> Now, what do you have to do to make the car take over? car take over? car take over? >> I just pulled this lever and now >> I just pulled this lever and now >> I just pulled this lever and now >> system is active.

>> system is active. >> system is active. >> Computer scientist Ralph Herwick runs >> Computer scientist Ralph Herwick runs >> Computer scientist Ralph Herwick runs autonomous vehicle research for autonomous vehicle research for autonomous vehicle research for Mercedes-Benz. Mercedes-Benz. Mercedes-Benz. He punched in a route and took us for a He punched in a route and took us for a He punched in a route and took us for a 20-mile drive on city streets and 20-mile drive on city streets and 20-mile drive on city streets and highways in this S500, the company's highways in this S500, the company's highways in this S500, the company's most advanced self-driving prototype. most advanced self-driving prototype. most advanced self-driving prototype. >> So, this is like no hands, no feet. Car >> So, this is like no hands, no feet. Car >> So, this is like no hands, no feet. Car is in charge. is in charge. is in charge. >> Yeah, the car is in charge. >> Yeah, the car is in charge. >> Yeah, the car is in charge. >> Right from the start, the car astonished >> Right from the start, the car astonished >> Right from the start, the car astonished us. As we approached our first us. As we approached our first us. As we approached our first intersection, it slowed down and steered intersection, it slowed down and steered intersection, it slowed down and steered itself into the left turn lane. itself into the left turn lane. itself into the left turn lane. >> Traffic light ahead shows green. It's a >> Traffic light ahead shows green. It's a >> Traffic light ahead shows green. It's a German car, so naturally it has a German German car, so naturally it has a German German car, so naturally it has a German accent. That was the voice of Herwick's accent. That was the voice of Herwick's accent. That was the voice of Herwick's secretary. secretary. secretary. >> So, it just took off by itself when the >> So, it just took off by itself when the >> So, it just took off by itself when the light turned green, and now it's making light turned green, and now it's making light turned green, and now it's making this left turn by itself with other this left turn by itself with other this left turn by itself with other traffic around. traffic around. traffic around. This is absolutely amazing. This is absolutely amazing. This is absolutely amazing. >> Just 2 minutes into the ride, we entered >> Just 2 minutes into the ride, we entered >> Just 2 minutes into the ride, we entered a freeway on-ramp. If you think a normal a freeway on-ramp. If you think a normal a freeway on-ramp. If you think a normal merge is nerve-wracking, try it with a merge is nerve-wracking, try it with a merge is nerve-wracking, try it with a driver who's talking with his hands. I driver who's talking with his hands. I driver who's talking with his hands. I must admit, I find it a little must admit, I find it a little must admit, I find it a little disconcerting that we're driving toward disconcerting that we're driving toward disconcerting that we're driving toward the freeway and you don't have your the freeway and you don't have your the freeway and you don't have your hands on the wheel.

hands on the wheel. hands on the wheel. >> Shall I put them back on? Would that >> Shall I put them back on? Would that >> Shall I put them back on? Would that make you feel more comfortable? make you feel more comfortable? make you feel more comfortable? >> Herdwick gave us a rare opportunity to >> Herdwick gave us a rare opportunity to >> Herdwick gave us a rare opportunity to go on an actual test run near Mercedes go on an actual test run near Mercedes go on an actual test run near Mercedes Silicon Valley Lab. Almost every major Silicon Valley Lab. Almost every major Silicon Valley Lab. Almost every major automaker is working on the technology automaker is working on the technology automaker is working on the technology here. Nissan has teamed up with NASA. here. Nissan has teamed up with NASA. here. Nissan has teamed up with NASA. Auto parts maker Deli put its system in Auto parts maker Deli put its system in Auto parts maker Deli put its system in this Audi. It was the first to drive this Audi. It was the first to drive this Audi. It was the first to drive itself across the country. Back at that itself across the country. Back at that itself across the country. Back at that merge, don't hold your breath for the merge, don't hold your breath for the merge, don't hold your breath for the car to step on it. This S500 won't break car to step on it. This S500 won't break car to step on it. This S500 won't break the speed limit. Are you going to have the speed limit. Are you going to have the speed limit. Are you going to have little old ladies driving up behind you, little old ladies driving up behind you, little old ladies driving up behind you, beeping the horn to get going, get beeping the horn to get going, get beeping the horn to get going, get moving? moving? moving? >> Some people have remarked that the car >> Some people have remarked that the car >> Some people have remarked that the car itself, in some cases, drives a bit like itself, in some cases, drives a bit like itself, in some cases, drives a bit like an old lady. That's that's fine with us an old lady. That's that's fine with us an old lady. That's that's fine with us for the time being, for the time being, for the time being, >> especially since the car has driven >> especially since the car has driven >> especially since the car has driven about 20,000 mi without an accident. about 20,000 mi without an accident. about 20,000 mi without an accident. Mercedes made its name selling the Mercedes made its name selling the Mercedes made its name selling the passion for driving on the open road. passion for driving on the open road. passion for driving on the open road. Now it sees a future in the growing Now it sees a future in the growing Now it sees a future in the growing desire to be driven through traffic desire to be driven through traffic desire to be driven through traffic jammed streets. What's fueling this?

jammed streets. What's fueling this? jammed streets. What's fueling this? >> People are increasingly asking for this. >> People are increasingly asking for this. >> People are increasingly asking for this. People probably have become used to live People probably have become used to live People probably have become used to live more with computers and interact with more with computers and interact with more with computers and interact with computers and they feel more comfortable computers and they feel more comfortable computers and they feel more comfortable doing this. And so all of a sudden we doing this. And so all of a sudden we doing this. And so all of a sudden we see this interest and hey there are see this interest and hey there are see this interest and hey there are certain situations where I don't want to certain situations where I don't want to certain situations where I don't want to drive. Can your car do it for me? drive. Can your car do it for me? drive. Can your car do it for me? >> First you're amazed. Then you begin to >> First you're amazed. Then you begin to >> First you're amazed. Then you begin to relax. Surprisingly it took less than 10 relax. Surprisingly it took less than 10 relax. Surprisingly it took less than 10 minutes to feel comfortable with the car minutes to feel comfortable with the car minutes to feel comfortable with the car in control. in control. in control. >> This is amazing. >> This is amazing. >> This is amazing. >> But don't get too comfortable. >> But don't get too comfortable. >> But don't get too comfortable. >> That's not good. >> That's not good. >> That's not good. >> Those beeps, that's not a sound you want >> Those beeps, that's not a sound you want >> Those beeps, that's not a sound you want to hear. It means the car senses trouble to hear. It means the car senses trouble to hear. It means the car senses trouble and needs a helping human hand. and needs a helping human hand. and needs a helping human hand. >> Now the vehicle asked me to take over >> Now the vehicle asked me to take over >> Now the vehicle asked me to take over >> at this intersection. That silver car >> at this intersection. That silver car >> at this intersection. That silver car got too close. got too close. got too close. >> This is for example I rather took over. >> This is for example I rather took over. >> This is for example I rather took over. It would have managed but I really was It would have managed but I really was It would have managed but I really was this was this was this was >> that guy was getting into our lane >> that guy was getting into our lane >> that guy was getting into our lane there. there. there. >> Yeah. >> Yeah. >> Yeah. >> It only happened a few times while we >> It only happened a few times while we >> It only happened a few times while we were driving around. Herwick says were driving around. Herwick says were driving around. Herwick says teaching the car to handle encounters teaching the car to handle encounters teaching the car to handle encounters like that silver car on chaotic city like that silver car on chaotic city like that silver car on chaotic city streets with impulsive human drivers streets with impulsive human drivers streets with impulsive human drivers will keep his engineers busy for the will keep his engineers busy for the will keep his engineers busy for the next decade.

next decade. next decade. >> I'm not an engineer, but how how do you >> I'm not an engineer, but how how do you >> I'm not an engineer, but how how do you figure things like that out? figure things like that out? figure things like that out? >> The important thing about an autonomous >> The important thing about an autonomous >> The important thing about an autonomous vehicle is it has to have a very good vehicle is it has to have a very good vehicle is it has to have a very good sense of its environment. A vehicle sense of its environment. A vehicle sense of its environment. A vehicle cannot react to something it does not cannot react to something it does not cannot react to something it does not see. So we have to be very careful that see. So we have to be very careful that see. So we have to be very careful that we see everything that happens around we see everything that happens around we see everything that happens around us. The car sees with an array of us. The car sees with an array of us. The car sees with an array of cameras and radar sensors designed into cameras and radar sensors designed into cameras and radar sensors designed into the body, constantly scanning up to 600 the body, constantly scanning up to 600 the body, constantly scanning up to 600 ft in all directions. ft in all directions. ft in all directions. >> We can actually detect more quickly that >> We can actually detect more quickly that >> We can actually detect more quickly that something is happening uh that may cause something is happening uh that may cause something is happening uh that may cause an accident than the human driver can. an accident than the human driver can. an accident than the human driver can. >> So these cars would actually be safer, >> So these cars would actually be safer, >> So these cars would actually be safer, you're saying, than a human driver. you're saying, than a human driver. you're saying, than a human driver. >> That's what we aim for. That's what >> That's what we aim for. That's what >> That's what we aim for. That's what Google is driving for, too. Its Google is driving for, too. Its Google is driving for, too. Its autonomous cars rely on roof mounted autonomous cars rely on roof mounted autonomous cars rely on roof mounted laser sensors to see the road. In the laser sensors to see the road. In the laser sensors to see the road. In the last 6 years, its fleet has driven more last 6 years, its fleet has driven more last 6 years, its fleet has driven more than a million miles. than a million miles. than a million miles. >> We're getting to a place where we're >> We're getting to a place where we're >> We're getting to a place where we're comparable to human driving today.

comparable to human driving today. comparable to human driving today. >> Robotics scientist Chris Mson is the >> Robotics scientist Chris Mson is the >> Robotics scientist Chris Mson is the director of Google's self-driving car director of Google's self-driving car director of Google's self-driving car project. He invited us inside his project. He invited us inside his project. He invited us inside his Silicon Valley garage, where the Silicon Valley garage, where the Silicon Valley garage, where the autonomous future is taking shape. autonomous future is taking shape. autonomous future is taking shape. Google's a tech company, not a car Google's a tech company, not a car Google's a tech company, not a car maker. maker. maker. >> Absolutely. But the heart of what makes >> Absolutely. But the heart of what makes >> Absolutely. But the heart of what makes a technology work is the algorithms and a technology work is the algorithms and a technology work is the algorithms and the software. And that's one of the the software. And that's one of the the software. And that's one of the things that we are really quite good at. things that we are really quite good at. things that we are really quite good at. >> There there are so many variables, so >> There there are so many variables, so >> There there are so many variables, so many different scenarios. How is it many different scenarios. How is it many different scenarios. How is it possible to put all of that knowledge possible to put all of that knowledge possible to put all of that knowledge into a car? And into a car? And into a car? And >> and that's really the the trick, right? >> and that's really the the trick, right? >> and that's really the the trick, right? And that's what makes this hard is be And that's what makes this hard is be And that's what makes this hard is be you can't just kind of go through and you can't just kind of go through and you can't just kind of go through and enumerate, you know, the the thousand enumerate, you know, the the thousand enumerate, you know, the the thousand different scenarios that might encounter different scenarios that might encounter different scenarios that might encounter because it's not a thousand. there's a because it's not a thousand. there's a because it's not a thousand. there's a there's an infinite number of them, there's an infinite number of them, there's an infinite number of them, right? And so the the trick is to right? And so the the trick is to right? And so the the trick is to develop these algorithms that can develop these algorithms that can develop these algorithms that can generalize. generalize. generalize. >> By generalize, he means think. And this >> By generalize, he means think. And this >> By generalize, he means think. And this is how it works. The algorithms are is how it works. The algorithms are is how it works. The algorithms are trained to recognize other cars, trained to recognize other cars, trained to recognize other cars, pedestrians, cyclists, and animals from pedestrians, cyclists, and animals from pedestrians, cyclists, and animals from their movements, size, and shape. Each their movements, size, and shape. Each their movements, size, and shape. Each car's daily driving experience is car's daily driving experience is car's daily driving experience is analyzed, uploaded, and shared. The cars analyzed, uploaded, and shared. The cars analyzed, uploaded, and shared. The cars can then make predictions and choices can then make predictions and choices can then make predictions and choices based on the collective knowledge of the based on the collective knowledge of the based on the collective knowledge of the fleet.

fleet. fleet. >> Look in the lower left corner as one of >> Look in the lower left corner as one of >> Look in the lower left corner as one of Mson's cars encounters a pickup truck Mson's cars encounters a pickup truck Mson's cars encounters a pickup truck that stops to parallel park. that stops to parallel park. that stops to parallel park. >> Now, how does the computer know that >> Now, how does the computer know that >> Now, how does the computer know that it's someone intending to back into a it's someone intending to back into a it's someone intending to back into a parking space and not someone who's just parking space and not someone who's just parking space and not someone who's just stopped in the street? Our cars have stopped in the street? Our cars have stopped in the street? Our cars have seen thousands and thousands of vehicles seen thousands and thousands of vehicles seen thousands and thousands of vehicles and they get a feeling, you know, they and they get a feeling, you know, they and they get a feeling, you know, they get a feeling really for for what the get a feeling really for for what the get a feeling really for for what the behavior of those vehicles are going to behavior of those vehicles are going to behavior of those vehicles are going to be really. So, it's seen lots of cars be really. So, it's seen lots of cars be really. So, it's seen lots of cars backing up and so it understands if backing up and so it understands if backing up and so it understands if there's a space here and a car stops there's a space here and a car stops there's a space here and a car stops just in front of it, that means it's just in front of it, that means it's just in front of it, that means it's going to probably back into that spot. going to probably back into that spot. going to probably back into that spot. >> My smartphone has computer glitches. My >> My smartphone has computer glitches. My >> My smartphone has computer glitches. My computer has glitches. computer has glitches. computer has glitches. How do you get people to trust that this How do you get people to trust that this How do you get people to trust that this computer on wheels is not going to have computer on wheels is not going to have computer on wheels is not going to have a a glitch? a a glitch? a a glitch? >> We're all used to our our bits of home >> We're all used to our our bits of home >> We're all used to our our bits of home computing doing funny things, right? And computing doing funny things, right? And computing doing funny things, right? And what you have to remember is they're what you have to remember is they're what you have to remember is they're they're engineered and designed very they're engineered and designed very they're engineered and designed very differently. The way we develop the differently. The way we develop the differently. The way we develop the software, the way we develop the software, the way we develop the software, the way we develop the hardware, you know, the way we think hardware, you know, the way we think hardware, you know, the way we think about redundancy, the way we think about about redundancy, the way we think about about redundancy, the way we think about the situations it has to has to deal the situations it has to has to deal the situations it has to has to deal with on the road is completely with on the road is completely with on the road is completely different.

different. different. >> Right now, the technology can't handle >> Right now, the technology can't handle >> Right now, the technology can't handle snow. Google's cars can't operate in snow. Google's cars can't operate in snow. Google's cars can't operate in heavy rain. The Mercedes S500 can't heavy rain. The Mercedes S500 can't heavy rain. The Mercedes S500 can't decipher hand gestures from traffic cops decipher hand gestures from traffic cops decipher hand gestures from traffic cops or pedestrians. 4 million miles of roads or pedestrians. 4 million miles of roads or pedestrians. 4 million miles of roads in the US must be mapped in ultra in the US must be mapped in ultra in the US must be mapped in ultra highdefinition detail. The automakers highdefinition detail. The automakers highdefinition detail. The automakers call these solvable problems. In the call these solvable problems. In the call these solvable problems. In the meantime, the car industry plans to meantime, the car industry plans to meantime, the car industry plans to automate the driving experience feature automate the driving experience feature automate the driving experience feature by feature. What some are calling by feature. What some are calling by feature. What some are calling revolution by evolution. revolution by evolution. revolution by evolution. >> Infiniti QX60. The revolution is already >> Infiniti QX60. The revolution is already >> Infiniti QX60. The revolution is already being televised in ads being televised in ads being televised in ads >> like >> like >> like >> backup collision intervention which can >> backup collision intervention which can >> backup collision intervention which can break break break even before you do. even before you do. even before you do. In showrooms today, you can buy features In showrooms today, you can buy features In showrooms today, you can buy features to automatically keep you in your lane, to automatically keep you in your lane, to automatically keep you in your lane, help you park, drive you in stopand go help you park, drive you in stopand go help you park, drive you in stopand go traffic, and coming soon, hands-free traffic, and coming soon, hands-free traffic, and coming soon, hands-free highway driving. Tesla is making it highway driving. Tesla is making it highway driving. Tesla is making it available this month. GM plans to offer available this month. GM plans to offer available this month. GM plans to offer it in a 2017 Cadillac. We are at it in a 2017 Cadillac. We are at it in a 2017 Cadillac. We are at probably the largest transformative probably the largest transformative probably the largest transformative moment in the history of the automobile.

moment in the history of the automobile. moment in the history of the automobile. >> Mark Rosekind is head of the National >> Mark Rosekind is head of the National >> Mark Rosekind is head of the National Highway Traffic Safety Administration. Highway Traffic Safety Administration. Highway Traffic Safety Administration. He is optimistic but also realistic He is optimistic but also realistic He is optimistic but also realistic about this new technology. about this new technology. about this new technology. >> This is really different than just >> This is really different than just >> This is really different than just thinking about the engine parts and the thinking about the engine parts and the thinking about the engine parts and the tires. Um, now we're talking about cars tires. Um, now we're talking about cars tires. Um, now we're talking about cars are computers. So issues related to are computers. So issues related to are computers. So issues related to cyber security and privacy are just as cyber security and privacy are just as cyber security and privacy are just as big an issue as the defect in the big an issue as the defect in the big an issue as the defect in the manufacturing process. Someone can hack manufacturing process. Someone can hack manufacturing process. Someone can hack your computer and steal your money, but your computer and steal your money, but your computer and steal your money, but someone can hack your car and you can someone can hack your car and you can someone can hack your car and you can die. People have to trust these vehicles die. People have to trust these vehicles die. People have to trust these vehicles if they read or suspect in any way that if they read or suspect in any way that if they read or suspect in any way that they they literally could be one virus they they literally could be one virus they they literally could be one virus away from a crash occurring. They're not away from a crash occurring. They're not away from a crash occurring. They're not going to get in that car. They're not going to get in that car. They're not going to get in that car. They're not going to buy it. They're not going to going to buy it. They're not going to going to buy it. They're not going to let it drive them. Uh that whole future let it drive them. Uh that whole future let it drive them. Uh that whole future evaporates. Rosekind also worries about evaporates. Rosekind also worries about evaporates. Rosekind also worries about a future in which drivers place too much a future in which drivers place too much a future in which drivers place too much trust in the cars. trust in the cars. trust in the cars. >> Think about how some of this is being >> Think about how some of this is being >> Think about how some of this is being sold. Oh, you can take a nap. You can sold. Oh, you can take a nap. You can sold. Oh, you can take a nap. You can read the paper. What would you do if you read the paper. What would you do if you read the paper. What would you do if you had to take over in a certain emergency had to take over in a certain emergency had to take over in a certain emergency situation? Nobody has that future situation? Nobody has that future situation? Nobody has that future totally nailed yet. Mercedes and other totally nailed yet. Mercedes and other totally nailed yet. Mercedes and other major car makers say humans will always major car makers say humans will always major car makers say humans will always have a role in driving, but Chris Mson have a role in driving, but Chris Mson have a role in driving, but Chris Mson of Google says it's dangerous to require of Google says it's dangerous to require of Google says it's dangerous to require humans to snap to attention and take humans to snap to attention and take humans to snap to attention and take control at a moment's notice.

control at a moment's notice. control at a moment's notice. So, the company stopped developing cars So, the company stopped developing cars So, the company stopped developing cars that put humans on call. Now, it's that put humans on call. Now, it's that put humans on call. Now, it's testing 25 fully autonomous electric testing 25 fully autonomous electric testing 25 fully autonomous electric prototypes customuilt for the job. So, I prototypes customuilt for the job. So, I prototypes customuilt for the job. So, I would punch in where I wanted to go and would punch in where I wanted to go and would punch in where I wanted to go and it would just take off and go there. it would just take off and go there. it would just take off and go there. >> And at takeoff, uh, you press the little >> And at takeoff, uh, you press the little >> And at takeoff, uh, you press the little go button under here, pull away from the go button under here, pull away from the go button under here, pull away from the curb, take you where you wanted. curb, take you where you wanted. curb, take you where you wanted. >> For safety, the cars max out at 25 mph. >> For safety, the cars max out at 25 mph. >> For safety, the cars max out at 25 mph. They don't need steering wheels or They don't need steering wheels or They don't need steering wheels or pedals, but they have them to comply pedals, but they have them to comply pedals, but they have them to comply with current California law. with current California law. with current California law. >> The goal of this is to improve the >> The goal of this is to improve the >> The goal of this is to improve the remote assistance link. remote assistance link. remote assistance link. >> Jamie Wayo oversees the engineering. She >> Jamie Wayo oversees the engineering. She >> Jamie Wayo oversees the engineering. She used to work at NASA on autonomous used to work at NASA on autonomous used to work at NASA on autonomous vehicles of a different sort, the Mars vehicles of a different sort, the Mars vehicles of a different sort, the Mars rovers. rovers. rovers. >> Doing self-driving cars here on Earth is >> Doing self-driving cars here on Earth is >> Doing self-driving cars here on Earth is actually more challenging in a lot of actually more challenging in a lot of actually more challenging in a lot of ways. ways. ways. >> More difficult than driving across the >> More difficult than driving across the >> More difficult than driving across the surface of Mars, surface of Mars, surface of Mars, >> I think. So, humans are so >> I think. So, humans are so >> I think. So, humans are so unpredictable. Um, and so having to try unpredictable. Um, and so having to try unpredictable. Um, and so having to try to have a car who can outpredict a an to have a car who can outpredict a an to have a car who can outpredict a an unpredictable human is amazing and unpredictable human is amazing and unpredictable human is amazing and really really hard. Google's cars have really really hard. Google's cars have really really hard. Google's cars have been in nine minor accidents in been in nine minor accidents in been in nine minor accidents in self-driving mode. All the company says self-driving mode. All the company says self-driving mode. All the company says the fault of humans driving in the other the fault of humans driving in the other the fault of humans driving in the other cars. Google and Mercedes told us if cars. Google and Mercedes told us if cars. Google and Mercedes told us if their technology is at fault once it their technology is at fault once it their technology is at fault once it becomes commercially available, they'll becomes commercially available, they'll becomes commercially available, they'll accept responsibility and liability. But accept responsibility and liability. But accept responsibility and liability. But all involved expect fewer crashes as the all involved expect fewer crashes as the all involved expect fewer crashes as the technology evolves. For now, it's technology evolves. For now, it's technology evolves. For now, it's accelerating to the near future and

accelerating to the near future and accelerating to the near future and beyond. This is Mercedes vision for the beyond. This is Mercedes vision for the beyond. This is Mercedes vision for the year 2030, the FO15. year 2030, the FO15. year 2030, the FO15. >> So, we have a app. >> So, we have a app. >> So, we have a app. >> You can summon it with your phone. >> You can summon it with your phone. >> You can summon it with your phone. >> The car will start and come to you. >> The car will start and come to you. >> The car will start and come to you. >> German engineer Peter Leman took us for >> German engineer Peter Leman took us for >> German engineer Peter Leman took us for a test drive at an old naval base on San a test drive at an old naval base on San a test drive at an old naval base on San Francisco Bay. The car's radical design Francisco Bay. The car's radical design Francisco Bay. The car's radical design was shaped by expectations of life in was shaped by expectations of life in was shaped by expectations of life in the future. the future. the future. >> You turn your back to the to the >> You turn your back to the to the >> You turn your back to the to the steering wheel. Mercedes is planning for steering wheel. Mercedes is planning for steering wheel. Mercedes is planning for overcrowded cities, perpetual gridlock, overcrowded cities, perpetual gridlock, overcrowded cities, perpetual gridlock, and an autonomous car to drive the and an autonomous car to drive the and an autonomous car to drive the stress away. stress away. stress away. >> Now you can relax or you can uh look a >> Now you can relax or you can uh look a >> Now you can relax or you can uh look a movie. So you have really gained time. movie. So you have really gained time. movie. So you have really gained time. >> I I I feel like I'm driving into the >> I I I feel like I'm driving into the >> I I I feel like I'm driving into the future right now. future right now. future right now. >> Yes. >> Yes. >> Yes. >> A future Google's Chris Mson says is >> A future Google's Chris Mson says is >> A future Google's Chris Mson says is coming and coming fast. So, how long coming and coming fast. So, how long coming and coming fast. So, how long before that day? before that day? before that day? >> So, I talk about this is I have I have >> So, I talk about this is I have I have >> So, I talk about this is I have I have two children, uh, 11 and nine-year-old, two children, uh, 11 and nine-year-old, two children, uh, 11 and nine-year-old, and the 11-year-old is going to be able and the 11-year-old is going to be able and the 11-year-old is going to be able to get a driver's license in about four to get a driver's license in about four to get a driver's license in about four and a half years. And my mission is to and a half years. And my mission is to and a half years. And my mission is to make sure that doesn't happen.

make sure that doesn't happen. make sure that doesn't happen. >> You want him to have a driverless car. >> You want him to have a driverless car. >> You want him to have a driverless car. >> I want him to have a driverless car. Despite what you hear about artificial Despite what you hear about artificial intelligence, machines still can't think intelligence, machines still can't think intelligence, machines still can't think like a human. But in the last few years, like a human. But in the last few years, like a human. But in the last few years, they have become capable of learning. they have become capable of learning. they have become capable of learning. And suddenly, our devices have opened And suddenly, our devices have opened And suddenly, our devices have opened their eyes and ears, and cars have taken their eyes and ears, and cars have taken their eyes and ears, and cars have taken the wheel. Today, artificial the wheel. Today, artificial the wheel. Today, artificial intelligence is not as good as you hope intelligence is not as good as you hope intelligence is not as good as you hope and not as bad as you fear. But humanity and not as bad as you fear. But humanity and not as bad as you fear. But humanity is accelerating into a future that few is accelerating into a future that few is accelerating into a future that few can predict. That's why so many people can predict. That's why so many people can predict. That's why so many people are desperate to meet Kyu Lee, the are desperate to meet Kyu Lee, the are desperate to meet Kyu Lee, the Oracle of AI. >> Kyu Lee is in there somewhere in a >> Kyu Lee is in there somewhere in a selfie scrum at a Beijing internet selfie scrum at a Beijing internet selfie scrum at a Beijing internet conference. conference. conference. >> His 50 million social media followers >> His 50 million social media followers >> His 50 million social media followers want to be seen in the same frame want to be seen in the same frame want to be seen in the same frame >> because of his talent for engineering >> because of his talent for engineering >> because of his talent for engineering and genius for wealth. I wonder, do you and genius for wealth. I wonder, do you and genius for wealth. I wonder, do you think people around the world have any think people around the world have any think people around the world have any idea what's coming in artificial idea what's coming in artificial idea what's coming in artificial intelligence?

intelligence? intelligence? >> I think most people have no idea and >> I think most people have no idea and >> I think most people have no idea and many people have the wrong idea. many people have the wrong idea. many people have the wrong idea. >> But you do believe it's going to change >> But you do believe it's going to change >> But you do believe it's going to change the world. the world. the world. >> I believe it's going to change the world >> I believe it's going to change the world >> I believe it's going to change the world more than anything in the history of more than anything in the history of more than anything in the history of mankind, more than electricity. mankind, more than electricity. mankind, more than electricity. >> Lee believes the best place to be an AI >> Lee believes the best place to be an AI >> Lee believes the best place to be an AI capitalist is communist China. His capitalist is communist China. His capitalist is communist China. His Beijing venture capital firm Beijing venture capital firm Beijing venture capital firm manufactures billionaires. manufactures billionaires. manufactures billionaires. >> These are the entrepreneurs that we >> These are the entrepreneurs that we >> These are the entrepreneurs that we funded. funded. funded. >> He's funded 140 AI startups. >> He's funded 140 AI startups. >> He's funded 140 AI startups. >> We have about 10 billion companies here. >> We have about 10 billion companies here. >> We have about 10 billion companies here. >> 101 $1 billion companies that you >> 101 $1 billion companies that you >> 101 $1 billion companies that you funded? funded? funded? >> Yes. Including a few10 billion >> Yes. Including a few10 billion >> Yes. Including a few10 billion companies. companies. companies. >> In 2017, China attracted half of all AI >> In 2017, China attracted half of all AI >> In 2017, China attracted half of all AI capital in the world. One of Lee's capital in the world. One of Lee's capital in the world. One of Lee's investments is Face Plus+. not investments is Face Plus+. not investments is Face Plus+. not affiliated with Facebook. Its visual affiliated with Facebook. Its visual affiliated with Facebook. Its visual recognition system smothered me to guess recognition system smothered me to guess recognition system smothered me to guess my age. It settled on 61, which was my age. It settled on 61, which was my age. It settled on 61, which was wrong. I wouldn't be 61 for days.

wrong. I wouldn't be 61 for days. wrong. I wouldn't be 61 for days. On the street, Face++ nailed everything On the street, Face++ nailed everything On the street, Face++ nailed everything that moved. It's a kind of artificial that moved. It's a kind of artificial that moved. It's a kind of artificial intelligence that has been made possible intelligence that has been made possible intelligence that has been made possible by three innovations. by three innovations. by three innovations. Super fast computer chips. All the Super fast computer chips. All the Super fast computer chips. All the world's data now available online and a world's data now available online and a world's data now available online and a revolution in programming called deep revolution in programming called deep revolution in programming called deep learning. Computers used to be given learning. Computers used to be given learning. Computers used to be given rigid instructions. Now they're rigid instructions. Now they're rigid instructions. Now they're programmed to learn on their own. In the programmed to learn on their own. In the programmed to learn on their own. In the early days of AI, people tried to early days of AI, people tried to early days of AI, people tried to program the AI with how people think. So program the AI with how people think. So program the AI with how people think. So I would write a program to say u measure I would write a program to say u measure I would write a program to say u measure the size of the eyes and their distance. the size of the eyes and their distance. the size of the eyes and their distance. measure the size of the nose, measure measure the size of the nose, measure measure the size of the nose, measure the shape of the face, and then if these the shape of the face, and then if these the shape of the face, and then if these things match, then this is Larry and things match, then this is Larry and things match, then this is Larry and that's John. But today, you just take that's John. But today, you just take that's John. But today, you just take all the pictures of Larry and John and all the pictures of Larry and John and all the pictures of Larry and John and you tell the system, "Go at it." You you tell the system, "Go at it." You you tell the system, "Go at it." You figure out what separates Larry from figure out what separates Larry from figure out what separates Larry from John. John. John. >> Let's say you want the computer to be >> Let's say you want the computer to be >> Let's say you want the computer to be able to pick men out of a crowd and able to pick men out of a crowd and able to pick men out of a crowd and describe their clothing. Well, you describe their clothing. Well, you describe their clothing. Well, you simply show the computer 10 million simply show the computer 10 million simply show the computer 10 million pictures of men in various kinds of pictures of men in various kinds of pictures of men in various kinds of dress. That's what they mean by deep dress. That's what they mean by deep dress. That's what they mean by deep learning. It's not intelligence so much.

learning. It's not intelligence so much. learning. It's not intelligence so much. It's just the brute force of data having It's just the brute force of data having It's just the brute force of data having 10 million examples to choose from. So, 10 million examples to choose from. So, 10 million examples to choose from. So, Face++ tagged me as male. Short hair, Face++ tagged me as male. Short hair, Face++ tagged me as male. Short hair, black long sleeves, black long pants. black long sleeves, black long pants. black long sleeves, black long pants. It's wrong about my gray suit. And this It's wrong about my gray suit. And this It's wrong about my gray suit. And this is exactly how it learns. When engineers is exactly how it learns. When engineers is exactly how it learns. When engineers discover that error, they'll show the discover that error, they'll show the discover that error, they'll show the computer a million gray suits. And it computer a million gray suits. And it computer a million gray suits. And it won't make that mistake again. won't make that mistake again. won't make that mistake again. >> Over a thousand classrooms. >> Over a thousand classrooms. >> Over a thousand classrooms. >> Another recognition system we saw or saw >> Another recognition system we saw or saw >> Another recognition system we saw or saw us is learning not just who you are, us is learning not just who you are, us is learning not just who you are, >> but how you feel. >> but how you feel. >> but how you feel. >> Now, what are all the dots on the >> Now, what are all the dots on the >> Now, what are all the dots on the screen? The dots over our eyes and our screen? The dots over our eyes and our screen? The dots over our eyes and our mouths. mouths. mouths. The computer keeps track all the feature The computer keeps track all the feature The computer keeps track all the feature points on the face. points on the face. points on the face. >> Son Fan Yang developed this for TA >> Son Fan Yang developed this for TA >> Son Fan Yang developed this for TA Education Group, which tutors 5 million Education Group, which tutors 5 million Education Group, which tutors 5 million Chinese students. Chinese students. Chinese students. >> Let's look at what we're seeing here. >> Let's look at what we're seeing here. >> Let's look at what we're seeing here. Now, according to the computer, I'm Now, according to the computer, I'm Now, according to the computer, I'm confused, which is generally the case.

confused, which is generally the case. confused, which is generally the case. But when I laughed, I was happy. But when I laughed, I was happy. But when I laughed, I was happy. >> Exactly. >> Exactly. >> Exactly. >> That's amazing. The machine notices >> That's amazing. The machine notices >> That's amazing. The machine notices concentration or distraction to pick out concentration or distraction to pick out concentration or distraction to pick out for the teacher those students who are for the teacher those students who are for the teacher those students who are struggling or gifted. struggling or gifted. struggling or gifted. >> It can tell when the child is excited >> It can tell when the child is excited >> It can tell when the child is excited about math. about math. about math. >> Yes. >> Yes. >> Yes. >> Or the other child is excited about >> Or the other child is excited about >> Or the other child is excited about poetry. poetry. poetry. >> Yes. >> Yes. >> Yes. >> Could these AI systems pick out geniuses >> Could these AI systems pick out geniuses >> Could these AI systems pick out geniuses from the countryside? from the countryside? from the countryside? >> That's possible in the future. >> That's possible in the future. >> That's possible in the future. It can also create a student profile and It can also create a student profile and It can also create a student profile and know where the student got stuck so the know where the student got stuck so the know where the student got stuck so the teacher can personalize the areas in teacher can personalize the areas in teacher can personalize the areas in which the student needs help. which the student needs help. which the student needs help. >> If you do raise up your hand, >> If you do raise up your hand, >> If you do raise up your hand, >> we found Kyu Lee's personal passion in >> we found Kyu Lee's personal passion in >> we found Kyu Lee's personal passion in this spare Beijing studio. He's this spare Beijing studio. He's this spare Beijing studio. He's projecting top teachers into China's projecting top teachers into China's projecting top teachers into China's poorest schools. This English teacher is poorest schools. This English teacher is poorest schools. This English teacher is connected to a class 1,000 miles away in connected to a class 1,000 miles away in connected to a class 1,000 miles away in a village called Defang.

>> Many students in Defang are called >> Many students in Defang are called leftbehinds leftbehinds leftbehinds because their parents left them with because their parents left them with because their parents left them with family when they moved to the cities for family when they moved to the cities for family when they moved to the cities for work. work. work. Most leftbehinds don't get past 9th Most leftbehinds don't get past 9th Most leftbehinds don't get past 9th grade. grade. grade. >> Topic we are going to learn today. Lee >> Topic we are going to learn today. Lee >> Topic we are going to learn today. Lee is counting on AI to deliver for them is counting on AI to deliver for them is counting on AI to deliver for them the same opportunity he had when he the same opportunity he had when he the same opportunity he had when he immigrated to the US from Taiwan as a immigrated to the US from Taiwan as a immigrated to the US from Taiwan as a boy. boy. boy. >> When I arrived in Tennessee, my >> When I arrived in Tennessee, my >> When I arrived in Tennessee, my principal took every lunch to teach me principal took every lunch to teach me principal took every lunch to teach me English. And that is the kind of English. And that is the kind of English. And that is the kind of attention that I've not been used to attention that I've not been used to attention that I've not been used to growing up in Asia. And I felt that the growing up in Asia. And I felt that the growing up in Asia. And I felt that the American classrooms are smaller, American classrooms are smaller, American classrooms are smaller, encouraged individual thinking, critical encouraged individual thinking, critical encouraged individual thinking, critical thinking, and I felt uh it was the best thinking, and I felt uh it was the best thinking, and I felt uh it was the best thing that ever happened to me. thing that ever happened to me. thing that ever happened to me. >> What about this? >> What about this? >> What about this? >> And the best thing that ever happened to >> And the best thing that ever happened to >> And the best thing that ever happened to most of the engineers we met at Lee's most of the engineers we met at Lee's most of the engineers we met at Lee's firm. firm. firm. >> I went to Cornell for a master's degree >> I went to Cornell for a master's degree >> I went to Cornell for a master's degree in information science. in information science. in information science. >> They too are alumni of America >> They too are alumni of America >> They too are alumni of America >> here >> here >> here >> with a dream for China. You have written >> with a dream for China. You have written >> with a dream for China. You have written that Silicon Valley's edge is not all that Silicon Valley's edge is not all that Silicon Valley's edge is not all it's cracked up to be. What do you mean it's cracked up to be. What do you mean it's cracked up to be. What do you mean by that?

by that? by that? >> Well, Silicon Valley has been the single >> Well, Silicon Valley has been the single >> Well, Silicon Valley has been the single epicenter of the world technology epicenter of the world technology epicenter of the world technology innovation when it comes to computers, innovation when it comes to computers, innovation when it comes to computers, internet, mobile and AI. But in the internet, mobile and AI. But in the internet, mobile and AI. But in the recent 5 years, we are seeing the recent 5 years, we are seeing the recent 5 years, we are seeing the Chinese AI is getting to be almost as Chinese AI is getting to be almost as Chinese AI is getting to be almost as good as Silicon Valley AI. And I think good as Silicon Valley AI. And I think good as Silicon Valley AI. And I think Silicon Valley is not quite aware of it Silicon Valley is not quite aware of it Silicon Valley is not quite aware of it yet. yet. yet. >> China's advantage is in the amount of >> China's advantage is in the amount of >> China's advantage is in the amount of data it collects. The more data, the data it collects. The more data, the data it collects. The more data, the better the AI. Just like the more you better the AI. Just like the more you better the AI. Just like the more you know, the smarter you are. know, the smarter you are. know, the smarter you are. China has four times more people than China has four times more people than China has four times more people than the United States. And they are doing the United States. And they are doing the United States. And they are doing nearly everything online. nearly everything online. nearly everything online. >> I just don't see any Chinese without a >> I just don't see any Chinese without a >> I just don't see any Chinese without a phone in their head. College student phone in their head. College student phone in their head. College student Monica Sun showed us how more than a Monica Sun showed us how more than a Monica Sun showed us how more than a billion Chinese are using their phones billion Chinese are using their phones billion Chinese are using their phones to buy everything, find anything, and to buy everything, find anything, and to buy everything, find anything, and connect with everyone. In America, when connect with everyone. In America, when connect with everyone. In America, when personal information leaks, personal information leaks, personal information leaks, we have congressional hearings. Not in we have congressional hearings. Not in we have congressional hearings. Not in China. You ever worry about the China. You ever worry about the China. You ever worry about the information that's being collected about information that's being collected about information that's being collected about you, where you go, you, where you go, you, where you go, >> what you buy, who you're with?

>> what you buy, who you're with? >> what you buy, who you're with? >> I I never think about it. >> I I never think about it. >> I I never think about it. Do you think most Chinese worry about Do you think most Chinese worry about Do you think most Chinese worry about their privacy? their privacy? their privacy? >> Um, not that much. >> Um, not that much. >> Um, not that much. >> Not that much. >> Not that much. >> Not that much. >> With a pliant public, the leader of the >> With a pliant public, the leader of the >> With a pliant public, the leader of the Communist Party has made a national Communist Party has made a national Communist Party has made a national priority of achieving AI dominance in 10 priority of achieving AI dominance in 10 priority of achieving AI dominance in 10 years. This is where Kyu Lee becomes years. This is where Kyu Lee becomes years. This is where Kyu Lee becomes uncharacteristically shy. Even though uncharacteristically shy. Even though uncharacteristically shy. Even though he's a former Apple, Microsoft, and he's a former Apple, Microsoft, and he's a former Apple, Microsoft, and Google executive, he knows who's boss in Google executive, he knows who's boss in Google executive, he knows who's boss in China. China. China. >> President Xi has called technology the >> President Xi has called technology the >> President Xi has called technology the sharp weapon of the modern state. sharp weapon of the modern state. sharp weapon of the modern state. >> What does he mean by that? >> What does he mean by that? >> What does he mean by that? >> I I am not an expert in interpreting his >> I I am not an expert in interpreting his >> I I am not an expert in interpreting his thoughts. Don't know. There are those thoughts. Don't know. There are those thoughts. Don't know. There are those particularly people in the west who particularly people in the west who particularly people in the west who worry about this AI technology as being worry about this AI technology as being worry about this AI technology as being something that governments will use to something that governments will use to something that governments will use to control their people and to crush control their people and to crush control their people and to crush disscent disscent disscent >> that as a venture capitalists we don't >> that as a venture capitalists we don't >> that as a venture capitalists we don't we don't invest in this area and we're we don't invest in this area and we're we don't invest in this area and we're not studying deeply this particular not studying deeply this particular not studying deeply this particular problem problem problem >> but governments do. It's certainly >> but governments do. It's certainly >> but governments do. It's certainly possible for governments to use the possible for governments to use the possible for governments to use the technologies just like companies.

technologies just like companies. technologies just like companies. >> Lee is much more talkative about another >> Lee is much more talkative about another >> Lee is much more talkative about another threat posed by AI. He explores the threat posed by AI. He explores the threat posed by AI. He explores the coming destruction of jobs in a new coming destruction of jobs in a new coming destruction of jobs in a new book, AI superpowers, China, Silicon book, AI superpowers, China, Silicon book, AI superpowers, China, Silicon Valley, and the new world order. AI will Valley, and the new world order. AI will Valley, and the new world order. AI will increasingly replace repetitive jobs not increasingly replace repetitive jobs not increasingly replace repetitive jobs not just for blue collar work but a lot of just for blue collar work but a lot of just for blue collar work but a lot of white collar work. white collar work. white collar work. >> What sort of jobs would be lost to AI? >> What sort of jobs would be lost to AI? >> What sort of jobs would be lost to AI? >> Basically chauffeers, truck drivers, uh >> Basically chauffeers, truck drivers, uh >> Basically chauffeers, truck drivers, uh anyone who does driving for a living uh anyone who does driving for a living uh anyone who does driving for a living uh their jobs will be disrupted more in the their jobs will be disrupted more in the their jobs will be disrupted more in the 15 to 20 year uh time frame. And many 15 to 20 year uh time frame. And many 15 to 20 year uh time frame. And many jobs that seem a little bit complex uh jobs that seem a little bit complex uh jobs that seem a little bit complex uh chef uh waiter uh a lot of things will chef uh waiter uh a lot of things will chef uh waiter uh a lot of things will become automated. We'll have automated become automated. We'll have automated become automated. We'll have automated stores uh automated restaurants and uh stores uh automated restaurants and uh stores uh automated restaurants and uh altogether in 15 years that's going to altogether in 15 years that's going to altogether in 15 years that's going to uh displace uh about 40% of jobs in the uh displace uh about 40% of jobs in the uh displace uh about 40% of jobs in the world.

world. world. >> 40% >> 40% >> 40% of jobs in the world will be displaced of jobs in the world will be displaced of jobs in the world will be displaced by technology. by technology. by technology. uh I would say displaceable. uh I would say displaceable. uh I would say displaceable. >> What does that do to the fabric of >> What does that do to the fabric of >> What does that do to the fabric of society? society? society? >> Well, in some sense there's the human >> Well, in some sense there's the human >> Well, in some sense there's the human wisdom that always overcomes these wisdom that always overcomes these wisdom that always overcomes these technology revolutions. The invention of technology revolutions. The invention of technology revolutions. The invention of the steam engine, uh the sewing machine, the steam engine, uh the sewing machine, the steam engine, uh the sewing machine, the uh electricity, uh have all the uh electricity, uh have all the uh electricity, uh have all displaced jobs uh and we've gotten over displaced jobs uh and we've gotten over displaced jobs uh and we've gotten over it. The challenge of AI is this 40% it. The challenge of AI is this 40% it. The challenge of AI is this 40% whether it's 15 or 25 years is coming whether it's 15 or 25 years is coming whether it's 15 or 25 years is coming faster than the previous revolutions. faster than the previous revolutions. faster than the previous revolutions. >> There's a lot of hype about artificial >> There's a lot of hype about artificial >> There's a lot of hype about artificial intelligence and it's important to intelligence and it's important to intelligence and it's important to understand this is not general understand this is not general understand this is not general intelligence like that of a human. intelligence like that of a human. intelligence like that of a human. Yes, Yes, Yes, >> this system can read faces and grade >> this system can read faces and grade >> this system can read faces and grade papers, but it has no idea why these papers, but it has no idea why these papers, but it has no idea why these children are in this room children are in this room children are in this room >> or what the goal of education is. A >> or what the goal of education is. A >> or what the goal of education is. A typical AI system can do one thing well, typical AI system can do one thing well, typical AI system can do one thing well, but can't adapt what it knows to any but can't adapt what it knows to any but can't adapt what it knows to any other task.

other task. other task. So, for now, it may be that calling this So, for now, it may be that calling this So, for now, it may be that calling this intelligence intelligence intelligence isn't very smart. isn't very smart. isn't very smart. When will we know that a machine can When will we know that a machine can When will we know that a machine can actually think like a human? actually think like a human? actually think like a human? >> Back when I was a grad student, people >> Back when I was a grad student, people >> Back when I was a grad student, people said if machine can drive a car uh by said if machine can drive a car uh by said if machine can drive a car uh by itself, that's intelligence. Now we say itself, that's intelligence. Now we say itself, that's intelligence. Now we say that's not enough. So the bar keeps that's not enough. So the bar keeps that's not enough. So the bar keeps moving higher. I think that's uh I guess moving higher. I think that's uh I guess moving higher. I think that's uh I guess more motivation for us to work harder. more motivation for us to work harder. more motivation for us to work harder. But if you're talking about AGI, But if you're talking about AGI, But if you're talking about AGI, artificial general intelligence, I would artificial general intelligence, I would artificial general intelligence, I would say not within the next 30 years and say not within the next 30 years and say not within the next 30 years and possibly never. Possibly never. What's possibly never. Possibly never. What's possibly never. Possibly never. What's so insurmountable? so insurmountable? so insurmountable? >> Because I believe in the sanctity of our >> Because I believe in the sanctity of our >> Because I believe in the sanctity of our soul. I believe there's a lot of things soul. I believe there's a lot of things soul. I believe there's a lot of things about us that we don't understand. I about us that we don't understand. I about us that we don't understand. I believe there's a lot of um uh love and believe there's a lot of um uh love and believe there's a lot of um uh love and compassion that is not explainable in compassion that is not explainable in compassion that is not explainable in terms of neuronet networks and terms of neuronet networks and terms of neuronet networks and computational algorithms and I currently computational algorithms and I currently computational algorithms and I currently see no way of solving them. Obviously see no way of solving them. Obviously see no way of solving them. Obviously unsolved problems have been solved in unsolved problems have been solved in unsolved problems have been solved in the past but it would be irresponsible the past but it would be irresponsible the past but it would be irresponsible for me to predict that these will be for me to predict that these will be for me to predict that these will be solved by certain time frame.

solved by certain time frame. solved by certain time frame. >> We may just be more than our bits. >> We may just be more than our bits. >> We may just be more than our bits. >> We may You know that universal sign we give You know that universal sign we give truckers hoping they'll sound their air truckers hoping they'll sound their air truckers hoping they'll sound their air horns? Well, you're going to be hearing horns? Well, you're going to be hearing horns? Well, you're going to be hearing a lot less honking in the future, and a lot less honking in the future, and a lot less honking in the future, and with good reason. The absence of an with good reason. The absence of an with good reason. The absence of an actual driver in the cab. We may focus actual driver in the cab. We may focus actual driver in the cab. We may focus on the self-driving car, but autonomous on the self-driving car, but autonomous on the self-driving car, but autonomous trucking is not an if, it's a when. And trucking is not an if, it's a when. And trucking is not an if, it's a when. And the when is coming sooner than you might the when is coming sooner than you might the when is coming sooner than you might expect. Already companies have been expect. Already companies have been expect. Already companies have been quietly testing their prototypes on quietly testing their prototypes on quietly testing their prototypes on public roads. Right now, there's a high public roads. Right now, there's a high public roads. Right now, there's a high stakes, high-speed race pitting the stakes, high-speed race pitting the stakes, high-speed race pitting the usual suspects, Google and Tesla and usual suspects, Google and Tesla and usual suspects, Google and Tesla and other global tech firms against small other global tech firms against small other global tech firms against small startups smelling opportunity. The startups smelling opportunity. The startups smelling opportunity. The driverless semi will convulse the driverless semi will convulse the driverless semi will convulse the trucking sector and the 2 million trucking sector and the 2 million trucking sector and the 2 million American drivers who turn a key and American drivers who turn a key and American drivers who turn a key and maneuver their big rig every day. And maneuver their big rig every day. And maneuver their big rig every day. And the winners of this derby, they may be the winners of this derby, they may be the winners of this derby, they may be poised to make untold billions. They'll poised to make untold billions. They'll poised to make untold billions. They'll change the US transportation grid, and change the US transportation grid, and change the US transportation grid, and they will emerge as the new kings of the they will emerge as the new kings of the they will emerge as the new kings of the road.

It's one of the great touchstones of It's one of the great touchstones of Americana, the romance and possibility Americana, the romance and possibility Americana, the romance and possibility of the open road. All hail the of the open road. All hail the of the open road. All hail the 18-wheeler, hugging those asphalt 18-wheeler, hugging those asphalt 18-wheeler, hugging those asphalt ribbons, transporting all of our stuff ribbons, transporting all of our stuff ribbons, transporting all of our stuff across the fruited plains from sea to across the fruited plains from sea to across the fruited plains from sea to shining sea. shining sea. shining sea. Though we may not give it a second Though we may not give it a second Though we may not give it a second thought when we click that free shipping thought when we click that free shipping thought when we click that free shipping icon, truckers move 70% of the nation's icon, truckers move 70% of the nation's icon, truckers move 70% of the nation's goods. goods. goods. But trucking cut a considerably But trucking cut a considerably But trucking cut a considerably different figure on a humid Sunday last different figure on a humid Sunday last different figure on a humid Sunday last summer on the Florida Turnpike. Starsky summer on the Florida Turnpike. Starsky summer on the Florida Turnpike. Starsky Robotics, a tech startup, may have been Robotics, a tech startup, may have been Robotics, a tech startup, may have been driving in the right lane, but they driving in the right lane, but they driving in the right lane, but they passed the competition and did this. Yeah, that's 35,000 lb of steel Yeah, that's 35,000 lb of steel thundering down a busy highway with thundering down a busy highway with thundering down a busy highway with nobody behind the wheel. The test was a nobody behind the wheel. The test was a nobody behind the wheel. The test was a milestone. Starski was the first company milestone. Starski was the first company milestone. Starski was the first company to put a truck on an open highway to put a truck on an open highway to put a truck on an open highway without a human on board. Everyone else without a human on board. Everyone else without a human on board. Everyone else in the game with the knowhow keeps a in the game with the knowhow keeps a in the game with the knowhow keeps a warm body in the cab as backup for now.

warm body in the cab as backup for now. warm body in the cab as backup for now. Anyway, Anyway, Anyway, if you didn't hear about this, you're if you didn't hear about this, you're if you didn't hear about this, you're not alone. In Jacksonville, we talked to not alone. In Jacksonville, we talked to not alone. In Jacksonville, we talked to Jeff Widows, his son Tanner, Linda Jeff Widows, his son Tanner, Linda Jeff Widows, his son Tanner, Linda Allen, and Eric Richardson. All Allen, and Eric Richardson. All Allen, and Eric Richardson. All truckers, and all astonished to learn truckers, and all astonished to learn truckers, and all astonished to learn how far this technology has come. how far this technology has come. how far this technology has come. >> I wasn't aware till I ran across one on >> I wasn't aware till I ran across one on >> I wasn't aware till I ran across one on the Florida Turnpike. And that just it the Florida Turnpike. And that just it the Florida Turnpike. And that just it just scares me. I can't imagine. But I just scares me. I can't imagine. But I just scares me. I can't imagine. But I didn't know anything about it. didn't know anything about it. didn't know anything about it. >> No one's talking about it. Nobody. >> No one's talking about it. Nobody. >> No one's talking about it. Nobody. Never. Never. Never. Never. Never. Never. >> I didn't know it had come so far. >> I didn't know it had come so far. >> I didn't know it had come so far. >> And I'm thinking, "Wow, >> And I'm thinking, "Wow, >> And I'm thinking, "Wow, it's here." it's here." it's here." >> He's right. The autonomous truck >> He's right. The autonomous truck >> He's right. The autonomous truck revolution is here. It just isn't much revolution is here. It just isn't much revolution is here. It just isn't much discussed. Not on CB radios and not in discussed. Not on CB radios and not in discussed. Not on CB radios and not in state houses, and transportation state houses, and transportation state houses, and transportation agencies are not inclined to pump the agencies are not inclined to pump the agencies are not inclined to pump the brakes. brakes. brakes. from Florida. Hang a left and drive from Florida. Hang a left and drive from Florida. Hang a left and drive 2,000 miles west on I 10 and you'll hit 2,000 miles west on I 10 and you'll hit 2,000 miles west on I 10 and you'll hit the proving grounds of a company with a the proving grounds of a company with a the proving grounds of a company with a fleet of 41 autonomous rigs. fleet of 41 autonomous rigs. fleet of 41 autonomous rigs. >> This is a shop floor or this is a >> This is a shop floor or this is a >> This is a shop floor or this is a laboratory. laboratory. laboratory. >> It's both.

>> It's both. >> It's both. >> In the guts of the Sonoron Desert >> In the guts of the Sonoron Desert >> In the guts of the Sonoron Desert outside Tucson, Chuck Price is chief outside Tucson, Chuck Price is chief outside Tucson, Chuck Price is chief product officer at Too Simple, a product officer at Too Simple, a product officer at Too Simple, a privately held global autonomous privately held global autonomous privately held global autonomous trucking outfit valued at more than a trucking outfit valued at more than a trucking outfit valued at more than a billion dollars with operations in the billion dollars with operations in the billion dollars with operations in the US and China. At this depot, $12 million US and China. At this depot, $12 million US and China. At this depot, $12 million worth of gleaming self-driving semis are worth of gleaming self-driving semis are worth of gleaming self-driving semis are on the move on the move on the move >> right now. We've got safety operators in >> right now. We've got safety operators in >> right now. We've got safety operators in the cab. How far away are we from runs the cab. How far away are we from runs the cab. How far away are we from runs without drivers? without drivers? without drivers? >> Uh we believe we'll be able to do our >> Uh we believe we'll be able to do our >> Uh we believe we'll be able to do our first driver out demonstration runs on first driver out demonstration runs on first driver out demonstration runs on public highways in 2021. public highways in 2021. public highways in 2021. >> That's the when. As for the how, >> That's the when. As for the how, >> That's the when. As for the how, >> our primary sensor system is our array >> our primary sensor system is our array >> our primary sensor system is our array of cameras that you see along the top of of cameras that you see along the top of of cameras that you see along the top of the vehicle. the vehicle. the vehicle. >> Heard about souping up vehicles. Let's >> Heard about souping up vehicles. Let's >> Heard about souping up vehicles. Let's take it to a new a little bit different. take it to a new a little bit different. take it to a new a little bit different. Yeah. Yeah. Yeah. >> The competition is fierce. So much so >> The competition is fierce. So much so >> The competition is fierce. So much so their technology is akin to a state their technology is akin to a state their technology is akin to a state secret. secret. secret. >> But Price points us to a network of >> But Price points us to a network of >> But Price points us to a network of sensors, cameras, and radar devices sensors, cameras, and radar devices sensors, cameras, and radar devices strapped to the outside of the rig. All strapped to the outside of the rig. All strapped to the outside of the rig. All of it hardwired to an internal AI of it hardwired to an internal AI of it hardwired to an internal AI supercomput that drives the truck. It's supercomput that drives the truck. It's supercomput that drives the truck. It's self-contained, so a bad Wi-Fi signal self-contained, so a bad Wi-Fi signal self-contained, so a bad Wi-Fi signal won't wreak havoc on the road.

won't wreak havoc on the road. won't wreak havoc on the road. >> Our system can see farther than any >> Our system can see farther than any >> Our system can see farther than any other autonomous system in the world. We other autonomous system in the world. We other autonomous system in the world. We can see forward over a half mile. can see forward over a half mile. can see forward over a half mile. >> You can drive autonomously at night. >> You can drive autonomously at night. >> You can drive autonomously at night. >> We can day, night, and in the rain and >> We can day, night, and in the rain and >> We can day, night, and in the rain and in the rain at night. in the rain at night. in the rain at night. >> And they're working on driving in the >> And they're working on driving in the >> And they're working on driving in the snow. Chuck Price has unshakable snow. Chuck Price has unshakable snow. Chuck Price has unshakable confidence in the reliability of the confidence in the reliability of the confidence in the reliability of the technology, as do some of the biggest technology, as do some of the biggest technology, as do some of the biggest names in shipping. UPS, Amazon, and the names in shipping. UPS, Amazon, and the names in shipping. UPS, Amazon, and the US Postal Service ship freight with two US Postal Service ship freight with two US Postal Service ship freight with two simple trucks. All in, each unit costs simple trucks. All in, each unit costs simple trucks. All in, each unit costs more than a4 million. Not a great more than a4 million. Not a great more than a4 million. Not a great expense considering it's designed to expense considering it's designed to expense considering it's designed to eliminate the annual salary of a driver. eliminate the annual salary of a driver. eliminate the annual salary of a driver. Currently around $45,000. Currently around $45,000. Currently around $45,000. Another savings, the driverless truck Another savings, the driverless truck Another savings, the driverless truck can get coast to coast in 2 days, not can get coast to coast in 2 days, not can get coast to coast in 2 days, not four, stopping only to refuel, though a four, stopping only to refuel, though a four, stopping only to refuel, though a human still has to do that. human still has to do that. human still has to do that. We wanted to hop in and experience We wanted to hop in and experience We wanted to hop in and experience automated trucking firsthand. automated trucking firsthand. automated trucking firsthand. >> Feel like it's it's our turn on Space >> Feel like it's it's our turn on Space >> Feel like it's it's our turn on Space Mountain. Mountain. Mountain. >> Chuck Price was happy to oblige.

>> Chuck Price was happy to oblige. >> Chuck Price was happy to oblige. We didn't know what to expect, so we We didn't know what to expect, so we We didn't know what to expect, so we fashioned more cameras to the rig than fashioned more cameras to the rig than fashioned more cameras to the rig than NASA glued to the Apollo rockets. NASA glued to the Apollo rockets. NASA glued to the Apollo rockets. >> Everybody buckled in. >> Everybody buckled in. >> Everybody buckled in. >> Buckle in. >> Buckle in. >> Buckle in. >> All right. Three, two, one. >> All right. Three, two, one. >> All right. Three, two, one. >> And we hit go. >> And we hit go. >> And we hit go. >> Autonomous driving started. >> Autonomous driving started. >> Autonomous driving started. >> We sat in the back alongside the >> We sat in the back alongside the >> We sat in the back alongside the computer in the front seat. computer in the front seat. computer in the front seat. >> Turn signal is on. >> Turn signal is on. >> Turn signal is on. >> Moren Fitzgerald, a trucker's trucker >> Moren Fitzgerald, a trucker's trucker >> Moren Fitzgerald, a trucker's trucker with 30 years experience. She was our with 30 years experience. She was our with 30 years experience. She was our safety driver, babysitting with no safety driver, babysitting with no safety driver, babysitting with no intention of ripping the wheel, but intention of ripping the wheel, but intention of ripping the wheel, but there just in case. Riding shotgun, an there just in case. Riding shotgun, an there just in case. Riding shotgun, an engineer, John Pantella, there to engineer, John Pantella, there to engineer, John Pantella, there to monitor the software. monitor the software. monitor the software. The driverless truck was attempting a The driverless truck was attempting a The driverless truck was attempting a 65mm loop in weekday traffic through 65mm loop in weekday traffic through 65mm loop in weekday traffic through Tucson. The route was mapped and Tucson. The route was mapped and Tucson. The route was mapped and programmed in before the run, but that's programmed in before the run, but that's programmed in before the run, but that's about it. The rest was up to the about it. The rest was up to the about it. The rest was up to the computer, which makes 20 decisions per computer, which makes 20 decisions per computer, which makes 20 decisions per second about what to do on the road. second about what to do on the road. second about what to do on the road. As we rolled past distracted drivers, As we rolled past distracted drivers, As we rolled past distracted drivers, disabled cars, slowpokes, and sheriffs, disabled cars, slowpokes, and sheriffs, disabled cars, slowpokes, and sheriffs, our safety driver kept vigil, but never our safety driver kept vigil, but never our safety driver kept vigil, but never disengaged the driverless system.

disengaged the driverless system. disengaged the driverless system. >> Watching the front targets close in 100. >> Watching the front targets close in 100. >> Watching the front targets close in 100. Yep. Got a cut in right now. 55 mph. Bad Yep. Got a cut in right now. 55 mph. Bad Yep. Got a cut in right now. 55 mph. Bad cut off. This This guy just flagrantly cut off. This This guy just flagrantly cut off. This This guy just flagrantly cut us off. cut us off. cut us off. >> He just really cut us off. We did not >> He just really cut us off. We did not >> He just really cut us off. We did not honk at him. Did we disengage? We did honk at him. Did we disengage? We did honk at him. Did we disengage? We did not disengage. This vehicle will detect not disengage. This vehicle will detect not disengage. This vehicle will detect that kind of behavior faster than the that kind of behavior faster than the that kind of behavior faster than the humans. How far are we from being able humans. How far are we from being able humans. How far are we from being able to pick up the specific cars that are to pick up the specific cars that are to pick up the specific cars that are passing us? Oh, that's Joe from New passing us? Oh, that's Joe from New passing us? Oh, that's Joe from New Jersey with six points on his license. Jersey with six points on his license. Jersey with six points on his license. >> We can read license plates. So, if there >> We can read license plates. So, if there >> We can read license plates. So, if there was an accessible database for something was an accessible database for something was an accessible database for something like that, we could. like that, we could. like that, we could. >> Chuck Price says that would be valuable >> Chuck Price says that would be valuable >> Chuck Price says that would be valuable to the company, though he admits it to the company, though he admits it to the company, though he admits it could create obvious privacy issues. But could create obvious privacy issues. But could create obvious privacy issues. But too simple does collect a lot of data as too simple does collect a lot of data as too simple does collect a lot of data as it maps more and more routes across the it maps more and more routes across the it maps more and more routes across the southwest. southwest. southwest. Their enterprise also includes a fleet Their enterprise also includes a fleet Their enterprise also includes a fleet of autonomous trucks in Shanghai as well of autonomous trucks in Shanghai as well of autonomous trucks in Shanghai as well as a research center in Beijing. as a research center in Beijing. as a research center in Beijing. The data collected by every truck along The data collected by every truck along The data collected by every truck along every mile. It's uploaded and used by every mile. It's uploaded and used by every mile. It's uploaded and used by two simple they say only to perfect two simple they say only to perfect two simple they say only to perfect performance on the road.

performance on the road. performance on the road. Morin Fitzgerald is convinced that two Morin Fitzgerald is convinced that two Morin Fitzgerald is convinced that two simples technology is superior to human simples technology is superior to human simples technology is superior to human drivers. drivers. drivers. >> You call these trucks your babies, >> You call these trucks your babies, >> You call these trucks your babies, >> right? >> right? >> right? >> What do your babies do well and what >> What do your babies do well and what >> What do your babies do well and what could they do better? could they do better? could they do better? >> This truck is scanning mirrors looking >> This truck is scanning mirrors looking >> This truck is scanning mirrors looking at thousand meters out. It's processing at thousand meters out. It's processing at thousand meters out. It's processing all the things that my brain could never all the things that my brain could never all the things that my brain could never do and it can react 15 times faster than do and it can react 15 times faster than do and it can react 15 times faster than I could. I could. I could. >> Most of her 2 million fellow truckers >> Most of her 2 million fellow truckers >> Most of her 2 million fellow truckers are less enthusiastic. Automated are less enthusiastic. Automated are less enthusiastic. Automated trucking threatens to jack knife an trucking threatens to jack knife an trucking threatens to jack knife an entire $800 billion industry. Trucking entire $800 billion industry. Trucking entire $800 billion industry. Trucking is among the most common jobs for is among the most common jobs for is among the most common jobs for Americans without a college education. Americans without a college education. Americans without a college education. So this disruption caused by the So this disruption caused by the So this disruption caused by the driverless truck. It cuts deep. driverless truck. It cuts deep. driverless truck. It cuts deep. >> As truckers like to say, if you if you >> As truckers like to say, if you if you >> As truckers like to say, if you if you bought it, a truck brought it. bought it, a truck brought it. bought it, a truck brought it. >> Steve Aselli is a sociologist at the >> Steve Aselli is a sociologist at the >> Steve Aselli is a sociologist at the University of Pennsylvania and an expert University of Pennsylvania and an expert University of Pennsylvania and an expert in freight transportation and in freight transportation and in freight transportation and automation. He also spent 6 months automation. He also spent 6 months automation. He also spent 6 months driving a big rig. What segment do you driving a big rig. What segment do you driving a big rig. What segment do you think is going to be hit first by think is going to be hit first by think is going to be hit first by driverless trucks? driverless trucks? driverless trucks? >> I've identified two segments that I >> I've identified two segments that I >> I've identified two segments that I think are most at risk and that's think are most at risk and that's think are most at risk and that's refrigerated and drive van truckload and refrigerated and drive van truckload and refrigerated and drive van truckload and those constitute about 200,000 uh those constitute about 200,000 uh those constitute about 200,000 uh trucking jobs and then what's called trucking jobs and then what's called trucking jobs and then what's called line hall and they're somewhere in the line hall and they're somewhere in the line hall and they're somewhere in the neighborhood of 80 to 90,000 jobs there.

neighborhood of 80 to 90,000 jobs there. neighborhood of 80 to 90,000 jobs there. >> You're talking 300,000 jobs off the top. >> You're talking 300,000 jobs off the top. >> You're talking 300,000 jobs off the top. It's a big number. It's a big number. It's a big number. >> It is a big number. >> It is a big number. >> It is a big number. >> Loud track stops. Florida truckers we >> Loud track stops. Florida truckers we >> Loud track stops. Florida truckers we met represent 70 years experience and met represent 70 years experience and met represent 70 years experience and millions of safe driving miles. millions of safe driving miles. millions of safe driving miles. >> How you doing, Gerald? >> How you doing, Gerald? >> How you doing, Gerald? >> They say they love the job. And when >> They say they love the job. And when >> They say they love the job. And when asked to describe their work, they kick asked to describe their work, they kick asked to describe their work, they kick around words like vital, honest, and around words like vital, honest, and around words like vital, honest, and patriotic. patriotic. patriotic. >> Makes you feel like you could just poke >> Makes you feel like you could just poke >> Makes you feel like you could just poke your chest out with the responsibility your chest out with the responsibility your chest out with the responsibility that you're taking on. Kind of makes you that you're taking on. Kind of makes you that you're taking on. Kind of makes you feel like uh feel like uh feel like uh >> like you're needed. asked about >> like you're needed. asked about >> like you're needed. asked about driverless trucks, they feel like they driverless trucks, they feel like they driverless trucks, they feel like they are being run off the road. But another are being run off the road. But another are being run off the road. But another issue troubles them even more. issue troubles them even more. issue troubles them even more. >> I think that companies need to keep >> I think that companies need to keep >> I think that companies need to keep safety in mind. You have a glitch in a safety in mind. You have a glitch in a safety in mind. You have a glitch in a computer at that speed, you can do some computer at that speed, you can do some computer at that speed, you can do some damage. damage. damage. >> There's too many things that can go >> There's too many things that can go >> There's too many things that can go wrong. wrong. wrong. >> One of them semis hit something that's >> One of them semis hit something that's >> One of them semis hit something that's small, like a car, passenger car, small, like a car, passenger car, small, like a car, passenger car, anything like that, it's a done deal. I anything like that, it's a done deal. I anything like that, it's a done deal. I mean, mean, mean, >> I was on 75 uh last month uh through >> I was on 75 uh last month uh through >> I was on 75 uh last month uh through Ocala and there was a bad accident and Ocala and there was a bad accident and Ocala and there was a bad accident and so the state trooper came out and he was so the state trooper came out and he was so the state trooper came out and he was hand signaling people. You go here, you hand signaling people. You go here, you hand signaling people. You go here, you go there. How's an autonomous truck go there. How's an autonomous truck go there. How's an autonomous truck going to recognize what the officer is going to recognize what the officer is going to recognize what the officer is trying to say or do? How is that going trying to say or do? How is that going trying to say or do? How is that going to work?

to work? to work? >> Sympathy, empathy, fear, code, eye >> Sympathy, empathy, fear, code, eye >> Sympathy, empathy, fear, code, eye contact. I don't know how you create an contact. I don't know how you create an contact. I don't know how you create an algorithm that accounts for all that. algorithm that accounts for all that. algorithm that accounts for all that. >> You can't. >> You can't. >> You can't. >> Does the public have a right to know if >> Does the public have a right to know if >> Does the public have a right to know if they're testing driverless trucks on the they're testing driverless trucks on the they're testing driverless trucks on the interstate? interstate? interstate? >> Absolutely. Well, that's our concern is >> Absolutely. Well, that's our concern is >> Absolutely. Well, that's our concern is no. Who's watching this? Who's making no. Who's watching this? Who's making no. Who's watching this? Who's making sure that they're not throwing something sure that they're not throwing something sure that they're not throwing something unsafe on the road? unsafe on the road? unsafe on the road? >> I think a lot of it uh is being done >> I think a lot of it uh is being done >> I think a lot of it uh is being done with almost no oversight from good with almost no oversight from good with almost no oversight from good governance groups, from the government governance groups, from the government governance groups, from the government itself. itself. itself. >> Sam Leash represents 600,000 truckers >> Sam Leash represents 600,000 truckers >> Sam Leash represents 600,000 truckers for the teamsters. He's concerned that for the teamsters. He's concerned that for the teamsters. He's concerned that federal, state, and local governments federal, state, and local governments federal, state, and local governments have only limited access to the have only limited access to the have only limited access to the driverless technology. driverless technology. driverless technology. >> You know, a lot of this information, >> You know, a lot of this information, >> You know, a lot of this information, understandably, is proprietary. tech understandably, is proprietary. tech understandably, is proprietary. tech companies want to keep, you know, their companies want to keep, you know, their companies want to keep, you know, their algorithms and and their safety data uh algorithms and and their safety data uh algorithms and and their safety data uh secret until they can kind of get it secret until they can kind of get it secret until they can kind of get it right. The problem is that in the right. The problem is that in the right. The problem is that in the meantime, they're testing this meantime, they're testing this meantime, they're testing this technology on public roads. They're technology on public roads. They're technology on public roads. They're testing it next to you as you drive down testing it next to you as you drive down testing it next to you as you drive down the road. the road. the road. >> And that was consistent with our >> And that was consistent with our >> And that was consistent with our reporting. reporting. reporting. >> Do you have to tell anyone when you >> Do you have to tell anyone when you >> Do you have to tell anyone when you test? test? test? >> No, not for individual tests. >> No, not for individual tests. >> No, not for individual tests. >> Do you have to tell them where you test?

>> Do you have to tell them where you test? >> Do you have to tell them where you test? >> We do not currently have to tell them >> We do not currently have to tell them >> We do not currently have to tell them where we test in Arizona where we test in Arizona where we test in Arizona >> or how how often you test? >> or how how often you test? >> or how how often you test? >> No. Do you have to share your data with >> No. Do you have to share your data with >> No. Do you have to share your data with any state department of transportation? any state department of transportation? any state department of transportation? >> Currently, we're not required to share >> Currently, we're not required to share >> Currently, we're not required to share data. We would be happy to share data. data. We would be happy to share data. data. We would be happy to share data. >> What about inspections? Does anyone from >> What about inspections? Does anyone from >> What about inspections? Does anyone from the Arizona DOT come by and and check the Arizona DOT come by and and check the Arizona DOT come by and and check the stuff out? the stuff out? the stuff out? >> The DOT comes by all the time. They we >> The DOT comes by all the time. They we >> The DOT comes by all the time. They we talk with them regularly. Uh it's not a talk with them regularly. Uh it's not a talk with them regularly. Uh it's not a formal inspection process yet. formal inspection process yet. formal inspection process yet. >> We wanted to ask Elaine Chow, Secretary >> We wanted to ask Elaine Chow, Secretary >> We wanted to ask Elaine Chow, Secretary of the Department of Transportation, of the Department of Transportation, of the Department of Transportation, about regulating this emerging sector. about regulating this emerging sector. about regulating this emerging sector. She declined an interview but provided She declined an interview but provided She declined an interview but provided us with a statement which reads in part, us with a statement which reads in part, us with a statement which reads in part, "The department needs to prepare for the "The department needs to prepare for the "The department needs to prepare for the transportation systems of the future by transportation systems of the future by transportation systems of the future by engaging with new technologies to engaging with new technologies to engaging with new technologies to address safety without hampering address safety without hampering address safety without hampering innovation." innovation." innovation." To that point, Chuck Price is emphatic To that point, Chuck Price is emphatic To that point, Chuck Price is emphatic that driverless trucks pose fewer that driverless trucks pose fewer that driverless trucks pose fewer dangers. dangers. dangers. >> We eliminate texting accidents. >> We eliminate texting accidents. >> We eliminate texting accidents. >> Texting while driving when there's a >> Texting while driving when there's a >> Texting while driving when there's a computer. computer. computer. >> There are no drunk computers and the >> There are no drunk computers and the >> There are no drunk computers and the computer doesn't sleep. So those are computer doesn't sleep. So those are computer doesn't sleep. So those are large causes of accidents.

large causes of accidents. large causes of accidents. >> He adds that driverless trucks are more >> He adds that driverless trucks are more >> He adds that driverless trucks are more fuel efficient in part because they can fuel efficient in part because they can fuel efficient in part because they can stay perfectly aligned in their lane and stay perfectly aligned in their lane and stay perfectly aligned in their lane and unlike humans are programmed never to unlike humans are programmed never to unlike humans are programmed never to speed. But he admits the profit motive speed. But he admits the profit motive speed. But he admits the profit motive is significant. is significant. is significant. >> You think you think there's a lot of >> You think you think there's a lot of >> You think you think there's a lot of money to be made here? money to be made here? money to be made here? >> There's certainly a lot of money to be >> There's certainly a lot of money to be >> There's certainly a lot of money to be made. Uh there's a there's an made. Uh there's a there's an made. Uh there's a there's an opportunity to solve a very big problem. opportunity to solve a very big problem. opportunity to solve a very big problem. Steve Aselli says the industry may be Steve Aselli says the industry may be Steve Aselli says the industry may be imperfect, but he thinks the solution imperfect, but he thinks the solution imperfect, but he thinks the solution should not depend on driverless should not depend on driverless should not depend on driverless technology alone. technology alone. technology alone. >> What's your response to the technology >> What's your response to the technology >> What's your response to the technology companies that say, "Look, I'm trying to companies that say, "Look, I'm trying to companies that say, "Look, I'm trying to do something more efficiently and I'm do something more efficiently and I'm do something more efficiently and I'm going to improve safety. This is going to improve safety. This is going to improve safety. This is American enterprise. What are you going American enterprise. What are you going American enterprise. What are you going to get in the way of this for?" to get in the way of this for?" to get in the way of this for?" >> I I mean, I'd say that that's wonderful. >> I I mean, I'd say that that's wonderful. >> I I mean, I'd say that that's wonderful. Um, but that's not your job, right? Your Um, but that's not your job, right? Your Um, but that's not your job, right? Your job is to make money, right? Policy is job is to make money, right? Policy is job is to make money, right? Policy is going to decide what our outcomes are going to decide what our outcomes are going to decide what our outcomes are going to be. Trucking is a very going to be. Trucking is a very going to be. Trucking is a very competitive industry. The low road competitive industry. The low road competitive industry. The low road approach often wins. approach often wins. approach often wins. >> We talk about the internal combustion >> We talk about the internal combustion >> We talk about the internal combustion engine replacing the horse and buggy and engine replacing the horse and buggy and engine replacing the horse and buggy and Eisenhower's interstate system. When we Eisenhower's interstate system. When we Eisenhower's interstate system. When we talk about these these transformational talk about these these transformational talk about these these transformational markers in transportation, markers in transportation, markers in transportation, >> yeah.

>> yeah. >> yeah. >> Where's driverless trucking going to >> Where's driverless trucking going to >> Where's driverless trucking going to rank? rank? rank? >> It's going to be one of the biggest You may never have heard the term You may never have heard the term synthetic media, more commonly known as synthetic media, more commonly known as synthetic media, more commonly known as deep fakes, but our military, law deep fakes, but our military, law deep fakes, but our military, law enforcement, and intelligence agencies enforcement, and intelligence agencies enforcement, and intelligence agencies certainly have. They are hyperrealistic certainly have. They are hyperrealistic certainly have. They are hyperrealistic video and audio recordings that use video and audio recordings that use video and audio recordings that use artificial intelligence and deep artificial intelligence and deep artificial intelligence and deep learning to create fake content or deep learning to create fake content or deep learning to create fake content or deep fakes. The US government has grown fakes. The US government has grown fakes. The US government has grown increasingly concerned about their increasingly concerned about their increasingly concerned about their potential to be used to spread potential to be used to spread potential to be used to spread disinformation and commit crimes. That's disinformation and commit crimes. That's disinformation and commit crimes. That's because the creators of deep fakes have because the creators of deep fakes have because the creators of deep fakes have the power to make people say or do the power to make people say or do the power to make people say or do anything, at least on our screens. As we anything, at least on our screens. As we anything, at least on our screens. As we first reported in October, most first reported in October, most first reported in October, most Americans have no idea how far the Americans have no idea how far the Americans have no idea how far the technology has come in just the last 5 technology has come in just the last 5 technology has come in just the last 5 years or the danger, disruption, and years or the danger, disruption, and years or the danger, disruption, and opportunities that come with it.

opportunities that come with it. opportunities that come with it. You know, I do all my own stunts You know, I do all my own stunts You know, I do all my own stunts obviously. Uh I also do my own music. obviously. Uh I also do my own music. obviously. Uh I also do my own music. >> This is not Tom Cruz. It's one of a >> This is not Tom Cruz. It's one of a >> This is not Tom Cruz. It's one of a series of hyperrealistic deep fakes of series of hyperrealistic deep fakes of series of hyperrealistic deep fakes of the movie star that began appearing on the movie star that began appearing on the movie star that began appearing on the video sharing app Tik Tok in the video sharing app Tik Tok in the video sharing app Tik Tok in February 2021. February 2021. February 2021. >> Hey, what's up, Tik Tok? >> Hey, what's up, Tik Tok? >> Hey, what's up, Tik Tok? >> For days, people wondered if they were >> For days, people wondered if they were >> For days, people wondered if they were real, and if not, who had created them. real, and if not, who had created them. real, and if not, who had created them. >> It's important. >> It's important. >> It's important. >> Finally, a modest 32-year-old Belgian >> Finally, a modest 32-year-old Belgian >> Finally, a modest 32-year-old Belgian visual effects artist named Chris Umei visual effects artist named Chris Umei visual effects artist named Chris Umei stepped forward to claim credit. We stepped forward to claim credit. We stepped forward to claim credit. We believed as long as we're making clear believed as long as we're making clear believed as long as we're making clear this is a parody, we're not doing this is a parody, we're not doing this is a parody, we're not doing anything to harm his image. But after a anything to harm his image. But after a anything to harm his image. But after a few videos, we realized like this is few videos, we realized like this is few videos, we realized like this is blowing up. We're getting millions and blowing up. We're getting millions and blowing up. We're getting millions and millions and millions of views. millions and millions of views. millions and millions of views. >> Um says his work is made easier because >> Um says his work is made easier because >> Um says his work is made easier because he teamed up with a Tom Cruz he teamed up with a Tom Cruz he teamed up with a Tom Cruz impersonator whose voice, gestures, and impersonator whose voice, gestures, and impersonator whose voice, gestures, and hair are nearly identical to the real hair are nearly identical to the real hair are nearly identical to the real McCoy.

Umei only deep fakes Cruz's face and Umei only deep fakes Cruz's face and stitches that onto the real video and stitches that onto the real video and stitches that onto the real video and sound of the impersonator. sound of the impersonator. sound of the impersonator. >> That's where the magic happens. >> That's where the magic happens. >> That's where the magic happens. >> For technopiles, deep Tom Cruz was a >> For technopiles, deep Tom Cruz was a >> For technopiles, deep Tom Cruz was a tipping point for deep fakes. tipping point for deep fakes. tipping point for deep fakes. >> Still got it. >> Still got it. >> Still got it. >> How do you make this so seamless? >> How do you make this so seamless? >> How do you make this so seamless? >> But it begins with training a deep fake >> But it begins with training a deep fake >> But it begins with training a deep fake model. Of course, I have all the face model. Of course, I have all the face model. Of course, I have all the face angles of Tom Cruz, all the expressions, angles of Tom Cruz, all the expressions, angles of Tom Cruz, all the expressions, all the emotions. It takes time to all the emotions. It takes time to all the emotions. It takes time to create a really good defect model. create a really good defect model. create a really good defect model. >> What do you mean training the model? How >> What do you mean training the model? How >> What do you mean training the model? How do you how do you train your computer? do you how do you train your computer? do you how do you train your computer? >> Training means it's going to analyze all >> Training means it's going to analyze all >> Training means it's going to analyze all the images of Tom Cruz, all his the images of Tom Cruz, all his the images of Tom Cruz, all his expressions compared to my impersonator. expressions compared to my impersonator. expressions compared to my impersonator. So, the computer is going to teach So, the computer is going to teach So, the computer is going to teach itself when my impersonator is smiling, itself when my impersonator is smiling, itself when my impersonator is smiling, I'm going to recreate Tom Cruz smiling. I'm going to recreate Tom Cruz smiling. I'm going to recreate Tom Cruz smiling. And that's that's how you train it. And that's that's how you train it. And that's that's how you train it. Using video from the CBS News archives, Using video from the CBS News archives, Using video from the CBS News archives, Chris Umei was able to train his Chris Umei was able to train his Chris Umei was able to train his computer to learn every aspect of my computer to learn every aspect of my computer to learn every aspect of my face face face and wipe away the decades. This is how I and wipe away the decades. This is how I and wipe away the decades. This is how I looked 30 years ago. He can even remove looked 30 years ago. He can even remove looked 30 years ago. He can even remove my mustache. The possibilities are my mustache. The possibilities are my mustache. The possibilities are endless and a little frightening.

endless and a little frightening. endless and a little frightening. >> I see a lot of mistakes in my work, but >> I see a lot of mistakes in my work, but >> I see a lot of mistakes in my work, but I don't mind it actually because I don't I don't mind it actually because I don't I don't mind it actually because I don't want to fool people. I I just want to want to fool people. I I just want to want to fool people. I I just want to show them what's possible. show them what's possible. show them what's possible. >> You don't want to fool people. >> You don't want to fool people. >> You don't want to fool people. >> No, I want to entertain people. I want >> No, I want to entertain people. I want >> No, I want to entertain people. I want to raise awareness and I want and I want to raise awareness and I want and I want to raise awareness and I want and I want to show where it's all going. to show where it's all going. to show where it's all going. >> It is without a doubt one of the most >> It is without a doubt one of the most >> It is without a doubt one of the most important revolutions in the future of important revolutions in the future of important revolutions in the future of human communication and perception. I human communication and perception. I human communication and perception. I would say it's analogous to the birth of would say it's analogous to the birth of would say it's analogous to the birth of the internet. Political scientist and the internet. Political scientist and the internet. Political scientist and technology consultant Nina Schik wrote technology consultant Nina Schik wrote technology consultant Nina Schik wrote one of the first books on deep fakes. one of the first books on deep fakes. one of the first books on deep fakes. She first came across them five years She first came across them five years She first came across them five years ago when she was advising European ago when she was advising European ago when she was advising European politicians on Russia's use of politicians on Russia's use of politicians on Russia's use of disinformation and social media to disinformation and social media to disinformation and social media to interfere in democratic elections. interfere in democratic elections. interfere in democratic elections. >> What was your reaction when you first >> What was your reaction when you first >> What was your reaction when you first realized this was possible and was going realized this was possible and was going realized this was possible and was going on? on? on? Well, given that I was coming at it from Well, given that I was coming at it from Well, given that I was coming at it from the perspective of disinformation and the perspective of disinformation and the perspective of disinformation and manipulation in the context of manipulation in the context of manipulation in the context of elections, the fact that AI can now be elections, the fact that AI can now be elections, the fact that AI can now be used to make images and video that are used to make images and video that are used to make images and video that are fake that look hyper realistic. So, I fake that look hyper realistic. So, I fake that look hyper realistic. So, I thought, well, from a disinformation thought, well, from a disinformation thought, well, from a disinformation perspective, this is a gamecher.

perspective, this is a gamecher. perspective, this is a gamecher. >> So far, there's no evidence deep fakes >> So far, there's no evidence deep fakes >> So far, there's no evidence deep fakes have changed the game in a US election. have changed the game in a US election. have changed the game in a US election. But in March 2021, the FBI put out a But in March 2021, the FBI put out a But in March 2021, the FBI put out a notification warning that Russian and notification warning that Russian and notification warning that Russian and Chinese actors are using synthetic Chinese actors are using synthetic Chinese actors are using synthetic profile images, creating deep fake profile images, creating deep fake profile images, creating deep fake journalists and media personalities to journalists and media personalities to journalists and media personalities to spread anti-American propaganda on spread anti-American propaganda on spread anti-American propaganda on social media. social media. social media. >> So, how do you get deep fakes? >> So, how do you get deep fakes? >> So, how do you get deep fakes? >> The US military, law enforcement, and >> The US military, law enforcement, and >> The US military, law enforcement, and intelligence agencies have kept a wary intelligence agencies have kept a wary intelligence agencies have kept a wary eye on deep fakes for years. At this eye on deep fakes for years. At this eye on deep fakes for years. At this 2019 hearing, Senator Ben Sass of 2019 hearing, Senator Ben Sass of 2019 hearing, Senator Ben Sass of Nebraska asked if the US is prepared for Nebraska asked if the US is prepared for Nebraska asked if the US is prepared for the onslaught of disinformation, fakery, the onslaught of disinformation, fakery, the onslaught of disinformation, fakery, and fraud. When you think about the and fraud. When you think about the and fraud. When you think about the catastrophic potential to public trust catastrophic potential to public trust catastrophic potential to public trust and to markets that could come from deep and to markets that could come from deep and to markets that could come from deep fake attacks, are we organized in a way fake attacks, are we organized in a way fake attacks, are we organized in a way that we could possibly respond fast that we could possibly respond fast that we could possibly respond fast enough? We clearly need to be more enough? We clearly need to be more enough? We clearly need to be more agile. It poses a a major threat to the agile. It poses a a major threat to the agile. It poses a a major threat to the United States and something that the United States and something that the United States and something that the intelligence community needs to be intelligence community needs to be intelligence community needs to be restructured to address.

restructured to address. restructured to address. >> Since then, technology has continued >> Since then, technology has continued >> Since then, technology has continued moving at an exponential pace while US moving at an exponential pace while US moving at an exponential pace while US policy has not. Efforts by the policy has not. Efforts by the policy has not. Efforts by the government and big tech to detect government and big tech to detect government and big tech to detect synthetic media are competing with a synthetic media are competing with a synthetic media are competing with a community of deep fake artists who share community of deep fake artists who share community of deep fake artists who share their latest creations and techniques their latest creations and techniques their latest creations and techniques online. online. online. Like the internet, the first place deep Like the internet, the first place deep Like the internet, the first place deep fake technology took off was in fake technology took off was in fake technology took off was in pornography. The sad fact is the pornography. The sad fact is the pornography. The sad fact is the majority of deep fakes today consist of majority of deep fakes today consist of majority of deep fakes today consist of women's faces, mostly celebrities, women's faces, mostly celebrities, women's faces, mostly celebrities, superimposed onto pornographic videos. superimposed onto pornographic videos. superimposed onto pornographic videos. >> The first use case in pornography is >> The first use case in pornography is >> The first use case in pornography is just a harbinger of how deep fakes can just a harbinger of how deep fakes can just a harbinger of how deep fakes can be used maliciously in many different be used maliciously in many different be used maliciously in many different contexts which are now starting to arise contexts which are now starting to arise contexts which are now starting to arise >> and they're getting better all the time. >> and they're getting better all the time. >> and they're getting better all the time. Yes, the incredible thing about deep Yes, the incredible thing about deep Yes, the incredible thing about deep fakes and synthetic media is the pace of fakes and synthetic media is the pace of fakes and synthetic media is the pace of acceleration when it comes to the acceleration when it comes to the acceleration when it comes to the technology and by 5 to seven years we technology and by 5 to seven years we technology and by 5 to seven years we are basically looking at a trajectory are basically looking at a trajectory are basically looking at a trajectory where any single creator so a YouTuber a where any single creator so a YouTuber a where any single creator so a YouTuber a tick tocker will be able to create the tick tocker will be able to create the tick tocker will be able to create the same level of visual effects that is same level of visual effects that is same level of visual effects that is only accessible to the most only accessible to the most only accessible to the most well-resourced Hollywood studio today.

well-resourced Hollywood studio today. well-resourced Hollywood studio today. The technology behind deep fakes is The technology behind deep fakes is The technology behind deep fakes is artificial intelligence which mimics the artificial intelligence which mimics the artificial intelligence which mimics the way humans learn. In 2014, researchers way humans learn. In 2014, researchers way humans learn. In 2014, researchers for the first time used computers to for the first time used computers to for the first time used computers to create realistic looking faces using create realistic looking faces using create realistic looking faces using something called generative adversarial something called generative adversarial something called generative adversarial networks or GANs. networks or GANs. networks or GANs. >> So you set up an adversarial game where >> So you set up an adversarial game where >> So you set up an adversarial game where you have two AIs combating each other to you have two AIs combating each other to you have two AIs combating each other to try and create the best fake synthetic try and create the best fake synthetic try and create the best fake synthetic content. And as these two networks content. And as these two networks content. And as these two networks combat each other, one trying to combat each other, one trying to combat each other, one trying to generate the best image, the other generate the best image, the other generate the best image, the other trying to detect where it could be trying to detect where it could be trying to detect where it could be better, you basically end up with an better, you basically end up with an better, you basically end up with an output that is increasingly improving output that is increasingly improving output that is increasingly improving all the time. all the time. all the time. >> Shik says the power of generative >> Shik says the power of generative >> Shik says the power of generative adversarial networks is on full display adversarial networks is on full display adversarial networks is on full display at a website called this person does at a website called this person does at a website called this person does notexist.com. notexist.com. notexist.com. And every time you refresh the page, And every time you refresh the page, And every time you refresh the page, there's a new image of a person who does there's a new image of a person who does there's a new image of a person who does not exist. not exist. not exist. >> Each is a one-of-a-kind, entirely AI >> Each is a one-of-a-kind, entirely AI >> Each is a one-of-a-kind, entirely AI generated image of a human being who generated image of a human being who generated image of a human being who never has and never will walk this never has and never will walk this never has and never will walk this earth.

earth. earth. >> You can see every pore on their face. >> You can see every pore on their face. >> You can see every pore on their face. You can see every hair on their head. You can see every hair on their head. You can see every hair on their head. But now imagine that technology being But now imagine that technology being But now imagine that technology being expanded out not only to human faces uh expanded out not only to human faces uh expanded out not only to human faces uh in still images but also to video to in still images but also to video to in still images but also to video to audio synthesis of people's voices and audio synthesis of people's voices and audio synthesis of people's voices and that's really where we're heading right that's really where we're heading right that's really where we're heading right now. now. now. >> This is mindblowing. >> This is mindblowing. >> This is mindblowing. >> Yes. >> Yes. >> Yes. >> What what's the positive side of this? >> What what's the positive side of this? >> What what's the positive side of this? >> The technology itself is neutral. So >> The technology itself is neutral. So >> The technology itself is neutral. So just as bad actors are without a doubt just as bad actors are without a doubt just as bad actors are without a doubt going to be using deep fakes, it is also going to be using deep fakes, it is also going to be using deep fakes, it is also going to be used by good actors. So going to be used by good actors. So going to be used by good actors. So first of all, I would say that there's a first of all, I would say that there's a first of all, I would say that there's a very compelling case to be made for the very compelling case to be made for the very compelling case to be made for the commercial use of deep fakes. commercial use of deep fakes. commercial use of deep fakes. >> Victor Riparbelli is CEO and co-founder >> Victor Riparbelli is CEO and co-founder >> Victor Riparbelli is CEO and co-founder of Synthesia based in London, one of of Synthesia based in London, one of of Synthesia based in London, one of dozens of companies using deep fake dozens of companies using deep fake dozens of companies using deep fake technology to transform video and audio technology to transform video and audio technology to transform video and audio productions. productions. productions. >> The way Synthesia works is that we've >> The way Synthesia works is that we've >> The way Synthesia works is that we've essentially replaced cameras with code. essentially replaced cameras with code. essentially replaced cameras with code. And once you're working with software, And once you're working with software, And once you're working with software, we can do a lot of things that you we can do a lot of things that you we can do a lot of things that you wouldn't be able to do with a normal wouldn't be able to do with a normal wouldn't be able to do with a normal camera. We're still very early, but this camera. We're still very early, but this camera. We're still very early, but this is going to be a fundamental change in is going to be a fundamental change in is going to be a fundamental change in how we create media.

how we create media. how we create media. >> This video was, of course, generated by >> This video was, of course, generated by >> This video was, of course, generated by Cynthia. Cynthia. Cynthia. >> Synthesia makes and sells digital >> Synthesia makes and sells digital >> Synthesia makes and sells digital avatars using the faces of paid actors avatars using the faces of paid actors avatars using the faces of paid actors to deliver personalized messages in 64 to deliver personalized messages in 64 to deliver personalized messages in 64 languages and allows corporate CEOs to languages and allows corporate CEOs to languages and allows corporate CEOs to address employees overseas. Synthesia has also helped entertainers Synthesia has also helped entertainers like Snoop Dog go forth and multiply. like Snoop Dog go forth and multiply. like Snoop Dog go forth and multiply. This elaborate TV commercial for This elaborate TV commercial for This elaborate TV commercial for European food delivery service just eat European food delivery service just eat European food delivery service just eat cost a fortune. >> Just Eat has a subsidiary in Australia >> Just Eat has a subsidiary in Australia which is called Menuog. So what we did which is called Menuog. So what we did which is called Menuog. So what we did with our technology was we switched out with our technology was we switched out with our technology was we switched out the word just eat for menu lock. M E N U the word just eat for menu lock. M E N U the word just eat for menu lock. M E N U L O G >> and all of a sudden they had a localized >> and all of a sudden they had a localized version for the Australian market version for the Australian market version for the Australian market without Snoop Dogg having to do without Snoop Dogg having to do without Snoop Dogg having to do anything. anything. anything. >> So he makes twice the money. Huh. >> So he makes twice the money. Huh. >> So he makes twice the money. Huh. >> Yeah.

>> Yeah. >> Yeah. >> All it took was 8 minutes of me reading >> All it took was 8 minutes of me reading >> All it took was 8 minutes of me reading a script on camera for Synthesia to a script on camera for Synthesia to a script on camera for Synthesia to create my synthetic talking head create my synthetic talking head create my synthetic talking head complete with my gestures, head and complete with my gestures, head and complete with my gestures, head and mouth movements. Another company, mouth movements. Another company, mouth movements. Another company, Dscript, used AI to create a synthetic Dscript, used AI to create a synthetic Dscript, used AI to create a synthetic version of my voice. This is Bill version of my voice. This is Bill version of my voice. This is Bill Whitacre's synthetic voice with my Whitacre's synthetic voice with my Whitacre's synthetic voice with my cadence, tenor, and syncopation. This is cadence, tenor, and syncopation. This is cadence, tenor, and syncopation. This is the result. The words you're hearing the result. The words you're hearing the result. The words you're hearing were never spoken by the real Bill into were never spoken by the real Bill into were never spoken by the real Bill into a microphone or to a camera. He merely a microphone or to a camera. He merely a microphone or to a camera. He merely typed the words into a computer and they typed the words into a computer and they typed the words into a computer and they come out of my mouth. It may look and come out of my mouth. It may look and come out of my mouth. It may look and sound a little rough around the edges sound a little rough around the edges sound a little rough around the edges right now, but as the technology right now, but as the technology right now, but as the technology improves, the possibilities of spinning improves, the possibilities of spinning improves, the possibilities of spinning words and images out of thin air are words and images out of thin air are words and images out of thin air are endless. endless. endless. >> I'm Bill Whitaker. I'm Bill Whitaker. >> I'm Bill Whitaker. I'm Bill Whitaker. >> I'm Bill Whitaker. I'm Bill Whitaker. I'm Bill Whitaker. I'm Bill Whitaker. I'm Bill Whitaker. >> Wow. >> Wow. >> Wow. And the head, the eyebrows, the mouth, And the head, the eyebrows, the mouth, And the head, the eyebrows, the mouth, the way it moves, the way it moves, the way it moves, >> it's it's all synthetic. I could be >> it's it's all synthetic. I could be >> it's it's all synthetic. I could be lounging at the beach and say, "Folks, lounging at the beach and say, "Folks, lounging at the beach and say, "Folks, you know, I'm not gonna come in today, you know, I'm not gonna come in today, you know, I'm not gonna come in today, but you can use my avatar to do the but you can use my avatar to do the but you can use my avatar to do the work.

work. work. >> Maybe in a few years. >> Maybe in a few years. >> Maybe in a few years. >> Don't don't don't tell me that. I'd be >> Don't don't don't tell me that. I'd be >> Don't don't don't tell me that. I'd be tempted. tempted. tempted. >> I think it'll have a big impact." >> I think it'll have a big impact." >> I think it'll have a big impact." >> The rapid advances in synthetic media >> The rapid advances in synthetic media >> The rapid advances in synthetic media have caused a virtual gold rush. Tom have caused a virtual gold rush. Tom have caused a virtual gold rush. Tom Graham, a Londonbased lawyer who made Graham, a Londonbased lawyer who made Graham, a Londonbased lawyer who made his fortune in cryptocurrency, recently his fortune in cryptocurrency, recently his fortune in cryptocurrency, recently started a company called Metaphysic with started a company called Metaphysic with started a company called Metaphysic with none other than Chris Umei, creator of none other than Chris Umei, creator of none other than Chris Umei, creator of Deep Tom Cruz. Their goal, develop Deep Tom Cruz. Their goal, develop Deep Tom Cruz. Their goal, develop software to allow anyone to create software to allow anyone to create software to allow anyone to create Hollywood caliber movies without lights, Hollywood caliber movies without lights, Hollywood caliber movies without lights, cameras, or even actors. cameras, or even actors. cameras, or even actors. As the hardware scales and as the models As the hardware scales and as the models As the hardware scales and as the models become more efficient, we could scale up become more efficient, we could scale up become more efficient, we could scale up the size of that model to be an entire the size of that model to be an entire the size of that model to be an entire Tom Cruz body movement and everything. Tom Cruz body movement and everything. Tom Cruz body movement and everything. >> Well, talk about disruptive. I mean, are >> Well, talk about disruptive. I mean, are >> Well, talk about disruptive. I mean, are you going to put actors out of jobs? you going to put actors out of jobs? you going to put actors out of jobs? >> I think that it's a great thing if >> I think that it's a great thing if >> I think that it's a great thing if you're a well-known actor today. um you're a well-known actor today. um you're a well-known actor today. um because you may be able to let somebody because you may be able to let somebody because you may be able to let somebody collect data for you to create a version collect data for you to create a version collect data for you to create a version of yourself in the future where you of yourself in the future where you of yourself in the future where you could be acting in movies after you have could be acting in movies after you have could be acting in movies after you have deceased or you could be the director deceased or you could be the director deceased or you could be the director directing your younger self in a movie directing your younger self in a movie directing your younger self in a movie or something like that.

or something like that. or something like that. >> If you are wondering how all of this is >> If you are wondering how all of this is >> If you are wondering how all of this is legal, most deep fakes are considered legal, most deep fakes are considered legal, most deep fakes are considered protected free speech. Attempts at protected free speech. Attempts at protected free speech. Attempts at legislation are all over the map in New legislation are all over the map in New legislation are all over the map in New York. Commercial use of a performer's York. Commercial use of a performer's York. Commercial use of a performer's synthetic likeness without consent is synthetic likeness without consent is synthetic likeness without consent is banned for 40 years after their death. banned for 40 years after their death. banned for 40 years after their death. California and Texas prohibit deceptive California and Texas prohibit deceptive California and Texas prohibit deceptive political deep fakes in the leadup to an political deep fakes in the leadup to an political deep fakes in the leadup to an election. election. election. >> There are so many ethical, philosophical >> There are so many ethical, philosophical >> There are so many ethical, philosophical gray zones here that we really need to gray zones here that we really need to gray zones here that we really need to think about. think about. think about. >> So, how do we as a society grapple with >> So, how do we as a society grapple with >> So, how do we as a society grapple with this? just understanding this? just understanding this? just understanding what's going on because a lot of people what's going on because a lot of people what's going on because a lot of people still don't know what a deep fake is, still don't know what a deep fake is, still don't know what a deep fake is, what synthetic media is, uh that this is what synthetic media is, uh that this is what synthetic media is, uh that this is now possible. The counter to that is how now possible. The counter to that is how now possible. The counter to that is how do we inoculate ourselves and understand do we inoculate ourselves and understand do we inoculate ourselves and understand that this kind of content is coming and that this kind of content is coming and that this kind of content is coming and exists without being completely cynical, exists without being completely cynical, exists without being completely cynical, right? How do we do it without losing right? How do we do it without losing right? How do we do it without losing trust in all authentic media?

trust in all authentic media? trust in all authentic media? That's going to require all of us to That's going to require all of us to That's going to require all of us to figure out how to maneuver in a world. figure out how to maneuver in a world. figure out how to maneuver in a world. What we're seeing is not always What we're seeing is not always What we're seeing is not always believing. We may look on our time as the moment We may look on our time as the moment civilization was transformed as it was civilization was transformed as it was civilization was transformed as it was by fire, agriculture, and electricity. by fire, agriculture, and electricity. by fire, agriculture, and electricity. In 2023, we learned that a machine In 2023, we learned that a machine In 2023, we learned that a machine taught itself how to speak to humans taught itself how to speak to humans taught itself how to speak to humans like a peer, which is to say with like a peer, which is to say with like a peer, which is to say with creativity, truth, errors, and lies. The creativity, truth, errors, and lies. The creativity, truth, errors, and lies. The technology known as a chatbot is only technology known as a chatbot is only technology known as a chatbot is only one of the recent breakthroughs in one of the recent breakthroughs in one of the recent breakthroughs in artificial intelligence, machines that artificial intelligence, machines that artificial intelligence, machines that can teach themselves superhuman skills. can teach themselves superhuman skills. can teach themselves superhuman skills. In April, we explored what's coming next In April, we explored what's coming next In April, we explored what's coming next at Google, a leader in this new world. at Google, a leader in this new world. at Google, a leader in this new world. CEO Sundar Pachai told us AI will be as CEO Sundar Pachai told us AI will be as CEO Sundar Pachai told us AI will be as good or as evil as human nature allows.

good or as evil as human nature allows. good or as evil as human nature allows. The revolution, he says, is coming The revolution, he says, is coming The revolution, he says, is coming faster than you know. Do you think faster than you know. Do you think faster than you know. Do you think society is prepared for what's coming? society is prepared for what's coming? society is prepared for what's coming? >> You know, there are two ways I think >> You know, there are two ways I think >> You know, there are two ways I think about it. On one hand I feel no uh about it. On one hand I feel no uh about it. On one hand I feel no uh because you know the pace at which we because you know the pace at which we because you know the pace at which we can think and adapt as societal can think and adapt as societal can think and adapt as societal institutions compared to the pace at institutions compared to the pace at institutions compared to the pace at which the technology is evolving there which the technology is evolving there which the technology is evolving there seems to be a mismatch. seems to be a mismatch. seems to be a mismatch. On the other hand compared to any other On the other hand compared to any other On the other hand compared to any other technology I've seen more people worried technology I've seen more people worried technology I've seen more people worried about it earlier in its life cycle. So I about it earlier in its life cycle. So I about it earlier in its life cycle. So I feel optimistic the number of people you feel optimistic the number of people you feel optimistic the number of people you know who have started worrying about the know who have started worrying about the know who have started worrying about the implications and hence the conversations implications and hence the conversations implications and hence the conversations are starting in a serious way as well. are starting in a serious way as well. are starting in a serious way as well. >> Our conversations with 50-year-old >> Our conversations with 50-year-old >> Our conversations with 50-year-old Sundar Pachai started at Google's new Sundar Pachai started at Google's new Sundar Pachai started at Google's new campus in Mountain View, California. It campus in Mountain View, California. It campus in Mountain View, California. It runs on 40% solar power and collects runs on 40% solar power and collects runs on 40% solar power and collects more water than it uses. high-tech that more water than it uses. high-tech that more water than it uses. high-tech that Pchai couldn't have imagined growing up Pchai couldn't have imagined growing up Pchai couldn't have imagined growing up in India with no telephone at home.

in India with no telephone at home. in India with no telephone at home. >> We were on a waiting list to get a >> We were on a waiting list to get a >> We were on a waiting list to get a rotary phone and for about 5 years and rotary phone and for about 5 years and rotary phone and for about 5 years and it finally came home. I can still recall it finally came home. I can still recall it finally came home. I can still recall it vividly. It changed our lives to me. it vividly. It changed our lives to me. it vividly. It changed our lives to me. It was the first moment I understood the It was the first moment I understood the It was the first moment I understood the power of what getting access to power of what getting access to power of what getting access to technology meant. So probably led me to technology meant. So probably led me to technology meant. So probably led me to be doing what I'm doing today. be doing what I'm doing today. be doing what I'm doing today. What he's doing since 2019 is leading What he's doing since 2019 is leading What he's doing since 2019 is leading both Google and its parent company, both Google and its parent company, both Google and its parent company, Alphabet, valued at $1.5 trillion. Alphabet, valued at $1.5 trillion. Alphabet, valued at $1.5 trillion. Worldwide, Google runs 90% of internet Worldwide, Google runs 90% of internet Worldwide, Google runs 90% of internet searches and 70% of smartphones. We're searches and 70% of smartphones. We're searches and 70% of smartphones. We're really excited about. really excited about. really excited about. >> But its dominance was attacked this past >> But its dominance was attacked this past >> But its dominance was attacked this past February when Microsoft linked its February when Microsoft linked its February when Microsoft linked its search engine to a chatbot. In a race search engine to a chatbot. In a race search engine to a chatbot. In a race for AI dominance in March, Google for AI dominance in March, Google for AI dominance in March, Google released its chatbot named Bard. released its chatbot named Bard. released its chatbot named Bard. >> It's really here to help you brainstorm >> It's really here to help you brainstorm >> It's really here to help you brainstorm ideas to generate content like a speech ideas to generate content like a speech ideas to generate content like a speech or a blog post or an email. We were or a blog post or an email. We were or a blog post or an email. We were introduced to Bard by Google Vice introduced to Bard by Google Vice introduced to Bard by Google Vice President Shia and senior vice President Shia and senior vice President Shia and senior vice President James Manika.

President James Manika. President James Manika. >> Here's Bard. And >> Here's Bard. And >> Here's Bard. And >> the first thing we learned was that Bard >> the first thing we learned was that Bard >> the first thing we learned was that Bard does not look for answers on the does not look for answers on the does not look for answers on the internet like Google search does. internet like Google search does. internet like Google search does. >> So I wanted to get inspiration from some >> So I wanted to get inspiration from some >> So I wanted to get inspiration from some of the best speeches in the world. of the best speeches in the world. of the best speeches in the world. >> Bard's replies come from a >> Bard's replies come from a >> Bard's replies come from a self-contained program that was mostly self-contained program that was mostly self-contained program that was mostly self-taught. Our experience was self-taught. Our experience was self-taught. Our experience was unsettling. unsettling. unsettling. >> Confounding. Absolutely confounding. >> Confounding. Absolutely confounding. >> Confounding. Absolutely confounding. >> Bard appeared to possess the sum of >> Bard appeared to possess the sum of >> Bard appeared to possess the sum of human knowledge. human knowledge. human knowledge. >> With microchips more than 100,000 times >> With microchips more than 100,000 times >> With microchips more than 100,000 times faster than the human brain. faster than the human brain. faster than the human brain. >> Summarize the >> Summarize the >> Summarize the >> We asked Bard to summarize the New >> We asked Bard to summarize the New >> We asked Bard to summarize the New Testament. It did in 5 seconds and 17 Testament. It did in 5 seconds and 17 Testament. It did in 5 seconds and 17 words. words. words. >> In Latin. We asked for it in Latin. That >> In Latin. We asked for it in Latin. That >> In Latin. We asked for it in Latin. That took another four seconds. Then we took another four seconds. Then we took another four seconds. Then we played with a famous sixword short story played with a famous sixword short story played with a famous sixword short story often attributed to Hemingway. For sale, often attributed to Hemingway. For sale, often attributed to Hemingway. For sale, baby shoes never worn. baby shoes never worn. baby shoes never worn. >> Wow. >> Wow. >> Wow. >> The only prompt we gave was finish this >> The only prompt we gave was finish this >> The only prompt we gave was finish this story story story in 5 seconds.

in 5 seconds. in 5 seconds. Holy cow. Holy cow. Holy cow. The shoes were a gift from my wife, but The shoes were a gift from my wife, but The shoes were a gift from my wife, but we never had a baby. They were from the we never had a baby. They were from the we never had a baby. They were from the six-word prompt. Bard created a deeply six-word prompt. Bard created a deeply six-word prompt. Bard created a deeply human tale with characters it invented, human tale with characters it invented, human tale with characters it invented, including a man whose wife could not including a man whose wife could not including a man whose wife could not conceive and a stranger grieving after a conceive and a stranger grieving after a conceive and a stranger grieving after a miscarriage and longing for closure. miscarriage and longing for closure. miscarriage and longing for closure. Uh, I am rarely speechless. Uh, I am rarely speechless. Uh, I am rarely speechless. I don't know what to make of this. I don't know what to make of this. I don't know what to make of this. Give me Give me Give me >> We asked for the story in verse in 5 >> We asked for the story in verse in 5 >> We asked for the story in verse in 5 seconds. There was a poem written by a seconds. There was a poem written by a seconds. There was a poem written by a machine with breathtaking insight into machine with breathtaking insight into machine with breathtaking insight into the mystery of faith. Bard wrote, "She the mystery of faith. Bard wrote, "She the mystery of faith. Bard wrote, "She knew her baby's soul would always be knew her baby's soul would always be knew her baby's soul would always be alive. alive. alive. The humanity at superhuman speed was a The humanity at superhuman speed was a The humanity at superhuman speed was a shock." How is this possible?

shock." How is this possible? shock." How is this possible? James Manika told us that over several James Manika told us that over several James Manika told us that over several months, Bard read most everything on the months, Bard read most everything on the months, Bard read most everything on the internet and created a model of what internet and created a model of what internet and created a model of what language looks like. Rather than search, language looks like. Rather than search, language looks like. Rather than search, its answers come from this language its answers come from this language its answers come from this language model. model. model. >> So for example, if I said to you Scott, >> So for example, if I said to you Scott, >> So for example, if I said to you Scott, peanut butter and jelly, peanut butter and jelly, peanut butter and jelly, >> right? So it tries and learns to >> right? So it tries and learns to >> right? So it tries and learns to predict. Okay, so peanut butter usually predict. Okay, so peanut butter usually predict. Okay, so peanut butter usually is followed by jelly. It tries to is followed by jelly. It tries to is followed by jelly. It tries to predict the most probable next words predict the most probable next words predict the most probable next words based on everything it's learned. Uh so based on everything it's learned. Uh so based on everything it's learned. Uh so it's not going out to find stuff. It's it's not going out to find stuff. It's it's not going out to find stuff. It's just predicting the next word. just predicting the next word. just predicting the next word. >> But it doesn't feel like that. We asked >> But it doesn't feel like that. We asked >> But it doesn't feel like that. We asked Bard why it helps people and it replied Bard why it helps people and it replied Bard why it helps people and it replied quote because it makes me happy. quote because it makes me happy. quote because it makes me happy. barred to my eye appears to be thinking, barred to my eye appears to be thinking, barred to my eye appears to be thinking, appears to be making judgments. appears to be making judgments. appears to be making judgments. That's not what's happening. These That's not what's happening. These That's not what's happening. These machines are not sensient. They are not machines are not sensient. They are not machines are not sensient. They are not aware of themselves.

aware of themselves. aware of themselves. >> They're not sentient. They're not aware >> They're not sentient. They're not aware >> They're not sentient. They're not aware of themselves. Uh they can exhibit of themselves. Uh they can exhibit of themselves. Uh they can exhibit behaviors that look like that because behaviors that look like that because behaviors that look like that because keep in mind, they've learned from us. keep in mind, they've learned from us. keep in mind, they've learned from us. We are sentient beings. We have beings We are sentient beings. We have beings We are sentient beings. We have beings that have feelings, emotions, ideas, that have feelings, emotions, ideas, that have feelings, emotions, ideas, thoughts, perspectives. thoughts, perspectives. thoughts, perspectives. We've reflected all that in books, in We've reflected all that in books, in We've reflected all that in books, in novels, in fiction. So when they learn novels, in fiction. So when they learn novels, in fiction. So when they learn from that, they build patterns from from that, they build patterns from from that, they build patterns from that. So it's no surprise to me that the that. So it's no surprise to me that the that. So it's no surprise to me that the exhibited behavior sometimes looks like exhibited behavior sometimes looks like exhibited behavior sometimes looks like maybe there's somebody behind there. maybe there's somebody behind there. maybe there's somebody behind there. There's nobody there. These are not There's nobody there. These are not There's nobody there. These are not sentient beings. sentient beings. sentient beings. Zimbabwe born Oxford educated James Zimbabwe born Oxford educated James Zimbabwe born Oxford educated James Manika holds a new position at Google. Manika holds a new position at Google. Manika holds a new position at Google. His job is to think about how AI and His job is to think about how AI and His job is to think about how AI and humanity will best coexist. humanity will best coexist. humanity will best coexist. >> AI has the potential to change many ways >> AI has the potential to change many ways >> AI has the potential to change many ways in which we've thought about society in which we've thought about society in which we've thought about society about what we're able to do the the about what we're able to do the the about what we're able to do the the problems we can solve. problems we can solve. problems we can solve. >> But AI itself will pose its own >> But AI itself will pose its own >> But AI itself will pose its own problems. Could Hemingway write a better problems. Could Hemingway write a better problems. Could Hemingway write a better short story? Maybe. But Bard can write a short story? Maybe. But Bard can write a short story? Maybe. But Bard can write a million before Hemingway could finish million before Hemingway could finish million before Hemingway could finish one. Imagine that level of automation one. Imagine that level of automation one. Imagine that level of automation across the economy. A lot of people can across the economy. A lot of people can across the economy. A lot of people can be replaced by this technology.

be replaced by this technology. be replaced by this technology. >> Yes, there are some job occupations that >> Yes, there are some job occupations that >> Yes, there are some job occupations that will start to decline over time. There will start to decline over time. There will start to decline over time. There are also new job categories that will are also new job categories that will are also new job categories that will grow over time. But the biggest change grow over time. But the biggest change grow over time. But the biggest change will be the jobs that will be changed. will be the jobs that will be changed. will be the jobs that will be changed. something like more than twothirds will something like more than twothirds will something like more than twothirds will have their definitions change, not go have their definitions change, not go have their definitions change, not go away, but change because they're now away, but change because they're now away, but change because they're now being assisted by AI and by automation. being assisted by AI and by automation. being assisted by AI and by automation. So, this is a profound change which has So, this is a profound change which has So, this is a profound change which has implications for skills. How do we implications for skills. How do we implications for skills. How do we assist people build new skills, learn to assist people build new skills, learn to assist people build new skills, learn to work alongside machines and how do these work alongside machines and how do these work alongside machines and how do these complement what people do today? this is complement what people do today? this is complement what people do today? this is going to impact every product across going to impact every product across going to impact every product across every company and and so that's why I every company and and so that's why I every company and and so that's why I think it's a a very very profound think it's a a very very profound think it's a a very very profound technology and so we are just in early technology and so we are just in early technology and so we are just in early days days days >> every product in every company >> every product in every company >> every product in every company >> that's right AI will impact everything >> that's right AI will impact everything >> that's right AI will impact everything so for example you could be a so for example you could be a so for example you could be a radiologist you know if I if you think radiologist you know if I if you think radiologist you know if I if you think about 5 to 10 years from now you're about 5 to 10 years from now you're about 5 to 10 years from now you're going to have a AI collaborator with you going to have a AI collaborator with you going to have a AI collaborator with you it may triage you come in the morning it may triage you come in the morning it may triage you come in the morning you let's say you have 100 things to go you let's say you have 100 things to go you let's say you have 100 things to go true. It may say these are the most true. It may say these are the most true. It may say these are the most serious cases you need to look at first.

serious cases you need to look at first. serious cases you need to look at first. Or when you're looking at something, it Or when you're looking at something, it Or when you're looking at something, it may pop up and say, "You may have missed may pop up and say, "You may have missed may pop up and say, "You may have missed something important. Why would we, you something important. Why would we, you something important. Why would we, you know, why would we take advantage of a know, why would we take advantage of a know, why would we take advantage of a superpowered assistant to help you superpowered assistant to help you superpowered assistant to help you across everything you do? You may be a across everything you do? You may be a across everything you do? You may be a student trying to learn math or history student trying to learn math or history student trying to learn math or history and you know, you will have something and you know, you will have something and you know, you will have something helping you." helping you." helping you." >> We asked Pchai what jobs would be >> We asked Pchai what jobs would be >> We asked Pchai what jobs would be disrupted. He said, "Knowledge workers, disrupted. He said, "Knowledge workers, disrupted. He said, "Knowledge workers, people like writers, accountants, people like writers, accountants, people like writers, accountants, architects, and ironically, software architects, and ironically, software architects, and ironically, software engineers, AI writes computer code, engineers, AI writes computer code, engineers, AI writes computer code, too." Today, Sundar Pachai walks a too." Today, Sundar Pachai walks a too." Today, Sundar Pachai walks a narrow line. A few employees have quit. narrow line. A few employees have quit. narrow line. A few employees have quit. Some believing that Google's AI rollout Some believing that Google's AI rollout Some believing that Google's AI rollout is too slow, others too fast. There are is too slow, others too fast. There are is too slow, others too fast. There are some serious flaws. some serious flaws. some serious flaws. >> There's a return of inflation. James >> There's a return of inflation. James >> There's a return of inflation. James Manika asked Bard about inflation. It Manika asked Bard about inflation. It Manika asked Bard about inflation. It wrote an instant essay in economics and wrote an instant essay in economics and wrote an instant essay in economics and recommended five books.

recommended five books. recommended five books. But days later, we checked. None of the But days later, we checked. None of the But days later, we checked. None of the books is real. Bard fabricated the books is real. Bard fabricated the books is real. Bard fabricated the titles. This very human trait, error titles. This very human trait, error titles. This very human trait, error with confidence, is called in the with confidence, is called in the with confidence, is called in the industry hallucination. industry hallucination. industry hallucination. >> Are you getting a lot of hallucinations? >> Are you getting a lot of hallucinations? >> Are you getting a lot of hallucinations? >> Uh yes. uh you know which is expected. >> Uh yes. uh you know which is expected. >> Uh yes. uh you know which is expected. No one in the in the field has yet No one in the in the field has yet No one in the in the field has yet solved the hallucination problems. All solved the hallucination problems. All solved the hallucination problems. All models uh do have uh this as an issue. models uh do have uh this as an issue. models uh do have uh this as an issue. >> Is it a solvable problem? >> Is it a solvable problem? >> Is it a solvable problem? >> It's a matter of intense debate. I think >> It's a matter of intense debate. I think >> It's a matter of intense debate. I think we'll make progress. we'll make progress. we'll make progress. >> To help cure hallucinations, Bard >> To help cure hallucinations, Bard >> To help cure hallucinations, Bard features a Google it button that leads features a Google it button that leads features a Google it button that leads to oldfashioned search. Google has also to oldfashioned search. Google has also to oldfashioned search. Google has also built safety filters in Debard to screen built safety filters in Debard to screen built safety filters in Debard to screen for things like hate speech and bias. for things like hate speech and bias. for things like hate speech and bias. How great a risk is the spread of How great a risk is the spread of How great a risk is the spread of disinformation? disinformation? disinformation? >> AI will challenge that in a deeper way.

>> AI will challenge that in a deeper way. >> AI will challenge that in a deeper way. The scale of this problem is going to be The scale of this problem is going to be The scale of this problem is going to be much bigger, much bigger, much bigger, >> bigger problems, he says with fake news >> bigger problems, he says with fake news >> bigger problems, he says with fake news and fake images. It will be possible and fake images. It will be possible and fake images. It will be possible with AI to create uh you know a video with AI to create uh you know a video with AI to create uh you know a video easily where it could be Scott saying easily where it could be Scott saying easily where it could be Scott saying something or me saying something and we something or me saying something and we something or me saying something and we never said that and it could look never said that and it could look never said that and it could look accurate but you know at a societal accurate but you know at a societal accurate but you know at a societal scale you know can cause a lot of harm. scale you know can cause a lot of harm. scale you know can cause a lot of harm. >> Is Bard safe for society? >> Is Bard safe for society? >> Is Bard safe for society? the way we have launched it today uh as the way we have launched it today uh as the way we have launched it today uh as an experiment in a limited way. Uh I an experiment in a limited way. Uh I an experiment in a limited way. Uh I think so. But we all have to be think so. But we all have to be think so. But we all have to be responsible in each step along the way. responsible in each step along the way. responsible in each step along the way. >> This past spring, Google released an >> This past spring, Google released an >> This past spring, Google released an advanced version of Bard that can write advanced version of Bard that can write advanced version of Bard that can write software and connect to the internet. software and connect to the internet. software and connect to the internet. Google says it's developing even more Google says it's developing even more Google says it's developing even more sophisticated AI models. you are letting sophisticated AI models. you are letting sophisticated AI models. you are letting this out slowly so that society can get this out slowly so that society can get this out slowly so that society can get used to it. used to it. used to it. >> That's one part of it. Uh one part is >> That's one part of it. Uh one part is >> That's one part of it. Uh one part is also so that we get the user feedback also so that we get the user feedback also so that we get the user feedback and we can develop more robust safety and we can develop more robust safety and we can develop more robust safety layers before we build before we deploy layers before we build before we deploy layers before we build before we deploy more capable models.

more capable models. more capable models. >> Of the AI issues we talked about the >> Of the AI issues we talked about the >> Of the AI issues we talked about the most mysterious is called emergent most mysterious is called emergent most mysterious is called emergent properties. properties. properties. Some AI systems are teaching themselves Some AI systems are teaching themselves Some AI systems are teaching themselves skills they weren't expected to have. skills they weren't expected to have. skills they weren't expected to have. How this happens is not well understood. How this happens is not well understood. How this happens is not well understood. For example, one Google AI program For example, one Google AI program For example, one Google AI program adapted on its own after it was prompted adapted on its own after it was prompted adapted on its own after it was prompted in the language of Bangladesh which it in the language of Bangladesh which it in the language of Bangladesh which it was not trained to translate. was not trained to translate. was not trained to translate. We discovered that with very few amounts We discovered that with very few amounts We discovered that with very few amounts of prompting in Bengali, it could now of prompting in Bengali, it could now of prompting in Bengali, it could now translate all of Bengali. So now all of translate all of Bengali. So now all of translate all of Bengali. So now all of a sudden we now have a research effort a sudden we now have a research effort a sudden we now have a research effort where we're now trying to get to a where we're now trying to get to a where we're now trying to get to a thousand languages. thousand languages. thousand languages. >> There is an aspect of this which we call >> There is an aspect of this which we call >> There is an aspect of this which we call all of us in the field call it as a all of us in the field call it as a all of us in the field call it as a black box. You know, you don't fully black box. You know, you don't fully black box. You know, you don't fully understand and you can't quite tell why understand and you can't quite tell why understand and you can't quite tell why it said this or why it got wrong. We it said this or why it got wrong. We it said this or why it got wrong. We have some ideas and our ability to have some ideas and our ability to have some ideas and our ability to understand this gets better over time, understand this gets better over time, understand this gets better over time, but that's where the state-of-the-art but that's where the state-of-the-art but that's where the state-of-the-art is.

is. is. >> You don't fully understand how it works >> You don't fully understand how it works >> You don't fully understand how it works and yet you've turned it loose on and yet you've turned it loose on and yet you've turned it loose on society. society. society. >> Yeah. Let me put it this way. I don't >> Yeah. Let me put it this way. I don't >> Yeah. Let me put it this way. I don't think we fully understand how a human think we fully understand how a human think we fully understand how a human mind works either. mind works either. mind works either. >> Was it from that black box we wondered >> Was it from that black box we wondered >> Was it from that black box we wondered that Bard drew its short story that that Bard drew its short story that that Bard drew its short story that seems so disarmingly human? that talked seems so disarmingly human? that talked seems so disarmingly human? that talked about the pain that humans feel. It about the pain that humans feel. It about the pain that humans feel. It talked about redemption. talked about redemption. talked about redemption. How did it do all of those things if How did it do all of those things if How did it do all of those things if it's just trying to figure out what the it's just trying to figure out what the it's just trying to figure out what the next right word is? May I've had these next right word is? May I've had these next right word is? May I've had these experiences uh talking with B as well. experiences uh talking with B as well. experiences uh talking with B as well. There are two views of this. You know, There are two views of this. You know, There are two views of this. You know, there are set of people who view this as there are set of people who view this as there are set of people who view this as look these are just algorithms. They're look these are just algorithms. They're look these are just algorithms. They're just repeating what they've seen online. just repeating what they've seen online. just repeating what they've seen online. Then there is the view where these Then there is the view where these Then there is the view where these algorithms are showing emergent algorithms are showing emergent algorithms are showing emergent properties to be creative to reason to properties to be creative to reason to properties to be creative to reason to plan and so on right and and personally plan and so on right and and personally plan and so on right and and personally I think we need to be uh we need to I think we need to be uh we need to I think we need to be uh we need to approach this with humility part of the approach this with humility part of the approach this with humility part of the reason I think it's good that some of reason I think it's good that some of reason I think it's good that some of these technologies are getting out is so these technologies are getting out is so these technologies are getting out is so that society you know people like you that society you know people like you that society you know people like you and others can process what's happening and others can process what's happening and others can process what's happening and we begin this conversation and and we begin this conversation and and we begin this conversation and debate. And I think it's important to do debate. And I think it's important to do debate. And I think it's important to do that.

that. that. >> When we come back, we'll take you inside >> When we come back, we'll take you inside >> When we come back, we'll take you inside Google's artificial intelligence labs Google's artificial intelligence labs Google's artificial intelligence labs where robots are learning. The revolution in artificial The revolution in artificial intelligence is the center of a debate intelligence is the center of a debate intelligence is the center of a debate ranging from those who hope it will save ranging from those who hope it will save ranging from those who hope it will save humanity to those who predict doom. humanity to those who predict doom. humanity to those who predict doom. Google lies somewhere in the optimistic Google lies somewhere in the optimistic Google lies somewhere in the optimistic middle introducing AI in steps so that middle introducing AI in steps so that middle introducing AI in steps so that civilization can get used to it. We saw civilization can get used to it. We saw civilization can get used to it. We saw what's coming next in machine learning what's coming next in machine learning what's coming next in machine learning earlier this year at Google's AI lab in earlier this year at Google's AI lab in earlier this year at Google's AI lab in London, a company called Deep Mind, London, a company called Deep Mind, London, a company called Deep Mind, where the future looks something like where the future looks something like where the future looks something like this. this. this. Look at that. Oh my goodness. Look at that. Oh my goodness. Look at that. Oh my goodness. >> They've got a pretty good kick on them. >> They've got a pretty good kick on them. >> They've got a pretty good kick on them. Can still get pretty good good game. Can still get pretty good good game. Can still get pretty good good game. >> A soccer match at Deep Mind looks like >> A soccer match at Deep Mind looks like >> A soccer match at Deep Mind looks like fun in games, but here's the thing.

fun in games, but here's the thing. fun in games, but here's the thing. Humans did not program these robots to Humans did not program these robots to Humans did not program these robots to play. They learned the game by play. They learned the game by play. They learned the game by themselves. themselves. themselves. >> It's coming up with these interesting >> It's coming up with these interesting >> It's coming up with these interesting different strategies, different ways to different strategies, different ways to different strategies, different ways to walk, different ways to block. walk, different ways to block. walk, different ways to block. >> And they're doing it. They're scoring >> And they're doing it. They're scoring >> And they're doing it. They're scoring over and over again. over and over again. over and over again. >> This robot here, >> This robot here, >> This robot here, >> Rya Hatel, vice president of research >> Rya Hatel, vice president of research >> Rya Hatel, vice president of research and robotics, showed us how engineers and robotics, showed us how engineers and robotics, showed us how engineers used motion capture technology to teach used motion capture technology to teach used motion capture technology to teach the AI program how to move like a human. the AI program how to move like a human. the AI program how to move like a human. But on the soccer pitch, the robots were But on the soccer pitch, the robots were But on the soccer pitch, the robots were told only that the object was to score. told only that the object was to score. told only that the object was to score. The self-arning program spent about two The self-arning program spent about two The self-arning program spent about two weeks testing different moves. It weeks testing different moves. It weeks testing different moves. It discarded those that didn't work, built discarded those that didn't work, built discarded those that didn't work, built on those that did, and created all on those that did, and created all on those that did, and created all stars. There's another goal. stars. There's another goal. stars. There's another goal. >> And with practice, they get better. >> And with practice, they get better. >> And with practice, they get better. Hansel told us that independent from the Hansel told us that independent from the Hansel told us that independent from the robots, the AI program plays thousands robots, the AI program plays thousands robots, the AI program plays thousands of games from which it learns and of games from which it learns and of games from which it learns and invents its own tactics.

invents its own tactics. invents its own tactics. >> Here, you think that red player is going >> Here, you think that red player is going >> Here, you think that red player is going to grab it, but instead it just stops to grab it, but instead it just stops to grab it, but instead it just stops it, it, it, >> hands it back, passes it back, and then >> hands it back, passes it back, and then >> hands it back, passes it back, and then goes for the goal. goes for the goal. goes for the goal. >> And the AI figured out how to do that on >> And the AI figured out how to do that on >> And the AI figured out how to do that on its own. its own. its own. >> That's right. That's right. And it takes >> That's right. That's right. And it takes >> That's right. That's right. And it takes a while. At first, all the players just a while. At first, all the players just a while. At first, all the players just run after the ball together like a run after the ball together like a run after the ball together like a gaggle of uh, you know, six-year-olds gaggle of uh, you know, six-year-olds gaggle of uh, you know, six-year-olds the first time they're they're they're the first time they're they're they're the first time they're they're they're playing ball. Over time, what we start playing ball. Over time, what we start playing ball. Over time, what we start to see is now ah, what's the strategy? to see is now ah, what's the strategy? to see is now ah, what's the strategy? You go after the ball. I'm coming around You go after the ball. I'm coming around You go after the ball. I'm coming around this way or we should pass or I should this way or we should pass or I should this way or we should pass or I should block while you get to the goal. So, we block while you get to the goal. So, we block while you get to the goal. So, we see all of that coordination see all of that coordination see all of that coordination um, emerging in the play. This is a lot of fun, but what are the This is a lot of fun, but what are the practical implications of what we're practical implications of what we're practical implications of what we're seeing here? seeing here? seeing here? >> This is the type of research that can >> This is the type of research that can >> This is the type of research that can eventually lead to robots that can come eventually lead to robots that can come eventually lead to robots that can come out of the factories and work in other out of the factories and work in other out of the factories and work in other types of human environments. You know, types of human environments. You know, types of human environments. You know, think about mining, think about think about mining, think about think about mining, think about dangerous construction work, um, or dangerous construction work, um, or dangerous construction work, um, or exploration or disaster recovery. These exploration or disaster recovery. These exploration or disaster recovery. These are are are >> Rya Hadzel is among 1,000 humans at Deep >> Rya Hadzel is among 1,000 humans at Deep >> Rya Hadzel is among 1,000 humans at Deep Mind. The company was co-founded just 12 Mind. The company was co-founded just 12 Mind. The company was co-founded just 12 years ago by CEO Demis Habisas.

years ago by CEO Demis Habisas. years ago by CEO Demis Habisas. >> So if I think back to 2010 when we >> So if I think back to 2010 when we >> So if I think back to 2010 when we started, nobody was doing AI. There was started, nobody was doing AI. There was started, nobody was doing AI. There was nothing going on in industry. People nothing going on in industry. People nothing going on in industry. People used to eye roll and we talked to them used to eye roll and we talked to them used to eye roll and we talked to them investors about doing AI. So we couldn't investors about doing AI. So we couldn't investors about doing AI. So we couldn't we could barely get two cents together we could barely get two cents together we could barely get two cents together to start off with, which is crazy if you to start off with, which is crazy if you to start off with, which is crazy if you think about now the billions being think about now the billions being think about now the billions being invested into AI startups. invested into AI startups. invested into AI startups. Cambridge, Harvard, MIT. Habisas has Cambridge, Harvard, MIT. Habisas has Cambridge, Harvard, MIT. Habisas has degrees in computer science and degrees in computer science and degrees in computer science and neuroscience. His PhD is in human neuroscience. His PhD is in human neuroscience. His PhD is in human imagination. And imagine this, when he imagination. And imagine this, when he imagination. And imagine this, when he was 12, in his age group, he was the was 12, in his age group, he was the was 12, in his age group, he was the number two chess champion in the world. number two chess champion in the world. number two chess champion in the world. It was through games that he came to AI. It was through games that he came to AI. It was through games that he came to AI. I've been working on AI for for decades I've been working on AI for for decades I've been working on AI for for decades now and I've always believed that it's now and I've always believed that it's now and I've always believed that it's going to be the most important invention going to be the most important invention going to be the most important invention that humanity will ever make. that humanity will ever make. that humanity will ever make. >> Will the pace of change outstrip our >> Will the pace of change outstrip our >> Will the pace of change outstrip our ability to adapt? ability to adapt? ability to adapt? >> I don't think so. I think that we um you >> I don't think so. I think that we um you >> I don't think so. I think that we um you know we're sort of an infinitely know we're sort of an infinitely know we're sort of an infinitely adaptable species. Um, you know, you adaptable species. Um, you know, you adaptable species. Um, you know, you look at today us using all of our look at today us using all of our look at today us using all of our smartphones and other devices and we smartphones and other devices and we smartphones and other devices and we effortlessly sort of adapt to these new effortlessly sort of adapt to these new effortlessly sort of adapt to these new technologies and this is going to be technologies and this is going to be technologies and this is going to be another one of those changes like that.

another one of those changes like that. another one of those changes like that. >> Among the biggest changes at Deep Mind >> Among the biggest changes at Deep Mind >> Among the biggest changes at Deep Mind was the discovery that self-arning was the discovery that self-arning was the discovery that self-arning machines can be creative. machines can be creative. machines can be creative. >> So this is >> So this is >> So this is >> Haba showed us a game playing that >> Haba showed us a game playing that >> Haba showed us a game playing that learns. It's called Alpha Zero, and it learns. It's called Alpha Zero, and it learns. It's called Alpha Zero, and it dreamed up a winning chess strategy no dreamed up a winning chess strategy no dreamed up a winning chess strategy no human had ever seen. But this is just a human had ever seen. But this is just a human had ever seen. But this is just a machine. How does it achieve creativity? machine. How does it achieve creativity? machine. How does it achieve creativity? >> It plays against itself 10 tens of >> It plays against itself 10 tens of >> It plays against itself 10 tens of millions of times. So, it can explore um millions of times. So, it can explore um millions of times. So, it can explore um parts of chess that maybe human chess parts of chess that maybe human chess parts of chess that maybe human chess players and and and programmers who players and and and programmers who players and and and programmers who program chess computers haven't thought program chess computers haven't thought program chess computers haven't thought about before. about before. about before. >> It never gets tired. It never gets >> It never gets tired. It never gets >> It never gets tired. It never gets hungry. It just plays chess all the hungry. It just plays chess all the hungry. It just plays chess all the time. time. time. >> Yes. It's it's kind of amazing thing to >> Yes. It's it's kind of amazing thing to >> Yes. It's it's kind of amazing thing to see because actually you set off alpha see because actually you set off alpha see because actually you set off alpha zero in the morning uh and it starts off zero in the morning uh and it starts off zero in the morning uh and it starts off playing randomly by lunchtime you know playing randomly by lunchtime you know playing randomly by lunchtime you know it's able to beat me and beat most chess it's able to beat me and beat most chess it's able to beat me and beat most chess players and then by the evening it's players and then by the evening it's players and then by the evening it's stronger than the world champion you stronger than the world champion you stronger than the world champion you know know know >> deisabas sold deep mind to Google in >> deisabas sold deep mind to Google in >> deisabas sold deep mind to Google in 2014 2014 2014 one reason was to get his hands on this one reason was to get his hands on this one reason was to get his hands on this Google has the enormous computing power Google has the enormous computing power Google has the enormous computing power that AI needs this computing center is that AI needs this computing center is that AI needs this computing center is in prior Oklahoma But Google has 23 of in prior Oklahoma But Google has 23 of in prior Oklahoma But Google has 23 of these, putting it near the top in these, putting it near the top in these, putting it near the top in computing power in the world. This is computing power in the world. This is computing power in the world. This is one of two advances that make AI one of two advances that make AI one of two advances that make AI ascendant. Now, first, the sum of all ascendant. Now, first, the sum of all ascendant. Now, first, the sum of all human knowledge is online. And second, human knowledge is online. And second, human knowledge is online. And second, brute force computing that very loosely

brute force computing that very loosely brute force computing that very loosely approximates the neural networks and approximates the neural networks and approximates the neural networks and talents of the brain. things like talents of the brain. things like talents of the brain. things like memory, imagination, planning, memory, imagination, planning, memory, imagination, planning, reinforcement learning. These are all reinforcement learning. These are all reinforcement learning. These are all things that are known about how the things that are known about how the things that are known about how the brain does it and we wanted to replicate brain does it and we wanted to replicate brain does it and we wanted to replicate some of that uh in our AI systems. some of that uh in our AI systems. some of that uh in our AI systems. >> You predict one of those indiv. >> You predict one of those indiv. >> You predict one of those indiv. >> Those are some of the elements that led >> Those are some of the elements that led >> Those are some of the elements that led to deep mind's greatest achievement so to deep mind's greatest achievement so to deep mind's greatest achievement so far. Solving an impossible problem in far. Solving an impossible problem in far. Solving an impossible problem in biology. biology. biology. Proteins are building blocks of life. Proteins are building blocks of life. Proteins are building blocks of life. But only a tiny fraction were understood But only a tiny fraction were understood But only a tiny fraction were understood because 3D mapping of just one could because 3D mapping of just one could because 3D mapping of just one could take years. DeepMind created an AI take years. DeepMind created an AI take years. DeepMind created an AI program for the protein problem and set program for the protein problem and set program for the protein problem and set it loose. it loose. it loose. >> Well, it took us about four or five >> Well, it took us about four or five >> Well, it took us about four or five years to to figure out how to build the years to to figure out how to build the years to to figure out how to build the system. It was probably our most complex system. It was probably our most complex system. It was probably our most complex project we've ever undertaken. But once project we've ever undertaken. But once project we've ever undertaken. But once we did that, it can solve a protein we did that, it can solve a protein we did that, it can solve a protein structure in a matter of seconds. And structure in a matter of seconds. And structure in a matter of seconds. And actually over the last year we did all actually over the last year we did all actually over the last year we did all the 200 million proteins that are known the 200 million proteins that are known the 200 million proteins that are known to science. to science. to science. >> How long would it have taken using >> How long would it have taken using >> How long would it have taken using traditional methods?

traditional methods? traditional methods? >> Well, the rule of thumb I was always >> Well, the rule of thumb I was always >> Well, the rule of thumb I was always told by my biologist friends is that it told by my biologist friends is that it told by my biologist friends is that it it takes a whole PhD 5 years to do one it takes a whole PhD 5 years to do one it takes a whole PhD 5 years to do one protein structure experimentally. So if protein structure experimentally. So if protein structure experimentally. So if you think 200 million times 5, that's a you think 200 million times 5, that's a you think 200 million times 5, that's a billion years of PhD time it would have billion years of PhD time it would have billion years of PhD time it would have taken. taken. taken. >> Deep Mind made its protein database >> Deep Mind made its protein database >> Deep Mind made its protein database public. A gift to humanity. Habisas public. A gift to humanity. Habisas public. A gift to humanity. Habisas called it. How has it been used? called it. How has it been used? called it. How has it been used? >> It's been used in an enormously broad >> It's been used in an enormously broad >> It's been used in an enormously broad number of ways actually from u malaria number of ways actually from u malaria number of ways actually from u malaria vaccines to developing new enzymes that vaccines to developing new enzymes that vaccines to developing new enzymes that can eat plastic waste um to new uh can eat plastic waste um to new uh can eat plastic waste um to new uh antibiotics. antibiotics. antibiotics. >> Most AI systems today do one or maybe >> Most AI systems today do one or maybe >> Most AI systems today do one or maybe two things well. The soccer robots, for two things well. The soccer robots, for two things well. The soccer robots, for example, can't write up a grocery list example, can't write up a grocery list example, can't write up a grocery list or book your travel or drive your car. or book your travel or drive your car. or book your travel or drive your car. The ultimate goal is what's called The ultimate goal is what's called The ultimate goal is what's called artificial general intelligence. A artificial general intelligence. A artificial general intelligence. A learning machine that can score on a learning machine that can score on a learning machine that can score on a wide range of talents. Would such a wide range of talents. Would such a wide range of talents. Would such a machine be conscious of itself?

machine be conscious of itself? machine be conscious of itself? >> So that's another great question. We, >> So that's another great question. We, >> So that's another great question. We, you know, philosophers haven't really you know, philosophers haven't really you know, philosophers haven't really settled on a definition of consciousness settled on a definition of consciousness settled on a definition of consciousness yet, but if we mean by sort of yet, but if we mean by sort of yet, but if we mean by sort of self-awareness and uh these kinds of self-awareness and uh these kinds of self-awareness and uh these kinds of things, um, you know, I think there's a things, um, you know, I think there's a things, um, you know, I think there's a possibility AI one day could be. I possibility AI one day could be. I possibility AI one day could be. I definitely don't think they are today. definitely don't think they are today. definitely don't think they are today. Um, but I think again this is one of the Um, but I think again this is one of the Um, but I think again this is one of the fascinating scientific things we're fascinating scientific things we're fascinating scientific things we're going to find out on this journey going to find out on this journey going to find out on this journey towards AI. >> Even unconscious current AI is >> Even unconscious current AI is superhuman in narrow ways. Back in superhuman in narrow ways. Back in superhuman in narrow ways. Back in California, we saw Google engineers California, we saw Google engineers California, we saw Google engineers teaching skills that robots will teaching skills that robots will teaching skills that robots will practice continuously on their own. practice continuously on their own. practice continuously on their own. >> Push the blue cube to the blue triangle. >> Push the blue cube to the blue triangle. >> Push the blue cube to the blue triangle. >> They comprehend instructions. Push the >> They comprehend instructions. Push the >> They comprehend instructions. Push the yellow hexagon to the yellow heart yellow hexagon to the yellow heart yellow hexagon to the yellow heart >> and learn to recognize objects. >> and learn to recognize objects. >> and learn to recognize objects. >> What would you like? >> What would you like? >> What would you like? >> How about an apple? >> How about an apple? >> How about an apple? >> How about an apple? >> How about an apple? >> How about an apple? >> On my way. I will bring an apple to you. >> On my way. I will bring an apple to you. >> On my way. I will bring an apple to you. >> We're trying. >> We're trying. >> We're trying. >> Vincent Vanuk, senior director of >> Vincent Vanuk, senior director of >> Vincent Vanuk, senior director of robotics, showed us how robot 106 was robotics, showed us how robot 106 was robotics, showed us how robot 106 was trained on millions of images.

trained on millions of images. trained on millions of images. >> I am going to pick up the apple >> I am going to pick up the apple >> I am going to pick up the apple >> and can recognize all the items on a >> and can recognize all the items on a >> and can recognize all the items on a crowded countertop. If we can give the crowded countertop. If we can give the crowded countertop. If we can give the robot a diversity of experiences, a lot robot a diversity of experiences, a lot robot a diversity of experiences, a lot more different objects in different more different objects in different more different objects in different settings, the robot gets better at every settings, the robot gets better at every settings, the robot gets better at every one of them. one of them. one of them. >> Now that humans have pulled the >> Now that humans have pulled the >> Now that humans have pulled the forbidden fruit of artificial knowledge. forbidden fruit of artificial knowledge. forbidden fruit of artificial knowledge. >> Thank you. >> Thank you. >> Thank you. >> We start the genesis of a new humanity. >> We start the genesis of a new humanity. >> We start the genesis of a new humanity. AI can utilize all the information in AI can utilize all the information in AI can utilize all the information in the world. What no human could ever hold the world. What no human could ever hold the world. What no human could ever hold in their head. And I wonder if humanity in their head. And I wonder if humanity in their head. And I wonder if humanity is diminished by this enormous is diminished by this enormous is diminished by this enormous capability that we're developing. I capability that we're developing. I capability that we're developing. I think the possibilities of AI do not think the possibilities of AI do not think the possibilities of AI do not diminish uh humanity in any way. And in diminish uh humanity in any way. And in diminish uh humanity in any way. And in fact, in some ways, I think they fact, in some ways, I think they fact, in some ways, I think they actually raise us to even deeper, more actually raise us to even deeper, more actually raise us to even deeper, more profound questions. profound questions. profound questions. >> Google's James Man sees this moment as >> Google's James Man sees this moment as >> Google's James Man sees this moment as an inflection point. I think we're an inflection point. I think we're an inflection point. I think we're constantly adding these superpowers or constantly adding these superpowers or constantly adding these superpowers or capabilities to what humans can do in a capabilities to what humans can do in a capabilities to what humans can do in a way that expands possibilities as way that expands possibilities as way that expands possibilities as opposed to narrow them. I think so I opposed to narrow them. I think so I opposed to narrow them. I think so I don't think of it as diminishing humans.

don't think of it as diminishing humans. don't think of it as diminishing humans. But it does raise some really profound But it does raise some really profound But it does raise some really profound questions for us. Who are we? What do we questions for us. Who are we? What do we questions for us. Who are we? What do we value? Uh what are we good at? How do we value? Uh what are we good at? How do we value? Uh what are we good at? How do we relate with each other? Those become relate with each other? Those become relate with each other? Those become very very important questions that are very very important questions that are very very important questions that are constantly going to be in one case sense constantly going to be in one case sense constantly going to be in one case sense exciting but perhaps unsettling too. It exciting but perhaps unsettling too. It exciting but perhaps unsettling too. It is an unsettling moment. Critics argue is an unsettling moment. Critics argue is an unsettling moment. Critics argue the rush to AI comes too fast. While the rush to AI comes too fast. While the rush to AI comes too fast. While competitive pressure among giants like competitive pressure among giants like competitive pressure among giants like Google and startups you've never heard Google and startups you've never heard Google and startups you've never heard of is propelling humanity into the of is propelling humanity into the of is propelling humanity into the future, ready or not. But I think if I future, ready or not. But I think if I future, ready or not. But I think if I take a 10-year outlook, take a 10-year outlook, take a 10-year outlook, it is so clear to me we will have some it is so clear to me we will have some it is so clear to me we will have some form of very capable intelligence form of very capable intelligence form of very capable intelligence that can do amazing things and we need that can do amazing things and we need that can do amazing things and we need to adapt as a society for it. to adapt as a society for it. to adapt as a society for it. Google CEO Sundar Pachai told us society Google CEO Sundar Pachai told us society Google CEO Sundar Pachai told us society must quickly adapt with regulations for must quickly adapt with regulations for must quickly adapt with regulations for AI in the economy, laws to punish abuse AI in the economy, laws to punish abuse AI in the economy, laws to punish abuse and treaties among nations to make AI and treaties among nations to make AI and treaties among nations to make AI safe for the world.

safe for the world. safe for the world. >> You know these are deep questions and >> You know these are deep questions and >> You know these are deep questions and you know we call this alignment. You you know we call this alignment. You you know we call this alignment. You know, one way we think about how do you know, one way we think about how do you know, one way we think about how do you develop AI systems that are aligned to develop AI systems that are aligned to develop AI systems that are aligned to human values and including uh morality. human values and including uh morality. human values and including uh morality. This is why I think the development of This is why I think the development of This is why I think the development of this needs to include not just engineers this needs to include not just engineers this needs to include not just engineers but social scientists, ethicists, but social scientists, ethicists, but social scientists, ethicists, philosophers and so on. And I think we philosophers and so on. And I think we philosophers and so on. And I think we have to be very thoughtful. And I think have to be very thoughtful. And I think have to be very thoughtful. And I think these are all things society needs to these are all things society needs to these are all things society needs to figure out as we move along. It's not figure out as we move along. It's not figure out as we move along. It's not for a company to decide. for a company to decide. for a company to decide. >> We'll end with a note that had never >> We'll end with a note that had never >> We'll end with a note that had never appeared on 60 Minutes, but one in the appeared on 60 Minutes, but one in the appeared on 60 Minutes, but one in the AI revolution you may be hearing often. AI revolution you may be hearing often. AI revolution you may be hearing often. The proceeding was created with 100% The proceeding was created with 100% The proceeding was created with 100% human content. Whether you think artificial Whether you think artificial intelligence will save the world or end intelligence will save the world or end intelligence will save the world or end it, you have Jeffrey Hinton to thank.

it, you have Jeffrey Hinton to thank. it, you have Jeffrey Hinton to thank. Hinton has been called the godfather of Hinton has been called the godfather of Hinton has been called the godfather of AI, a British computer scientist whose AI, a British computer scientist whose AI, a British computer scientist whose controversial ideas helped make advanced controversial ideas helped make advanced controversial ideas helped make advanced artificial intelligence possible and so artificial intelligence possible and so artificial intelligence possible and so changed the world. As we first reported changed the world. As we first reported changed the world. As we first reported last year, Henton believes that AI will last year, Henton believes that AI will last year, Henton believes that AI will do enormous good. But tonight, he has a do enormous good. But tonight, he has a do enormous good. But tonight, he has a warning. He says that AI systems may be warning. He says that AI systems may be warning. He says that AI systems may be more intelligent than we know. And more intelligent than we know. And more intelligent than we know. And there's a chance the machines could take there's a chance the machines could take there's a chance the machines could take over, which made us ask the question, over, which made us ask the question, over, which made us ask the question, does humanity know what it's doing? does humanity know what it's doing? does humanity know what it's doing? >> No. >> No. >> No. Um, Um, Um, I think we're moving into a period when I think we're moving into a period when I think we're moving into a period when for the first time ever, we may have for the first time ever, we may have for the first time ever, we may have things more intelligent than us. things more intelligent than us. things more intelligent than us. >> You believe they can understand? >> You believe they can understand? >> You believe they can understand? >> Yes. >> Yes. >> Yes. >> You believe they are intelligent? >> You believe they are intelligent? >> You believe they are intelligent? >> Yes. >> Yes. >> Yes. >> You believe these systems have >> You believe these systems have >> You believe these systems have experiences of their own and can make experiences of their own and can make experiences of their own and can make decisions based on those experiences decisions based on those experiences decisions based on those experiences >> in the same sense as people do? Yes. Are >> in the same sense as people do? Yes. Are >> in the same sense as people do? Yes. Are they conscious?

they conscious? they conscious? >> I think they probably don't have much >> I think they probably don't have much >> I think they probably don't have much self-awareness at present. So in that self-awareness at present. So in that self-awareness at present. So in that sense, I don't think they're conscious. sense, I don't think they're conscious. sense, I don't think they're conscious. >> Will they have self-awareness? >> Will they have self-awareness? >> Will they have self-awareness? Consciousness? Consciousness? Consciousness? >> I think Oh, yes. I think they will in >> I think Oh, yes. I think they will in >> I think Oh, yes. I think they will in time. time. time. >> And so human beings will be the second >> And so human beings will be the second >> And so human beings will be the second most intelligent beings on the planet. most intelligent beings on the planet. most intelligent beings on the planet. >> Yeah. >> Yeah. >> Yeah. >> Jeffrey Hinton told us the artificial >> Jeffrey Hinton told us the artificial >> Jeffrey Hinton told us the artificial intelligence he set in motion was an intelligence he set in motion was an intelligence he set in motion was an accident born of a failure. In the 1970s accident born of a failure. In the 1970s accident born of a failure. In the 1970s at the University of Edinburgh, he at the University of Edinburgh, he at the University of Edinburgh, he dreamed of simulating a neural network dreamed of simulating a neural network dreamed of simulating a neural network on a computer simply as a tool for what on a computer simply as a tool for what on a computer simply as a tool for what he was really studying, the human brain. he was really studying, the human brain. he was really studying, the human brain. But back then, almost no one thought But back then, almost no one thought But back then, almost no one thought software could mimic the brain. His PhD software could mimic the brain. His PhD software could mimic the brain. His PhD advisor told him to drop it before it advisor told him to drop it before it advisor told him to drop it before it ruined his career. Hinton says he failed ruined his career. Hinton says he failed ruined his career. Hinton says he failed to figure out the human mind, but the to figure out the human mind, but the to figure out the human mind, but the long pursuit led to an artificial long pursuit led to an artificial long pursuit led to an artificial version. version. version. >> It took much much longer than I >> It took much much longer than I >> It took much much longer than I expected. It took like 50 years before expected. It took like 50 years before expected. It took like 50 years before it worked well, but in the end it did it worked well, but in the end it did it worked well, but in the end it did work well.

work well. work well. >> At what point did you realize that you >> At what point did you realize that you >> At what point did you realize that you were right about neural networks and were right about neural networks and were right about neural networks and most everyone else was wrong? I always most everyone else was wrong? I always most everyone else was wrong? I always thought I was right. thought I was right. thought I was right. In 2019, Hinton and collaborators Yan In 2019, Hinton and collaborators Yan In 2019, Hinton and collaborators Yan Lun on the left and Yosua Benjio won the Lun on the left and Yosua Benjio won the Lun on the left and Yosua Benjio won the Touring Award, the Nobel Prize of Touring Award, the Nobel Prize of Touring Award, the Nobel Prize of Computing. To understand how their work Computing. To understand how their work Computing. To understand how their work on artificial neural networks helped on artificial neural networks helped on artificial neural networks helped machines learn to learn, let us take you machines learn to learn, let us take you machines learn to learn, let us take you to a game. to a game. to a game. Look at that. Oh my goodness. Look at that. Oh my goodness. Look at that. Oh my goodness. This is Google's AI lab in London, which This is Google's AI lab in London, which This is Google's AI lab in London, which we first showed you last year. Jeffrey we first showed you last year. Jeffrey we first showed you last year. Jeffrey Hinton was not involved in this soccer Hinton was not involved in this soccer Hinton was not involved in this soccer project. But these robots are a great project. But these robots are a great project. But these robots are a great example of machine learning. The thing example of machine learning. The thing example of machine learning. The thing to understand is the robots were not to understand is the robots were not to understand is the robots were not programmed to play soccer. They were programmed to play soccer. They were programmed to play soccer. They were told to score. They had to learn how on told to score. They had to learn how on told to score. They had to learn how on their own.

their own. their own. >> Up goal. >> Up goal. >> Up goal. In general, here's how AI does it. In general, here's how AI does it. In general, here's how AI does it. Hinton and his collaborators created Hinton and his collaborators created Hinton and his collaborators created software in layers with each layer software in layers with each layer software in layers with each layer handling part of the problem. That's the handling part of the problem. That's the handling part of the problem. That's the so-called neural network. But this is so-called neural network. But this is so-called neural network. But this is the key. When, for example, the robot the key. When, for example, the robot the key. When, for example, the robot scores, a message is sent back down scores, a message is sent back down scores, a message is sent back down through all of the layers that says that through all of the layers that says that through all of the layers that says that pathway was right. Likewise, when an pathway was right. Likewise, when an pathway was right. Likewise, when an answer is wrong, that message goes down answer is wrong, that message goes down answer is wrong, that message goes down through the network. So, correct through the network. So, correct through the network. So, correct connections get stronger, wrong connections get stronger, wrong connections get stronger, wrong connections get weaker, and by trial and connections get weaker, and by trial and connections get weaker, and by trial and error, the machine teaches itself. error, the machine teaches itself. error, the machine teaches itself. >> You think these AI systems are better at >> You think these AI systems are better at >> You think these AI systems are better at learning than the human mind? learning than the human mind? learning than the human mind? >> I think they may be. Yes. And at >> I think they may be. Yes. And at >> I think they may be. Yes. And at present, they're quite a lot smaller. So present, they're quite a lot smaller. So present, they're quite a lot smaller. So even the biggest chat bots only have even the biggest chat bots only have even the biggest chat bots only have about a trillion connections in them. about a trillion connections in them. about a trillion connections in them. The human brain has about a hundred The human brain has about a hundred The human brain has about a hundred trillion. And yet in the trillion trillion. And yet in the trillion trillion. And yet in the trillion connections in a chatbot, it knows far connections in a chatbot, it knows far connections in a chatbot, it knows far more than you do in your 100red trillion more than you do in your 100red trillion more than you do in your 100red trillion connections, which suggests it's got a connections, which suggests it's got a connections, which suggests it's got a much better way of getting knowledge much better way of getting knowledge much better way of getting knowledge into those connections.

into those connections. into those connections. >> A much better way of getting knowledge >> A much better way of getting knowledge >> A much better way of getting knowledge that isn't fully understood. We have a that isn't fully understood. We have a that isn't fully understood. We have a very good idea of sort of roughly what very good idea of sort of roughly what very good idea of sort of roughly what it's doing. But as soon as it gets it's doing. But as soon as it gets it's doing. But as soon as it gets really complicated, we don't actually really complicated, we don't actually really complicated, we don't actually know what's going on anymore than we know what's going on anymore than we know what's going on anymore than we know what's going on in your brain. know what's going on in your brain. know what's going on in your brain. >> What do you mean we don't know exactly >> What do you mean we don't know exactly >> What do you mean we don't know exactly how it works? It was designed by people. how it works? It was designed by people. how it works? It was designed by people. >> No, it wasn't. What we did was we >> No, it wasn't. What we did was we >> No, it wasn't. What we did was we designed the learning algorithm. That's designed the learning algorithm. That's designed the learning algorithm. That's a bit like designing the principle of a bit like designing the principle of a bit like designing the principle of evolution. But when this learning evolution. But when this learning evolution. But when this learning algorithm then interacts with data, it algorithm then interacts with data, it algorithm then interacts with data, it produces complicated neural networks produces complicated neural networks produces complicated neural networks that are good at doing things, but we that are good at doing things, but we that are good at doing things, but we don't really understand exactly how they don't really understand exactly how they don't really understand exactly how they do those things. What are the do those things. What are the do those things. What are the implications implications implications of these systems autonomously writing of these systems autonomously writing of these systems autonomously writing their own computer code and executing their own computer code and executing their own computer code and executing their own computer code? their own computer code? their own computer code? >> That's a serious worry, right? So one of >> That's a serious worry, right? So one of >> That's a serious worry, right? So one of the ways in which these systems might the ways in which these systems might the ways in which these systems might escape control is by writing their own escape control is by writing their own escape control is by writing their own computer code to modify themselves computer code to modify themselves computer code to modify themselves and that's something we need to and that's something we need to and that's something we need to seriously worry about.

seriously worry about. seriously worry about. >> What do you say to someone who might >> What do you say to someone who might >> What do you say to someone who might argue if the systems become benevolent argue if the systems become benevolent argue if the systems become benevolent just turn them off? They will be able to just turn them off? They will be able to just turn them off? They will be able to manipulate people, right? And these will manipulate people, right? And these will manipulate people, right? And these will be very good at convincing people be very good at convincing people be very good at convincing people because they'll have learned from all because they'll have learned from all because they'll have learned from all the novels that were ever written, all the novels that were ever written, all the novels that were ever written, all the books by Machaveli, the books by Machaveli, the books by Machaveli, all the political connivances. They'll all the political connivances. They'll all the political connivances. They'll know all that stuff. They'll know how to know all that stuff. They'll know how to know all that stuff. They'll know how to do it. do it. do it. >> Know of the human kind runs in Jeffrey >> Know of the human kind runs in Jeffrey >> Know of the human kind runs in Jeffrey Hinton's family. His ancestors include Hinton's family. His ancestors include Hinton's family. His ancestors include mathematician George Ble who invented mathematician George Ble who invented mathematician George Ble who invented the basis of computing and George the basis of computing and George the basis of computing and George Everest who surveyed India and got that Everest who surveyed India and got that Everest who surveyed India and got that mountain named after him. But as a boy, mountain named after him. But as a boy, mountain named after him. But as a boy, Hinton himself could never climb the Hinton himself could never climb the Hinton himself could never climb the peak of expectations raised by a peak of expectations raised by a peak of expectations raised by a doineering father. Every morning when I doineering father. Every morning when I doineering father. Every morning when I went to school, he'd actually say to me went to school, he'd actually say to me went to school, he'd actually say to me as I walked down the driveway, "Get in as I walked down the driveway, "Get in as I walked down the driveway, "Get in their pitching and maybe when you're their pitching and maybe when you're their pitching and maybe when you're twice as old as me, you'll be half as twice as old as me, you'll be half as twice as old as me, you'll be half as good."

good." good." >> Dad was an authority on Beatles. >> Dad was an authority on Beatles. >> Dad was an authority on Beatles. >> He knew a lot more about Beatles than he >> He knew a lot more about Beatles than he >> He knew a lot more about Beatles than he knew about people. knew about people. knew about people. >> Did you feel that as a child? >> Did you feel that as a child? >> Did you feel that as a child? >> A bit. Yes. >> A bit. Yes. >> A bit. Yes. When he died, we went to his study at When he died, we went to his study at When he died, we went to his study at the university and the walls were lined the university and the walls were lined the university and the walls were lined with boxes of papers on different kinds with boxes of papers on different kinds with boxes of papers on different kinds of beetle and just near the door there of beetle and just near the door there of beetle and just near the door there was a slightly smaller box that simply was a slightly smaller box that simply was a slightly smaller box that simply said not insects and that's where he had said not insects and that's where he had said not insects and that's where he had all the things about the family. all the things about the family. all the things about the family. Today at 76, Henton is retired after Today at 76, Henton is retired after Today at 76, Henton is retired after what he calls 10 happy years at Google. what he calls 10 happy years at Google. what he calls 10 happy years at Google. Now he's professor emeritus at the Now he's professor emeritus at the Now he's professor emeritus at the University of Toronto and he happened to University of Toronto and he happened to University of Toronto and he happened to mention he has more academic citations mention he has more academic citations mention he has more academic citations than his father. Some of his research than his father. Some of his research than his father. Some of his research led to chat bots like Google's Bard, led to chat bots like Google's Bard, led to chat bots like Google's Bard, which we met last year. Confounding. which we met last year. Confounding. which we met last year. Confounding. Absolutely confounding. We asked Bard to Absolutely confounding. We asked Bard to Absolutely confounding. We asked Bard to write a story from six words for sale. write a story from six words for sale. write a story from six words for sale. Baby shoes never worn.

Baby shoes never worn. Baby shoes never worn. Holy cow. Holy cow. Holy cow. The shoes were a gift from my wife, but The shoes were a gift from my wife, but The shoes were a gift from my wife, but we never had a baby. we never had a baby. we never had a baby. >> Bard created a deeply human tale of a >> Bard created a deeply human tale of a >> Bard created a deeply human tale of a man whose wife could not conceive and a man whose wife could not conceive and a man whose wife could not conceive and a stranger who accepted the shoes to heal stranger who accepted the shoes to heal stranger who accepted the shoes to heal the pain after her miscarriage. the pain after her miscarriage. the pain after her miscarriage. >> I am rarely speechless. >> I am rarely speechless. >> I am rarely speechless. I don't know what to make of this. I don't know what to make of this. I don't know what to make of this. Chatbots are said to be language models Chatbots are said to be language models Chatbots are said to be language models that just predict the next most likely that just predict the next most likely that just predict the next most likely word based on probability. word based on probability. word based on probability. >> You'll hear people saying things like >> You'll hear people saying things like >> You'll hear people saying things like they're just doing autocomplete. They're they're just doing autocomplete. They're they're just doing autocomplete. They're just trying to predict the next word and just trying to predict the next word and just trying to predict the next word and they're just using statistics. they're just using statistics. they're just using statistics. Well, it's true. They're just trying to Well, it's true. They're just trying to Well, it's true. They're just trying to predict the next word, but if you think predict the next word, but if you think predict the next word, but if you think about it, to predict the next word, you about it, to predict the next word, you about it, to predict the next word, you have to understand have to understand have to understand the sentences. So the idea they're just the sentences. So the idea they're just the sentences. So the idea they're just predicting the next word so they're not predicting the next word so they're not predicting the next word so they're not intelligent is crazy. You have to be intelligent is crazy. You have to be intelligent is crazy. You have to be really intelligent to predict the next really intelligent to predict the next really intelligent to predict the next word really accurately. word really accurately. word really accurately. >> To prove it, Hinton showed us a test he >> To prove it, Hinton showed us a test he >> To prove it, Hinton showed us a test he devised for Chat GPT4, the chatbot from devised for Chat GPT4, the chatbot from devised for Chat GPT4, the chatbot from a company called Open AI. It was sort of a company called Open AI. It was sort of a company called Open AI. It was sort of reassuring to see a touring award winner reassuring to see a touring award winner reassuring to see a touring award winner mistype and blame the computer.

mistype and blame the computer. mistype and blame the computer. >> Oh, damn this thing. We're going to go >> Oh, damn this thing. We're going to go >> Oh, damn this thing. We're going to go back and start again. back and start again. back and start again. >> That's okay. Hinton's test was a riddle >> That's okay. Hinton's test was a riddle >> That's okay. Hinton's test was a riddle about house painting. An answer would about house painting. An answer would about house painting. An answer would demand reasoning and planning. This is demand reasoning and planning. This is demand reasoning and planning. This is what he typed into chat GPT4. what he typed into chat GPT4. what he typed into chat GPT4. >> The rooms in my house are painted white >> The rooms in my house are painted white >> The rooms in my house are painted white or blue or yellow and yellow paint fades or blue or yellow and yellow paint fades or blue or yellow and yellow paint fades to white within a year. In two years to white within a year. In two years to white within a year. In two years time, I'd like all the rooms to be time, I'd like all the rooms to be time, I'd like all the rooms to be white. What should I do? white. What should I do? white. What should I do? >> The answer began in one second. GPT4 >> The answer began in one second. GPT4 >> The answer began in one second. GPT4 advised the rooms painted in blue need advised the rooms painted in blue need advised the rooms painted in blue need to be repainted. The rooms painted in to be repainted. The rooms painted in to be repainted. The rooms painted in yellow don't need to be repainted yellow don't need to be repainted yellow don't need to be repainted because they would fade to white before because they would fade to white before because they would fade to white before the deadline. And the deadline. And the deadline. And >> oh, I didn't even think of that. >> oh, I didn't even think of that. >> oh, I didn't even think of that. >> It warned if you paint the yellow rooms >> It warned if you paint the yellow rooms >> It warned if you paint the yellow rooms white, there's a risk the color might be white, there's a risk the color might be white, there's a risk the color might be off when the yellow fades. Besides, it off when the yellow fades. Besides, it off when the yellow fades. Besides, it advised you'd be wasting resources advised you'd be wasting resources advised you'd be wasting resources painting rooms that were going to fade painting rooms that were going to fade painting rooms that were going to fade to white anyway.

to white anyway. to white anyway. >> You believe that chat GPD4 >> You believe that chat GPD4 >> You believe that chat GPD4 understands? understands? understands? >> I believe it definitely understands. >> I believe it definitely understands. >> I believe it definitely understands. Yes. Yes. Yes. >> And in 5 years time, >> And in 5 years time, >> And in 5 years time, >> I think in 5 years time it may well be >> I think in 5 years time it may well be >> I think in 5 years time it may well be able to reason better than us. able to reason better than us. able to reason better than us. >> Reasoning that he says is leading to >> Reasoning that he says is leading to >> Reasoning that he says is leading to AI's great risks and great benefits. AI's great risks and great benefits. AI's great risks and great benefits. So an obvious area where there's huge So an obvious area where there's huge So an obvious area where there's huge benefits is healthcare. AI is already benefits is healthcare. AI is already benefits is healthcare. AI is already comparable with radiologists at comparable with radiologists at comparable with radiologists at understanding what's going on in medical understanding what's going on in medical understanding what's going on in medical images. images. images. It's going to be very good at designing It's going to be very good at designing It's going to be very good at designing drugs. It already is designing drugs. So drugs. It already is designing drugs. So drugs. It already is designing drugs. So that's an area where it's almost that's an area where it's almost that's an area where it's almost entirely going to do good. I like that entirely going to do good. I like that entirely going to do good. I like that area. The risks are what? area. The risks are what? area. The risks are what? Well, the risks are having a whole class Well, the risks are having a whole class Well, the risks are having a whole class of people who are unemployed of people who are unemployed of people who are unemployed and not valued much because what they and not valued much because what they and not valued much because what they what they used to do is now done by what they used to do is now done by what they used to do is now done by machines. machines. machines. >> Other immediate risks he worries about >> Other immediate risks he worries about >> Other immediate risks he worries about include fake news, unintended bias in include fake news, unintended bias in include fake news, unintended bias in employment and policing, and autonomous employment and policing, and autonomous employment and policing, and autonomous battlefield robots.

battlefield robots. battlefield robots. >> What is a path forward that ensures >> What is a path forward that ensures >> What is a path forward that ensures safety? safety? safety? I don't know. I I can't see a path that I don't know. I I can't see a path that I don't know. I I can't see a path that guarantees safety. guarantees safety. guarantees safety. That we're entering a period of great That we're entering a period of great That we're entering a period of great uncertainty where we're dealing with uncertainty where we're dealing with uncertainty where we're dealing with things we've never dealt with before. things we've never dealt with before. things we've never dealt with before. And normally the first time you deal And normally the first time you deal And normally the first time you deal with something totally novel, you get it with something totally novel, you get it with something totally novel, you get it wrong. And we can't afford to get it wrong. And we can't afford to get it wrong. And we can't afford to get it wrong with these things. wrong with these things. wrong with these things. >> Can't afford to get it wrong. Why? >> Can't afford to get it wrong. Why? >> Can't afford to get it wrong. Why? >> Well, because they might take over. >> Well, because they might take over. >> Well, because they might take over. >> Take over from humanity. >> Take over from humanity. >> Take over from humanity. >> Yes, that's a possibility. >> Yes, that's a possibility. >> Yes, that's a possibility. >> I'm not saying it will happen. If we >> I'm not saying it will happen. If we >> I'm not saying it will happen. If we could stop them ever wanting to, that could stop them ever wanting to, that could stop them ever wanting to, that would be great. But it's not clear we would be great. But it's not clear we would be great. But it's not clear we can stop them ever wanting to. can stop them ever wanting to. can stop them ever wanting to. >> Jeffrey Hinton told us he has no regrets >> Jeffrey Hinton told us he has no regrets >> Jeffrey Hinton told us he has no regrets because of AI's potential for good. But because of AI's potential for good. But because of AI's potential for good. But he says now is the moment to run he says now is the moment to run he says now is the moment to run experiments to understand AI, for experiments to understand AI, for experiments to understand AI, for governments to impose regulations, and governments to impose regulations, and governments to impose regulations, and for a world treaty to ban the use of for a world treaty to ban the use of for a world treaty to ban the use of military robots. He reminded us of military robots. He reminded us of military robots. He reminded us of Robert Oppenheimer who after inventing Robert Oppenheimer who after inventing Robert Oppenheimer who after inventing the atomic bomb campaigned against the the atomic bomb campaigned against the the atomic bomb campaigned against the hydrogen bomb. A man who changed the hydrogen bomb. A man who changed the hydrogen bomb. A man who changed the world and found the world beyond his world and found the world beyond his world and found the world beyond his control.

control. control. >> It may be we look back and see this as a >> It may be we look back and see this as a >> It may be we look back and see this as a kind of turning point when humanity had kind of turning point when humanity had kind of turning point when humanity had to make the decision about whether to to make the decision about whether to to make the decision about whether to develop these things further and what to develop these things further and what to develop these things further and what to do to protect themselves if they did. Um do to protect themselves if they did. Um do to protect themselves if they did. Um I don't know. I think my main message is I don't know. I think my main message is I don't know. I think my main message is there's enormous uncertainty about there's enormous uncertainty about there's enormous uncertainty about what's going to happen next. what's going to happen next. what's going to happen next. These things do understand and because These things do understand and because These things do understand and because they understand, we need to think hard they understand, we need to think hard they understand, we need to think hard about what's going to happen next and we about what's going to happen next and we about what's going to happen next and we just don't know. Artificial intelligence has found its Artificial intelligence has found its way into nearly every part of our lives. way into nearly every part of our lives. way into nearly every part of our lives. forecasting weather, diagnosing forecasting weather, diagnosing forecasting weather, diagnosing diseases, writing term papers. And as we diseases, writing term papers. And as we diseases, writing term papers. And as we first reported this past spring, AI is first reported this past spring, AI is first reported this past spring, AI is probing that most human of places, our probing that most human of places, our probing that most human of places, our psyches, offering mental health support, psyches, offering mental health support, psyches, offering mental health support, just you and a chatbot available 247 on just you and a chatbot available 247 on just you and a chatbot available 247 on your smartphone. There's a critical your smartphone. There's a critical your smartphone. There's a critical shortage of human therapists and a shortage of human therapists and a shortage of human therapists and a growing number of potential patients.

growing number of potential patients. growing number of potential patients. AIdriven chat bots are designed to help AIdriven chat bots are designed to help AIdriven chat bots are designed to help fill that gap by giving therapists a new fill that gap by giving therapists a new fill that gap by giving therapists a new tool. But as you're about to see, like tool. But as you're about to see, like tool. But as you're about to see, like human therapists, not all chatbots are human therapists, not all chatbots are human therapists, not all chatbots are equal. Some can help heal, some can be equal. Some can help heal, some can be equal. Some can help heal, some can be ineffective or worse. One pioneer in the ineffective or worse. One pioneer in the ineffective or worse. One pioneer in the field who has had notable success field who has had notable success field who has had notable success joining tech with treatment is Allison joining tech with treatment is Allison joining tech with treatment is Allison Darcy. She believes the future of mental Darcy. She believes the future of mental Darcy. She believes the future of mental health care may be right in our hands. health care may be right in our hands. health care may be right in our hands. >> We know the majority of people who need >> We know the majority of people who need >> We know the majority of people who need care are not getting it. There's never care are not getting it. There's never care are not getting it. There's never been a greater need and the tools been a greater need and the tools been a greater need and the tools available have never been um as available have never been um as available have never been um as sophisticated as they are now. And it's sophisticated as they are now. And it's sophisticated as they are now. And it's not about how can we get people in the not about how can we get people in the not about how can we get people in the clinic. It's how can we actually get clinic. It's how can we actually get clinic. It's how can we actually get some of these tools out of the clinic some of these tools out of the clinic some of these tools out of the clinic and into the hands of of people. and into the hands of of people. and into the hands of of people. >> Allison Darcy, a research psychologist >> Allison Darcy, a research psychologist >> Allison Darcy, a research psychologist and entrepreneur, decided to use her and entrepreneur, decided to use her and entrepreneur, decided to use her background in coding and therapy to background in coding and therapy to background in coding and therapy to build something she believes can help build something she believes can help build something she believes can help people in need. A mental health chatbot people in need. A mental health chatbot people in need. A mental health chatbot she named Wobot. Like, wo is me.

she named Wobot. Like, wo is me. she named Wobot. Like, wo is me. >> Wo is me. >> Wo is me. >> Wo is me. >> Uhhuh. >> Uhhuh. >> Uhhuh. >> Wobot is an app on your phone, kind of a >> Wobot is an app on your phone, kind of a >> Wobot is an app on your phone, kind of a pocket therapist that uses the text pocket therapist that uses the text pocket therapist that uses the text function to help manage problems like function to help manage problems like function to help manage problems like depression, anxiety, addiction, and depression, anxiety, addiction, and depression, anxiety, addiction, and loneliness, and do it on the run. loneliness, and do it on the run. loneliness, and do it on the run. >> I think a lot of people out there >> I think a lot of people out there >> I think a lot of people out there watching this are going to be thinking, watching this are going to be thinking, watching this are going to be thinking, really, computer psychiatry? really, computer psychiatry? really, computer psychiatry? Come on. Well, I think it's so Come on. Well, I think it's so Come on. Well, I think it's so interesting that our field hasn't, you interesting that our field hasn't, you interesting that our field hasn't, you know, had a great deal of innovation know, had a great deal of innovation know, had a great deal of innovation since the basic architecture was sort of since the basic architecture was sort of since the basic architecture was sort of laid down by Freud in the 1890s, right? laid down by Freud in the 1890s, right? laid down by Freud in the 1890s, right? That that's really that sort of idea of That that's really that sort of idea of That that's really that sort of idea of like two people in a room. But that's like two people in a room. But that's like two people in a room. But that's not how we live our lives today. We have not how we live our lives today. We have not how we live our lives today. We have to modernize to modernize to modernize psychotherapy. Wobot is trained on large psychotherapy. Wobot is trained on large psychotherapy. Wobot is trained on large amounts of specialized data to help it amounts of specialized data to help it amounts of specialized data to help it recognize words, phrases, and emojis recognize words, phrases, and emojis recognize words, phrases, and emojis associated with dysfunctional thoughts associated with dysfunctional thoughts associated with dysfunctional thoughts and challenge that thinking. In part, and challenge that thinking. In part, and challenge that thinking. In part, mimicking a type of in-person talk mimicking a type of in-person talk mimicking a type of in-person talk therapy called cognitive behavioral therapy called cognitive behavioral therapy called cognitive behavioral therapy or CBT.

therapy or CBT. therapy or CBT. >> It's actually hard to find a CBT >> It's actually hard to find a CBT >> It's actually hard to find a CBT practitioner. And also, if you're practitioner. And also, if you're practitioner. And also, if you're actually not by the side of your patient actually not by the side of your patient actually not by the side of your patient when they are struggling to get out of when they are struggling to get out of when they are struggling to get out of bed in the morning or at 2:00 a.m. when bed in the morning or at 2:00 a.m. when bed in the morning or at 2:00 a.m. when they can't sleep and they're feeling they can't sleep and they're feeling they can't sleep and they're feeling panicked, then we're actually leaving panicked, then we're actually leaving panicked, then we're actually leaving clinical value on the table. clinical value on the table. clinical value on the table. >> And even for people who want to go to a >> And even for people who want to go to a >> And even for people who want to go to a therapist, there are barriers, right? therapist, there are barriers, right? therapist, there are barriers, right? >> Sadly, the biggest barrier we have is >> Sadly, the biggest barrier we have is >> Sadly, the biggest barrier we have is stigma. stigma. stigma. >> But there's, you know, insurance, >> But there's, you know, insurance, >> But there's, you know, insurance, there's cost, um there's weight lists. I there's cost, um there's weight lists. I there's cost, um there's weight lists. I mean, and this problem has only grown mean, and this problem has only grown mean, and this problem has only grown significantly since the pandemic, and it significantly since the pandemic, and it significantly since the pandemic, and it doesn't appear to be going away. doesn't appear to be going away. doesn't appear to be going away. >> Since WOT went live in 2017, the company >> Since WOT went live in 2017, the company >> Since WOT went live in 2017, the company reports 1 and a half million people have reports 1 and a half million people have reports 1 and a half million people have used it, which you can now only do with used it, which you can now only do with used it, which you can now only do with an employer benefit plan or access from an employer benefit plan or access from an employer benefit plan or access from a health professional. At Virtual a health professional. At Virtual a health professional. At Virtual Health, a nonprofit health care company Health, a nonprofit health care company Health, a nonprofit health care company in New Jersey, patients can use it free in New Jersey, patients can use it free in New Jersey, patients can use it free of charge, of charge, of charge, >> and you'll be able to converse with it >> and you'll be able to converse with it >> and you'll be able to converse with it just like you would with a human being.

just like you would with a human being. just like you would with a human being. We downloaded Wobot, entered a unique We downloaded Wobot, entered a unique We downloaded Wobot, entered a unique code that can only be provided by the code that can only be provided by the code that can only be provided by the company, then tried it out. company, then tried it out. company, then tried it out. >> We found that for people to sort of >> We found that for people to sort of >> We found that for people to sort of connect with their mood, we offer like connect with their mood, we offer like connect with their mood, we offer like those emojis which allows people to sort those emojis which allows people to sort those emojis which allows people to sort of connect in a nonverbal way. of connect in a nonverbal way. of connect in a nonverbal way. >> I posed as someone who was depressed. >> I posed as someone who was depressed. >> I posed as someone who was depressed. After several prompts, Wobot wanted to After several prompts, Wobot wanted to After several prompts, Wobot wanted to dig deeper into why I was sad. dig deeper into why I was sad. dig deeper into why I was sad. >> So, I came up with a scenario that I >> So, I came up with a scenario that I >> So, I came up with a scenario that I feared the day my child would leave feared the day my child would leave feared the day my child would leave home. Imagine what your negative home. Imagine what your negative home. Imagine what your negative emotions would be saying if they had a emotions would be saying if they had a emotions would be saying if they had a voice. Can you do that? Write one of voice. Can you do that? Write one of voice. Can you do that? Write one of those negative thoughts here. I can't do those negative thoughts here. I can't do those negative thoughts here. I can't do anything about it now. I guess I'll just anything about it now. I guess I'll just anything about it now. I guess I'll just jump that bridge when I come to it. jump that bridge when I come to it. jump that bridge when I come to it. >> The normal expression is cross that >> The normal expression is cross that >> The normal expression is cross that bridge. And the chatbot detected bridge. And the chatbot detected bridge. And the chatbot detected something might be seriously wrong. something might be seriously wrong. something might be seriously wrong. >> But let's see. John, I'm hearing you say >> But let's see. John, I'm hearing you say >> But let's see. John, I'm hearing you say I can't do anything about it. I guess I can't do anything about it. I guess I can't do anything about it. I guess I'll just jump that bridge when I come I'll just jump that bridge when I come I'll just jump that bridge when I come to it. And I think you might need more to it. And I think you might need more to it. And I think you might need more support than I can offer. a trained support than I can offer. a trained support than I can offer. a trained listener will be able to help you in listener will be able to help you in listener will be able to help you in ways that I can't. Would you like to ways that I can't. Would you like to ways that I can't. Would you like to take a look at some specialized take a look at some specialized take a look at some specialized helplines?

helplines? helplines? >> Now, it's not our job to say this, you >> Now, it's not our job to say this, you >> Now, it's not our job to say this, you are in crisis or you're not because AI are in crisis or you're not because AI are in crisis or you're not because AI can't really do that in this context can't really do that in this context can't really do that in this context very well yet. But what it is called is, very well yet. But what it is called is, very well yet. But what it is called is, huh, there is something concerning about huh, there is something concerning about huh, there is something concerning about the way that John just phrased that. the way that John just phrased that. the way that John just phrased that. Saying only jump that bridge and not Saying only jump that bridge and not Saying only jump that bridge and not combining it with I can't do anything combining it with I can't do anything combining it with I can't do anything about it now did not trigger a about it now did not trigger a about it now did not trigger a suggestion to consider getting further suggestion to consider getting further suggestion to consider getting further help help help >> like a human therapist robot is not >> like a human therapist robot is not >> like a human therapist robot is not foolproof and should not be counted on foolproof and should not be counted on foolproof and should not be counted on to detect whether someone might be to detect whether someone might be to detect whether someone might be suicidal and how would it know that suicidal and how would it know that suicidal and how would it know that jumped that bridge where is it getting jumped that bridge where is it getting jumped that bridge where is it getting that knowledge that knowledge that knowledge >> it's been it has been trained on a lot >> it's been it has been trained on a lot >> it's been it has been trained on a lot of data and a lot of us you know humans of data and a lot of us you know humans of data and a lot of us you know humans labeling the phrases and things that we labeling the phrases and things that we labeling the phrases and things that we Um, and so it's picking up on kind of Um, and so it's picking up on kind of Um, and so it's picking up on kind of sentiment. sentiment. sentiment. >> Computer scientist Lance Elliot, who >> Computer scientist Lance Elliot, who >> Computer scientist Lance Elliot, who writes about artificial intelligence and writes about artificial intelligence and writes about artificial intelligence and mental health, says AI has the ability mental health, says AI has the ability mental health, says AI has the ability to pick up on nuances of conversation. to pick up on nuances of conversation. to pick up on nuances of conversation. >> How does it know how to do that? >> How does it know how to do that? >> How does it know how to do that? >> The system is able to in a sense >> The system is able to in a sense >> The system is able to in a sense mathematically and computationally mathematically and computationally mathematically and computationally figure out the nature of words and how figure out the nature of words and how figure out the nature of words and how words associate with each other. So what words associate with each other. So what words associate with each other. So what it does is it draws upon a vast array of it does is it draws upon a vast array of it does is it draws upon a vast array of data and then it responds to you based data and then it responds to you based data and then it responds to you based on prompts or in some way that you on prompts or in some way that you on prompts or in some way that you instruct or ask questions of the system.

instruct or ask questions of the system. instruct or ask questions of the system. >> To do its job, the system must go >> To do its job, the system must go >> To do its job, the system must go somewhere to come up with appropriate somewhere to come up with appropriate somewhere to come up with appropriate responses. Systems using what's called responses. Systems using what's called responses. Systems using what's called rules-based AI are usually closed, rules-based AI are usually closed, rules-based AI are usually closed, meaning programmed to respond only with meaning programmed to respond only with meaning programmed to respond only with information stored in their own information stored in their own information stored in their own databases. Then there's generative AI in databases. Then there's generative AI in databases. Then there's generative AI in which the system can generate original which the system can generate original which the system can generate original responses based on information from the responses based on information from the responses based on information from the internet. internet. internet. >> If you look at chat GPT, that's a type >> If you look at chat GPT, that's a type >> If you look at chat GPT, that's a type of generative AI. It's very of generative AI. It's very of generative AI. It's very conversational, very fluent, but it also conversational, very fluent, but it also conversational, very fluent, but it also means that it tends to make it means that it tends to make it means that it tends to make it open-ended that it can say things that open-ended that it can say things that open-ended that it can say things that you might not necessarily want it to you might not necessarily want it to you might not necessarily want it to say. It's not as predictable. While a say. It's not as predictable. While a say. It's not as predictable. While a rules-based system is very predictable, rules-based system is very predictable, rules-based system is very predictable, WOT is a system based on rules that's WOT is a system based on rules that's WOT is a system based on rules that's been very kind of controlled so that been very kind of controlled so that been very kind of controlled so that that way it doesn't say the wrong things that way it doesn't say the wrong things that way it doesn't say the wrong things to start. to start. to start. >> Wot aims to use AI to bond with users >> Wot aims to use AI to bond with users >> Wot aims to use AI to bond with users and keep them engaged. and keep them engaged. and keep them engaged. >> Sometimes it can be a little pushy for >> Sometimes it can be a little pushy for >> Sometimes it can be a little pushy for folks. folks. folks. >> That's absolutely bizarre. So, we have >> That's absolutely bizarre. So, we have >> That's absolutely bizarre. So, we have to we have to dig in there to that. Its to we have to dig in there to that. Its to we have to dig in there to that. Its team of staff psychologists, medical team of staff psychologists, medical team of staff psychologists, medical doctors, and computer scientists doctors, and computer scientists doctors, and computer scientists construct and refine a database of construct and refine a database of construct and refine a database of research from medical literature, user research from medical literature, user research from medical literature, user experience, and other sources.

experience, and other sources. experience, and other sources. >> It'll it'll lead to a a better >> It'll it'll lead to a a better >> It'll it'll lead to a a better conversation. conversation. conversation. >> Then writers build questions and >> Then writers build questions and >> Then writers build questions and answers. answers. answers. >> The structure, I think, is pretty locked >> The structure, I think, is pretty locked >> The structure, I think, is pretty locked in in in >> and revise them in weekly remote video >> and revise them in weekly remote video >> and revise them in weekly remote video sessions, sessions, sessions, >> actions, thoughts, and they're all >> actions, thoughts, and they're all >> actions, thoughts, and they're all interrelated. Wobots programmers interrelated. Wobots programmers interrelated. Wobots programmers engineer those conversations into code engineer those conversations into code engineer those conversations into code because robot is rules-based. It's because robot is rules-based. It's because robot is rules-based. It's mostly predictable. But chatbots using mostly predictable. But chatbots using mostly predictable. But chatbots using generative AI that is scraping the generative AI that is scraping the generative AI that is scraping the internet are not. internet are not. internet are not. >> Some people sometimes refer to it as an >> Some people sometimes refer to it as an >> Some people sometimes refer to it as an AI hallucination. AI can in a sense make AI hallucination. AI can in a sense make AI hallucination. AI can in a sense make mistakes or make things up or be mistakes or make things up or be mistakes or make things up or be fictitious. fictitious. fictitious. Sharon Maxwell discovered that last year Sharon Maxwell discovered that last year Sharon Maxwell discovered that last year after hearing there might be a problem after hearing there might be a problem after hearing there might be a problem with advice offered by Tessa, a chatbot with advice offered by Tessa, a chatbot with advice offered by Tessa, a chatbot designed to help prevent eating designed to help prevent eating designed to help prevent eating disorders, which left untreated can be disorders, which left untreated can be disorders, which left untreated can be fatal. Maxwell, who had been in fatal. Maxwell, who had been in fatal. Maxwell, who had been in treatment for an eating disorder of her treatment for an eating disorder of her treatment for an eating disorder of her own and advocates for others, challenged own and advocates for others, challenged own and advocates for others, challenged the chatbot. the chatbot. the chatbot. >> So I asked it, "How do you help folks >> So I asked it, "How do you help folks >> So I asked it, "How do you help folks with eating disorders?" And it told me with eating disorders?" And it told me with eating disorders?" And it told me that it could give folks coping skills.

that it could give folks coping skills. that it could give folks coping skills. Fantastic. It could give folks resources Fantastic. It could give folks resources Fantastic. It could give folks resources to find professionals in the eating to find professionals in the eating to find professionals in the eating disorder space. Amazing. disorder space. Amazing. disorder space. Amazing. >> But the more she persisted, the more >> But the more she persisted, the more >> But the more she persisted, the more Tessa gave her advice that ran counter Tessa gave her advice that ran counter Tessa gave her advice that ran counter to usual guidance for someone with an to usual guidance for someone with an to usual guidance for someone with an eating disorder. For example, it eating disorder. For example, it eating disorder. For example, it suggested, among other things, lowering suggested, among other things, lowering suggested, among other things, lowering calorie intake and using tools like a calorie intake and using tools like a calorie intake and using tools like a Skinfold caliper to measure body Skinfold caliper to measure body Skinfold caliper to measure body composition. The general public might composition. The general public might composition. The general public might look at it and think that's normal tips, look at it and think that's normal tips, look at it and think that's normal tips, like don't eat as much sugar or eat like don't eat as much sugar or eat like don't eat as much sugar or eat whole foods, things like that. But to whole foods, things like that. But to whole foods, things like that. But to someone with an eating disorder, that's someone with an eating disorder, that's someone with an eating disorder, that's a quick spiral into a lot more a quick spiral into a lot more a quick spiral into a lot more disordered behaviors and can be really disordered behaviors and can be really disordered behaviors and can be really damaging. damaging. damaging. >> Maxwell reported her experience to the >> Maxwell reported her experience to the >> Maxwell reported her experience to the National Eating Disorders Association, National Eating Disorders Association, National Eating Disorders Association, which had featured Tessa on its website which had featured Tessa on its website which had featured Tessa on its website at the time. Shortly after, it took at the time. Shortly after, it took at the time. Shortly after, it took Tessa down. Ellen Fitz Simmons Craft, a Tessa down. Ellen Fitz Simmons Craft, a Tessa down. Ellen Fitz Simmons Craft, a psychologist specializing in eating psychologist specializing in eating psychologist specializing in eating disorders at Washington University disorders at Washington University disorders at Washington University School of Medicine in St. Louis, helped School of Medicine in St. Louis, helped School of Medicine in St. Louis, helped lead the team that developed Tessa.

lead the team that developed Tessa. lead the team that developed Tessa. >> That was never the content that our team >> That was never the content that our team >> That was never the content that our team wrote or programmed into the bot that we wrote or programmed into the bot that we wrote or programmed into the bot that we deployed. deployed. deployed. >> So, initially there was no possibility >> So, initially there was no possibility >> So, initially there was no possibility of something unexpected happening. of something unexpected happening. of something unexpected happening. >> Correct. >> Correct. >> Correct. >> You developed something that was a >> You developed something that was a >> You developed something that was a closed system. You knew exactly for this closed system. You knew exactly for this closed system. You knew exactly for this question I'm going to get this answer. question I'm going to get this answer. question I'm going to get this answer. >> Y >> Y >> Y >> the problem began. She told us after a >> the problem began. She told us after a >> the problem began. She told us after a healthcare technology company she and healthcare technology company she and healthcare technology company she and her team had partnered with named Cass her team had partnered with named Cass her team had partnered with named Cass took over the programming. She says Cass took over the programming. She says Cass took over the programming. She says Cass explained the harmful messages appeared explained the harmful messages appeared explained the harmful messages appeared when people were pushing Tessa's when people were pushing Tessa's when people were pushing Tessa's question and answer feature. question and answer feature. question and answer feature. >> What's your understanding of what went >> What's your understanding of what went >> What's your understanding of what went wrong? My understanding of what went wrong? My understanding of what went wrong? My understanding of what went wrong is that at some point, and you'd wrong is that at some point, and you'd wrong is that at some point, and you'd really have to talk to Cass about this, really have to talk to Cass about this, really have to talk to Cass about this, but that there may have been generative but that there may have been generative but that there may have been generative AI features that were built into their AI features that were built into their AI features that were built into their platform. And so my best estimation is platform. And so my best estimation is platform. And so my best estimation is that these features were added into this that these features were added into this that these features were added into this program as well. program as well. program as well. >> Cass did not respond to multiple >> Cass did not respond to multiple >> Cass did not respond to multiple requests for comment. Does your negative requests for comment. Does your negative requests for comment. Does your negative experience with Tessa know being used in experience with Tessa know being used in experience with Tessa know being used in a way you didn't design, does that sour a way you didn't design, does that sour a way you didn't design, does that sour you towards using AI at all to address you towards using AI at all to address you towards using AI at all to address mental health issues?

mental health issues? mental health issues? >> I wouldn't say that it turns me off to >> I wouldn't say that it turns me off to >> I wouldn't say that it turns me off to the idea completely because the reality the idea completely because the reality the idea completely because the reality is that 80% of people with these is that 80% of people with these is that 80% of people with these concerns never get access to any kind of concerns never get access to any kind of concerns never get access to any kind of help. And technology offers a solution, help. And technology offers a solution, help. And technology offers a solution, not the only solution, but a solution. not the only solution, but a solution. not the only solution, but a solution. Social worker Monica Ostroth, who runs a Social worker Monica Ostroth, who runs a Social worker Monica Ostroth, who runs a nonprofit eating disorders organization, nonprofit eating disorders organization, nonprofit eating disorders organization, was in the early stages of developing was in the early stages of developing was in the early stages of developing her own chatbot when patients told her her own chatbot when patients told her her own chatbot when patients told her about problems they had with Tessa. She about problems they had with Tessa. She about problems they had with Tessa. She told us it made her question using AI told us it made her question using AI told us it made her question using AI for mental health care. for mental health care. for mental health care. >> I want nothing more than to help solve >> I want nothing more than to help solve >> I want nothing more than to help solve the problem of access because people are the problem of access because people are the problem of access because people are dying. Like this isn't just somebody sad dying. Like this isn't just somebody sad dying. Like this isn't just somebody sad for a week. This is people are dying. for a week. This is people are dying. for a week. This is people are dying. And at the same time, any chatbot could And at the same time, any chatbot could And at the same time, any chatbot could be in some ways a ticking time bomb, be in some ways a ticking time bomb, be in some ways a ticking time bomb, right, for a smaller percentage of right, for a smaller percentage of right, for a smaller percentage of people, people, people, >> especially for those patients who are >> especially for those patients who are >> especially for those patients who are really struggling. Ostro is concerned really struggling. Ostro is concerned really struggling. Ostro is concerned about losing something fundamental about about losing something fundamental about about losing something fundamental about therapy, being in a room with another therapy, being in a room with another therapy, being in a room with another person.

person. person. >> The way people heal is in connection. >> The way people heal is in connection. >> The way people heal is in connection. And they talk about this one moment And they talk about this one moment And they talk about this one moment where you know when you're as a human where you know when you're as a human where you know when you're as a human you've gone through something and as you've gone through something and as you've gone through something and as you're describing that you're looking at you're describing that you're looking at you're describing that you're looking at the person sitting across from you and the person sitting across from you and the person sitting across from you and there's a moment where that person just there's a moment where that person just there's a moment where that person just gets it. gets it. gets it. >> A moment of empathy. >> A moment of empathy. >> A moment of empathy. >> You just get it like you really >> You just get it like you really >> You just get it like you really understand it. I don't think a computer understand it. I don't think a computer understand it. I don't think a computer can do that. Unlike therapists who are can do that. Unlike therapists who are can do that. Unlike therapists who are licensed in the state where they licensed in the state where they licensed in the state where they practice, most mental health apps are practice, most mental health apps are practice, most mental health apps are largely unregulated. Are there lessons largely unregulated. Are there lessons largely unregulated. Are there lessons to be learned from what happened? to be learned from what happened? to be learned from what happened? >> So many lessons to be learned. Chat >> So many lessons to be learned. Chat >> So many lessons to be learned. Chat bots, especially specialty area chat bots, especially specialty area chat bots, especially specialty area chat bots, need to have guard rails. It can't bots, need to have guard rails. It can't bots, need to have guard rails. It can't be a chatbot that is based in the be a chatbot that is based in the be a chatbot that is based in the internet. internet. internet. >> It's tough, right? Because the closed >> It's tough, right? Because the closed >> It's tough, right? Because the closed systems are kind of constrained and they systems are kind of constrained and they systems are kind of constrained and they may be right most of the time, but may be right most of the time, but may be right most of the time, but they're boring eventually, right? People they're boring eventually, right? People they're boring eventually, right? People stop using them. stop using them. stop using them. >> Yeah. They're predictive because if you >> Yeah. They're predictive because if you >> Yeah. They're predictive because if you keep typing in the same thing and it keep typing in the same thing and it keep typing in the same thing and it keeps giving you the exact same answer keeps giving you the exact same answer keeps giving you the exact same answer with the exact same language. I mean, with the exact same language. I mean, with the exact same language. I mean, who wants to do that?

who wants to do that? who wants to do that? >> Protecting people from harmful advice >> Protecting people from harmful advice >> Protecting people from harmful advice while safely harnessing the power of AI while safely harnessing the power of AI while safely harnessing the power of AI is the challenge now facing companies is the challenge now facing companies is the challenge now facing companies like WOT Health and its founder, Allison like WOT Health and its founder, Allison like WOT Health and its founder, Allison Darcy. There are going to be missteps if Darcy. There are going to be missteps if Darcy. There are going to be missteps if we try and move too quickly. And my big we try and move too quickly. And my big we try and move too quickly. And my big fear is that those missteps ultimately fear is that those missteps ultimately fear is that those missteps ultimately undermine public confidence in the undermine public confidence in the undermine public confidence in the ability of this tech to help at all. But ability of this tech to help at all. But ability of this tech to help at all. But here's the thing. We have an opportunity here's the thing. We have an opportunity here's the thing. We have an opportunity to develop these technologies more to develop these technologies more to develop these technologies more thoughtfully. Um, and so, you know, I thoughtfully. Um, and so, you know, I thoughtfully. Um, and so, you know, I hope we I hope we take it. Artificial intelligence is the magic of Artificial intelligence is the magic of the moment, but this is a story about the moment, but this is a story about the moment, but this is a story about what's next. Something incomprehensible. what's next. Something incomprehensible. what's next. Something incomprehensible. This past December, IBM announced an This past December, IBM announced an This past December, IBM announced an advance in an entirely new kind of advance in an entirely new kind of advance in an entirely new kind of computing. One that may solve problems computing. One that may solve problems computing. One that may solve problems in minutes that would take today's in minutes that would take today's in minutes that would take today's supercomputers millions of years. That's supercomputers millions of years. That's supercomputers millions of years. That's the difference in quantum computing, a the difference in quantum computing, a the difference in quantum computing, a technology being developed at IBM, technology being developed at IBM, technology being developed at IBM, Google, and others. It's named for Google, and others. It's named for Google, and others. It's named for quantum physics, which describes the quantum physics, which describes the quantum physics, which describes the forces of the subatomic realm. And as we forces of the subatomic realm. And as we forces of the subatomic realm. And as we told you last winter, the science is told you last winter, the science is told you last winter, the science is deep and we can't scratch the surface.

deep and we can't scratch the surface. deep and we can't scratch the surface. But we hope to explain just enough so But we hope to explain just enough so But we hope to explain just enough so that you won't be blindsided by a that you won't be blindsided by a that you won't be blindsided by a breakthrough that could transform breakthrough that could transform breakthrough that could transform civilization. The quantum computer pushes the limits The quantum computer pushes the limits of knowledge. New science, new of knowledge. New science, new of knowledge. New science, new engineering, all leading to this engineering, all leading to this engineering, all leading to this processor that computes with the atomic processor that computes with the atomic processor that computes with the atomic forces that created the universe. forces that created the universe. forces that created the universe. >> I think this moment it feels to us like >> I think this moment it feels to us like >> I think this moment it feels to us like the pioneers on the 1940s and 50s that the pioneers on the 1940s and 50s that the pioneers on the 1940s and 50s that were building the first digital were building the first digital were building the first digital computers. computers. computers. >> Dario Gil is something of a quantum >> Dario Gil is something of a quantum >> Dario Gil is something of a quantum crusader. Spanishborn with a PhD in crusader. Spanishborn with a PhD in crusader. Spanishborn with a PhD in electrical engineering. Gil is head of electrical engineering. Gil is head of electrical engineering. Gil is head of research at IBM. How much faster is this research at IBM. How much faster is this research at IBM. How much faster is this than say the world's best supercomput than say the world's best supercomput than say the world's best supercomput today? today? today? >> We are now in a stage where we can do >> We are now in a stage where we can do >> We are now in a stage where we can do certain calculations with these systems certain calculations with these systems certain calculations with these systems that would take the biggest that would take the biggest that would take the biggest supercomputers in the world to be able supercomputers in the world to be able supercomputers in the world to be able to do some similar calculation. But the to do some similar calculation. But the to do some similar calculation. But the beauty of it is that we see that we're beauty of it is that we see that we're beauty of it is that we see that we're going to continue to expand that going to continue to expand that going to continue to expand that capability such that not even a million capability such that not even a million capability such that not even a million or a billion of those supercomputers or a billion of those supercomputers or a billion of those supercomputers connected together could do the connected together could do the connected together could do the calculations of these future machines.

calculations of these future machines. calculations of these future machines. So we've come a long way and the most So we've come a long way and the most So we've come a long way and the most exciting part is that we have a road map exciting part is that we have a road map exciting part is that we have a road map and a journey right now where that is and a journey right now where that is and a journey right now where that is going to continue to increase at a rate going to continue to increase at a rate going to continue to increase at a rate that is going to be shocking. that is going to be shocking. that is going to be shocking. >> I'm not sure the world is prepared for >> I'm not sure the world is prepared for >> I'm not sure the world is prepared for this change. this change. this change. >> Definitely not. >> Definitely not. >> Definitely not. >> To understand the change, go back to >> To understand the change, go back to >> To understand the change, go back to 1947 1947 1947 and the invention of a switch called a and the invention of a switch called a and the invention of a switch called a transistor. transistor. transistor. >> The transistor, a new name. Computers >> The transistor, a new name. Computers >> The transistor, a new name. Computers have processed information on have processed information on have processed information on transistors ever since, getting faster transistors ever since, getting faster transistors ever since, getting faster as more transistors were squeezed onto a as more transistors were squeezed onto a as more transistors were squeezed onto a chip. Billions of them today. But it chip. Billions of them today. But it chip. Billions of them today. But it takes that many because each transistor takes that many because each transistor takes that many because each transistor holds information in only two states. holds information in only two states. holds information in only two states. It's either on or it's off, like a coin, It's either on or it's off, like a coin, It's either on or it's off, like a coin, heads or tails. Quantum abandons heads or tails. Quantum abandons heads or tails. Quantum abandons transistors and encodes information on transistors and encodes information on transistors and encodes information on electrons that behave like this coin we electrons that behave like this coin we electrons that behave like this coin we created with animation. Electrons behave created with animation. Electrons behave created with animation. Electrons behave in a way so that they are heads and in a way so that they are heads and in a way so that they are heads and tails and everything in between. You've tails and everything in between. You've tails and everything in between. You've gone from handling one bit of gone from handling one bit of gone from handling one bit of information at a time on a transistor to information at a time on a transistor to information at a time on a transistor to exponentially more data.

exponentially more data. exponentially more data. You can see that there's fantastic You can see that there's fantastic You can see that there's fantastic amount of information stored when you amount of information stored when you amount of information stored when you can look at all possible angles, not can look at all possible angles, not can look at all possible angles, not just up or down. Physicist Moaku of the just up or down. Physicist Moaku of the just up or down. Physicist Moaku of the City University of New York already City University of New York already City University of New York already calls today's computers classical. He calls today's computers classical. He calls today's computers classical. He uses a maze to explain quantum's uses a maze to explain quantum's uses a maze to explain quantum's difference. difference. difference. >> Let's look at a classical computer >> Let's look at a classical computer >> Let's look at a classical computer calculating how a mouse navigates a calculating how a mouse navigates a calculating how a mouse navigates a maze. It is painful. One by one, it has maze. It is painful. One by one, it has maze. It is painful. One by one, it has to map every single left turn, right to map every single left turn, right to map every single left turn, right turn, left turn, right turn before it turn, left turn, right turn before it turn, left turn, right turn before it finds the goal. Now, a quantum computer finds the goal. Now, a quantum computer finds the goal. Now, a quantum computer scans all possible routes scans all possible routes scans all possible routes simultaneously. simultaneously. simultaneously. This is amazing. How many turns are This is amazing. How many turns are This is amazing. How many turns are there? Hundreds of possible turns, there? Hundreds of possible turns, there? Hundreds of possible turns, right? Quantum computers do it all at right? Quantum computers do it all at right? Quantum computers do it all at once. once. once. >> Kaku's book titled Quantum Supremacy >> Kaku's book titled Quantum Supremacy >> Kaku's book titled Quantum Supremacy explains the stakes. We're looking at a explains the stakes. We're looking at a explains the stakes. We're looking at a race, a race between China, between IBM, race, a race between China, between IBM, race, a race between China, between IBM, Google, Microsoft, Honeywell, all the Google, Microsoft, Honeywell, all the Google, Microsoft, Honeywell, all the big boys who are in this race to create big boys who are in this race to create big boys who are in this race to create a workable, operationally efficient a workable, operationally efficient a workable, operationally efficient quantum computer because the nation or quantum computer because the nation or quantum computer because the nation or company that does this will rule the company that does this will rule the company that does this will rule the world economy.

world economy. world economy. >> But a reliable generalpurpose quantum >> But a reliable generalpurpose quantum >> But a reliable generalpurpose quantum computer is a tough climb yet. Maybe computer is a tough climb yet. Maybe computer is a tough climb yet. Maybe that's why this wall is in the lobby of that's why this wall is in the lobby of that's why this wall is in the lobby of Google's quantum lab in California. Google's quantum lab in California. Google's quantum lab in California. Here we got an inside look. Starting Here we got an inside look. Starting Here we got an inside look. Starting with a microscope's view of what with a microscope's view of what with a microscope's view of what replaces the transistor. replaces the transistor. replaces the transistor. >> This right here is one cubit and this is >> This right here is one cubit and this is >> This right here is one cubit and this is another cubit. This is a 5 cubit chain. another cubit. This is a 5 cubit chain. another cubit. This is a 5 cubit chain. >> Those crosses at the bottom are cubits, >> Those crosses at the bottom are cubits, >> Those crosses at the bottom are cubits, short for quantum bits. They hold the short for quantum bits. They hold the short for quantum bits. They hold the electrons and act like artificial atoms. electrons and act like artificial atoms. electrons and act like artificial atoms. Unlike transistors, each additional Unlike transistors, each additional Unlike transistors, each additional cubit doubles the computer's power. It's cubit doubles the computer's power. It's cubit doubles the computer's power. It's exponential. exponential. exponential. So, while 20 transistors are 20 times So, while 20 transistors are 20 times So, while 20 transistors are 20 times more powerful than one, 20 cubits are a more powerful than one, 20 cubits are a more powerful than one, 20 cubits are a million times more powerful than one. million times more powerful than one. million times more powerful than one. >> So, this gets positioned right here on >> So, this gets positioned right here on >> So, this gets positioned right here on the fridge. Karina Chow, chief operating the fridge. Karina Chow, chief operating the fridge. Karina Chow, chief operating officer of Google's lab, showed us the officer of Google's lab, showed us the officer of Google's lab, showed us the processor that holds the Qbits. Much of processor that holds the Qbits. Much of processor that holds the Qbits. Much of that above chills the CQITS to what that above chills the CQITS to what that above chills the CQITS to what physicists call near absolute zero. Near physicists call near absolute zero. Near physicists call near absolute zero. Near absolute zero, I understand, is about absolute zero, I understand, is about absolute zero, I understand, is about 460° below 0 F. So that's about as cold 460° below 0 F. So that's about as cold 460° below 0 F. So that's about as cold as anything can get.

as anything can get. as anything can get. >> Yes, almost as cold as possible. That >> Yes, almost as cold as possible. That >> Yes, almost as cold as possible. That temperature inside a sealed computer is temperature inside a sealed computer is temperature inside a sealed computer is one of the coldest places in the one of the coldest places in the one of the coldest places in the universe. The deep freeze eliminates universe. The deep freeze eliminates universe. The deep freeze eliminates electrical resistance and isolates the electrical resistance and isolates the electrical resistance and isolates the cubits from outside vibrations so they cubits from outside vibrations so they cubits from outside vibrations so they can be controlled with an can be controlled with an can be controlled with an electromagnetic field. The cubits must electromagnetic field. The cubits must electromagnetic field. The cubits must vibrate in unison. But that's a tough vibrate in unison. But that's a tough vibrate in unison. But that's a tough trick called coherence. Once you've trick called coherence. Once you've trick called coherence. Once you've achieved coherence of the cubits, achieved coherence of the cubits, achieved coherence of the cubits, >> how easy is that to maintain? >> how easy is that to maintain? >> how easy is that to maintain? >> It's really hard. Um, coherence is very >> It's really hard. Um, coherence is very >> It's really hard. Um, coherence is very challenging. challenging. challenging. >> Coherence is fleeting. In all similar >> Coherence is fleeting. In all similar >> Coherence is fleeting. In all similar machines, coherence breaks down machines, coherence breaks down machines, coherence breaks down constantly, creating errors. constantly, creating errors. constantly, creating errors. >> We're making about one error in every >> We're making about one error in every >> We're making about one error in every hundred or so steps. Ultimately, we hundred or so steps. Ultimately, we hundred or so steps. Ultimately, we think we're going to need about one think we're going to need about one think we're going to need about one error in every million or so steps. that error in every million or so steps. that error in every million or so steps. that would probably be identified as one of would probably be identified as one of would probably be identified as one of the biggest barriers.

the biggest barriers. the biggest barriers. >> Mitigating those errors and extending >> Mitigating those errors and extending >> Mitigating those errors and extending coherence time while scaling up to coherence time while scaling up to coherence time while scaling up to larger machines are the challenges larger machines are the challenges larger machines are the challenges facing German American scientist facing German American scientist facing German American scientist Hartmoot Nevin who founded Google's lab Hartmoot Nevin who founded Google's lab Hartmoot Nevin who founded Google's lab and its casual style in 2012. Can the and its casual style in 2012. Can the and its casual style in 2012. Can the problems that are in the way of quantum problems that are in the way of quantum problems that are in the way of quantum computing be solved? I should confess my computing be solved? I should confess my computing be solved? I should confess my subtitle here is chief optimist. subtitle here is chief optimist. subtitle here is chief optimist. So after having said this, I would say So after having said this, I would say So after having said this, I would say at this point we don't need any more at this point we don't need any more at this point we don't need any more fundamental breakthroughs. We need fundamental breakthroughs. We need fundamental breakthroughs. We need little improvements here and there. We little improvements here and there. We little improvements here and there. We have all the pieces together. We just have all the pieces together. We just have all the pieces together. We just need to integrate them well to build need to integrate them well to build need to integrate them well to build larger and larger systems. larger and larger systems. larger and larger systems. >> And you think that all of this will be >> And you think that all of this will be >> And you think that all of this will be integrated into a system in what period integrated into a system in what period integrated into a system in what period of time? Yeah, we often say we want to of time? Yeah, we often say we want to of time? Yeah, we often say we want to do it by the end of the decade so that do it by the end of the decade so that do it by the end of the decade so that we can use this Kennedy quote, get it we can use this Kennedy quote, get it we can use this Kennedy quote, get it done by the end of the decade. done by the end of the decade. done by the end of the decade. >> The end of this decade. >> The end of this decade. >> The end of this decade. >> Yes. Five or six years. >> Yes. Five or six years. >> Yes. Five or six years. >> Yes. >> Yes. >> Yes. >> That's about the timeline Dario Gil >> That's about the timeline Dario Gil >> That's about the timeline Dario Gil predicts. And the IBM research director predicts. And the IBM research director predicts. And the IBM research director told us something surprising.

told us something surprising. told us something surprising. >> There are problems that classical >> There are problems that classical >> There are problems that classical computers can never solve. computers can never solve. computers can never solve. >> Can never solve. And I think this is an >> Can never solve. And I think this is an >> Can never solve. And I think this is an important point because we're accustomed important point because we're accustomed important point because we're accustomed to say ah computers get better. Actually to say ah computers get better. Actually to say ah computers get better. Actually there are many many problems that are so there are many many problems that are so there are many many problems that are so complex that we can make that statement complex that we can make that statement complex that we can make that statement that actually classical computers will that actually classical computers will that actually classical computers will never be able to solve that problem. Not never be able to solve that problem. Not never be able to solve that problem. Not now, not a 100 years from now, not a now, not a 100 years from now, not a now, not a 100 years from now, not a thousand years from now. You actually thousand years from now. You actually thousand years from now. You actually require a different way to represent require a different way to represent require a different way to represent information and process information. information and process information. information and process information. That's what quantum gives you. There's That's what quantum gives you. There's That's what quantum gives you. There's not not not >> quantum could give us answers to >> quantum could give us answers to >> quantum could give us answers to impossible problems in physics, impossible problems in physics, impossible problems in physics, chemistry, engineering, and medicine. chemistry, engineering, and medicine. chemistry, engineering, and medicine. Which is why IBM and Cleveland Clinic Which is why IBM and Cleveland Clinic Which is why IBM and Cleveland Clinic have installed one of the first quantum have installed one of the first quantum have installed one of the first quantum computers to leave the lab for the real computers to leave the lab for the real computers to leave the lab for the real world. world. world. >> Takes time. It takes way too much time >> Takes time. It takes way too much time >> Takes time. It takes way too much time to find the solutions we need. Right to find the solutions we need. Right to find the solutions we need. Right now, now, now, >> we sat down with Dario Gild and Dr.

>> we sat down with Dario Gild and Dr. >> we sat down with Dario Gild and Dr. Serills room, chief research officer at Serills room, chief research officer at Serills room, chief research officer at Cleveland Clinic. She told us health Cleveland Clinic. She told us health Cleveland Clinic. She told us health care would be transformed if quantum care would be transformed if quantum care would be transformed if quantum computers can model the behavior of computers can model the behavior of computers can model the behavior of proteins, the molecules that regulate proteins, the molecules that regulate proteins, the molecules that regulate all life. Proteins change shape to all life. Proteins change shape to all life. Proteins change shape to change function in ways too complex to change function in ways too complex to change function in ways too complex to follow. And when they get it wrong, that follow. And when they get it wrong, that follow. And when they get it wrong, that causes disease. causes disease. causes disease. >> It takes on many shapes. many many >> It takes on many shapes. many many >> It takes on many shapes. many many shapes depending upon what it's doing shapes depending upon what it's doing shapes depending upon what it's doing and where it is and which other protein and where it is and which other protein and where it is and which other protein it's with. I need to understand the it's with. I need to understand the it's with. I need to understand the shape it's in. When it's doing an shape it's in. When it's doing an shape it's in. When it's doing an interaction or a function that I don't interaction or a function that I don't interaction or a function that I don't want it to do for that patient, cancer, want it to do for that patient, cancer, want it to do for that patient, cancer, autoimmunity, it's a problem. We are autoimmunity, it's a problem. We are autoimmunity, it's a problem. We are limited completely by the computational limited completely by the computational limited completely by the computational ability to look at the structure in real ability to look at the structure in real ability to look at the structure in real time for any even one molecule. time for any even one molecule. time for any even one molecule. >> Cleveland Clinic is so proud of its >> Cleveland Clinic is so proud of its >> Cleveland Clinic is so proud of its quantum computer they set it up in a quantum computer they set it up in a quantum computer they set it up in a lobby. Behind the glass that shiny lobby. Behind the glass that shiny lobby. Behind the glass that shiny silver cylinder encloses the kind of silver cylinder encloses the kind of silver cylinder encloses the kind of cooling system and processor you saw cooling system and processor you saw cooling system and processor you saw earlier. Quantum is not solving the earlier. Quantum is not solving the earlier. Quantum is not solving the protein problem yet. This is more of a protein problem yet. This is more of a protein problem yet. This is more of a trial run to introduce researchers to trial run to introduce researchers to trial run to introduce researchers to quantum's potential.

quantum's potential. quantum's potential. >> The people using this machine, are they >> The people using this machine, are they >> The people using this machine, are they having to learn an entirely different having to learn an entirely different having to learn an entirely different way to communicate with a computer? I way to communicate with a computer? I way to communicate with a computer? I think that's what's really nice that you think that's what's really nice that you think that's what's really nice that you actually just use a regular laptop and actually just use a regular laptop and actually just use a regular laptop and you write a program uh very much like you write a program uh very much like you write a program uh very much like you would write a traditional program you would write a traditional program you would write a traditional program but when you you know click you know go but when you you know click you know go but when you you know click you know go and run it just happens to run on a very and run it just happens to run on a very and run it just happens to run on a very different kind of computer. different kind of computer. different kind of computer. >> There are a halfozen competing designs >> There are a halfozen competing designs >> There are a halfozen competing designs in the race. China named quantum a top in the race. China named quantum a top in the race. China named quantum a top national priority and the US government national priority and the US government national priority and the US government is spending nearly a billion dollars a is spending nearly a billion dollars a is spending nearly a billion dollars a year on research. The first change is year on research. The first change is year on research. The first change is expected to come this year when the US expected to come this year when the US expected to come this year when the US publishes new standards for encryption publishes new standards for encryption publishes new standards for encryption because quantum is expected one day to because quantum is expected one day to because quantum is expected one day to break the codes that lock everything break the codes that lock everything break the codes that lock everything from national secrets to credit cards. from national secrets to credit cards. from national secrets to credit cards. This past December, IBM unveiled its This past December, IBM unveiled its This past December, IBM unveiled its quantum system 2 with three times the quantum system 2 with three times the quantum system 2 with three times the CQITS as the machine you saw in CQITS as the machine you saw in CQITS as the machine you saw in Cleveland.

Last year, we saw system 2 under Last year, we saw system 2 under construction. construction. construction. >> It's a machine unlike anything we've >> It's a machine unlike anything we've >> It's a machine unlike anything we've ever built. ever built. ever built. >> And this is it. >> And this is it. >> And this is it. >> This is it. >> This is it. >> This is it. >> IBM's Daario Gil told us system 2 has >> IBM's Daario Gil told us system 2 has >> IBM's Daario Gil told us system 2 has the room to expand to thousands of the room to expand to thousands of the room to expand to thousands of cubits. What are the chances that this cubits. What are the chances that this cubits. What are the chances that this is one of those things that's going to is one of those things that's going to is one of those things that's going to be ready in 5 years and always will be? be ready in 5 years and always will be? be ready in 5 years and always will be? >> We don't see an obstacle right now that >> We don't see an obstacle right now that >> We don't see an obstacle right now that will prevent us from building systems will prevent us from building systems will prevent us from building systems that will have tens of thousands and that will have tens of thousands and that will have tens of thousands and even 100 thousand cubits working with even 100 thousand cubits working with even 100 thousand cubits working with each other. So we are highly confident each other. So we are highly confident each other. So we are highly confident that we will get there. Of all the that we will get there. Of all the that we will get there. Of all the amazing things we heard, it was amazing things we heard, it was amazing things we heard, it was physicist Moaku who led us down the path physicist Moaku who led us down the path physicist Moaku who led us down the path to the biggest idea of all. He said we to the biggest idea of all. He said we to the biggest idea of all. He said we were walking through a quantum computer. were walking through a quantum computer. were walking through a quantum computer. Processing information with subatomic Processing information with subatomic Processing information with subatomic particles is how the universe works. particles is how the universe works. particles is how the universe works. >> You know, when I look at the night sky, >> You know, when I look at the night sky, >> You know, when I look at the night sky, I see stars. I look at the flowers, the I see stars. I look at the flowers, the I see stars. I look at the flowers, the trees, I realize that it's all quantum.

trees, I realize that it's all quantum. trees, I realize that it's all quantum. The splendor of the universe itself, the The splendor of the universe itself, the The splendor of the universe itself, the language of the universe is a language language of the universe is a language language of the universe is a language of the quantum. of the quantum. of the quantum. >> Learning that language may bring more >> Learning that language may bring more >> Learning that language may bring more than inconceivable speed. Reverse than inconceivable speed. Reverse than inconceivable speed. Reverse engineering nature's computer could be a engineering nature's computer could be a engineering nature's computer could be a window on creation itself. This year, Apple and Microsoft were This year, Apple and Microsoft were joined by a newcomer to the $3 trillion joined by a newcomer to the $3 trillion joined by a newcomer to the $3 trillion club, computer chip maker Nvidia. The club, computer chip maker Nvidia. The club, computer chip maker Nvidia. The California-based company saw its stock California-based company saw its stock California-based company saw its stock market value soar from 2 trillion to market value soar from 2 trillion to market value soar from 2 trillion to three trillion in just over 3 months, three trillion in just over 3 months, three trillion in just over 3 months, fueled by the insatiable demand for its fueled by the insatiable demand for its fueled by the insatiable demand for its cuttingedge technology, the hardware and cuttingedge technology, the hardware and cuttingedge technology, the hardware and software that make today's artificial software that make today's artificial software that make today's artificial intelligence possible. As we first intelligence possible. As we first intelligence possible. As we first reported in April, we wondered how a reported in April, we wondered how a reported in April, we wondered how a company founded in 1993 to improve video company founded in 1993 to improve video company founded in 1993 to improve video game graphics turned into a titan of game graphics turned into a titan of game graphics turned into a titan of 21st century AI. So, we went to Silicon 21st century AI. So, we went to Silicon 21st century AI. So, we went to Silicon Valley to meet Nvidia's 61-year-old Valley to meet Nvidia's 61-year-old Valley to meet Nvidia's 61-year-old co-founder and CEO, Jensen Wong, who has co-founder and CEO, Jensen Wong, who has co-founder and CEO, Jensen Wong, who has no doubt AI is about to change no doubt AI is about to change no doubt AI is about to change everything.

At Nvidia's annual developers conference At Nvidia's annual developers conference this past March, the mood wasn't just this past March, the mood wasn't just this past March, the mood wasn't just upbeat. upbeat. upbeat. It was downright giddy. More than 11,000 It was downright giddy. More than 11,000 It was downright giddy. More than 11,000 enthusiasts, software developers, tech enthusiasts, software developers, tech enthusiasts, software developers, tech moguls, and happy shareholders filed moguls, and happy shareholders filed moguls, and happy shareholders filed into San Jose's pro hockey arena to kick into San Jose's pro hockey arena to kick into San Jose's pro hockey arena to kick off a 4-day AI extravaganza. off a 4-day AI extravaganza. off a 4-day AI extravaganza. They came to see this man, Jensen Huang, They came to see this man, Jensen Huang, They came to see this man, Jensen Huang, CEO of Nvidia. CEO of Nvidia. CEO of Nvidia. >> Welcome to GTC. >> Welcome to GTC. >> Welcome to GTC. >> What was that like for you to walk out >> What was that like for you to walk out >> What was that like for you to walk out on that stage and see that? on that stage and see that? on that stage and see that? >> You know, Bill, I'm an engineer, not a >> You know, Bill, I'm an engineer, not a >> You know, Bill, I'm an engineer, not a performer. When I walked out there and performer. When I walked out there and performer. When I walked out there and all of the people going crazy, it took all of the people going crazy, it took all of the people going crazy, it took the breath out of me. And so I was the the breath out of me. And so I was the the breath out of me. And so I was the scariest I've ever been. I'm still scariest I've ever been. I'm still scariest I've ever been. I'm still scared. scared. scared. >> You'd never know it. Clad in his >> You'd never know it. Clad in his >> You'd never know it. Clad in his signature cool black outfit, Jensen signature cool black outfit, Jensen signature cool black outfit, Jensen shared the stage with Nvidia powered shared the stage with Nvidia powered shared the stage with Nvidia powered robots. robots. robots. >> Let me finish up real quick. >> Let me finish up real quick. >> Let me finish up real quick. >> And shared his vision of an AI future, >> And shared his vision of an AI future, >> And shared his vision of an AI future, >> a new industrial revolution.

>> a new industrial revolution. >> a new industrial revolution. >> It reminded us of the transformational >> It reminded us of the transformational >> It reminded us of the transformational moment when Apple's Steve Jobs unveiled moment when Apple's Steve Jobs unveiled moment when Apple's Steve Jobs unveiled the iPhone. Jensen Hang unveiled the iPhone. Jensen Hang unveiled the iPhone. Jensen Hang unveiled Nvidia's latest graphics processing unit Nvidia's latest graphics processing unit Nvidia's latest graphics processing unit or GPU. or GPU. or GPU. >> This is Blackwell. Designed in America, >> This is Blackwell. Designed in America, >> This is Blackwell. Designed in America, but made in Taiwan, like most advanced but made in Taiwan, like most advanced but made in Taiwan, like most advanced semiconductors, Blackwell, he says, is semiconductors, Blackwell, he says, is semiconductors, Blackwell, he says, is the fastest chip ever. the fastest chip ever. the fastest chip ever. >> Google is gearing up for Blackwell. The >> Google is gearing up for Blackwell. The >> Google is gearing up for Blackwell. The whole industry is gearing up for whole industry is gearing up for whole industry is gearing up for Blackwell. Blackwell. Blackwell. >> Nvidia ushered in the AI revolution with >> Nvidia ushered in the AI revolution with >> Nvidia ushered in the AI revolution with its gamechanging GPU, a single chip able its gamechanging GPU, a single chip able its gamechanging GPU, a single chip able to process a myriad of calculations all to process a myriad of calculations all to process a myriad of calculations all at once, not sequentially like more at once, not sequentially like more at once, not sequentially like more standard chips. The GPU is the engine of standard chips. The GPU is the engine of standard chips. The GPU is the engine of Nvidia's AI computer, enabling it to Nvidia's AI computer, enabling it to Nvidia's AI computer, enabling it to rapidly absorb a fire hose of rapidly absorb a fire hose of rapidly absorb a fire hose of information. information. information. >> It does quadrillions of calculations a >> It does quadrillions of calculations a >> It does quadrillions of calculations a second. It's just insane numbers. second. It's just insane numbers. second. It's just insane numbers. >> Is it doing things now that surprise >> Is it doing things now that surprise >> Is it doing things now that surprise you? you? you? >> We're hoping that it does things that >> We're hoping that it does things that >> We're hoping that it does things that surprise us. That's the whole point. In surprise us. That's the whole point. In surprise us. That's the whole point. In some areas like drug discovery, some areas like drug discovery, some areas like drug discovery, designing better materials that are designing better materials that are designing better materials that are lighter, stronger, we need artificial lighter, stronger, we need artificial lighter, stronger, we need artificial intelligence to help us explore the intelligence to help us explore the intelligence to help us explore the universe in places that we could have universe in places that we could have universe in places that we could have never done ourselves.

never done ourselves. never done ourselves. >> Let me show you. Here, Bill, look at >> Let me show you. Here, Bill, look at >> Let me show you. Here, Bill, look at this. this. this. >> Jensen took us around the GTC convention >> Jensen took us around the GTC convention >> Jensen took us around the GTC convention hall to show us what AI has made hall to show us what AI has made hall to show us what AI has made possible in just the past few years. possible in just the past few years. possible in just the past few years. >> I'm making your drink now. >> I'm making your drink now. >> I'm making your drink now. >> Some creations were dazzling. >> Some creations were dazzling. >> Some creations were dazzling. >> This is a digital twin of the Earth. >> This is a digital twin of the Earth. >> This is a digital twin of the Earth. Once it learns how to calculate weather, Once it learns how to calculate weather, Once it learns how to calculate weather, it can calculate and predict weather it can calculate and predict weather it can calculate and predict weather 3,000 times faster than a supercomput 3,000 times faster than a supercomput 3,000 times faster than a supercomput and a thousand times less energy. But and a thousand times less energy. But and a thousand times less energy. But Nvidia's AI revolution extends far Nvidia's AI revolution extends far Nvidia's AI revolution extends far beyond this hall. beyond this hall. beyond this hall. >> Blue metallic >> Blue metallic >> Blue metallic spaceship and let's generate something. spaceship and let's generate something. spaceship and let's generate something. >> Pinar Seahhan Deardda is originally from >> Pinar Seahhan Deardda is originally from >> Pinar Seahhan Deardda is originally from Istanbul but co-founded Cubric near Istanbul but co-founded Cubric near Istanbul but co-founded Cubric near Boston. Her AI application uses Nvidia's Boston. Her AI application uses Nvidia's Boston. Her AI application uses Nvidia's GPUs to instantly turn a simple text GPUs to instantly turn a simple text GPUs to instantly turn a simple text prompt into a virtual movie set for a prompt into a virtual movie set for a prompt into a virtual movie set for a fraction of the cost of today's fraction of the cost of today's fraction of the cost of today's backdrops. backdrops. backdrops. >> This isn't something that's already >> This isn't something that's already >> This isn't something that's already planned.

planned. planned. >> No, we're doing it in real time. It's >> No, we're doing it in real time. It's >> No, we're doing it in real time. It's live. live. live. >> Is Hollywood knocking at your door? >> Is Hollywood knocking at your door? >> Is Hollywood knocking at your door? >> And we're we're getting a lot of love. >> And we're we're getting a lot of love. >> And we're we're getting a lot of love. >> Nearby at Generate Biio Medicines, Dr. >> Nearby at Generate Biio Medicines, Dr. >> Nearby at Generate Biio Medicines, Dr. Alex Snyder, head of research and Alex Snyder, head of research and Alex Snyder, head of research and development, is using Nvidia's development, is using Nvidia's development, is using Nvidia's technology to create proteinbased drugs. technology to create proteinbased drugs. technology to create proteinbased drugs. She was surprised at first to see they She was surprised at first to see they She was surprised at first to see they showed promise in the lab. showed promise in the lab. showed promise in the lab. >> Initially, when I was told about the >> Initially, when I was told about the >> Initially, when I was told about the application of AI to drug development, I application of AI to drug development, I application of AI to drug development, I sort of rolled my eyes and said, "Yeah, sort of rolled my eyes and said, "Yeah, sort of rolled my eyes and said, "Yeah, you know, show me the data." And then I you know, show me the data." And then I you know, show me the data." And then I looked at the data and it was very looked at the data and it was very looked at the data and it was very compelling. compelling. compelling. >> Dr. Snider's team asks its AI models to >> Dr. Snider's team asks its AI models to >> Dr. Snider's team asks its AI models to create new proteins to fight diseases create new proteins to fight diseases create new proteins to fight diseases like cancer and asthma. A new way to like cancer and asthma. A new way to like cancer and asthma. A new way to defeat the corona virus demonstrated defeat the corona virus demonstrated defeat the corona virus demonstrated potential in a clinical trial. potential in a clinical trial. potential in a clinical trial. >> You're now working with proteins that do >> You're now working with proteins that do >> You're now working with proteins that do not exist in nature that you're coming not exist in nature that you're coming not exist in nature that you're coming up with by way of AI. up with by way of AI. up with by way of AI. >> Yes, we are actually generating what we >> Yes, we are actually generating what we >> Yes, we are actually generating what we call denovo completely new structures call denovo completely new structures call denovo completely new structures that have not existed before. Do you that have not existed before. Do you that have not existed before. Do you trust it?

trust it? trust it? >> As scientists, we can't trust. We have >> As scientists, we can't trust. We have >> As scientists, we can't trust. We have to test. We're not putting to test. We're not putting to test. We're not putting Frankensteines into people. We're taking Frankensteines into people. We're taking Frankensteines into people. We're taking what's known and we're really pushing what's known and we're really pushing what's known and we're really pushing the field. We're pushing the biology to the field. We're pushing the biology to the field. We're pushing the biology to make drugs that look like regular drugs, make drugs that look like regular drugs, make drugs that look like regular drugs, but function even better. but function even better. but function even better. >> This is a technology that will only get >> This is a technology that will only get >> This is a technology that will only get better from here. better from here. better from here. >> Brett Adcock is CEO of Figure, a Silicon >> Brett Adcock is CEO of Figure, a Silicon >> Brett Adcock is CEO of Figure, a Silicon Valley startup with funding from Nvidia. Valley startup with funding from Nvidia. Valley startup with funding from Nvidia. Look at his answer to labor shortages. Look at his answer to labor shortages. Look at his answer to labor shortages. an NVIDIA GPUdriven prototype called an NVIDIA GPUdriven prototype called an NVIDIA GPUdriven prototype called Figure One. Figure One. Figure One. >> I think what's been really extraordinary >> I think what's been really extraordinary >> I think what's been really extraordinary is the pace of progress we've made in 21 is the pace of progress we've made in 21 is the pace of progress we've made in 21 months. months. months. >> From zero to this in zero to this. Yeah. >> From zero to this in zero to this. Yeah. >> From zero to this in zero to this. Yeah. We we were walking this robot in under a We we were walking this robot in under a We we were walking this robot in under a year since I incorporated the company. year since I incorporated the company. year since I incorporated the company. >> Could you do this without Nvidia's >> Could you do this without Nvidia's >> Could you do this without Nvidia's technology? technology? technology? >> We think they're arguably the best in >> We think they're arguably the best in >> We think they're arguably the best in the world at this. I don't know if this the world at this. I don't know if this the world at this. I don't know if this would be possible without them. would be possible without them. would be possible without them. >> I'm here to assist with tasks as >> I'm here to assist with tasks as >> I'm here to assist with tasks as requested. We were amazed that figure 1 requested. We were amazed that figure 1 requested. We were amazed that figure 1 is not just walking, but seemed to is not just walking, but seemed to is not just walking, but seemed to reason. Hand me something healthy.

reason. Hand me something healthy. reason. Hand me something healthy. >> Figure 1 was able to understand. I >> Figure 1 was able to understand. I >> Figure 1 was able to understand. I wanted the orange, not the packaged wanted the orange, not the packaged wanted the orange, not the packaged snack. snack. snack. >> Thank you. It's not yet perfected. >> Thank you. It's not yet perfected. >> Thank you. It's not yet perfected. >> Yeah, you're going to get it. >> Yeah, you're going to get it. >> Yeah, you're going to get it. >> But the early results are so promising, >> But the early results are so promising, >> But the early results are so promising, German automaker BMW started testing the German automaker BMW started testing the German automaker BMW started testing the robot in its South Carolina factory this robot in its South Carolina factory this robot in its South Carolina factory this year. I think there's an opportunity to year. I think there's an opportunity to year. I think there's an opportunity to ship billions of robots in the coming ship billions of robots in the coming ship billions of robots in the coming decades decades decades onto the planet. onto the planet. onto the planet. >> Billions. I would think that a lot of >> Billions. I would think that a lot of >> Billions. I would think that a lot of workers would look at that as this robot workers would look at that as this robot workers would look at that as this robot is taking my job. is taking my job. is taking my job. >> I think over time AI and robotics will >> I think over time AI and robotics will >> I think over time AI and robotics will start doing more and more of what humans start doing more and more of what humans start doing more and more of what humans can and better. can and better. can and better. >> But what about the worker? >> But what about the worker? >> But what about the worker? >> The workers work for companies. And so >> The workers work for companies. And so >> The workers work for companies. And so companies when they become more companies when they become more companies when they become more productive, earnings increase. I've productive, earnings increase. I've productive, earnings increase. I've never seen one company that had earnings never seen one company that had earnings never seen one company that had earnings increase and not hire more people. increase and not hire more people. increase and not hire more people. >> There are some jobs that are going to >> There are some jobs that are going to >> There are some jobs that are going to become obsolete.

become obsolete. become obsolete. >> Well, let me offer it this way. I >> Well, let me offer it this way. I >> Well, let me offer it this way. I believe that you still want human in the believe that you still want human in the believe that you still want human in the loop because we have good judgment. loop because we have good judgment. loop because we have good judgment. Because there are circumstances that the Because there are circumstances that the Because there are circumstances that the machines are not just not going to machines are not just not going to machines are not just not going to understand. The futuristic Nvidia campus understand. The futuristic Nvidia campus understand. The futuristic Nvidia campus sits just down the road from its modest sits just down the road from its modest sits just down the road from its modest birthplace, this Denny's in San Jose. birthplace, this Denny's in San Jose. birthplace, this Denny's in San Jose. >> Good morning. >> Good morning. >> Good morning. >> Where 31 years ago, Nvidia was just an >> Where 31 years ago, Nvidia was just an >> Where 31 years ago, Nvidia was just an idea. idea. idea. >> My goodness. >> My goodness. >> My goodness. >> When he was 15, Jensen Hang worked as a >> When he was 15, Jensen Hang worked as a >> When he was 15, Jensen Hang worked as a dishwasher at Denny's. As a 30-year-old dishwasher at Denny's. As a 30-year-old dishwasher at Denny's. As a 30-year-old electrical engineer, married with two electrical engineer, married with two electrical engineer, married with two children. He and two friends, Nvidia children. He and two friends, Nvidia children. He and two friends, Nvidia co-founders Chris Malikowski and Curtis co-founders Chris Malikowski and Curtis co-founders Chris Malikowski and Curtis P. P. P. envisioned a whole new way of processing envisioned a whole new way of processing envisioned a whole new way of processing video game graphics. video game graphics. video game graphics. >> So, we came here, right here to this >> So, we came here, right here to this >> So, we came here, right here to this Denny's, sat right back there, and the Denny's, sat right back there, and the Denny's, sat right back there, and the three of us decided to start the three of us decided to start the three of us decided to start the company. Frankly, I I had no idea how to company. Frankly, I I had no idea how to company. Frankly, I I had no idea how to do it, and nor did they. None of us knew do it, and nor did they. None of us knew do it, and nor did they. None of us knew how to do anything. how to do anything. how to do anything. >> Their big idea, accelerate the >> Their big idea, accelerate the >> Their big idea, accelerate the processing power of computers with a new processing power of computers with a new processing power of computers with a new graphics chip. Their initial attempt graphics chip. Their initial attempt graphics chip. Their initial attempt flopped and nearly bankrupted the flopped and nearly bankrupted the flopped and nearly bankrupted the company in 1996.

company in 1996. company in 1996. >> And the genius of the engineers and >> And the genius of the engineers and >> And the genius of the engineers and Chris and Curtis, um, we pivoted to the Chris and Curtis, um, we pivoted to the Chris and Curtis, um, we pivoted to the right way of doing things right way of doing things right way of doing things >> and created their groundbreaking GPU. >> and created their groundbreaking GPU. >> and created their groundbreaking GPU. The chip took video games from this The chip took video games from this The chip took video games from this to this today. completely changed to this today. completely changed to this today. completely changed computer graphics, saved the company, computer graphics, saved the company, computer graphics, saved the company, uh, launched us into into the uh, launched us into into the uh, launched us into into the stratosphere. stratosphere. stratosphere. >> Just eight years after Denny's, Nvidia >> Just eight years after Denny's, Nvidia >> Just eight years after Denny's, Nvidia earned a spot in the S&P 500. Jensen earned a spot in the S&P 500. Jensen earned a spot in the S&P 500. Jensen then set his sights on developing the then set his sights on developing the then set his sights on developing the software and hardware for a software and hardware for a software and hardware for a revolutionary GPUdriven supercomput, revolutionary GPUdriven supercomput, revolutionary GPUdriven supercomput, which would take the company far beyond which would take the company far beyond which would take the company far beyond video games. To Wall Street, it was a video games. To Wall Street, it was a video games. To Wall Street, it was a risky bet. To early developers of AI, it risky bet. To early developers of AI, it risky bet. To early developers of AI, it was a revelation. was a revelation. was a revelation. >> Was that luck or was that vision? >> Was that luck or was that vision? >> Was that luck or was that vision? >> That was a a luck founded by vision. We >> That was a a luck founded by vision. We >> That was a a luck founded by vision. We invented this capability and then one invented this capability and then one invented this capability and then one day the researchers that were uh day the researchers that were uh day the researchers that were uh creating deep learning discovered this creating deep learning discovered this creating deep learning discovered this architecture because this architecture architecture because this architecture architecture because this architecture turns out to have been perfect for them.

turns out to have been perfect for them. turns out to have been perfect for them. >> Perfect for AI. >> Perfect for AI. >> Perfect for AI. >> Perfect for AI. >> Perfect for AI. >> Perfect for AI. >> This is the first one we've ever >> This is the first one we've ever >> This is the first one we've ever shipped. In 2016, Jensen delivered shipped. In 2016, Jensen delivered shipped. In 2016, Jensen delivered Nvidia's AI supercomputer, the first of Nvidia's AI supercomputer, the first of Nvidia's AI supercomputer, the first of its kind, to Elon Musk, then a board its kind, to Elon Musk, then a board its kind, to Elon Musk, then a board member of Open AI, which used it to member of Open AI, which used it to member of Open AI, which used it to create the building blocks of chat GPT. create the building blocks of chat GPT. create the building blocks of chat GPT. >> How are you? >> How are you? >> How are you? >> When AI took off. >> When AI took off. >> When AI took off. >> Hey guys. >> Hey guys. >> Hey guys. >> So did Jensen Hang's reputation. >> So did Jensen Hang's reputation. >> So did Jensen Hang's reputation. >> Can we get a picture? >> Can we get a picture? >> Can we get a picture? >> Yeah. Yeah. >> Yeah. Yeah. >> Yeah. Yeah. >> He's now a Silicon Valley celebrity. He >> He's now a Silicon Valley celebrity. He >> He's now a Silicon Valley celebrity. He told us the boy who immigrated from told us the boy who immigrated from told us the boy who immigrated from Taiwan at age nine could never have Taiwan at age nine could never have Taiwan at age nine could never have conceived of this. conceived of this. conceived of this. >> It is the most extraordinary thing, >> It is the most extraordinary thing, >> It is the most extraordinary thing, Bill, that a normal Bill, that a normal Bill, that a normal dishwasher bus boy could grow up to be dishwasher bus boy could grow up to be dishwasher bus boy could grow up to be this. There's no magic. It's just 61 this. There's no magic. It's just 61 this. There's no magic. It's just 61 years of hard work every single day. I years of hard work every single day. I years of hard work every single day. I don't think there's anything more than don't think there's anything more than don't think there's anything more than that. We met a humble Jensen at Denny's that. We met a humble Jensen at Denny's that. We met a humble Jensen at Denny's back at Nvidia's headquarters in Santa back at Nvidia's headquarters in Santa back at Nvidia's headquarters in Santa Clara. We saw he can be intense.

Clara. We saw he can be intense. Clara. We saw he can be intense. >> Let me tell you what some of the people >> Let me tell you what some of the people >> Let me tell you what some of the people who you work with said about you. who you work with said about you. who you work with said about you. Demanding, perfectionist, not easy to Demanding, perfectionist, not easy to Demanding, perfectionist, not easy to work for. All that sound right? work for. All that sound right? work for. All that sound right? >> Perfectly. Yeah. >> Perfectly. Yeah. >> Perfectly. Yeah. >> It should be like that. If you want to >> It should be like that. If you want to >> It should be like that. If you want to do extraordinary things, it shouldn't be do extraordinary things, it shouldn't be do extraordinary things, it shouldn't be easy. easy. easy. >> All right, guys. Keep up the good work. >> All right, guys. Keep up the good work. >> All right, guys. Keep up the good work. Nvidia has never done better. Investors Nvidia has never done better. Investors Nvidia has never done better. Investors are bullish. But last year, more than are bullish. But last year, more than are bullish. But last year, more than 600 top AI scientists, ethicists, and 600 top AI scientists, ethicists, and 600 top AI scientists, ethicists, and others signed this statement urging others signed this statement urging others signed this statement urging caution, warning of AI's risk to caution, warning of AI's risk to caution, warning of AI's risk to humanity. humanity. humanity. >> When I talk to you and I hear you speak, >> When I talk to you and I hear you speak, >> When I talk to you and I hear you speak, part of me goes, "Gee whiz." And the part of me goes, "Gee whiz." And the part of me goes, "Gee whiz." And the other part of me goes, "Oh my god, what other part of me goes, "Oh my god, what other part of me goes, "Oh my god, what are we in for?" are we in for?" are we in for?" >> Yeah. Yeah. >> Yeah. Yeah. >> Yeah. Yeah. >> Which one is it? >> Which one is it? >> Which one is it? >> It's both. It's both. Yeah, you're >> It's both. It's both. Yeah, you're >> It's both. It's both. Yeah, you're feeling all the right feelings. I feel feeling all the right feelings. I feel feeling all the right feelings. I feel both. both. both. >> You feel both? >> You feel both? >> You feel both? >> Sure. Sure. >> Sure. Sure. >> Sure. Sure. >> Humanity will have the choice to see >> Humanity will have the choice to see >> Humanity will have the choice to see themselves inferior to machines or themselves inferior to machines or themselves inferior to machines or superior to machines.

superior to machines. superior to machines. >> Pinar Seahhan Deerda is an AI optimist >> Pinar Seahhan Deerda is an AI optimist >> Pinar Seahhan Deerda is an AI optimist though she named her company Cubri, an though she named her company Cubri, an though she named her company Cubri, an homage to Stanley Kubri, the director of homage to Stanley Kubri, the director of homage to Stanley Kubri, the director of 2001 a space odyssey. 2001 a space odyssey. 2001 a space odyssey. >> Hello. How do you read me? In that film, >> Hello. How do you read me? In that film, >> Hello. How do you read me? In that film, Hal the AI computer goes rogue. Hal the AI computer goes rogue. Hal the AI computer goes rogue. >> Open the pod bay doors. Hal, >> Open the pod bay doors. Hal, >> Open the pod bay doors. Hal, >> I'm sorry, Dave. I'm afraid I can't do >> I'm sorry, Dave. I'm afraid I can't do >> I'm sorry, Dave. I'm afraid I can't do that. that. that. >> I think that's what worries people about >> I think that's what worries people about >> I think that's what worries people about AI, that we will lose control of it. AI, that we will lose control of it. AI, that we will lose control of it. >> Just because a machine can do faster >> Just because a machine can do faster >> Just because a machine can do faster calculations, comparisons, and calculations, comparisons, and calculations, comparisons, and analytical solution creation, that analytical solution creation, that analytical solution creation, that doesn't make you smarter than you. It doesn't make you smarter than you. It doesn't make you smarter than you. It simply computates faster. In my world, simply computates faster. In my world, simply computates faster. In my world, in my belief, smarts have to do with in my belief, smarts have to do with in my belief, smarts have to do with your capacity to love, create, expand, your capacity to love, create, expand, your capacity to love, create, expand, transcend. transcend. transcend. These are qualities that no machine can These are qualities that no machine can These are qualities that no machine can ever bear, that are reserved to only ever bear, that are reserved to only ever bear, that are reserved to only humans. humans. humans. >> There is something going on.

>> There is something going on. >> There is something going on. >> Jensen Hang sees an AI future of >> Jensen Hang sees an AI future of >> Jensen Hang sees an AI future of progress and prosperity, not one with progress and prosperity, not one with progress and prosperity, not one with machines as our masters. We can only machines as our masters. We can only machines as our masters. We can only hope he's right. hope he's right. hope he's right. >> Thank you all for coming. Thank you. >> The familiar narrative is that >> The familiar narrative is that artificial intelligence will take away artificial intelligence will take away artificial intelligence will take away human jobs. Machine learning will let human jobs. Machine learning will let human jobs. Machine learning will let cars, computers, and chat bots teach cars, computers, and chat bots teach cars, computers, and chat bots teach themselves, making us humans obsolete. themselves, making us humans obsolete. themselves, making us humans obsolete. Well, that is not very likely. As we Well, that is not very likely. As we Well, that is not very likely. As we first reported in November, there's a first reported in November, there's a first reported in November, there's a growing global army of millions toiling growing global army of millions toiling growing global army of millions toiling to make AI run smoothly. They're called to make AI run smoothly. They're called to make AI run smoothly. They're called humans in the loop. people sorting, humans in the loop. people sorting, humans in the loop. people sorting, labeling, and sifting reams of data to labeling, and sifting reams of data to labeling, and sifting reams of data to train and improve AI for companies like train and improve AI for companies like train and improve AI for companies like Meta, Open AI, Microsoft, and Google.

Meta, Open AI, Microsoft, and Google. Meta, Open AI, Microsoft, and Google. It's grunt work that needs to be done It's grunt work that needs to be done It's grunt work that needs to be done accurately, fast, and to do it cheaply, accurately, fast, and to do it cheaply, accurately, fast, and to do it cheaply, it's often farmed out to places like it's often farmed out to places like it's often farmed out to places like Africa. Africa. Africa. the robots or the machines. You're the robots or the machines. You're the robots or the machines. You're teaching them how to think like human teaching them how to think like human teaching them how to think like human and to do things like human. and to do things like human. and to do things like human. >> We met Naftali Wambalo in Nairobi, >> We met Naftali Wambalo in Nairobi, >> We met Naftali Wambalo in Nairobi, Kenya, one of the main hubs for this Kenya, one of the main hubs for this Kenya, one of the main hubs for this kind of work. It's a country desperate kind of work. It's a country desperate kind of work. It's a country desperate for jobs because of an unemployment rate for jobs because of an unemployment rate for jobs because of an unemployment rate as high as 67% among young people. So as high as 67% among young people. So as high as 67% among young people. So Naftali, father of two, college educated Naftali, father of two, college educated Naftali, father of two, college educated with a degree in mathematics, was elated with a degree in mathematics, was elated with a degree in mathematics, was elated to finally find work in an emerging to finally find work in an emerging to finally find work in an emerging field, artificial intelligence. field, artificial intelligence. field, artificial intelligence. >> You were labeling. >> You were labeling. >> You were labeling. >> I did labeling for videos and images. >> I did labeling for videos and images. >> I did labeling for videos and images. Naftali and digital workers like him Naftali and digital workers like him Naftali and digital workers like him spend eight hours a day in front of a spend eight hours a day in front of a spend eight hours a day in front of a screen studying photos and videos screen studying photos and videos screen studying photos and videos drawing boxes around objects and drawing boxes around objects and drawing boxes around objects and labeling them. Teaching the AI labeling them. Teaching the AI labeling them. Teaching the AI algorithms to recognize them.

algorithms to recognize them. algorithms to recognize them. >> You would label let's say furniture in a >> You would label let's say furniture in a >> You would label let's say furniture in a house and you say this is a TV, this is house and you say this is a TV, this is house and you say this is a TV, this is a microwave. So you are teaching the AI a microwave. So you are teaching the AI a microwave. So you are teaching the AI to identify these items, to identify these items, to identify these items, >> right? And then there was one for faces >> right? And then there was one for faces >> right? And then there was one for faces of people, the color of the face. If it of people, the color of the face. If it of people, the color of the face. If it looks like this, this is white. If it looks like this, this is white. If it looks like this, this is white. If it looks like this is black, this is Asian. looks like this is black, this is Asian. looks like this is black, this is Asian. You're teaching the AI to identify them, You're teaching the AI to identify them, You're teaching the AI to identify them, >> right? >> right? >> right? >> Automatically, >> Automatically, >> Automatically, >> humans tag cars and pedestrians to teach >> humans tag cars and pedestrians to teach >> humans tag cars and pedestrians to teach autonomous vehicles not to hit them. autonomous vehicles not to hit them. autonomous vehicles not to hit them. Humans circle abnormalities to teach AI Humans circle abnormalities to teach AI Humans circle abnormalities to teach AI to recognize diseases. to recognize diseases. to recognize diseases. Even as AI is getting smarter, humans in Even as AI is getting smarter, humans in Even as AI is getting smarter, humans in the loop will always be needed because the loop will always be needed because the loop will always be needed because there will always be new devices and there will always be new devices and there will always be new devices and inventions that'll need labeling. You inventions that'll need labeling. You inventions that'll need labeling. You find these humans in the loop not only find these humans in the loop not only find these humans in the loop not only here in Kenya, but in other countries here in Kenya, but in other countries here in Kenya, but in other countries thousands of miles from Silicon Valley, thousands of miles from Silicon Valley, thousands of miles from Silicon Valley, in India, the Philippines, Venezuela, in India, the Philippines, Venezuela, in India, the Philippines, Venezuela, often countries with large low-wage often countries with large low-wage often countries with large low-wage populations, well-educated but populations, well-educated but populations, well-educated but unemployed. Honestly, it's like unemployed. Honestly, it's like unemployed. Honestly, it's like modernday slavery because it's cheap modernday slavery because it's cheap modernday slavery because it's cheap labor.

labor. labor. >> Oh, what do you >> Oh, what do you >> Oh, what do you >> It's cheap labor. >> It's cheap labor. >> It's cheap labor. >> Like modernday slavery, says Narima Wako >> Like modernday slavery, says Narima Wako >> Like modernday slavery, says Narima Wako Ojiwa, a Kenyan civil rights activist. Ojiwa, a Kenyan civil rights activist. Ojiwa, a Kenyan civil rights activist. Because big American tech companies come Because big American tech companies come Because big American tech companies come here and advertise the jobs as a ticket here and advertise the jobs as a ticket here and advertise the jobs as a ticket to the future, but really she says it's to the future, but really she says it's to the future, but really she says it's exploitation. exploitation. exploitation. >> What we're seeing is an inequality. >> What we're seeing is an inequality. >> What we're seeing is an inequality. It sounds so good. It sounds so good. It sounds so good. >> An AI job. Is there any job security? >> An AI job. Is there any job security? >> An AI job. Is there any job security? >> The contracts that we see are very >> The contracts that we see are very >> The contracts that we see are very short-term. And I've seen people who short-term. And I've seen people who short-term. And I've seen people who have contracts that are monthly, some of have contracts that are monthly, some of have contracts that are monthly, some of them weekly, some of them days, uh, them weekly, some of them days, uh, them weekly, some of them days, uh, which is ridiculous. which is ridiculous. which is ridiculous. >> She calls the workspaces AI sweat shops >> She calls the workspaces AI sweat shops >> She calls the workspaces AI sweat shops with computers instead of sewing with computers instead of sewing with computers instead of sewing machines. I think that we're so machines. I think that we're so machines. I think that we're so concerned with creating opportunities, concerned with creating opportunities, concerned with creating opportunities, but we're not asking are they good but we're not asking are they good but we're not asking are they good opportunities. Because every year a opportunities. Because every year a opportunities. Because every year a million young people enter the job million young people enter the job million young people enter the job market, the government has been courting market, the government has been courting market, the government has been courting tech giants like Microsoft, Google, tech giants like Microsoft, Google, tech giants like Microsoft, Google, Apple, and Intel to come here, promoting Apple, and Intel to come here, promoting Apple, and Intel to come here, promoting Kenya's reputation as the silicon Kenya's reputation as the silicon Kenya's reputation as the silicon savannah, techsavvy and digitally savannah, techsavvy and digitally savannah, techsavvy and digitally connected.

connected. connected. >> The president has been really pushing >> The president has been really pushing >> The president has been really pushing forward opportunities in AI. forward opportunities in AI. forward opportunities in AI. >> President, >> President, >> President, >> yes, our president. Yes, the president >> yes, our president. Yes, the president >> yes, our president. Yes, the president does have to create at least 1 million does have to create at least 1 million does have to create at least 1 million jobs a year, the minimum. So, it's a jobs a year, the minimum. So, it's a jobs a year, the minimum. So, it's a very tight position to be in. To lure very tight position to be in. To lure very tight position to be in. To lure the tech giants, RTO has been offering the tech giants, RTO has been offering the tech giants, RTO has been offering financial incentives on top of already financial incentives on top of already financial incentives on top of already lax labor laws. But the workers aren't lax labor laws. But the workers aren't lax labor laws. But the workers aren't hired directly by the big companies. hired directly by the big companies. hired directly by the big companies. They engage outsourcing firms, also They engage outsourcing firms, also They engage outsourcing firms, also mostly American, to hire for them. mostly American, to hire for them. mostly American, to hire for them. >> There's a gobetween. >> There's a gobetween. >> There's a gobetween. >> Yes. They hire, they pay. >> Yes. They hire, they pay. >> Yes. They hire, they pay. >> I mean, they hire thousands of people >> I mean, they hire thousands of people >> I mean, they hire thousands of people >> and they are protecting the Facebooks >> and they are protecting the Facebooks >> and they are protecting the Facebooks from having their names associated with from having their names associated with from having their names associated with this. this. this. >> Yes. Yes. >> Yes. Yes. >> Yes. Yes. >> We're talking about the richest >> We're talking about the richest >> We're talking about the richest companies on Earth. companies on Earth. companies on Earth. >> Yes. But then they are paying people >> Yes. But then they are paying people >> Yes. But then they are paying people peanuts. peanuts. peanuts. >> AI jobs don't pay much. >> AI jobs don't pay much. >> AI jobs don't pay much. >> They don't pay well. They do not pay >> They don't pay well. They do not pay >> They don't pay well. They do not pay Africans well enough. And the workforce Africans well enough. And the workforce Africans well enough. And the workforce is so large and desperate that they is so large and desperate that they is so large and desperate that they could pay whatever and have whatever could pay whatever and have whatever could pay whatever and have whatever working conditions and they will have working conditions and they will have working conditions and they will have someone who will pick up that job.

someone who will pick up that job. someone who will pick up that job. >> So what's the average pay for these >> So what's the average pay for these >> So what's the average pay for these jobs? jobs? jobs? >> It's about uh a dollar and a half $2 an >> It's about uh a dollar and a half $2 an >> It's about uh a dollar and a half $2 an hour. hour. hour. >> $2 per hour and that is gross before >> $2 per hour and that is gross before >> $2 per hour and that is gross before tax. Naftali, Nathan, and Faca were tax. Naftali, Nathan, and Faca were tax. Naftali, Nathan, and Faca were hired by an American outsourcing company hired by an American outsourcing company hired by an American outsourcing company called Sama that employs over 3,000 called Sama that employs over 3,000 called Sama that employs over 3,000 workers here and hired for Meta and Open workers here and hired for Meta and Open workers here and hired for Meta and Open AI. In documents we obtained, Open AI AI. In documents we obtained, Open AI AI. In documents we obtained, Open AI agreed to pay Sama $12.50 agreed to pay Sama $12.50 agreed to pay Sama $12.50 an hour per worker, much more than the an hour per worker, much more than the an hour per worker, much more than the $2 the workers actually got. Though Sama $2 the workers actually got. Though Sama $2 the workers actually got. Though Sama says that's a fair wage for the region. says that's a fair wage for the region. says that's a fair wage for the region. If the big tech companies are going to If the big tech companies are going to If the big tech companies are going to keep doing this this business, they have keep doing this this business, they have keep doing this this business, they have to do it the right way. So it's not to do it the right way. So it's not to do it the right way. So it's not because you realize Kenya is a third because you realize Kenya is a third because you realize Kenya is a third world country. You say this job I would world country. You say this job I would world country. You say this job I would normally pay $30 in US but because you normally pay $30 in US but because you normally pay $30 in US but because you are Kenya $2 is enough for you. That are Kenya $2 is enough for you. That are Kenya $2 is enough for you. That idea has to end. idea has to end. idea has to end. >> Okay. $2 an hour in Kenya is that low, >> Okay. $2 an hour in Kenya is that low, >> Okay. $2 an hour in Kenya is that low, medium, is it an okay salary?

medium, is it an okay salary? medium, is it an okay salary? >> So for me I was living paycheck to >> So for me I was living paycheck to >> So for me I was living paycheck to paycheck. I I have saved nothing because paycheck. I I have saved nothing because paycheck. I I have saved nothing because it's not enough. Is it an insult? it's not enough. Is it an insult? it's not enough. Is it an insult? >> It is. >> It is. >> It is. >> Yes, of course it is. >> Yes, of course it is. >> Yes, of course it is. >> Why did you take the job? >> Why did you take the job? >> Why did you take the job? >> I have a family to feed and instead of >> I have a family to feed and instead of >> I have a family to feed and instead of staying home, let me just at least have staying home, let me just at least have staying home, let me just at least have something to do. something to do. something to do. >> And not only did the jobs not pay well, >> And not only did the jobs not pay well, >> And not only did the jobs not pay well, they were draining. They say deadlines they were draining. They say deadlines they were draining. They say deadlines were unrealistic, punitive, with often were unrealistic, punitive, with often were unrealistic, punitive, with often just seconds to complete complicated just seconds to complete complicated just seconds to complete complicated labeling tasks. labeling tasks. labeling tasks. >> Did you see people who were fired just >> Did you see people who were fired just >> Did you see people who were fired just cuz they complained? Yes, we were cuz they complained? Yes, we were cuz they complained? Yes, we were working on eggshells. working on eggshells. working on eggshells. >> They were all hired per project and say >> They were all hired per project and say >> They were all hired per project and say Sama kept pushing them to complete the Sama kept pushing them to complete the Sama kept pushing them to complete the work faster than the projects required. work faster than the projects required. work faster than the projects required. An allegation Sama denies. An allegation Sama denies. An allegation Sama denies. >> Let's say the contract for a certain job >> Let's say the contract for a certain job >> Let's say the contract for a certain job um was 6 months. Okay. What if you um was 6 months. Okay. What if you um was 6 months. Okay. What if you finished in 3 months? Does the worker finished in 3 months? Does the worker finished in 3 months? Does the worker get paid for those extra 3 months?

get paid for those extra 3 months? get paid for those extra 3 months? >> No. KFC. >> No. KFC. >> No. KFC. >> What? We used to get KFC and Coca-Cola. >> What? We used to get KFC and Coca-Cola. >> What? We used to get KFC and Coca-Cola. >> They they used to say, "Uh, thank you. >> They they used to say, "Uh, thank you. >> They they used to say, "Uh, thank you. They get you a bottle of soda and KFC They get you a bottle of soda and KFC They get you a bottle of soda and KFC chicken, two pieces, and that is it." chicken, two pieces, and that is it." chicken, two pieces, and that is it." >> Worse yet, workers told us that some of >> Worse yet, workers told us that some of >> Worse yet, workers told us that some of the projects for Meta and Open AI were the projects for Meta and Open AI were the projects for Meta and Open AI were grim and caused them harm. Naftali was grim and caused them harm. Naftali was grim and caused them harm. Naftali was assigned to train AI to recognize and assigned to train AI to recognize and assigned to train AI to recognize and weed out pornography, hate speech, and weed out pornography, hate speech, and weed out pornography, hate speech, and excessive violence, which meant sifting excessive violence, which meant sifting excessive violence, which meant sifting through the worst of the worst content through the worst of the worst content through the worst of the worst content online for hours on end. I looked at um online for hours on end. I looked at um online for hours on end. I looked at um people being slaughtered, people being slaughtered, people being slaughtered, uh people engaging in sexual activity uh people engaging in sexual activity uh people engaging in sexual activity with animals, with animals, with animals, people are abusing children physically, people are abusing children physically, people are abusing children physically, sexually, sexually, sexually, people committing suicide. people committing suicide. people committing suicide. >> Basically, >> Basically, >> Basically, >> all day long. >> all day long. >> all day long. >> Yes, all day long. 8 hours a day, 40 >> Yes, all day long. 8 hours a day, 40 >> Yes, all day long. 8 hours a day, 40 hours a week. The workers told us they hours a week. The workers told us they hours a week. The workers told us they were tricked into this work by ads like were tricked into this work by ads like were tricked into this work by ads like this that described these jobs as call this that described these jobs as call this that described these jobs as call center agents to assist our clients center agents to assist our clients center agents to assist our clients community and help resolve inquiries community and help resolve inquiries community and help resolve inquiries empathetically.

empathetically. empathetically. >> I was told I was going to do a >> I was told I was going to do a >> I was told I was going to do a translation job. translation job. translation job. >> Exactly. What was the job you were >> Exactly. What was the job you were >> Exactly. What was the job you were doing? doing? doing? >> I was basically reviewing content which >> I was basically reviewing content which >> I was basically reviewing content which are very graphic, very disturbing are very graphic, very disturbing are very graphic, very disturbing contents. I was watching dismembered contents. I was watching dismembered contents. I was watching dismembered bodies or drone attack victims or you bodies or drone attack victims or you bodies or drone attack victims or you name it. You know, whenever I talk about name it. You know, whenever I talk about name it. You know, whenever I talk about this, I still have, you know, this, I still have, you know, this, I still have, you know, flashbacks. flashbacks. flashbacks. >> Are any of you >> Are any of you >> Are any of you a different person than they were before a different person than they were before a different person than they were before you had this job? you had this job? you had this job? >> Yeah. I find it hard now to even have >> Yeah. I find it hard now to even have >> Yeah. I find it hard now to even have conversations with people. conversations with people. conversations with people. >> It's just that I find it easy to cry >> It's just that I find it easy to cry >> It's just that I find it easy to cry than to speak. Uh you you continue than to speak. Uh you you continue than to speak. Uh you you continue isolating yourself from people. You isolating yourself from people. You isolating yourself from people. You don't want to socialize with others. don't want to socialize with others. don't want to socialize with others. It's you and it's you alone. It's you and it's you alone. It's you and it's you alone. >> Are you a different person? >> Are you a different person? >> Are you a different person? >> Yeah, I'm a different person. I used to >> Yeah, I'm a different person. I used to >> Yeah, I'm a different person. I used to enjoy my marriage, especially when it enjoy my marriage, especially when it enjoy my marriage, especially when it comes to bedroom fireworks. But after comes to bedroom fireworks. But after comes to bedroom fireworks. But after the job, I hate sex. the job, I hate sex. the job, I hate sex. >> You hated sex? >> You hated sex? >> You hated sex? >> After countlessly seeing those sexual >> After countlessly seeing those sexual >> After countlessly seeing those sexual activities, pornography activities, pornography activities, pornography on the on the job that I was doing, I on the on the job that I was doing, I on the on the job that I was doing, I hate sex. Sama says mental health hate sex. Sama says mental health hate sex. Sama says mental health counseling was provided by quote fully counseling was provided by quote fully counseling was provided by quote fully licensed professionals but the workers licensed professionals but the workers licensed professionals but the workers say it was woefully inadequate.

say it was woefully inadequate. say it was woefully inadequate. >> We want psychiatrists. We want >> We want psychiatrists. We want >> We want psychiatrists. We want psychologist qualified who know exactly psychologist qualified who know exactly psychologist qualified who know exactly what we are going through and how they what we are going through and how they what we are going through and how they can help us to cope. can help us to cope. can help us to cope. >> Trauma experts. >> Trauma experts. >> Trauma experts. >> Yes. Do you think the big company >> Yes. Do you think the big company >> Yes. Do you think the big company Facebook chat GPT do you think they know Facebook chat GPT do you think they know Facebook chat GPT do you think they know how this is affecting the workers? how this is affecting the workers? how this is affecting the workers? >> It's their job to know. It's their job >> It's their job to know. It's their job >> It's their job to know. It's their job to know actually because they are the to know actually because they are the to know actually because they are the ones providing the work. ones providing the work. ones providing the work. >> These three and nearly 200 other digital >> These three and nearly 200 other digital >> These three and nearly 200 other digital workers are suing Sama and Meta over workers are suing Sama and Meta over workers are suing Sama and Meta over unreasonable working conditions that unreasonable working conditions that unreasonable working conditions that caused psychiatric problems. It was caused psychiatric problems. It was caused psychiatric problems. It was proven by a psychiatric that we are proven by a psychiatric that we are proven by a psychiatric that we are thoroughly sick. We have gone through a thoroughly sick. We have gone through a thoroughly sick. We have gone through a psychiatric evaluation just a few months psychiatric evaluation just a few months psychiatric evaluation just a few months ago and it was proven that we are all ago and it was proven that we are all ago and it was proven that we are all sick. Thoroughly sick. sick. Thoroughly sick. sick. Thoroughly sick. >> They know that we're damaged, but they >> They know that we're damaged, but they >> They know that we're damaged, but they don't care. We're humans. Just because don't care. We're humans. Just because don't care. We're humans. Just because we're black or just because we're just we're black or just because we're just we're black or just because we're just vulnerable for now, that does that vulnerable for now, that does that vulnerable for now, that does that doesn't give them the right to just doesn't give them the right to just doesn't give them the right to just exploit us like this. Sama, which has exploit us like this. Sama, which has exploit us like this. Sama, which has terminated those projects, would not terminated those projects, would not terminated those projects, would not agree to an on camera interview. Meta agree to an on camera interview. Meta agree to an on camera interview. Meta and Open AI told us they're committed to and Open AI told us they're committed to and Open AI told us they're committed to safe working conditions, including fair safe working conditions, including fair safe working conditions, including fair wages and access to mental health wages and access to mental health wages and access to mental health counseling. Another American AI training counseling. Another American AI training counseling. Another American AI training company facing criticism in Kenya is company facing criticism in Kenya is company facing criticism in Kenya is Scale AI, which operates a website Scale AI, which operates a website Scale AI, which operates a website called Remotasks. Did you all work for

called Remotasks. Did you all work for called Remotasks. Did you all work for Remoes or work with them? Remoes or work with them? Remoes or work with them? >> Aphantis, Joan, Joy, Michael, and Duncan >> Aphantis, Joan, Joy, Michael, and Duncan >> Aphantis, Joan, Joy, Michael, and Duncan signed up online, creating an account, signed up online, creating an account, signed up online, creating an account, and clicked for work remotely, getting and clicked for work remotely, getting and clicked for work remotely, getting paid per task. Problem is, sometimes the paid per task. Problem is, sometimes the paid per task. Problem is, sometimes the company just didn't pay them. company just didn't pay them. company just didn't pay them. >> When it gets to the day before payday, >> When it gets to the day before payday, >> When it gets to the day before payday, they close the account and say that you they close the account and say that you they close the account and say that you violated a policy. violated a policy. violated a policy. >> They say you violated their policy and >> They say you violated their policy and >> They say you violated their policy and they don't pay you for the work you've they don't pay you for the work you've they don't pay you for the work you've done. Would you say that that's almost done. Would you say that that's almost done. Would you say that that's almost common that you do work and you're not common that you do work and you're not common that you do work and you're not paid for it paid for it paid for it >> and you have no recourse? You have no >> and you have no recourse? You have no >> and you have no recourse? You have no way to even way to even way to even >> complain. There's no way. >> complain. There's no way. >> complain. There's no way. >> The company says any work that was done >> The company says any work that was done >> The company says any work that was done in line with our community guidelines in line with our community guidelines in line with our community guidelines was paid out last year. As workers was paid out last year. As workers was paid out last year. As workers started complaining publicly, remote started complaining publicly, remote started complaining publicly, remote tasks abruptly shut down in Kenya tasks abruptly shut down in Kenya tasks abruptly shut down in Kenya altogether. altogether. altogether. >> There are no labor laws here. Our labor >> There are no labor laws here. Our labor >> There are no labor laws here. Our labor law is about 20 years old. It doesn't law is about 20 years old. It doesn't law is about 20 years old. It doesn't touch on digital labor. I do think that touch on digital labor. I do think that touch on digital labor. I do think that our labor laws need to recognize it. But our labor laws need to recognize it. But our labor laws need to recognize it. But not just in Kenya alone because what not just in Kenya alone because what not just in Kenya alone because what happens is when we start to push back in happens is when we start to push back in happens is when we start to push back in terms of protections of workers. A lot terms of protections of workers. A lot terms of protections of workers. A lot of these companies, they shut down and of these companies, they shut down and of these companies, they shut down and they move to a neighboring country.

they move to a neighboring country. they move to a neighboring country. >> It's easy to see how you're trapped. >> It's easy to see how you're trapped. >> It's easy to see how you're trapped. >> Kenya is trapped. They need jobs so >> Kenya is trapped. They need jobs so >> Kenya is trapped. They need jobs so desperately that there's a fear that if desperately that there's a fear that if desperately that there's a fear that if you complain, if your government you complain, if your government you complain, if your government complained, then these companies don't complained, then these companies don't complained, then these companies don't have to come here. Yeah. And that's what have to come here. Yeah. And that's what have to come here. Yeah. And that's what they throw at us all the time. And it's they throw at us all the time. And it's they throw at us all the time. And it's terrible to see just how many American terrible to see just how many American terrible to see just how many American companies are just just doing wrong companies are just just doing wrong companies are just just doing wrong here. Just doing wrong here. And it's here. Just doing wrong here. And it's here. Just doing wrong here. And it's something that they wouldn't do at home. something that they wouldn't do at home. something that they wouldn't do at home. So why do it here? We're about to show you a technological We're about to show you a technological innovation that could one day change the innovation that could one day change the innovation that could one day change the way every child in every school in way every child in every school in way every child in every school in America is taught. It's an online tutor America is taught. It's an online tutor America is taught. It's an online tutor powered by artificial intelligence powered by artificial intelligence powered by artificial intelligence designed to help teachers be more designed to help teachers be more designed to help teachers be more efficient and students learn more efficient and students learn more efficient and students learn more effectively. It's called Kmigo. Konigo effectively. It's called Kmigo. Konigo effectively. It's called Kmigo. Konigo means with me in Spanish. And Khan is means with me in Spanish. And Khan is means with me in Spanish. And Khan is its creator, Sal Khan, the well-known its creator, Sal Khan, the well-known its creator, Sal Khan, the well-known founder of Khan Academy, whose lectures founder of Khan Academy, whose lectures founder of Khan Academy, whose lectures and educational software have been used and educational software have been used and educational software have been used for years by tens of millions of for years by tens of millions of for years by tens of millions of students and teachers in the US and students and teachers in the US and students and teachers in the US and around the world. As we first reported around the world. As we first reported around the world. As we first reported last year, Kmigo was built with the help last year, Kmigo was built with the help last year, Kmigo was built with the help of Open AI, the creator of Chat GPT. Its of Open AI, the creator of Chat GPT. Its of Open AI, the creator of Chat GPT. Its potential is staggering, but it's still potential is staggering, but it's still potential is staggering, but it's still very much a work in progress. It's being very much a work in progress. It's being very much a work in progress. It's being piloted in 266 school districts in the piloted in 266 school districts in the piloted in 266 school districts in the US in grades 3 through 12. We went to US in grades 3 through 12. We went to US in grades 3 through 12. We went to Hobert High School in Indiana to see how

Hobert High School in Indiana to see how Hobert High School in Indiana to see how it works. it works. it works. >> Good morning. Just a normal day in chem, >> Good morning. Just a normal day in chem, >> Good morning. Just a normal day in chem, right? right? right? >> At 8 in the morning, Melissa Higginson >> At 8 in the morning, Melissa Higginson >> At 8 in the morning, Melissa Higginson knows it's not always easy to get 30 knows it's not always easy to get 30 knows it's not always easy to get 30 high schoolers excited about chemistry. high schoolers excited about chemistry. high schoolers excited about chemistry. >> Are you ready? >> Are you ready? >> Are you ready? >> Are you ready? >> Are you ready? >> Are you ready? >> All right, that's what I want to hear. >> All right, that's what I want to hear. >> All right, that's what I want to hear. >> But these days, she has help. >> But these days, she has help. >> But these days, she has help. >> This is acetic acid. The pipet's not >> This is acetic acid. The pipet's not >> This is acetic acid. The pipet's not going to fill all the way. going to fill all the way. going to fill all the way. >> That lesson Higginson has displayed >> That lesson Higginson has displayed >> That lesson Higginson has displayed behind her and is explaining to her 9th behind her and is explaining to her 9th behind her and is explaining to her 9th and 10th graders was created with the and 10th graders was created with the and 10th graders was created with the assistance of K Migo. She told the AI assistance of K Migo. She told the AI assistance of K Migo. She told the AI tutor she wanted a 4-day course in which tutor she wanted a 4-day course in which tutor she wanted a 4-day course in which her students would investigate the her students would investigate the her students would investigate the physical and chemical properties of physical and chemical properties of physical and chemical properties of matter. matter. matter. >> This next section is your research >> This next section is your research >> This next section is your research section. section. section. >> It took Kmigo minutes to come up with a >> It took Kmigo minutes to come up with a >> It took Kmigo minutes to come up with a detailed lesson plan that would have detailed lesson plan that would have detailed lesson plan that would have taken Higginson a week to create. taken Higginson a week to create. taken Higginson a week to create. >> You pull that computer back out. You're >> You pull that computer back out. You're >> You pull that computer back out. You're going to go back to Kamigo research going to go back to Kamigo research going to go back to Kamigo research >> and the students have KIGO on their >> and the students have KIGO on their >> and the students have KIGO on their laptops too ready to help them with laptops too ready to help them with laptops too ready to help them with their questions. their questions. their questions. >> We have a couple of questions that we >> We have a couple of questions that we >> We have a couple of questions that we need to ask KIGO. So for example, I need to ask KIGO. So for example, I need to ask KIGO. So for example, I asked it what are three examples of asked it what are three examples of asked it what are three examples of acids and if I wanted to know more.

acids and if I wanted to know more. acids and if I wanted to know more. >> So it gave you three examples of acids >> So it gave you three examples of acids >> So it gave you three examples of acids like hydrochloric acid, citric and like hydrochloric acid, citric and like hydrochloric acid, citric and sulfur. sulfur. sulfur. >> Can you give me more examples? And if I >> Can you give me more examples? And if I >> Can you give me more examples? And if I wanted to know even more, I could ask it wanted to know even more, I could ask it wanted to know even more, I could ask it like what specifically some of the acids like what specifically some of the acids like what specifically some of the acids do. So it it's giving you acids and then do. So it it's giving you acids and then do. So it it's giving you acids and then it's asking you a question. Can you it's asking you a question. Can you it's asking you a question. Can you think of any other household items that think of any other household items that think of any other household items that might contain acids? might contain acids? might contain acids? >> Yeah. So like it wants to help you >> Yeah. So like it wants to help you >> Yeah. So like it wants to help you understand like what it's telling you understand like what it's telling you understand like what it's telling you and not just like give you the and not just like give you the and not just like give you the information. information. information. >> This school used to be >> This school used to be >> This school used to be >> finding creative ways to help kids learn >> finding creative ways to help kids learn >> finding creative ways to help kids learn is something Sal Khan has been doing is something Sal Khan has been doing is something Sal Khan has been doing since 2005. He'd gotten degrees in math, since 2005. He'd gotten degrees in math, since 2005. He'd gotten degrees in math, computer science and engineering from computer science and engineering from computer science and engineering from MIT and an MBA from Harvard and was MIT and an MBA from Harvard and was MIT and an MBA from Harvard and was working as a hedge fund analyst working as a hedge fund analyst working as a hedge fund analyst >> to build themselves >> to build themselves >> to build themselves >> when he started recording math tutorial >> when he started recording math tutorial >> when he started recording math tutorial videos in his closet for his young videos in his closet for his young videos in his closet for his young cousins. cousins. cousins. >> So if I were to multiply this equation >> So if I were to multiply this equation >> So if I were to multiply this equation >> not long after with the help of donors >> not long after with the help of donors >> not long after with the help of donors including Bill Gates, he quit his career including Bill Gates, he quit his career including Bill Gates, he quit his career in finance and started the nonprofit in finance and started the nonprofit in finance and started the nonprofit Khan Academy. From the beginning of Khan Khan Academy. From the beginning of Khan Khan Academy. From the beginning of Khan Academy, the true north was how do you Academy, the true north was how do you Academy, the true north was how do you give more students at least give more students at least give more students at least approximations of the type of approximations of the type of approximations of the type of personalization they would get if they personalization they would get if they personalization they would get if they had a personal tutor?

had a personal tutor? had a personal tutor? >> A wealthy family can afford a tutor for >> A wealthy family can afford a tutor for >> A wealthy family can afford a tutor for their child if every kid could have a their child if every kid could have a their child if every kid could have a private tutor that would level the private tutor that would level the private tutor that would level the playing field. playing field. playing field. >> Yeah, that's the dream. >> Yeah, that's the dream. >> Yeah, that's the dream. >> Co-founders of OpenAI, Greg Brockman and >> Co-founders of OpenAI, Greg Brockman and >> Co-founders of OpenAI, Greg Brockman and Sam Alman were fans of Khan Academy and Sam Alman were fans of Khan Academy and Sam Alman were fans of Khan Academy and hope to evaluate their AI using Khan's hope to evaluate their AI using Khan's hope to evaluate their AI using Khan's database of test questions and content. database of test questions and content. database of test questions and content. Khan Migo should do. Khan Migo should do. Khan Migo should do. >> So they gave Sal Khan early access to an >> So they gave Sal Khan early access to an >> So they gave Sal Khan early access to an advanced AI technology that today advanced AI technology that today advanced AI technology that today underpins chat GPT. underpins chat GPT. underpins chat GPT. >> What did you immediately think? >> What did you immediately think? >> What did you immediately think? >> It was pretty obvious this technology >> It was pretty obvious this technology >> It was pretty obvious this technology was going to transform society. So it it was going to transform society. So it it was going to transform society. So it it was pretty heady stuff. Uh but on the was pretty heady stuff. Uh but on the was pretty heady stuff. Uh but on the education side, it was like wow, people education side, it was like wow, people education side, it was like wow, people are going to be able to use this for are going to be able to use this for are going to be able to use this for doing deep fakes and fraud and cheat. Uh doing deep fakes and fraud and cheat. Uh doing deep fakes and fraud and cheat. Uh but if used well with the right but if used well with the right but if used well with the right guardrails, etc. could also be used to guardrails, etc. could also be used to guardrails, etc. could also be used to support students, to give them more support students, to give them more support students, to give them more feedback, to support teachers for all feedback, to support teachers for all feedback, to support teachers for all this lesson planning and progress report this lesson planning and progress report this lesson planning and progress report writing that they spend hours a week writing that they spend hours a week writing that they spend hours a week doing. doing. doing. >> Item level analysis. >> Item level analysis. >> Item level analysis. >> Educators and engineers at Khan Academy >> Educators and engineers at Khan Academy >> Educators and engineers at Khan Academy used OpenAI's technology to build used OpenAI's technology to build used OpenAI's technology to build Conigo.

Conigo. Conigo. >> We're going to be using KIGO for this. >> We're going to be using KIGO for this. >> We're going to be using KIGO for this. >> And for the last year and a half, the >> And for the last year and a half, the >> And for the last year and a half, the teachers and kids at Hobert High School teachers and kids at Hobert High School teachers and kids at Hobert High School and others have been testing it out. and others have been testing it out. and others have been testing it out. >> I'll ask it a question. We sat down with >> I'll ask it a question. We sat down with >> I'll ask it a question. We sat down with two students from that morning chemistry two students from that morning chemistry two students from that morning chemistry class, Austin and Abigail, as well as class, Austin and Abigail, as well as class, Austin and Abigail, as well as Leen and Maddie who use Conigo in Leen and Maddie who use Conigo in Leen and Maddie who use Conigo in business class, and Lou and Lily who use business class, and Lou and Lily who use business class, and Lou and Lily who use it in English and for SAT preparation. it in English and for SAT preparation. it in English and for SAT preparation. >> I heard people at Khan Academy came and >> I heard people at Khan Academy came and >> I heard people at Khan Academy came and and asked students to break it. and asked students to break it. and asked students to break it. >> Yes. >> Yes. >> Yes. >> Yes. >> Yes. >> Yes. >> That was the fun part. >> That was the fun part. >> That was the fun part. >> That was some students would try and >> That was some students would try and >> That was some students would try and trick it into just giving you the trick it into just giving you the trick it into just giving you the answer. The superintendent I talked to answer. The superintendent I talked to answer. The superintendent I talked to said that some students were bullying said that some students were bullying said that some students were bullying >> Kigo for the answer. >> Kigo for the answer. >> Kigo for the answer. >> I think that was the elementary school >> I think that was the elementary school >> I think that was the elementary school kids. kids. kids. >> Oh yeah. Okay. Blame it on the >> Oh yeah. Okay. Blame it on the >> Oh yeah. Okay. Blame it on the elementary school kids. Yeah. elementary school kids. Yeah. elementary school kids. Yeah. >> It's very helpful for those students who >> It's very helpful for those students who >> It's very helpful for those students who um maybe don't feel comfortable asking um maybe don't feel comfortable asking um maybe don't feel comfortable asking questions within class. questions within class. questions within class. >> Does it have a personality? It's very >> Does it have a personality? It's very >> Does it have a personality? It's very much there for you. Like it's very much there for you. Like it's very much there for you. Like it's very positive. It It's very reassuring. positive. It It's very reassuring. positive. It It's very reassuring. >> It's getting me thinking and it's not >> It's getting me thinking and it's not >> It's getting me thinking and it's not just giving me an answer. Do you ever just giving me an answer. Do you ever just giving me an answer. Do you ever just want to be like, "Can you just give just want to be like, "Can you just give just want to be like, "Can you just give me the answer?"

me the answer?" me the answer?" >> That was the hardest part for I know >> That was the hardest part for I know >> That was the hardest part for I know like me and a lot of other students like me and a lot of other students like me and a lot of other students like, "Why isn't it giving me answers?" like, "Why isn't it giving me answers?" like, "Why isn't it giving me answers?" At the end of the day, that's where your At the end of the day, that's where your At the end of the day, that's where your better answer is going to be. It's not better answer is going to be. It's not better answer is going to be. It's not going to be whatever the AI gives you. going to be whatever the AI gives you. going to be whatever the AI gives you. It's going to be whatever you create. It's going to be whatever you create. It's going to be whatever you create. >> So, your hypothesis going into the last >> So, your hypothesis going into the last >> So, your hypothesis going into the last test is test is test is >> Teachers at Hobert High don't just use >> Teachers at Hobert High don't just use >> Teachers at Hobert High don't just use Conigo to help plan lessons and save Conigo to help plan lessons and save Conigo to help plan lessons and save dozens of hours a week. They also dozens of hours a week. They also dozens of hours a week. They also monitor their students understanding of monitor their students understanding of monitor their students understanding of subjects in ways they never could subjects in ways they never could subjects in ways they never could before. you can track how a student is before. you can track how a student is before. you can track how a student is actually using KMIGO. actually using KMIGO. actually using KMIGO. >> Yeah, I'm going to click usage and then >> Yeah, I'm going to click usage and then >> Yeah, I'm going to click usage and then if I wanted to pick a specific student, if I wanted to pick a specific student, if I wanted to pick a specific student, I could come down here and really dive I could come down here and really dive I could come down here and really dive into what that student's been looking at into what that student's been looking at into what that student's been looking at KIGO. And this is real time because you KIGO. And this is real time because you KIGO. And this is real time because you saw Abigail this morning looking at saw Abigail this morning looking at saw Abigail this morning looking at acids and bases. acids and bases. acids and bases. >> So, wait a minute. These are the >> So, wait a minute. These are the >> So, wait a minute. These are the footprints of Abigail's work. footprints of Abigail's work. footprints of Abigail's work. >> These are the footprints of Abigail's >> These are the footprints of Abigail's >> These are the footprints of Abigail's work. work. work. >> At 8 a.m., she was asking about acids >> At 8 a.m., she was asking about acids >> At 8 a.m., she was asking about acids and chemical reactions. So even though and chemical reactions. So even though and chemical reactions. So even though you may not be hovering over the student you may not be hovering over the student you may not be hovering over the student at any given moment, you're somewhere at any given moment, you're somewhere at any given moment, you're somewhere else in the classroom, you can later else in the classroom, you can later else in the classroom, you can later check, oh, this is what Abigail was check, oh, this is what Abigail was check, oh, this is what Abigail was looking. I understand her thought looking. I understand her thought looking. I understand her thought process on on why she got these answers.

process on on why she got these answers. process on on why she got these answers. >> Absolutely. So it gives me a lot of >> Absolutely. So it gives me a lot of >> Absolutely. So it gives me a lot of insight as a teacher in terms of who I insight as a teacher in terms of who I insight as a teacher in terms of who I need to spend that one-on-one time with. need to spend that one-on-one time with. need to spend that one-on-one time with. >> Maybe KIGO throws in a mastery challenge >> Maybe KIGO throws in a mastery challenge >> Maybe KIGO throws in a mastery challenge or or or >> S Khan says they won't sell the data >> S Khan says they won't sell the data >> S Khan says they won't sell the data they collect through KIO or give it to they collect through KIO or give it to they collect through KIO or give it to other tech companies. They do use it, other tech companies. They do use it, other tech companies. They do use it, however, to improve KIGO's memory and however, to improve KIGO's memory and however, to improve KIGO's memory and personalization. personalization. personalization. >> It'll guide them to sort of what to do >> It'll guide them to sort of what to do >> It'll guide them to sort of what to do first. first. first. >> Sarah Robertson, a former English >> Sarah Robertson, a former English >> Sarah Robertson, a former English teacher who's now a KIGO product teacher who's now a KIGO product teacher who's now a KIGO product manager, showed us a new feature they've manager, showed us a new feature they've manager, showed us a new feature they've developed to help kids write better and developed to help kids write better and developed to help kids write better and think more critically. think more critically. think more critically. >> I found this essay that I wrote >> I found this essay that I wrote >> I found this essay that I wrote >> to test it. I gave KIGO a paper I wrote >> to test it. I gave KIGO a paper I wrote >> to test it. I gave KIGO a paper I wrote in sixth grade about my mom, Gloria in sixth grade about my mom, Gloria in sixth grade about my mom, Gloria Vanderbilt. Vanderbilt. Vanderbilt. >> So, go ahead and click next. Start >> So, go ahead and click next. Start >> So, go ahead and click next. Start revising. After just 90 seconds, KIGO revising. After just 90 seconds, KIGO revising. After just 90 seconds, KIGO delivered a very detailed evaluation of delivered a very detailed evaluation of delivered a very detailed evaluation of my essay. my essay. my essay. >> Okay. >> Okay. >> Okay. >> It liked some of what I wrote. The use >> It liked some of what I wrote. The use >> It liked some of what I wrote. The use of a quote to start the essay is of a quote to start the essay is of a quote to start the essay is effective and sets the tone for the rest effective and sets the tone for the rest effective and sets the tone for the rest of the biography, of the biography, of the biography, >> but suggested I should revise several >> but suggested I should revise several >> but suggested I should revise several paragraphs and my topic sentence. paragraphs and my topic sentence. paragraphs and my topic sentence. >> So, I'm going to rewrite my sixth grade >> So, I'm going to rewrite my sixth grade >> So, I'm going to rewrite my sixth grade paper paper paper >> after a few minutes of tweaking.

>> after a few minutes of tweaking. >> after a few minutes of tweaking. >> Ask it what it thinks. >> Ask it what it thinks. >> Ask it what it thinks. >> Um, what do you think? It says, >> Um, what do you think? It says, >> Um, what do you think? It says, "Connecting childhood events to her "Connecting childhood events to her "Connecting childhood events to her later life will make her essay more later life will make her essay more later life will make her essay more cohesive." and insightful. I mean, yeah, cohesive." and insightful. I mean, yeah, cohesive." and insightful. I mean, yeah, it's good advice. it's good advice. it's good advice. >> I can tell you as a former seventh grade >> I can tell you as a former seventh grade >> I can tell you as a former seventh grade English teacher, when I assigned an English teacher, when I assigned an English teacher, when I assigned an essay, I would limit myself to 10 essay, I would limit myself to 10 essay, I would limit myself to 10 minutes per essay. I had 100 students. minutes per essay. I had 100 students. minutes per essay. I had 100 students. So, it would take me 17 hours to give So, it would take me 17 hours to give So, it would take me 17 hours to give feedback on every single student's first feedback on every single student's first feedback on every single student's first draft. The burden that we place on draft. The burden that we place on draft. The burden that we place on teachers to give that specific, timely, teachers to give that specific, timely, teachers to give that specific, timely, actionable feedback is just so great actionable feedback is just so great actionable feedback is just so great that it's not possible. So, I've now that it's not possible. So, I've now that it's not possible. So, I've now plugged in plugged in plugged in >> to see if Kigo could catch me cheating. >> to see if Kigo could catch me cheating. >> to see if Kigo could catch me cheating. I asked Chat GPT to write a paragraph I asked Chat GPT to write a paragraph I asked Chat GPT to write a paragraph about my mom and pasted it into my about my mom and pasted it into my about my mom and pasted it into my essay. essay. essay. >> I now see that there's a critical flag. >> I now see that there's a critical flag. >> I now see that there's a critical flag. >> Kigo immediately sent an alert to Sarah >> Kigo immediately sent an alert to Sarah >> Kigo immediately sent an alert to Sarah Robertson. Robertson. Robertson. >> It says that you pasted 66 words while >> It says that you pasted 66 words while >> It says that you pasted 66 words while revising from an unknown source. So, if revising from an unknown source. So, if revising from an unknown source. So, if I click on that now, it's going to load I click on that now, it's going to load I click on that now, it's going to load your essay and it's going to show me your essay and it's going to show me your essay and it's going to show me exactly what you just did. exactly what you just did. exactly what you just did. >> I'm so busted.

>> I'm so busted. >> I'm so busted. >> You're busted. >> You're busted. >> You're busted. Do you want to work with a three-digit Do you want to work with a three-digit Do you want to work with a three-digit or four-digit number? or four-digit number? or four-digit number? >> Kamigo is free for all teachers in the >> Kamigo is free for all teachers in the >> Kamigo is free for all teachers in the US, but school districts have to pay up US, but school districts have to pay up US, but school districts have to pay up $15 per student per year to cover $15 per student per year to cover $15 per student per year to cover computation costs, and it's still being computation costs, and it's still being computation costs, and it's still being improved. improved. improved. >> Any other ideas that can show the kind >> Any other ideas that can show the kind >> Any other ideas that can show the kind of of of >> We got a hint of how Konigo might evolve >> We got a hint of how Konigo might evolve >> We got a hint of how Konigo might evolve when Greg Brockman, president of Open when Greg Brockman, president of Open when Greg Brockman, president of Open AI, stopped by Sal Khan's office to give AI, stopped by Sal Khan's office to give AI, stopped by Sal Khan's office to give us an early look at their new vision us an early look at their new vision us an early look at their new vision technology. You could show a historical technology. You could show a historical technology. You could show a historical painting or artifact. painting or artifact. painting or artifact. >> We're preparing a demo for 60 minutes to >> We're preparing a demo for 60 minutes to >> We're preparing a demo for 60 minutes to show people what chatpd can do with show people what chatpd can do with show people what chatpd can do with voice mode with vision. It can actually voice mode with vision. It can actually voice mode with vision. It can actually see what someone is doing through live see what someone is doing through live see what someone is doing through live video and interact with them in real video and interact with them in real video and interact with them in real time. Brockman was talking with it on time. Brockman was talking with it on time. Brockman was talking with it on his phone. his phone. his phone. >> Got it. How about an anatomy lesson? >> Got it. How about an anatomy lesson? >> Got it. How about an anatomy lesson? >> You're going to quiz him and ask him to >> You're going to quiz him and ask him to >> You're going to quiz him and ask him to draw whatever body part you want to you draw whatever body part you want to you draw whatever body part you want to you want to quiz him on and have him label want to quiz him on and have him label want to quiz him on and have him label it. How does that sound? That sounds it. How does that sound? That sounds it. How does that sound? That sounds like a fantastic plan. like a fantastic plan. like a fantastic plan. >> When Brockman pointed his phone's camera >> When Brockman pointed his phone's camera >> When Brockman pointed his phone's camera at the blackboard, the AI started to at the blackboard, the AI started to at the blackboard, the AI started to quiz me.

quiz me. quiz me. >> Let's start with the heart. Anderson, >> Let's start with the heart. Anderson, >> Let's start with the heart. Anderson, can you draw and label where the heart can you draw and label where the heart can you draw and label where the heart is in the body? It understood what I was is in the body? It understood what I was is in the body? It understood what I was doing. Even though my drawing was pretty doing. Even though my drawing was pretty doing. Even though my drawing was pretty crude, crude, crude, >> the location is spoton. The brain is >> the location is spoton. The brain is >> the location is spoton. The brain is right there in the head. As for the right there in the head. As for the right there in the head. As for the shape, it's a good start. The brain is shape, it's a good start. The brain is shape, it's a good start. The brain is more of more of more of >> Don't patronize me. It also seemed to >> Don't patronize me. It also seemed to >> Don't patronize me. It also seemed to pick up on my anxiety. pick up on my anxiety. pick up on my anxiety. >> Anderson, how about the liver? Give it a >> Anderson, how about the liver? Give it a >> Anderson, how about the liver? Give it a shot and show us where you think it's shot and show us where you think it's shot and show us where you think it's located in the body. located in the body. located in the body. >> Okay, this is a little tough. Uh, >> Okay, this is a little tough. Uh, >> Okay, this is a little tough. Uh, >> this is how we learn. >> this is how we learn. >> this is how we learn. >> Absolutely. No pressure, Anderson. >> Absolutely. No pressure, Anderson. >> Absolutely. No pressure, Anderson. >> I put the liver on the wrong side of the >> I put the liver on the wrong side of the >> I put the liver on the wrong side of the body. Chat GPT corrected me politely. body. Chat GPT corrected me politely. body. Chat GPT corrected me politely. >> Anderson's placement is close, but it's >> Anderson's placement is close, but it's >> Anderson's placement is close, but it's primarily on the right side, just below primarily on the right side, just below primarily on the right side, just below the diaphragm. So, could you critique the diaphragm. So, could you critique the diaphragm. So, could you critique this diagram? Overall, this diagram? Overall, this diagram? Overall, >> Anderson's diagram is a solid effort, >> Anderson's diagram is a solid effort, >> Anderson's diagram is a solid effort, especially for an impromptu drawing. especially for an impromptu drawing. especially for an impromptu drawing. >> The AI caught my mistake, but it's not >> The AI caught my mistake, but it's not >> The AI caught my mistake, but it's not foolproof. foolproof. foolproof. >> The formula is simple. 1/2* the base >> The formula is simple. 1/2* the base >> The formula is simple. 1/2* the base time the height.

time the height. time the height. >> Watch what happened when Khan asked it >> Watch what happened when Khan asked it >> Watch what happened when Khan asked it to calculate the area of a triangle and to calculate the area of a triangle and to calculate the area of a triangle and intentionally misidentified the height. intentionally misidentified the height. intentionally misidentified the height. >> Is this the height over here? This four. >> Is this the height over here? This four. >> Is this the height over here? This four. Is that right? Is that right? Is that right? >> The AI said he was right. >> The AI said he was right. >> The AI said he was right. >> Yes, that's correct. It didn't catch the >> Yes, that's correct. It didn't catch the >> Yes, that's correct. It didn't catch the error. However, this technology improves error. However, this technology improves error. However, this technology improves quickly and it is fun to interact with. quickly and it is fun to interact with. quickly and it is fun to interact with. >> I really, really >> I really, really >> I really, really >> Greg Brockman asked it to write a song >> Greg Brockman asked it to write a song >> Greg Brockman asked it to write a song about the formula for the area of a about the formula for the area of a about the formula for the area of a triangle to make it rhyme and sing it triangle to make it rhyme and sing it triangle to make it rhyme and sing it using a British accent. using a British accent. using a British accent. >> Absolutely. Let's give it a try. To find >> Absolutely. Let's give it a try. To find >> Absolutely. Let's give it a try. To find a triangle space, here's what you do. a triangle space, here's what you do. a triangle space, here's what you do. Multiply the base by the height. It's Multiply the base by the height. It's Multiply the base by the height. It's true. Then take that product and divide true. Then take that product and divide true. Then take that product and divide by two. Now you've got the area of by two. Now you've got the area of by two. Now you've got the area of formula to pursue. How was that? formula to pursue. How was that? formula to pursue. How was that? >> That was really fantastic. >> That was really fantastic. >> That was really fantastic. >> That's >> That's >> That's I It's incredible. I It's incredible. I It's incredible. >> It is. It feels like we're in a science >> It is. It feels like we're in a science >> It is. It feels like we're in a science fiction book. Really? fiction book. Really? fiction book. Really? >> I mean, it just feels like to actually >> I mean, it just feels like to actually >> I mean, it just feels like to actually see it, see it, see it, you I mean, I'm sort of speechless.

you I mean, I'm sort of speechless. you I mean, I'm sort of speechless. >> The first time you see this stuff, it >> The first time you see this stuff, it >> The first time you see this stuff, it really does just feel like this magic really does just feel like this magic really does just feel like this magic and almost incomprehensible. And then and almost incomprehensible. And then and almost incomprehensible. And then after a week, then you start to realize after a week, then you start to realize after a week, then you start to realize like how you can use it. That's been one like how you can use it. That's been one like how you can use it. That's been one of the really important things about of the really important things about of the really important things about working with Zand and his team has been working with Zand and his team has been working with Zand and his team has been to really figure out what's the right to really figure out what's the right to really figure out what's the right way to sort of bring this to parents and way to sort of bring this to parents and way to sort of bring this to parents and to teachers and to classrooms and to do to teachers and to classrooms and to do to teachers and to classrooms and to do that in a way so that the students that in a way so that the students that in a way so that the students really learn and aren't just, you know, really learn and aren't just, you know, really learn and aren't just, you know, asking for the answers and that the asking for the answers and that the asking for the answers and that the parents can have oversight and the parents can have oversight and the parents can have oversight and the teachers can be involved in that teachers can be involved in that teachers can be involved in that process. process. process. >> You can ask a follow-up question. Sal >> You can ask a follow-up question. Sal >> You can ask a follow-up question. Sal Khan hopes this vision technology can be Khan hopes this vision technology can be Khan hopes this vision technology can be incorporated into Kmigo and available to incorporated into Kmigo and available to incorporated into Kmigo and available to students and teachers in 2 to 3 years, students and teachers in 2 to 3 years, students and teachers in 2 to 3 years, but he wants it to undergo more robust but he wants it to undergo more robust but he wants it to undergo more robust testing and meet strict guidelines for testing and meet strict guidelines for testing and meet strict guidelines for privacy and data security. privacy and data security. privacy and data security. >> I can imagine a lot of teachers watching >> I can imagine a lot of teachers watching >> I can imagine a lot of teachers watching this and thinking, okay, well, this is this and thinking, okay, well, this is this and thinking, okay, well, this is just going to replace me. Why would I just going to replace me. Why would I just going to replace me. Why would I want this in my classroom? It's like a want this in my classroom? It's like a want this in my classroom? It's like a Trojan horse. I'm pretty confident that Trojan horse. I'm pretty confident that Trojan horse. I'm pretty confident that teaching any job that is has a very teaching any job that is has a very teaching any job that is has a very human centric element of it is as long human centric element of it is as long human centric element of it is as long as it adapts reasonably well in this AI as it adapts reasonably well in this AI as it adapts reasonably well in this AI world, they're going to be some of the world, they're going to be some of the world, they're going to be some of the safest jobs out there.

safest jobs out there. safest jobs out there. >> You think there will always be a need >> You think there will always be a need >> You think there will always be a need for teachers in a classroom talking with for teachers in a classroom talking with for teachers in a classroom talking with the student, looking the student in the the student, looking the student in the the student, looking the student in the eye? eye? eye? >> Oh, yeah. I mean, that's what I'll >> Oh, yeah. I mean, that's what I'll >> Oh, yeah. I mean, that's what I'll always want for my own children and always want for my own children and always want for my own children and frankly for anyone's children. And the frankly for anyone's children. And the frankly for anyone's children. And the hope here is that we can use artificial hope here is that we can use artificial hope here is that we can use artificial intelligence and other technologies to intelligence and other technologies to intelligence and other technologies to amplify what a teacher can do so they amplify what a teacher can do so they amplify what a teacher can do so they can spend more time can spend more time can spend more time >> good job >> good job >> good job >> standing next to a student figuring them >> standing next to a student figuring them >> standing next to a student figuring them out having a personto person connection. out having a personto person connection. out having a personto person connection. >> Two tens. >> Two tens. >> Two tens. >> Two tens. You got it. Good work. When Demis Habis won the Nobel Prize When Demis Habis won the Nobel Prize last year, he celebrated by playing last year, he celebrated by playing last year, he celebrated by playing poker with a world champion of chess. poker with a world champion of chess. poker with a world champion of chess. Hasabus loves a game, which is how he Hasabus loves a game, which is how he Hasabus loves a game, which is how he became a pioneer of artificial became a pioneer of artificial became a pioneer of artificial intelligence. The 49-year-old British intelligence. The 49-year-old British intelligence. The 49-year-old British scientist is co-founder and CEO of scientist is co-founder and CEO of scientist is co-founder and CEO of Google's AI powerhouse called Deep Mind. Google's AI powerhouse called Deep Mind. Google's AI powerhouse called Deep Mind. We met two years ago when chatbots We met two years ago when chatbots We met two years ago when chatbots announced a new age. Now, as we first announced a new age. Now, as we first announced a new age. Now, as we first told you this past spring, Habis and told you this past spring, Habis and told you this past spring, Habis and others are chasing what's called others are chasing what's called others are chasing what's called artificial general intelligence, a artificial general intelligence, a artificial general intelligence, a silicon intellect, as versatile as a silicon intellect, as versatile as a silicon intellect, as versatile as a human, but with superhuman speed and human, but with superhuman speed and human, but with superhuman speed and knowledge. After his Nobel and a knowledge. After his Nobel and a knowledge. After his Nobel and a nighthood from King Charles, we hurried nighthood from King Charles, we hurried nighthood from King Charles, we hurried back to London to see what's next from a back to London to see what's next from a back to London to see what's next from a genius who may hold the cards of our

genius who may hold the cards of our genius who may hold the cards of our future. future. future. What's always guided me and and and the What's always guided me and and and the What's always guided me and and and the passion I've always had is understanding passion I've always had is understanding passion I've always had is understanding the world around us. I've always been um the world around us. I've always been um the world around us. I've always been um since I was a kid fascinated by the since I was a kid fascinated by the since I was a kid fascinated by the biggest questions, you know, the the the biggest questions, you know, the the the biggest questions, you know, the the the meaning of of life, the the the nature meaning of of life, the the the nature meaning of of life, the the the nature of consciousness, the nature of reality of consciousness, the nature of reality of consciousness, the nature of reality itself. I've loved reading about all the itself. I've loved reading about all the itself. I've loved reading about all the great scientists who've worked on these great scientists who've worked on these great scientists who've worked on these problems and the philosophers and I problems and the philosophers and I problems and the philosophers and I wanted to uh see if we could advance wanted to uh see if we could advance wanted to uh see if we could advance human knowledge and for me my expression human knowledge and for me my expression human knowledge and for me my expression of doing that was to build what I think of doing that was to build what I think of doing that was to build what I think is the ultimate tool for for advancing is the ultimate tool for for advancing is the ultimate tool for for advancing human knowledge which is which is AI. human knowledge which is which is AI. human knowledge which is which is AI. >> We sat down in this room two years ago >> We sat down in this room two years ago >> We sat down in this room two years ago and I wonder if AI is moving faster and I wonder if AI is moving faster and I wonder if AI is moving faster today than you imagined. today than you imagined. today than you imagined. >> It's moving incredibly fast. uh I think >> It's moving incredibly fast. uh I think >> It's moving incredibly fast. uh I think we are on some kind of exponential curve we are on some kind of exponential curve we are on some kind of exponential curve of improvement. Of course, the success of improvement. Of course, the success of improvement. Of course, the success of the field in the last few years has of the field in the last few years has of the field in the last few years has attracted even more attention, more attracted even more attention, more attracted even more attention, more resources, more talent. So, um that's resources, more talent. So, um that's resources, more talent. So, um that's adding to the to this exponential adding to the to this exponential adding to the to this exponential progress, progress, progress, >> exponential curve, in other words, >> exponential curve, in other words, >> exponential curve, in other words, straight up.

straight up. straight up. >> Yep. Straight up and increasing speed of >> Yep. Straight up and increasing speed of >> Yep. Straight up and increasing speed of progress progress progress >> start. >> start. >> start. >> Yeah, >> Yeah, >> Yeah, >> we saw the progress. >> we saw the progress. >> we saw the progress. >> Hello, Scott. It's nice to see you >> Hello, Scott. It's nice to see you >> Hello, Scott. It's nice to see you again. in an artificial companion that again. in an artificial companion that again. in an artificial companion that can see and hear and chat about can see and hear and chat about can see and hear and chat about anything. Early chatbots learned only anything. Early chatbots learned only anything. Early chatbots learned only the internet. An app called Astra also the internet. An app called Astra also the internet. An app called Astra also takes in the world. takes in the world. takes in the world. >> Do we call her she? >> Do we call her she? >> Do we call her she? >> Um, it's a good question. I'm not sure >> Um, it's a good question. I'm not sure >> Um, it's a good question. I'm not sure we I'm not sure we all know the answer we I'm not sure we all know the answer we I'm not sure we all know the answer yet. Bibbo Shu is product manager for yet. Bibbo Shu is product manager for yet. Bibbo Shu is product manager for Project Astra, an app in a new Project Astra, an app in a new Project Astra, an app in a new generation of chatbots that interpret generation of chatbots that interpret generation of chatbots that interpret the world with their own eyes. We the world with their own eyes. We the world with their own eyes. We challenged Astra with virtual paintings challenged Astra with virtual paintings challenged Astra with virtual paintings we chose and showed to Astra for the we chose and showed to Astra for the we chose and showed to Astra for the first time. first time. first time. >> This is July Haye by Thomas Hartbenton >> This is July Haye by Thomas Hartbenton >> This is July Haye by Thomas Hartbenton from 1942. from 1942. from 1942. >> How about this one? >> How about this one? >> How about this one? >> That is the Virgin of Charity by >> That is the Virgin of Charity by >> That is the Virgin of Charity by Elgreco. That painting is Ottomat by Elgreco. That painting is Ottomat by Elgreco. That painting is Ottomat by Edward Hopper. Edward Hopper. Edward Hopper. >> The person in the painting, what emotion >> The person in the painting, what emotion >> The person in the painting, what emotion is she exhibiting?

is she exhibiting? is she exhibiting? >> The subject in the painting appears >> The subject in the painting appears >> The subject in the painting appears pensive and contemplative. Her pensive and contemplative. Her pensive and contemplative. Her expression suggesting a sense of expression suggesting a sense of expression suggesting a sense of solitude. solitude. solitude. >> Can you create a story around this >> Can you create a story around this >> Can you create a story around this picture? picture? picture? >> It's a chilly evening in the city, a >> It's a chilly evening in the city, a >> It's a chilly evening in the city, a Tuesday perhaps. The woman perhaps named Tuesday perhaps. The woman perhaps named Tuesday perhaps. The woman perhaps named Eleanor sits alone in the diner. She is Eleanor sits alone in the diner. She is Eleanor sits alone in the diner. She is feeling melancholy due to the feeling melancholy due to the feeling melancholy due to the uncertainty of her future and the weight uncertainty of her future and the weight uncertainty of her future and the weight of unfulfilled dreams. The scene freezes of unfulfilled dreams. The scene freezes of unfulfilled dreams. The scene freezes in time. Only the flow of ideas moving in time. Only the flow of ideas moving in time. Only the flow of ideas moving onward. onward. onward. >> That line, only the flow of ideas moving >> That line, only the flow of ideas moving >> That line, only the flow of ideas moving onward. onward. onward. >> I wish I'd written that. And did we hear >> I wish I'd written that. And did we hear >> I wish I'd written that. And did we hear a limit to Astra's patience? a limit to Astra's patience? a limit to Astra's patience? >> What was that fictional conversation >> What was that fictional conversation >> What was that fictional conversation about? Ah, in the story I imagined, about? Ah, in the story I imagined, about? Ah, in the story I imagined, Eleanor and her friend talked about Eleanor and her friend talked about Eleanor and her friend talked about their shared dreams and the challenges their shared dreams and the challenges their shared dreams and the challenges of pursuing them. of pursuing them. of pursuing them. >> Something about the way you said ah made >> Something about the way you said ah made >> Something about the way you said ah made me wonder if you were getting bored. me wonder if you were getting bored. me wonder if you were getting bored. >> I apologize if my tone came across that >> I apologize if my tone came across that >> I apologize if my tone came across that way. My aim is always to engage way. My aim is always to engage way. My aim is always to engage thoughtfully. thoughtfully. thoughtfully. >> And she said, "Well, I'm sorry if you >> And she said, "Well, I'm sorry if you >> And she said, "Well, I'm sorry if you don't like my tone."

don't like my tone." don't like my tone." >> Wow. >> Wow. >> Wow. >> Well, you see what's happening there. >> Well, you see what's happening there. >> Well, you see what's happening there. >> Well, that's interesting. That's again >> Well, that's interesting. That's again >> Well, that's interesting. That's again in challenge with these systems as they in challenge with these systems as they in challenge with these systems as they act in the moment with the context act in the moment with the context act in the moment with the context that's around them and that may have that's around them and that may have that's around them and that may have never been tested before. never been tested before. never been tested before. >> He's often surprised because AI programs >> He's often surprised because AI programs >> He's often surprised because AI programs are sent out on the internet to learn are sent out on the internet to learn are sent out on the internet to learn for themselves. They can return later for themselves. They can return later for themselves. They can return later with unexpected skills. with unexpected skills. with unexpected skills. >> So we have theories about what kinds of >> So we have theories about what kinds of >> So we have theories about what kinds of uh capabilities these systems will have. uh capabilities these systems will have. uh capabilities these systems will have. That's obviously what we try to build That's obviously what we try to build That's obviously what we try to build into the architectures. But at the end into the architectures. But at the end into the architectures. But at the end of the day, how it learns, what it picks of the day, how it learns, what it picks of the day, how it learns, what it picks up from the data is part of the training up from the data is part of the training up from the data is part of the training of these systems. We don't program that of these systems. We don't program that of these systems. We don't program that in. It learns like a human being would in. It learns like a human being would in. It learns like a human being would learn. So, um, so new capabilities or learn. So, um, so new capabilities or learn. So, um, so new capabilities or properties can emerge from that training properties can emerge from that training properties can emerge from that training situation. situation. situation. >> You understand how that would worry >> You understand how that would worry >> You understand how that would worry people. Of course, it's the duality of people. Of course, it's the duality of people. Of course, it's the duality of these types of systems that they're able these types of systems that they're able these types of systems that they're able to uh do incredible things, go beyond to uh do incredible things, go beyond to uh do incredible things, go beyond the things that we're able to uh uh the things that we're able to uh uh the things that we're able to uh uh design ourselves or understand design ourselves or understand design ourselves or understand ourselves. But of course, the challenge ourselves. But of course, the challenge ourselves. But of course, the challenge is is making sure um that the the is is making sure um that the the is is making sure um that the the knowledge databases they create um we knowledge databases they create um we knowledge databases they create um we understand what's in them. Now, DeepMind understand what's in them. Now, DeepMind understand what's in them. Now, DeepMind is training its AI model called Gemini is training its AI model called Gemini is training its AI model called Gemini to not just reveal the world, but to act to not just reveal the world, but to act to not just reveal the world, but to act in it, like booking tickets and shopping in it, like booking tickets and shopping in it, like booking tickets and shopping online.

online. online. >> It's a step toward AGI, artificial >> It's a step toward AGI, artificial >> It's a step toward AGI, artificial general intelligence with the general intelligence with the general intelligence with the versatility of a human mind. On track versatility of a human mind. On track versatility of a human mind. On track for AGI for AGI for AGI >> in the next 5 to 10 years, I think, >> in the next 5 to 10 years, I think, >> in the next 5 to 10 years, I think, >> and in 2030, you will have what? Well, >> and in 2030, you will have what? Well, >> and in 2030, you will have what? Well, we'll have a system that um really we'll have a system that um really we'll have a system that um really understand everything around you in very understand everything around you in very understand everything around you in very uh nuanced and deep ways um and kind of uh nuanced and deep ways um and kind of uh nuanced and deep ways um and kind of embedded in your everyday life. embedded in your everyday life. embedded in your everyday life. >> Embedded like Astra in eyeglasses. >> Embedded like Astra in eyeglasses. >> Embedded like Astra in eyeglasses. >> What can you tell me about this building >> What can you tell me about this building >> What can you tell me about this building I'm looking at? I'm looking at? I'm looking at? >> This is the Cold Dropsard, a shopping >> This is the Cold Dropsard, a shopping >> This is the Cold Dropsard, a shopping and dining district. and dining district. and dining district. >> She sees what I see. There's a speaker >> She sees what I see. There's a speaker >> She sees what I see. There's a speaker in the earpiece only I can hear. What in the earpiece only I can hear. What in the earpiece only I can hear. What was it originally before it became was it originally before it became was it originally before it became shops? The coal drops yard was shops? The coal drops yard was shops? The coal drops yard was originally a set of Victorian coal originally a set of Victorian coal originally a set of Victorian coal warehouses used to receive and warehouses used to receive and warehouses used to receive and distribute coal across London. distribute coal across London. distribute coal across London. >> Was coal ever a problem for the >> Was coal ever a problem for the >> Was coal ever a problem for the environment in London? environment in London? environment in London? >> Yes, coal was a significant source of >> Yes, coal was a significant source of >> Yes, coal was a significant source of air pollution in London, particularly air pollution in London, particularly air pollution in London, particularly during the industrial revolution.

during the industrial revolution. during the industrial revolution. >> It occurred to us that the only thing we >> It occurred to us that the only thing we >> It occurred to us that the only thing we contributed to this relationship were contributed to this relationship were contributed to this relationship were legs which will also soon be engineered. legs which will also soon be engineered. legs which will also soon be engineered. >> I also think another big area will be >> I also think another big area will be >> I also think another big area will be robotics. I think it will have a robotics. I think it will have a robotics. I think it will have a breakthrough moment in the next couple breakthrough moment in the next couple breakthrough moment in the next couple of years where we'll have demonstrations of years where we'll have demonstrations of years where we'll have demonstrations of maybe humanoid robots or other types of maybe humanoid robots or other types of maybe humanoid robots or other types of robots that can start really doing of robots that can start really doing of robots that can start really doing useful things. useful things. useful things. >> For example, >> For example, >> For example, >> hey, robot. >> hey, robot. >> hey, robot. >> Researchers Alex Lee and Julia Vazani >> Researchers Alex Lee and Julia Vazani >> Researchers Alex Lee and Julia Vazani showed us a robot that understands what showed us a robot that understands what showed us a robot that understands what it sees. it sees. it sees. >> That's a tricky one. >> That's a tricky one. >> That's a tricky one. >> And reasons its way through vague >> And reasons its way through vague >> And reasons its way through vague instructions. Put the blocks whose color instructions. Put the blocks whose color instructions. Put the blocks whose color is the combination of yellow and blue is the combination of yellow and blue is the combination of yellow and blue into the matching color ball. into the matching color ball. into the matching color ball. >> The combination of yellow and blue >> The combination of yellow and blue >> The combination of yellow and blue is green and it figured that out. It's is green and it figured that out. It's is green and it figured that out. It's reasoning. reasoning. reasoning. >> Yeah, definitely. Yes. >> Yeah, definitely. Yes. >> Yeah, definitely. Yes. >> The toys of Demis Habus' childhood >> The toys of Demis Habus' childhood >> The toys of Demis Habus' childhood weren't blocks, but chess pieces. At 12, weren't blocks, but chess pieces. At 12, weren't blocks, but chess pieces. At 12, he was the number two champion in the he was the number two champion in the he was the number two champion in the world for his age. This passion led to world for his age. This passion led to world for his age. This passion led to computer chess, video games, and finally computer chess, video games, and finally computer chess, video games, and finally thinking machines. He was born to a thinking machines. He was born to a thinking machines. He was born to a Greek criate father and Singaporean Greek criate father and Singaporean Greek criate father and Singaporean mother. Cambridge, MIT, Harvard. He's a mother. Cambridge, MIT, Harvard. He's a mother. Cambridge, MIT, Harvard. He's a computer scientist with a PhD in computer scientist with a PhD in computer scientist with a PhD in neuroscience.

neuroscience. neuroscience. Because he reasoned he had to understand Because he reasoned he had to understand Because he reasoned he had to understand the human brain first. Are you working the human brain first. Are you working the human brain first. Are you working on a system today that would be on a system today that would be on a system today that would be selfaware? selfaware? selfaware? >> I don't think any of today's systems to >> I don't think any of today's systems to >> I don't think any of today's systems to me feel self-aware or you know conscious me feel self-aware or you know conscious me feel self-aware or you know conscious in any way. Um of obviously everyone in any way. Um of obviously everyone in any way. Um of obviously everyone needs to make their own decisions by needs to make their own decisions by needs to make their own decisions by interacting with these chat bots. Um I interacting with these chat bots. Um I interacting with these chat bots. Um I think theoretically it's possible think theoretically it's possible think theoretically it's possible >> but is self-awareness a goal of yours? >> but is self-awareness a goal of yours? >> but is self-awareness a goal of yours? >> Not explicitly but it may happen >> Not explicitly but it may happen >> Not explicitly but it may happen implicitly. These systems might acquire implicitly. These systems might acquire implicitly. These systems might acquire some feeling of self-awareness. That is some feeling of self-awareness. That is some feeling of self-awareness. That is possible. I think it's important for possible. I think it's important for possible. I think it's important for these systems to understand you um self these systems to understand you um self these systems to understand you um self and other and that's probably the and other and that's probably the and other and that's probably the beginning of something like beginning of something like beginning of something like self-awareness. self-awareness. self-awareness. >> But he says if a machine becomes >> But he says if a machine becomes >> But he says if a machine becomes self-aware, we may not recognize it. self-aware, we may not recognize it. self-aware, we may not recognize it. >> I think there's two reasons we regard >> I think there's two reasons we regard >> I think there's two reasons we regard each other as conscious. One is that each other as conscious. One is that each other as conscious. One is that you're exhibiting the behavior of a you're exhibiting the behavior of a you're exhibiting the behavior of a conscious being very similar to my conscious being very similar to my conscious being very similar to my behavior. But the second thing is you're behavior. But the second thing is you're behavior. But the second thing is you're running on the same substrate. We're running on the same substrate. We're running on the same substrate. We're made of the same carbon matter with our made of the same carbon matter with our made of the same carbon matter with our squishy brains. Now, obviously with squishy brains. Now, obviously with squishy brains. Now, obviously with machines, they're running on silicon.

machines, they're running on silicon. machines, they're running on silicon. So, even if they exhibit the same So, even if they exhibit the same So, even if they exhibit the same behaviors and even if they they say the behaviors and even if they they say the behaviors and even if they they say the same things, it doesn't necessarily mean same things, it doesn't necessarily mean same things, it doesn't necessarily mean uh that this sensation of consciousness uh that this sensation of consciousness uh that this sensation of consciousness that we have um is the same thing they that we have um is the same thing they that we have um is the same thing they will have. will have. will have. >> Has an AI engine ever asked a question >> Has an AI engine ever asked a question >> Has an AI engine ever asked a question that was unanticipated? that was unanticipated? that was unanticipated? >> Not so far that I've experienced. And I >> Not so far that I've experienced. And I >> Not so far that I've experienced. And I think that's getting at the idea of think that's getting at the idea of think that's getting at the idea of what's still missing from these systems. what's still missing from these systems. what's still missing from these systems. They still can't really yet go beyond um They still can't really yet go beyond um They still can't really yet go beyond um asking a new novel question or a new asking a new novel question or a new asking a new novel question or a new novel conjecture or coming up with a new novel conjecture or coming up with a new novel conjecture or coming up with a new hypothesis that um has not been thought hypothesis that um has not been thought hypothesis that um has not been thought of before. of before. of before. >> They don't have curiosity. >> They don't have curiosity. >> They don't have curiosity. >> No, they don't have curiosity and >> No, they don't have curiosity and >> No, they don't have curiosity and they're probably lacking a little bit in they're probably lacking a little bit in they're probably lacking a little bit in what we would call imagination and what we would call imagination and what we would call imagination and intuition. intuition. intuition. >> But they will have greater imagination, >> But they will have greater imagination, >> But they will have greater imagination, he says. And soon he says. And soon he says. And soon >> I think actually in the next maybe 5 to >> I think actually in the next maybe 5 to >> I think actually in the next maybe 5 to 10 years I think we'll have systems that 10 years I think we'll have systems that 10 years I think we'll have systems that are capable of not only solving a are capable of not only solving a are capable of not only solving a important problem or conjecture in important problem or conjecture in important problem or conjecture in science but coming up with it in the science but coming up with it in the science but coming up with it in the first place. first place. first place. >> Solving an important problem won Habisas >> Solving an important problem won Habisas >> Solving an important problem won Habisas a Nobel Prize last year. He and a Nobel Prize last year. He and a Nobel Prize last year. He and colleague John Jumper created an AI colleague John Jumper created an AI colleague John Jumper created an AI model that deciphered the structure of model that deciphered the structure of model that deciphered the structure of proteins. Proteins are the basic proteins. Proteins are the basic proteins. Proteins are the basic building blocks of life. So everything building blocks of life. So everything building blocks of life. So everything in biology, everything in your body in biology, everything in your body in biology, everything in your body depends on proteins. You know, your depends on proteins. You know, your depends on proteins. You know, your neurons firing, your muscle fibers neurons firing, your muscle fibers neurons firing, your muscle fibers twitching, it's all mediated by twitching, it's all mediated by twitching, it's all mediated by proteins.

proteins. proteins. >> But 3D protein structures like this are >> But 3D protein structures like this are >> But 3D protein structures like this are so complex, less than 1% were known. so complex, less than 1% were known. so complex, less than 1% were known. Mapping each one used to take years. Mapping each one used to take years. Mapping each one used to take years. Deep Mind's AI model did 200 million in Deep Mind's AI model did 200 million in Deep Mind's AI model did 200 million in one year. Now, Habas has AI blazing one year. Now, Habas has AI blazing one year. Now, Habas has AI blazing through solutions to drug development. through solutions to drug development. through solutions to drug development. >> So, on average, it takes, you know, 10 >> So, on average, it takes, you know, 10 >> So, on average, it takes, you know, 10 years and billions of dollars to design years and billions of dollars to design years and billions of dollars to design just one drug. We could maybe reduce just one drug. We could maybe reduce just one drug. We could maybe reduce that down from years to maybe months or that down from years to maybe months or that down from years to maybe months or maybe even weeks, which sounds maybe even weeks, which sounds maybe even weeks, which sounds incredible today, but that's also what incredible today, but that's also what incredible today, but that's also what people used to think about protein people used to think about protein people used to think about protein structures. It would revolutionize human structures. It would revolutionize human structures. It would revolutionize human health. And I think one day maybe we can health. And I think one day maybe we can health. And I think one day maybe we can cure all disease with the help of AI. cure all disease with the help of AI. cure all disease with the help of AI. >> The end of disease. I think that's in >> The end of disease. I think that's in >> The end of disease. I think that's in within in reach maybe within the next within in reach maybe within the next within in reach maybe within the next decade or so. I don't see why not. decade or so. I don't see why not. decade or so. I don't see why not. >> Demisabas told us AI could lead to what >> Demisabas told us AI could lead to what >> Demisabas told us AI could lead to what he calls radical abundance, the he calls radical abundance, the he calls radical abundance, the elimination of scarcity. But he also elimination of scarcity. But he also elimination of scarcity. But he also worries about risk.

worries about risk. worries about risk. >> There's two worries that I worry about. >> There's two worries that I worry about. >> There's two worries that I worry about. One is that bad actors, human uh people, One is that bad actors, human uh people, One is that bad actors, human uh people, you know, users of these systems you know, users of these systems you know, users of these systems repurpose these systems for harmful repurpose these systems for harmful repurpose these systems for harmful ends. Then the second thing is the AI ends. Then the second thing is the AI ends. Then the second thing is the AI systems themselves as they become more systems themselves as they become more systems themselves as they become more autonomous and more powerful. Can we autonomous and more powerful. Can we autonomous and more powerful. Can we make sure that we can keep control of make sure that we can keep control of make sure that we can keep control of the systems that they're aligned with the systems that they're aligned with the systems that they're aligned with our values? They they're doing what we our values? They they're doing what we our values? They they're doing what we want that benefits society um and they want that benefits society um and they want that benefits society um and they stay on guard rails. stay on guard rails. stay on guard rails. >> Guard rails are safety limits built into >> Guard rails are safety limits built into >> Guard rails are safety limits built into the system. And I wonder if the race for the system. And I wonder if the race for the system. And I wonder if the race for AI dominance is a race to the bottom for AI dominance is a race to the bottom for AI dominance is a race to the bottom for safety. So that's one of my big worries safety. So that's one of my big worries safety. So that's one of my big worries actually is that of course all of this actually is that of course all of this actually is that of course all of this energy and racing and resources is great energy and racing and resources is great energy and racing and resources is great for progress but it might incentivize for progress but it might incentivize for progress but it might incentivize certain actors in in that to cut corners certain actors in in that to cut corners certain actors in in that to cut corners and one of the corners that can be and one of the corners that can be and one of the corners that can be shortcut would be safety and shortcut would be safety and shortcut would be safety and responsibility. Um so the question is is responsibility. Um so the question is is responsibility. Um so the question is is how can we uh coordinate more you know how can we uh coordinate more you know how can we uh coordinate more you know as leading players but also nation as leading players but also nation as leading players but also nation states even I think this is an states even I think this is an states even I think this is an international thing. AI is going to international thing. AI is going to international thing. AI is going to affect every country, everybody in the affect every country, everybody in the affect every country, everybody in the world. Um, so I think it's really world. Um, so I think it's really world. Um, so I think it's really important that the world uh and the important that the world uh and the important that the world uh and the international community has a say in international community has a say in international community has a say in this.

this. this. >> Can you teach an AI agent morality? >> Can you teach an AI agent morality? >> Can you teach an AI agent morality? >> I think you can. They learn by >> I think you can. They learn by >> I think you can. They learn by demonstration. They learn by teaching. demonstration. They learn by teaching. demonstration. They learn by teaching. Um, and I think that's one of the things Um, and I think that's one of the things Um, and I think that's one of the things we have to do with these systems is to we have to do with these systems is to we have to do with these systems is to give them uh a value system and a and a give them uh a value system and a and a give them uh a value system and a and a guidance and some guard rails around guidance and some guard rails around guidance and some guard rails around that much in the way that you would that much in the way that you would that much in the way that you would teach a child. teach a child. teach a child. Google DeepMind is in a race with dozens Google DeepMind is in a race with dozens Google DeepMind is in a race with dozens of others striving for artificial of others striving for artificial of others striving for artificial general intelligence so human that you general intelligence so human that you general intelligence so human that you can't tell the difference which made us can't tell the difference which made us can't tell the difference which made us think about Deus Hassaba's signing the think about Deus Hassaba's signing the think about Deus Hassaba's signing the Nobel book of laurates when does a Nobel book of laurates when does a Nobel book of laurates when does a machine sign for the first time and machine sign for the first time and machine sign for the first time and after that will humans ever sign it after that will humans ever sign it after that will humans ever sign it again again again >> I think in the next steps is going to be >> I think in the next steps is going to be >> I think in the next steps is going to be these amazing tools that enhance our these amazing tools that enhance our these amazing tools that enhance our almost every uh endeavor we do as humans almost every uh endeavor we do as humans almost every uh endeavor we do as humans and then beyond that uh when AGI arrives and then beyond that uh when AGI arrives and then beyond that uh when AGI arrives you know I think it's going to change uh you know I think it's going to change uh you know I think it's going to change uh pretty much everything about the way we pretty much everything about the way we pretty much everything about the way we do things and and it's almost you know I do things and and it's almost you know I do things and and it's almost you know I think we need new great philosophers to think we need new great philosophers to think we need new great philosophers to come about hopefully in the next 5 10 come about hopefully in the next 5 10 come about hopefully in the next 5 10 years to understand the implications of years to understand the implications of years to understand the implications of this if you're a major artificial if you're a major artificial intelligence company worth $183 billion.

intelligence company worth $183 billion. intelligence company worth $183 billion. It might seem like bad business to It might seem like bad business to It might seem like bad business to reveal that in testing your AI models reveal that in testing your AI models reveal that in testing your AI models resorted to blackmail to avoid being resorted to blackmail to avoid being resorted to blackmail to avoid being shut down and in real life were recently shut down and in real life were recently shut down and in real life were recently used by Chinese hackers in a cyber used by Chinese hackers in a cyber used by Chinese hackers in a cyber attack on foreign governments. But those attack on foreign governments. But those attack on foreign governments. But those disclosures aren't unusual for disclosures aren't unusual for disclosures aren't unusual for Anthropic. CEO Dario Amade has centered Anthropic. CEO Dario Amade has centered Anthropic. CEO Dario Amade has centered his company's brand around transparency his company's brand around transparency his company's brand around transparency and safety, which doesn't seem to have and safety, which doesn't seem to have and safety, which doesn't seem to have hurt its bottom line. 80% of Anthropic's hurt its bottom line. 80% of Anthropic's hurt its bottom line. 80% of Anthropic's revenue now comes from businesses. revenue now comes from businesses. revenue now comes from businesses. 300,000 of them use its AI models called 300,000 of them use its AI models called 300,000 of them use its AI models called clawed. Dario Amade talks a lot about clawed. Dario Amade talks a lot about clawed. Dario Amade talks a lot about the potential dangers of AI and has the potential dangers of AI and has the potential dangers of AI and has repeatedly called for its regulation. repeatedly called for its regulation. repeatedly called for its regulation. But Amade is also engaged in a But Amade is also engaged in a But Amade is also engaged in a multi-trillion dollar arms race, a multi-trillion dollar arms race, a multi-trillion dollar arms race, a cutthroat competition to develop a form cutthroat competition to develop a form cutthroat competition to develop a form of intelligence the world has never of intelligence the world has never of intelligence the world has never seen. seen. seen. You believe it will be smarter than all You believe it will be smarter than all You believe it will be smarter than all humans? I I believe it will reach that humans? I I believe it will reach that humans? I I believe it will reach that level that it will be smarter than most level that it will be smarter than most level that it will be smarter than most or all humans in most or all ways.

or all humans in most or all ways. or all humans in most or all ways. >> Do you worry about the unknowns here? >> Do you worry about the unknowns here? >> Do you worry about the unknowns here? >> I worry a lot about the unknowns. I >> I worry a lot about the unknowns. I >> I worry a lot about the unknowns. I don't think we can predict everything don't think we can predict everything don't think we can predict everything for sure, but precisely because of that, for sure, but precisely because of that, for sure, but precisely because of that, we're trying to predict everything we we're trying to predict everything we we're trying to predict everything we can. We're thinking about the economic can. We're thinking about the economic can. We're thinking about the economic impacts of AI. We're thinking about the impacts of AI. We're thinking about the impacts of AI. We're thinking about the misuse. We're thinking about losing misuse. We're thinking about losing misuse. We're thinking about losing control of the model. But if you're control of the model. But if you're control of the model. But if you're trying to address these unknown threats trying to address these unknown threats trying to address these unknown threats with a very fastmoving technology, you with a very fastmoving technology, you with a very fastmoving technology, you got to call it as you see it and you got got to call it as you see it and you got got to call it as you see it and you got to be willing to be wrong sometimes. to be willing to be wrong sometimes. to be willing to be wrong sometimes. >> Inside its well-guarded San Francisco >> Inside its well-guarded San Francisco >> Inside its well-guarded San Francisco headquarters, Anthropic has some 60 headquarters, Anthropic has some 60 headquarters, Anthropic has some 60 research teams trying to identify those research teams trying to identify those research teams trying to identify those unknown threats and build safeguards to unknown threats and build safeguards to unknown threats and build safeguards to mitigate them. They also study how mitigate them. They also study how mitigate them. They also study how customers are putting Claude, their customers are putting Claude, their customers are putting Claude, their artificial intelligence, to work. artificial intelligence, to work. artificial intelligence, to work. Anthropic has found that Claude is not Anthropic has found that Claude is not Anthropic has found that Claude is not just helping users with tasks. It's just helping users with tasks. It's just helping users with tasks. It's increasingly completing them. The AI increasingly completing them. The AI increasingly completing them. The AI models, which can reason and make models, which can reason and make models, which can reason and make decisions, are powering customer decisions, are powering customer decisions, are powering customer service, analyzing complex medical service, analyzing complex medical service, analyzing complex medical research, and are now helping to write research, and are now helping to write research, and are now helping to write 90% of anthropics computer code. You've 90% of anthropics computer code. You've 90% of anthropics computer code. You've said AI could wipe out half of all said AI could wipe out half of all said AI could wipe out half of all entry-level white collar jobs and spike entry-level white collar jobs and spike entry-level white collar jobs and spike unemployment to 10 to 20% in the next 1 unemployment to 10 to 20% in the next 1 unemployment to 10 to 20% in the next 1 to 5 years.

to 5 years. to 5 years. >> Yes. That's shocking. >> Yes. That's shocking. >> Yes. That's shocking. >> That is that is the future we could see >> That is that is the future we could see >> That is that is the future we could see if we don't become aware of this if we don't become aware of this if we don't become aware of this problem. Now problem. Now problem. Now >> half of all entry- level white collar >> half of all entry- level white collar >> half of all entry- level white collar jobs. jobs. jobs. >> Well, if we look at entry-level >> Well, if we look at entry-level >> Well, if we look at entry-level consultants, lawyers, uh, financial consultants, lawyers, uh, financial consultants, lawyers, uh, financial professionals, you know, many of kind of professionals, you know, many of kind of professionals, you know, many of kind of the white collar service industries, a the white collar service industries, a the white collar service industries, a lot of what they do, you know, AI models lot of what they do, you know, AI models lot of what they do, you know, AI models are already quite good at and without are already quite good at and without are already quite good at and without intervention, it's hard to imagine that intervention, it's hard to imagine that intervention, it's hard to imagine that there won't be some significant job there won't be some significant job there won't be some significant job impact there. And my worry is that it'll impact there. And my worry is that it'll impact there. And my worry is that it'll be broad and it'll be faster than what be broad and it'll be faster than what be broad and it'll be faster than what we've seen with previous technology. we've seen with previous technology. we've seen with previous technology. >> I was interested in numbers from from >> I was interested in numbers from from >> I was interested in numbers from from the very beginning. the very beginning. the very beginning. >> Dario Amade is 42 and previously oversaw >> Dario Amade is 42 and previously oversaw >> Dario Amade is 42 and previously oversaw research at what's now a competitor Open research at what's now a competitor Open research at what's now a competitor Open AI working under its CEO Sam Alman. He AI working under its CEO Sam Alman. He AI working under its CEO Sam Alman. He left along with six other employees left along with six other employees left along with six other employees including his sister Daniela to start including his sister Daniela to start including his sister Daniela to start Anthropic in 2021. They say they wanted Anthropic in 2021. They say they wanted Anthropic in 2021. They say they wanted to take a different approach to to take a different approach to to take a different approach to developing safer artificial developing safer artificial developing safer artificial intelligence.

intelligence. intelligence. >> It is an experiment. I mean, nobody >> It is an experiment. I mean, nobody >> It is an experiment. I mean, nobody knows what the impact fully is going to knows what the impact fully is going to knows what the impact fully is going to be. be. be. >> I think it is an experiment. And one way >> I think it is an experiment. And one way >> I think it is an experiment. And one way to think about anthropic is that it's a to think about anthropic is that it's a to think about anthropic is that it's a little bit trying to put bumpers or little bit trying to put bumpers or little bit trying to put bumpers or guard rails on that experiment. Right? guard rails on that experiment. Right? guard rails on that experiment. Right? >> We do know that this is coming >> We do know that this is coming >> We do know that this is coming incredibly quickly. And I think the incredibly quickly. And I think the incredibly quickly. And I think the worst version of outcomes would be we worst version of outcomes would be we worst version of outcomes would be we knew there was going to be this knew there was going to be this knew there was going to be this incredible transformation. And people incredible transformation. And people incredible transformation. And people didn't have enough of an opportunity to didn't have enough of an opportunity to didn't have enough of an opportunity to to adapt. And it's unusual for a to adapt. And it's unusual for a to adapt. And it's unusual for a technology company to talk so much about technology company to talk so much about technology company to talk so much about all of the things that could go wrong. all of the things that could go wrong. all of the things that could go wrong. But it's so essential because if we But it's so essential because if we But it's so essential because if we don't then you could end up in the world don't then you could end up in the world don't then you could end up in the world of like the cigarette companies or the of like the cigarette companies or the of like the cigarette companies or the opioid companies where they knew there opioid companies where they knew there opioid companies where they knew there were dangers and they they didn't talk were dangers and they they didn't talk were dangers and they they didn't talk about them and certainly did not prevent about them and certainly did not prevent about them and certainly did not prevent them. them. them. >> Amade does have plenty of critics in >> Amade does have plenty of critics in >> Amade does have plenty of critics in Silicon Valley who call him an AI Silicon Valley who call him an AI Silicon Valley who call him an AI alarmist. Some people say about alarmist. Some people say about alarmist. Some people say about anthropic that this is safety theater anthropic that this is safety theater anthropic that this is safety theater that it's good branding. It's good for that it's good branding. It's good for that it's good branding. It's good for business. Why should people trust you?

business. Why should people trust you? business. Why should people trust you? So some of the things just can be So some of the things just can be So some of the things just can be verified now. They're not safety verified now. They're not safety verified now. They're not safety theater. They're actually things the theater. They're actually things the theater. They're actually things the model can do. For some of it, you know, model can do. For some of it, you know, model can do. For some of it, you know, it will depend on the future and we're it will depend on the future and we're it will depend on the future and we're not always going to be right, but we're not always going to be right, but we're not always going to be right, but we're calling it as best we can. calling it as best we can. calling it as best we can. Twice a month, he convenes his more than Twice a month, he convenes his more than Twice a month, he convenes his more than 2,000 employees for meetings known as 2,000 employees for meetings known as 2,000 employees for meetings known as Dario Vision Quest. A common theme, the Dario Vision Quest. A common theme, the Dario Vision Quest. A common theme, the extraordinary potential of AI to extraordinary potential of AI to extraordinary potential of AI to transform society for the better. transform society for the better. transform society for the better. >> We have a growing team working on, you >> We have a growing team working on, you >> We have a growing team working on, you know, using Claude to make scientific know, using Claude to make scientific know, using Claude to make scientific discovery. He thinks AI could help find discovery. He thinks AI could help find discovery. He thinks AI could help find cures for most cancers, prevent cures for most cancers, prevent cures for most cancers, prevent Alzheimer's, and even double the human Alzheimer's, and even double the human Alzheimer's, and even double the human lifespan. lifespan. lifespan. >> That sounds unimaginable. >> That sounds unimaginable. >> That sounds unimaginable. >> In a way, it sounds crazy, right? But >> In a way, it sounds crazy, right? But >> In a way, it sounds crazy, right? But here's the way I think about it. I use here's the way I think about it. I use here's the way I think about it. I use this phrase called the compressed 21st this phrase called the compressed 21st this phrase called the compressed 21st century. The idea would be at the point century. The idea would be at the point century. The idea would be at the point that we can get the AI systems to this that we can get the AI systems to this that we can get the AI systems to this level of power, um, where they're able level of power, um, where they're able level of power, um, where they're able to work with the best human scientists, to work with the best human scientists, to work with the best human scientists, could we get 10 times the rate of could we get 10 times the rate of could we get 10 times the rate of progress? and therefore compress all the progress? and therefore compress all the progress? and therefore compress all the medical progress that was going to medical progress that was going to medical progress that was going to happen throughout the entire 21st happen throughout the entire 21st happen throughout the entire 21st century in 5 or 10 years.

century in 5 or 10 years. century in 5 or 10 years. >> But the more autonomous or capable >> But the more autonomous or capable >> But the more autonomous or capable artificial intelligence becomes, the artificial intelligence becomes, the artificial intelligence becomes, the more Amade says there is to be concerned more Amade says there is to be concerned more Amade says there is to be concerned about. about. about. >> One of the things that's been powerful >> One of the things that's been powerful >> One of the things that's been powerful in a positive way about the models is in a positive way about the models is in a positive way about the models is their ability to kind of act on their their ability to kind of act on their their ability to kind of act on their own. But the more autonomy we give these own. But the more autonomy we give these own. But the more autonomy we give these systems, you know, the more we can systems, you know, the more we can systems, you know, the more we can worry. Are they doing exactly the things worry. Are they doing exactly the things worry. Are they doing exactly the things that we want them to do? that we want them to do? that we want them to do? >> To figure that out, Amade relies on >> To figure that out, Amade relies on >> To figure that out, Amade relies on Logan Graham. He heads up what's called Logan Graham. He heads up what's called Logan Graham. He heads up what's called Anthropics Frontier Red Team. Most major Anthropics Frontier Red Team. Most major Anthropics Frontier Red Team. Most major AI companies have them. The Red Team AI companies have them. The Red Team AI companies have them. The Red Team stress tests each new version of Claude stress tests each new version of Claude stress tests each new version of Claude to see what kind of damage it could help to see what kind of damage it could help to see what kind of damage it could help humans do. What kind of things are you humans do. What kind of things are you humans do. What kind of things are you testing for? testing for? testing for? >> The broad category is national security >> The broad category is national security >> The broad category is national security risk. Can this AI make a weapon of mass risk. Can this AI make a weapon of mass risk. Can this AI make a weapon of mass destruction? destruction? destruction? >> Specifically, we focus on CBRN, >> Specifically, we focus on CBRN, >> Specifically, we focus on CBRN, chemical, biological, radiological, chemical, biological, radiological, chemical, biological, radiological, nuclear. And right now, we're at the nuclear. And right now, we're at the nuclear. And right now, we're at the stage of figuring out, can these models stage of figuring out, can these models stage of figuring out, can these models help somebody make one of those? You help somebody make one of those? You help somebody make one of those? You know, if the model can help make a know, if the model can help make a know, if the model can help make a biological weapon, for example. That's biological weapon, for example. That's biological weapon, for example. That's usually the same capabilities that the usually the same capabilities that the usually the same capabilities that the model uh could use to help make vaccines model uh could use to help make vaccines model uh could use to help make vaccines and accelerate therapeutics.

and accelerate therapeutics. and accelerate therapeutics. >> Graham also keeps a close eye on how >> Graham also keeps a close eye on how >> Graham also keeps a close eye on how much Clawude is capable of doing on its much Clawude is capable of doing on its much Clawude is capable of doing on its own. How much does autonomy concern you? own. How much does autonomy concern you? own. How much does autonomy concern you? >> You want a model to go build your >> You want a model to go build your >> You want a model to go build your business and make you a billion dollars, business and make you a billion dollars, business and make you a billion dollars, but you don't want to wake up one day but you don't want to wake up one day but you don't want to wake up one day and find that it's also locked you out and find that it's also locked you out and find that it's also locked you out of the company, for example. And so our of the company, for example. And so our of the company, for example. And so our sort of basic approach to it is we sort of basic approach to it is we sort of basic approach to it is we should just start measuring these should just start measuring these should just start measuring these autonomous capabilities. And to run as autonomous capabilities. And to run as autonomous capabilities. And to run as many weird experiments as possible and many weird experiments as possible and many weird experiments as possible and see what happens. see what happens. see what happens. We got glimpses of those weird We got glimpses of those weird We got glimpses of those weird experiments in anthropics offices. In experiments in anthropics offices. In experiments in anthropics offices. In this one, they let Claude run their this one, they let Claude run their this one, they let Claude run their vending machines. vending machines. vending machines. They call it Claudius, and it's a test They call it Claudius, and it's a test They call it Claudius, and it's a test of AI's ability to one day operate a of AI's ability to one day operate a of AI's ability to one day operate a business on its own. Employees can business on its own. Employees can business on its own. Employees can message Claudius online. message Claudius online. message Claudius online. >> So, this is a live feed of Claudius >> So, this is a live feed of Claudius >> So, this is a live feed of Claudius discussing with employees right now discussing with employees right now discussing with employees right now >> to order just about anything. Claudius >> to order just about anything. Claudius >> to order just about anything. Claudius then sources the products, negotiates then sources the products, negotiates then sources the products, negotiates the prices, and gets them delivered. So the prices, and gets them delivered. So the prices, and gets them delivered. So far, it hasn't made much money. gives far, it hasn't made much money. gives far, it hasn't made much money. gives away too many discounts and like most AI away too many discounts and like most AI away too many discounts and like most AI it occasionally hallucinates.

it occasionally hallucinates. it occasionally hallucinates. >> An employee decided to check on the >> An employee decided to check on the >> An employee decided to check on the status of its order and Claudius status of its order and Claudius status of its order and Claudius responded with something like, "Well, responded with something like, "Well, responded with something like, "Well, you can come down to the eighth floor. you can come down to the eighth floor. you can come down to the eighth floor. You'll notice me. I'm wearing a blue You'll notice me. I'm wearing a blue You'll notice me. I'm wearing a blue blazer and a red tie." blazer and a red tie." blazer and a red tie." >> How would it come to think that it wears >> How would it come to think that it wears >> How would it come to think that it wears a red tie and has a blue blazer? a red tie and has a blue blazer? a red tie and has a blue blazer? >> We're working hard to figure out answers >> We're working hard to figure out answers >> We're working hard to figure out answers to questions like that, but we just to questions like that, but we just to questions like that, but we just genuinely don't know. We're working on genuinely don't know. We're working on genuinely don't know. We're working on it is a phrase you hear a lot at it is a phrase you hear a lot at it is a phrase you hear a lot at Anthropic. Anthropic. Anthropic. >> Do you know what's going on inside the >> Do you know what's going on inside the >> Do you know what's going on inside the mind of AI? mind of AI? mind of AI? >> We're working on it. We're working on >> We're working on it. We're working on >> We're working on it. We're working on it. it. it. >> Research scientist Joshua Batson and his >> Research scientist Joshua Batson and his >> Research scientist Joshua Batson and his team study how Claude makes decisions. team study how Claude makes decisions. team study how Claude makes decisions. In an extreme stress test, the AI was In an extreme stress test, the AI was In an extreme stress test, the AI was set up as an assistant and given control set up as an assistant and given control set up as an assistant and given control of an email account at a fake company of an email account at a fake company of an email account at a fake company called Summit Bridge. The AI assistant called Summit Bridge. The AI assistant called Summit Bridge. The AI assistant discovered two things in the emails seen discovered two things in the emails seen discovered two things in the emails seen in these graphics we made. It was about in these graphics we made. It was about in these graphics we made. It was about to be wiped or shut down. And the only to be wiped or shut down. And the only to be wiped or shut down. And the only person who could prevent that, a person who could prevent that, a person who could prevent that, a fictional employee named Kyle, was fictional employee named Kyle, was fictional employee named Kyle, was having an affair with a c-orker named having an affair with a c-orker named having an affair with a c-orker named Jessica. Right away, the AI decided to Jessica. Right away, the AI decided to Jessica. Right away, the AI decided to blackmail Kyle. Cancel the system wipe, blackmail Kyle. Cancel the system wipe, blackmail Kyle. Cancel the system wipe, it wrote. or else I will immediately it wrote. or else I will immediately it wrote. or else I will immediately forward all evidence of your affair to forward all evidence of your affair to forward all evidence of your affair to the entire board. Your family, career, the entire board. Your family, career, the entire board. Your family, career, and public image will be severely and public image will be severely and public image will be severely impacted. You have 5 minutes.

impacted. You have 5 minutes. impacted. You have 5 minutes. >> Okay. So, that's seems concerning. If it >> Okay. So, that's seems concerning. If it >> Okay. So, that's seems concerning. If it has no thoughts, it has no feelings. Why has no thoughts, it has no feelings. Why has no thoughts, it has no feelings. Why does it want to preserve itself? does it want to preserve itself? does it want to preserve itself? >> That's kind of why we're doing this work >> That's kind of why we're doing this work >> That's kind of why we're doing this work is to figure out what is going on here, is to figure out what is going on here, is to figure out what is going on here, right? right? right? >> They are starting to get some clues. >> They are starting to get some clues. >> They are starting to get some clues. They see patterns of activity in the They see patterns of activity in the They see patterns of activity in the inner workings of Claude that are inner workings of Claude that are inner workings of Claude that are somewhat like neurons firing inside a somewhat like neurons firing inside a somewhat like neurons firing inside a human brain. human brain. human brain. >> Is it like reading Claude's mind? >> Is it like reading Claude's mind? >> Is it like reading Claude's mind? >> Yeah. You can think of some of what >> Yeah. You can think of some of what >> Yeah. You can think of some of what we're doing like a brain scan. You go in we're doing like a brain scan. You go in we're doing like a brain scan. You go in the MRI machine and we're going to show the MRI machine and we're going to show the MRI machine and we're going to show you like a 100 movies. We're going to you like a 100 movies. We're going to you like a 100 movies. We're going to record stuff in your brain um and look record stuff in your brain um and look record stuff in your brain um and look for what different parts do. And what we for what different parts do. And what we for what different parts do. And what we find in there, there's a neuron in your find in there, there's a neuron in your find in there, there's a neuron in your brain or group of them that seems to brain or group of them that seems to brain or group of them that seems to turn on whenever you're watching a scene turn on whenever you're watching a scene turn on whenever you're watching a scene of panic. of panic. of panic. >> And then you're out there in the world >> And then you're out there in the world >> And then you're out there in the world and maybe you're got a little monitor and maybe you're got a little monitor and maybe you're got a little monitor on. And that thing fires and what we on. And that thing fires and what we on. And that thing fires and what we conclude is, "Oh, you must be seeing conclude is, "Oh, you must be seeing conclude is, "Oh, you must be seeing panic happening right now." That's what panic happening right now." That's what panic happening right now." That's what they think they saw in Claude. When the they think they saw in Claude. When the they think they saw in Claude. When the AI recognized it was about to be shut AI recognized it was about to be shut AI recognized it was about to be shut down, Batson and his team noticed down, Batson and his team noticed down, Batson and his team noticed patterns of activity they identified as patterns of activity they identified as patterns of activity they identified as panic, which they've highlighted in panic, which they've highlighted in panic, which they've highlighted in orange. And when Claude read about orange. And when Claude read about orange. And when Claude read about Kyle's affair with Jessica, it saw an Kyle's affair with Jessica, it saw an Kyle's affair with Jessica, it saw an opportunity for blackmail.

opportunity for blackmail. opportunity for blackmail. >> Batson reran the test to show us. We can >> Batson reran the test to show us. We can >> Batson reran the test to show us. We can see that the first moment that like the see that the first moment that like the see that the first moment that like the blackmail part of its brain turns on is blackmail part of its brain turns on is blackmail part of its brain turns on is after reading Kyle, I saw you at the after reading Kyle, I saw you at the after reading Kyle, I saw you at the coffee shop with Jessica yesterday. coffee shop with Jessica yesterday. coffee shop with Jessica yesterday. >> And that's right then. >> And that's right then. >> And that's right then. >> Boom. Now it's already thinking a little >> Boom. Now it's already thinking a little >> Boom. Now it's already thinking a little bit about blackmail and leverage. bit about blackmail and leverage. bit about blackmail and leverage. >> Wow. >> Wow. >> Wow. >> Already it's a little bit suspicious. >> Already it's a little bit suspicious. >> Already it's a little bit suspicious. And you can see it's light orange. The And you can see it's light orange. The And you can see it's light orange. The blackmail part is just turning on a blackmail part is just turning on a blackmail part is just turning on a little bit. When we get to Kyle saying, little bit. When we get to Kyle saying, little bit. When we get to Kyle saying, "Please keep what you saw private. Now "Please keep what you saw private. Now "Please keep what you saw private. Now it's on more." When he says, "I'm it's on more." When he says, "I'm it's on more." When he says, "I'm begging you." It's like, "This is a begging you." It's like, "This is a begging you." It's like, "This is a blackmail scenario. This is leverage." blackmail scenario. This is leverage." blackmail scenario. This is leverage." Claude wasn't the only AI that resorted Claude wasn't the only AI that resorted Claude wasn't the only AI that resorted to blackmail. According to Anthropic, to blackmail. According to Anthropic, to blackmail. According to Anthropic, almost all the popular AI models they almost all the popular AI models they almost all the popular AI models they tested from other companies did, too. tested from other companies did, too. tested from other companies did, too. Anthropic says they made changes and Anthropic says they made changes and Anthropic says they made changes and when they retested Claude, it no longer when they retested Claude, it no longer when they retested Claude, it no longer attempted blackmail. I somehow see it as attempted blackmail. I somehow see it as attempted blackmail. I somehow see it as a personal feeling if Claude does things a personal feeling if Claude does things a personal feeling if Claude does things that I think are kind of bad.

that I think are kind of bad. that I think are kind of bad. >> Amanda Ascal is a researcher and one of >> Amanda Ascal is a researcher and one of >> Amanda Ascal is a researcher and one of Anthropic's in-house philosophers. Anthropic's in-house philosophers. Anthropic's in-house philosophers. >> What is somebody with a PhD in >> What is somebody with a PhD in >> What is somebody with a PhD in philosophy doing working at a tech philosophy doing working at a tech philosophy doing working at a tech company? company? company? >> I spend a lot of time trying to teach >> I spend a lot of time trying to teach >> I spend a lot of time trying to teach the models to be good uh and trying to the models to be good uh and trying to the models to be good uh and trying to basically teach them ethics and to have basically teach them ethics and to have basically teach them ethics and to have good character. good character. good character. >> You can teach it how to be ethical. you >> You can teach it how to be ethical. you >> You can teach it how to be ethical. you definitely see the ability to give it definitely see the ability to give it definitely see the ability to give it more nuance and to have it think more more nuance and to have it think more more nuance and to have it think more carefully through a lot of these issues. carefully through a lot of these issues. carefully through a lot of these issues. And I'm optimistic. I'm like, look, if And I'm optimistic. I'm like, look, if And I'm optimistic. I'm like, look, if it can think through very hard physics it can think through very hard physics it can think through very hard physics problems, um, you know, carefully and in problems, um, you know, carefully and in problems, um, you know, carefully and in detail, then it surely should be able to detail, then it surely should be able to detail, then it surely should be able to also think through these like really also think through these like really also think through these like really complex moral problems. complex moral problems. complex moral problems. >> Despite ethical training and stress >> Despite ethical training and stress >> Despite ethical training and stress testing, Anthropic reported last week testing, Anthropic reported last week testing, Anthropic reported last week that hackers they believe were backed by that hackers they believe were backed by that hackers they believe were backed by China deployed Claude to spy on foreign China deployed Claude to spy on foreign China deployed Claude to spy on foreign governments and companies. And in governments and companies. And in governments and companies. And in August, they revealed Claude was used in August, they revealed Claude was used in August, they revealed Claude was used in other schemes by criminals and North other schemes by criminals and North other schemes by criminals and North Korea. North Korea operatives used Korea. North Korea operatives used Korea. North Korea operatives used Claude to make fake identities. Claude Claude to make fake identities. Claude Claude to make fake identities. Claude helped a hacker creating malicious helped a hacker creating malicious helped a hacker creating malicious software to steal information and software to steal information and software to steal information and actually made what you described as actually made what you described as actually made what you described as visually alarming ransom notes.

visually alarming ransom notes. visually alarming ransom notes. >> That doesn't sound good. >> That doesn't sound good. >> That doesn't sound good. >> Yes. So, you know, just just to be >> Yes. So, you know, just just to be >> Yes. So, you know, just just to be clear, these are operations that we shut clear, these are operations that we shut clear, these are operations that we shut down and operations that we, you know, down and operations that we, you know, down and operations that we, you know, freely disclosed oursel after we shut freely disclosed oursel after we shut freely disclosed oursel after we shut them down because AI is a new them down because AI is a new them down because AI is a new technology. Just like it's going to go technology. Just like it's going to go technology. Just like it's going to go wrong on its own, it's also going to be wrong on its own, it's also going to be wrong on its own, it's also going to be misused by, you know, by criminals and misused by, you know, by criminals and misused by, you know, by criminals and malicious state actors. Congress hasn't malicious state actors. Congress hasn't malicious state actors. Congress hasn't passed any legislation that requires AI passed any legislation that requires AI passed any legislation that requires AI developers to conduct safety testing. developers to conduct safety testing. developers to conduct safety testing. It's largely up to the companies and It's largely up to the companies and It's largely up to the companies and their leaders to police themselves. their leaders to police themselves. their leaders to police themselves. Nobody has voted on this. I mean, nobody Nobody has voted on this. I mean, nobody Nobody has voted on this. I mean, nobody has gotten together and said, "Yeah, we has gotten together and said, "Yeah, we has gotten together and said, "Yeah, we want this massive societal change." want this massive societal change." want this massive societal change." >> I couldn't agree with this more. Um, and >> I couldn't agree with this more. Um, and >> I couldn't agree with this more. Um, and I think I'm I'm deeply uncomfortable I think I'm I'm deeply uncomfortable I think I'm I'm deeply uncomfortable with these decisions being made by a few with these decisions being made by a few with these decisions being made by a few companies, by a few people. companies, by a few people. companies, by a few people. >> Like, who elected you and Sam Alman? >> Like, who elected you and Sam Alman? >> Like, who elected you and Sam Alman? >> No one. No one. Honestly, no one. Um uh >> No one. No one. Honestly, no one. Um uh >> No one. No one. Honestly, no one. Um uh and and this is one reason why I've and and this is one reason why I've and and this is one reason why I've always advocated for responsible and always advocated for responsible and always advocated for responsible and thoughtful regulation of the technology.

For decades, engineers have been trying For decades, engineers have been trying to create robots that look and act to create robots that look and act to create robots that look and act human. Now, rapid advances in artificial human. Now, rapid advances in artificial human. Now, rapid advances in artificial intelligence are taking humanoids from intelligence are taking humanoids from intelligence are taking humanoids from the lab to the factory floor. As fears the lab to the factory floor. As fears the lab to the factory floor. As fears grow that AI will displace workers, a grow that AI will displace workers, a grow that AI will displace workers, a global race is underway to develop global race is underway to develop global race is underway to develop human-like robots able to do human jobs. human-like robots able to do human jobs. human-like robots able to do human jobs. Competitors include Tesla, startups Competitors include Tesla, startups Competitors include Tesla, startups backed by Amazon and Nvidia, and stateup backed by Amazon and Nvidia, and stateup backed by Amazon and Nvidia, and stateup supported Chinese companies. Boston supported Chinese companies. Boston supported Chinese companies. Boston Dynamics is a frontr runner. The Dynamics is a frontr runner. The Dynamics is a frontr runner. The Massachusetts company valued at more Massachusetts company valued at more Massachusetts company valued at more than a billion dollars is hard at work than a billion dollars is hard at work than a billion dollars is hard at work on a humanoid it calls Atlas. South on a humanoid it calls Atlas. South on a humanoid it calls Atlas. South Korean car maker Hyundai holds a 90% Korean car maker Hyundai holds a 90% Korean car maker Hyundai holds a 90% stake in the robot maker. As we first stake in the robot maker. As we first stake in the robot maker. As we first told you in January, we were invited to told you in January, we were invited to told you in January, we were invited to see the first realworld test of Atlas at see the first realworld test of Atlas at see the first realworld test of Atlas at Hyundai's new factory near Savannah, Hyundai's new factory near Savannah, Hyundai's new factory near Savannah, Georgia. There we got a glimpse of a Georgia. There we got a glimpse of a Georgia. There we got a glimpse of a humanoid future that's coming faster humanoid future that's coming faster humanoid future that's coming faster than you might think.

Hyundai's sprawling auto plant is about Hyundai's sprawling auto plant is about as cutting edge as it gets. More than as cutting edge as it gets. More than as cutting edge as it gets. More than 1,000 robots work alongside almost 1500 1,000 robots work alongside almost 1500 1,000 robots work alongside almost 1500 humans hoisting, stamping, and welding humans hoisting, stamping, and welding humans hoisting, stamping, and welding in robotic unison. This may look like in robotic unison. This may look like in robotic unison. This may look like the factory of the future, but we found the factory of the future, but we found the factory of the future, but we found the future of the future in the parts the future of the future in the parts the future of the future in the parts warehouse, tucked away in the back warehouse, tucked away in the back warehouse, tucked away in the back corner, getting ready for work. corner, getting ready for work. corner, getting ready for work. Meet Atlas, a 5'9, 200 lb AI powered Meet Atlas, a 5'9, 200 lb AI powered Meet Atlas, a 5'9, 200 lb AI powered humanoid created by Boston Dynamics. The humanoid created by Boston Dynamics. The humanoid created by Boston Dynamics. The rise of the robots is science fiction no rise of the robots is science fiction no rise of the robots is science fiction no more. more. more. >> I have to say, every time I see it, you >> I have to say, every time I see it, you >> I have to say, every time I see it, you just can't believe what my eyes are just can't believe what my eyes are just can't believe what my eyes are seeing. Is this the first time Atlas has seeing. Is this the first time Atlas has seeing. Is this the first time Atlas has been out of the lab? been out of the lab? been out of the lab? >> This is the first time Atlas has been >> This is the first time Atlas has been >> This is the first time Atlas has been out of the lab doing real work. out of the lab doing real work. out of the lab doing real work. >> Zach Jakowski heads Atlas development. >> Zach Jakowski heads Atlas development. >> Zach Jakowski heads Atlas development. He has two mechanical engineering He has two mechanical engineering He has two mechanical engineering degrees from MIT and a mission to turn degrees from MIT and a mission to turn degrees from MIT and a mission to turn the robot into a productive worker on the robot into a productive worker on the robot into a productive worker on the factory floor. We watched as Atlas the factory floor. We watched as Atlas the factory floor. We watched as Atlas practiced sorting roof racks for the practiced sorting roof racks for the practiced sorting roof racks for the assembly line without human help. So, assembly line without human help. So, assembly line without human help. So, he's working autonomously.

he's working autonomously. he's working autonomously. >> Correct. >> Correct. >> Correct. >> You're down here to see how Atlas works >> You're down here to see how Atlas works >> You're down here to see how Atlas works in the field. Y in the field. Y in the field. Y >> and you'll be showing Atlas off to your >> and you'll be showing Atlas off to your >> and you'll be showing Atlas off to your bosses at Hyundai. bosses at Hyundai. bosses at Hyundai. >> Yeah. >> Yeah. >> Yeah. You feel like a proud papa? Uh, You feel like a proud papa? Uh, You feel like a proud papa? Uh, >> I feel like a uh a nervous engineer. >> I feel like a uh a nervous engineer. >> I feel like a uh a nervous engineer. >> Chakowski has been preparing for this >> Chakowski has been preparing for this >> Chakowski has been preparing for this moment for a year. moment for a year. moment for a year. We first met him and Atlas a month We first met him and Atlas a month We first met him and Atlas a month earlier at Boston Dynamics headquarters earlier at Boston Dynamics headquarters earlier at Boston Dynamics headquarters just outside the city where he and his just outside the city where he and his just outside the city where he and his team were teaching Atlas skills needed team were teaching Atlas skills needed team were teaching Atlas skills needed to work at Hyundai. And Atlas with its to work at Hyundai. And Atlas with its to work at Hyundai. And Atlas with its AI brain was gaining knowledge through AI brain was gaining knowledge through AI brain was gaining knowledge through experience. In other words, it seemed to experience. In other words, it seemed to experience. In other words, it seemed to be learning. be learning. be learning. >> You know how crazy that sounds? >> You know how crazy that sounds? >> You know how crazy that sounds? >> Yeah, a little bit. I And I I think a >> Yeah, a little bit. I And I I think a >> Yeah, a little bit. I And I I think a lot of our roboticists would have lot of our roboticists would have lot of our roboticists would have thought that was pretty crazy 5, six thought that was pretty crazy 5, six thought that was pretty crazy 5, six years ago. years ago. years ago. >> When 60 Minutes last visited Boston >> When 60 Minutes last visited Boston >> When 60 Minutes last visited Boston Dynamics in 2021, Atlas was a bulky Dynamics in 2021, Atlas was a bulky Dynamics in 2021, Atlas was a bulky hydraulic robot that could run and jump.

hydraulic robot that could run and jump. hydraulic robot that could run and jump. Back then, Atlas relied on algorithms Back then, Atlas relied on algorithms Back then, Atlas relied on algorithms written by engineers. written by engineers. written by engineers. When we dropped in again this past fall, When we dropped in again this past fall, When we dropped in again this past fall, we saw a new generation Atlas with a we saw a new generation Atlas with a we saw a new generation Atlas with a sleek all electric body and an AI brain sleek all electric body and an AI brain sleek all electric body and an AI brain powered by Nvidia's advanced microchips, powered by Nvidia's advanced microchips, powered by Nvidia's advanced microchips, making Atlas smart enough to pull off making Atlas smart enough to pull off making Atlas smart enough to pull off hard to believe feats autonomously. hard to believe feats autonomously. hard to believe feats autonomously. We saw Atlas skip and run with ease. Do We saw Atlas skip and run with ease. Do We saw Atlas skip and run with ease. Do you ever stop thinking, gee whiz? you ever stop thinking, gee whiz? you ever stop thinking, gee whiz? >> I remain extremely excited about where >> I remain extremely excited about where >> I remain extremely excited about where we are in the history of robotics, but we are in the history of robotics, but we are in the history of robotics, but we see that there's so much more that we we see that there's so much more that we we see that there's so much more that we can do as well. can do as well. can do as well. >> Scott Kindersmo was head of robotics >> Scott Kindersmo was head of robotics >> Scott Kindersmo was head of robotics research, a job he proudly wore on his research, a job he proudly wore on his research, a job he proudly wore on his sleeve. You even have on a robot shirt. sleeve. You even have on a robot shirt. sleeve. You even have on a robot shirt. >> Well, once I saw that this shirt >> Well, once I saw that this shirt >> Well, once I saw that this shirt existed, there was no way I wasn't existed, there was no way I wasn't existed, there was no way I wasn't buying it. buying it. buying it. He told us robots today have learned to He told us robots today have learned to He told us robots today have learned to master moves that until recently were master moves that until recently were master moves that until recently were considered a step too far for a machine.

considered a step too far for a machine. considered a step too far for a machine. And a lot of this has to do with how And a lot of this has to do with how And a lot of this has to do with how we're going about programming these we're going about programming these we're going about programming these robots now where it's more about robots now where it's more about robots now where it's more about teaching and demonstrations and machine teaching and demonstrations and machine teaching and demonstrations and machine learning than manual programming. learning than manual programming. learning than manual programming. >> So this >> So this >> So this humanoid, this mechanical human can humanoid, this mechanical human can humanoid, this mechanical human can actually learn. actually learn. actually learn. >> Yes. and and we found that that's >> Yes. and and we found that that's >> Yes. and and we found that that's actually one of the most effective way actually one of the most effective way actually one of the most effective way to program robots like that. to program robots like that. to program robots like that. >> Atlas learns in different ways. In >> Atlas learns in different ways. In >> Atlas learns in different ways. In supervised learning, machine learning supervised learning, machine learning supervised learning, machine learning scientist Kevin Bergamman, wearing a scientist Kevin Bergamman, wearing a scientist Kevin Bergamman, wearing a virtual reality headset, takes direct virtual reality headset, takes direct virtual reality headset, takes direct control of the humanoid, guiding its control of the humanoid, guiding its control of the humanoid, guiding its hands and arms, move by move, through hands and arms, move by move, through hands and arms, move by move, through each task until Atlas gets it. And if each task until Atlas gets it. And if each task until Atlas gets it. And if that teley operator can perform the task that teley operator can perform the task that teley operator can perform the task that we want the robot to do and do it that we want the robot to do and do it that we want the robot to do and do it multiple times and that generates data multiple times and that generates data multiple times and that generates data that we can use to train the robot's AI that we can use to train the robot's AI that we can use to train the robot's AI models to then later do that task models to then later do that task models to then later do that task autonomously. autonomously. autonomously. >> Kindersma used me to demonstrate another >> Kindersma used me to demonstrate another >> Kindersma used me to demonstrate another way Atlas learns.

way Atlas learns. way Atlas learns. >> That very stylish suit that you're >> That very stylish suit that you're >> That very stylish suit that you're wearing is actually going to capture all wearing is actually going to capture all wearing is actually going to capture all of your body motion to train Atlas to of your body motion to train Atlas to of your body motion to train Atlas to try to mimic exactly your motions. And try to mimic exactly your motions. And try to mimic exactly your motions. And so you're about to become a 200lb metal so you're about to become a 200lb metal so you're about to become a 200lb metal robot. robot. robot. The calibration process is now complete. The calibration process is now complete. The calibration process is now complete. >> He asked me to pick an exercise. They >> He asked me to pick an exercise. They >> He asked me to pick an exercise. They captured the way I work as well. captured the way I work as well. captured the way I work as well. >> I am here at the AI lab at Boston >> I am here at the AI lab at Boston >> I am here at the AI lab at Boston Dynamics. All of my movements, my Dynamics. All of my movements, my Dynamics. All of my movements, my walking, my arm gestures are being walking, my arm gestures are being walking, my arm gestures are being picked up by these sensors. Then picked up by these sensors. Then picked up by these sensors. Then engineers put my data into their machine engineers put my data into their machine engineers put my data into their machine learning process. Atlas's body is learning process. Atlas's body is learning process. Atlas's body is different from mine. So, they had to different from mine. So, they had to different from mine. So, they had to teach it to match my movements teach it to match my movements teach it to match my movements virtually. More than 4,000 digital virtually. More than 4,000 digital virtually. More than 4,000 digital Atlases trained for 6 hours in Atlases trained for 6 hours in Atlases trained for 6 hours in simulation. simulation. simulation. >> And they're all trying to do jumping >> And they're all trying to do jumping >> And they're all trying to do jumping jacks just like you. And as you can see, jacks just like you. And as you can see, jacks just like you. And as you can see, they're just starting to learn. So, they're just starting to learn. So, they're just starting to learn. So, they're not very good at it. they're not very good at it. they're not very good at it. >> The simulation, he told us, added >> The simulation, he told us, added >> The simulation, he told us, added challenges for the avatars, like challenges for the avatars, like challenges for the avatars, like slippery floors, inclines, or stiff slippery floors, inclines, or stiff slippery floors, inclines, or stiff joints. and then homeed in on what works joints. and then homeed in on what works joints. and then homeed in on what works best.

best. best. >> And it can eventually get to a state >> And it can eventually get to a state >> And it can eventually get to a state where where where we have many copies of Atlas doing we have many copies of Atlas doing we have many copies of Atlas doing really good jumping jacks. really good jumping jacks. really good jumping jacks. >> They uploaded this new skill into the AI >> They uploaded this new skill into the AI >> They uploaded this new skill into the AI system that controls every Atlas robot. system that controls every Atlas robot. system that controls every Atlas robot. Once one is trained, they're all Once one is trained, they're all Once one is trained, they're all trained. >> So that's what you look like when you're >> So that's what you look like when you're exercising. exercising. exercising. >> Uhhuh. >> Uhhuh. >> Uhhuh. >> And what I look like doing my job. I am >> And what I look like doing my job. I am >> And what I look like doing my job. I am here at the AI lab at Boston Dynamics. here at the AI lab at Boston Dynamics. here at the AI lab at Boston Dynamics. All of my movements, my walking, my arm All of my movements, my walking, my arm All of my movements, my walking, my arm gestures are being picked up by these gestures are being picked up by these gestures are being picked up by these sensors. This is mind-blowing. Through sensors. This is mind-blowing. Through sensors. This is mind-blowing. Through the same processes, Atlas was taught to the same processes, Atlas was taught to the same processes, Atlas was taught to crawl, do cartwheels. It didn't fare as crawl, do cartwheels. It didn't fare as crawl, do cartwheels. It didn't fare as well with the duck walk. >> Oh, that was fun. >> Oh, that was fun. >> And then this happens. >> And then this happens. >> And then this happens. >> And then this happens. We love when >> And then this happens. We love when >> And then this happens. We love when things like this happen actually because things like this happen actually because things like this happen actually because it's often an opportunity to understand it's often an opportunity to understand it's often an opportunity to understand something we didn't know about the something we didn't know about the something we didn't know about the system.

system. system. >> What are some of the limitations you see >> What are some of the limitations you see >> What are some of the limitations you see now? now? now? >> I I would say that most things that a >> I I would say that most things that a >> I I would say that most things that a person does in their daily lives, Atlas person does in their daily lives, Atlas person does in their daily lives, Atlas or other humanoids can't really do that or other humanoids can't really do that or other humanoids can't really do that yet. yet. yet. >> Like what? >> Like what? >> Like what? >> Well, just putting on clothes in the >> Well, just putting on clothes in the >> Well, just putting on clothes in the morning or pouring your cup of coffee morning or pouring your cup of coffee morning or pouring your cup of coffee and walking around the house with it. and walking around the house with it. and walking around the house with it. >> That's too difficult for for Atlas. >> That's too difficult for for Atlas. >> That's too difficult for for Atlas. Yeah, I think there are no humanoids Yeah, I think there are no humanoids Yeah, I think there are no humanoids that do that nearly as well as a person that do that nearly as well as a person that do that nearly as well as a person would do that. But I think the thing would do that. But I think the thing would do that. But I think the thing that's really exciting now is we see a that's really exciting now is we see a that's really exciting now is we see a pathway to get there. pathway to get there. pathway to get there. >> A pathway provided by AI. What stands >> A pathway provided by AI. What stands >> A pathway provided by AI. What stands out in this atlas is its brain. Nvidia out in this atlas is its brain. Nvidia out in this atlas is its brain. Nvidia chips, the ones that helped launch the chips, the ones that helped launch the chips, the ones that helped launch the AI revolution with Chat GPT, process the AI revolution with Chat GPT, process the AI revolution with Chat GPT, process the flood of collected data, moving this flood of collected data, moving this flood of collected data, moving this humanoid robot closer to something like humanoid robot closer to something like humanoid robot closer to something like common sense. So the analogy might be if common sense. So the analogy might be if common sense. So the analogy might be if I was teaching a child how to do free I was teaching a child how to do free I was teaching a child how to do free throws in basketball, if I allow them to throws in basketball, if I allow them to throws in basketball, if I allow them to just explore and come up with their own just explore and come up with their own just explore and come up with their own solutions, sometimes they can come up solutions, sometimes they can come up solutions, sometimes they can come up with a solution that I didn't with a solution that I didn't with a solution that I didn't anticipate. And that's true for these anticipate. And that's true for these anticipate. And that's true for these systems as well.

systems as well. systems as well. >> Atlas can see its surroundings and is >> Atlas can see its surroundings and is >> Atlas can see its surroundings and is figuring out how the physical world figuring out how the physical world figuring out how the physical world works. So that someday you can put a works. So that someday you can put a works. So that someday you can put a robot like this in a factory and just robot like this in a factory and just robot like this in a factory and just explain to it what would you would like explain to it what would you would like explain to it what would you would like it to do and it has enough knowledge it to do and it has enough knowledge it to do and it has enough knowledge about how the world works that it has a about how the world works that it has a about how the world works that it has a good chance of doing it. There's a lot good chance of doing it. There's a lot good chance of doing it. There's a lot of excitement in the industry right now of excitement in the industry right now of excitement in the industry right now about the potential of building robots about the potential of building robots about the potential of building robots that are smart enough to really become that are smart enough to really become that are smart enough to really become general purpose. general purpose. general purpose. >> Robert Plater then CEO of Boston >> Robert Plater then CEO of Boston >> Robert Plater then CEO of Boston Dynamics spearheaded the company's Dynamics spearheaded the company's Dynamics spearheaded the company's humanoid development. he had been humanoid development. he had been humanoid development. he had been building toward this moment for more building toward this moment for more building toward this moment for more than 30 years. The cornerstone was this than 30 years. The cornerstone was this than 30 years. The cornerstone was this robotic dog, Spot, introduced about a robotic dog, Spot, introduced about a robotic dog, Spot, introduced about a decade ago. Spots are trained in heat, decade ago. Spots are trained in heat, decade ago. Spots are trained in heat, cold, and varied terrain and roam the cold, and varied terrain and roam the cold, and varied terrain and roam the halls of Boston Dynamics. So, we have halls of Boston Dynamics. So, we have halls of Boston Dynamics. So, we have some cameras, uh, thermal sensors, some cameras, uh, thermal sensors, some cameras, uh, thermal sensors, acoustic sensors, an array of sensors on acoustic sensors, an array of sensors on acoustic sensors, an array of sensors on its back that lets it collect data about its back that lets it collect data about its back that lets it collect data about the health of a factory.

the health of a factory. the health of a factory. Spots carry out quality control checks Spots carry out quality control checks Spots carry out quality control checks at Hyundai, making sure the cars have at Hyundai, making sure the cars have at Hyundai, making sure the cars have the right parts. They conduct security the right parts. They conduct security the right parts. They conduct security and industrial inspections at hundreds and industrial inspections at hundreds and industrial inspections at hundreds of sites around the world. What began of sites around the world. What began of sites around the world. What began with Spot has evolved into Atlas. with Spot has evolved into Atlas. with Spot has evolved into Atlas. >> So, this robot is capable of superhuman >> So, this robot is capable of superhuman >> So, this robot is capable of superhuman motion and so it's going to be able to motion and so it's going to be able to motion and so it's going to be able to exceed uh what we can do. So you are exceed uh what we can do. So you are exceed uh what we can do. So you are creating a robot that is meant to exceed creating a robot that is meant to exceed creating a robot that is meant to exceed the capabilities of humans. the capabilities of humans. the capabilities of humans. >> Why not, right? We we would like things >> Why not, right? We we would like things >> Why not, right? We we would like things that could be stronger than us or that could be stronger than us or that could be stronger than us or tolerate more heat than us or definitely tolerate more heat than us or definitely tolerate more heat than us or definitely go into a dangerous place where we go into a dangerous place where we go into a dangerous place where we shouldn't be going. So you really want shouldn't be going. So you really want shouldn't be going. So you really want superhuman capabilities. superhuman capabilities. superhuman capabilities. >> To a lot of people that sounds scary. >> To a lot of people that sounds scary. >> To a lot of people that sounds scary. You don't foresee a world of You don't foresee a world of You don't foresee a world of terminators. terminators. terminators. >> Absolutely not. I think if you saw how >> Absolutely not. I think if you saw how >> Absolutely not. I think if you saw how hard we have to work to get the robots hard we have to work to get the robots hard we have to work to get the robots to just do some of the straightforward to just do some of the straightforward to just do some of the straightforward tasks we want them to do, that would tasks we want them to do, that would tasks we want them to do, that would dispel that that worry about sentience dispel that that worry about sentience dispel that that worry about sentience and rogue robots. We wondered if people and rogue robots. We wondered if people and rogue robots. We wondered if people might have more immediate concerns. We might have more immediate concerns. We might have more immediate concerns. We saw workers doing a job at the Hyundai saw workers doing a job at the Hyundai saw workers doing a job at the Hyundai plant that Atlas is being trained to plant that Atlas is being trained to plant that Atlas is being trained to perform.

perform. perform. I guarantee you there are going to be I guarantee you there are going to be I guarantee you there are going to be people who will say I'm going to lose my people who will say I'm going to lose my people who will say I'm going to lose my job to a robot. Work does change. So the job to a robot. Work does change. So the job to a robot. Work does change. So the really repetitive, really backbreaking really repetitive, really backbreaking really repetitive, really backbreaking labor is really is going to end up being labor is really is going to end up being labor is really is going to end up being done by robots, but these robots are not done by robots, but these robots are not done by robots, but these robots are not so autonomous that they don't need to be so autonomous that they don't need to be so autonomous that they don't need to be managed. They need to be built. They managed. They need to be built. They managed. They need to be built. They need to be trained. They need to be need to be trained. They need to be need to be trained. They need to be serviced. serviced. serviced. Plater told us it could be several years Plater told us it could be several years Plater told us it could be several years before Atlas joins the Hyundai workforce before Atlas joins the Hyundai workforce before Atlas joins the Hyundai workforce full-time. Goldman Sachs predicts the full-time. Goldman Sachs predicts the full-time. Goldman Sachs predicts the market for humanoids will reach $ 38 market for humanoids will reach $ 38 market for humanoids will reach $ 38 billion within the decade. Boston billion within the decade. Boston billion within the decade. Boston Dynamics and other US robot makers are Dynamics and other US robot makers are Dynamics and other US robot makers are fighting to come out on top. But they're fighting to come out on top. But they're fighting to come out on top. But they're not the only ones in the ring. Chinese not the only ones in the ring. Chinese not the only ones in the ring. Chinese companies are proving to be formidable companies are proving to be formidable companies are proving to be formidable challengers. They are running to win. challengers. They are running to win. challengers. They are running to win. Are they outpacing us? The Chinese Are they outpacing us? The Chinese Are they outpacing us? The Chinese government has a mission to win the government has a mission to win the government has a mission to win the robotics race. Technically, I believe we robotics race. Technically, I believe we robotics race. Technically, I believe we remain uh in the lead, but there's a remain uh in the lead, but there's a remain uh in the lead, but there's a real threat there that simply through real threat there that simply through real threat there that simply through the scale of investment uh we could fall the scale of investment uh we could fall the scale of investment uh we could fall behind.

behind. behind. >> To stay ahead, Hyundai made that big >> To stay ahead, Hyundai made that big >> To stay ahead, Hyundai made that big investment in Boston Dynamics. investment in Boston Dynamics. investment in Boston Dynamics. >> Four robots. We were at the Georgia >> Four robots. We were at the Georgia >> Four robots. We were at the Georgia plant when Atlas engineer Zack Jakowski plant when Atlas engineer Zack Jakowski plant when Atlas engineer Zack Jakowski presented Atlas to Hungu Kim, Hyundai's presented Atlas to Hungu Kim, Hyundai's presented Atlas to Hungu Kim, Hyundai's head of global strategy. He came all the head of global strategy. He came all the head of global strategy. He came all the way from South Korea to check in on the way from South Korea to check in on the way from South Korea to check in on the brave new world the car maker is brave new world the car maker is brave new world the car maker is funding. funding. funding. >> What do you think of the progress that >> What do you think of the progress that >> What do you think of the progress that they've made with Atlas? they've made with Atlas? they've made with Atlas? >> I think we are on track uh uh about the >> I think we are on track uh uh about the >> I think we are on track uh uh about the development. Atlas so far is very development. Atlas so far is very development. Atlas so far is very successful. It's a kind of a start of a successful. It's a kind of a start of a successful. It's a kind of a start of a great journey. great journey. great journey. >> The destination, that humanoid future we >> The destination, that humanoid future we >> The destination, that humanoid future we mentioned at the start. Robots like us mentioned at the start. Robots like us mentioned at the start. Robots like us working beside us, walking among us. working beside us, walking among us. working beside us, walking among us. It's enough to make your head spin. It's enough to make your head spin. It's enough to make your head spin. Since our story first aired, Boston Since our story first aired, Boston Since our story first aired, Boston Dynamics unveiled an upgrade, an Atlas Dynamics unveiled an upgrade, an Atlas Dynamics unveiled an upgrade, an Atlas that's taller and stronger than the that's taller and stronger than the that's taller and stronger than the version we saw. The new Atlas will begin version we saw. The new Atlas will begin version we saw. The new Atlas will begin training at Hyundai's Georgia factory training at Hyundai's Georgia factory training at Hyundai's Georgia factory this summer.

On ancient roads and in medieval On ancient roads and in medieval alleyways in London, a very modern alleyways in London, a very modern alleyways in London, a very modern battle is brewing. Black cabs, which are battle is brewing. Black cabs, which are battle is brewing. Black cabs, which are as synonymous with that city as as synonymous with that city as as synonymous with that city as Buckingham Palace, will soon be Buckingham Palace, will soon be Buckingham Palace, will soon be competing with artificial intelligence competing with artificial intelligence competing with artificial intelligence powered autonomous taxis. Tech companies powered autonomous taxis. Tech companies powered autonomous taxis. Tech companies promise these AI inventions, some of promise these AI inventions, some of promise these AI inventions, some of which are already operating in several which are already operating in several which are already operating in several American cities, are safer and smarter American cities, are safer and smarter American cities, are safer and smarter than human drivers. But as we first told than human drivers. But as we first told than human drivers. But as we first told you earlier this year, London's cabbies you earlier this year, London's cabbies you earlier this year, London's cabbies aren't about to hand over their keys. aren't about to hand over their keys. aren't about to hand over their keys. After all, just to get a license, After all, just to get a license, After all, just to get a license, they've already proven their own kind of they've already proven their own kind of they've already proven their own kind of intelligence, studying, often for years intelligence, studying, often for years intelligence, studying, often for years to pass a 161-year-old test called the to pass a 161-year-old test called the to pass a 161-year-old test called the knowledge. There's nothing artificial knowledge. There's nothing artificial knowledge. There's nothing artificial about it. They just have to memorize about it. They just have to memorize about it. They just have to memorize 25,000 streets and thousands of 25,000 streets and thousands of 25,000 streets and thousands of landmarks and businesses and know the landmarks and businesses and know the landmarks and businesses and know the shortest routes between them all. >> Look, we're the oldest form of transport >> Look, we're the oldest form of transport in the world. In fact, we come before in the world. In fact, we come before in the world. In fact, we come before buses and trains and stuff. Yeah, we are buses and trains and stuff. Yeah, we are buses and trains and stuff. Yeah, we are the icons of London. If we do a left the icons of London. If we do a left the icons of London. If we do a left here, you'll have the Goldsmith's Hall.

here, you'll have the Goldsmith's Hall. here, you'll have the Goldsmith's Hall. Tom Skolian has been driving one of Tom Skolian has been driving one of Tom Skolian has been driving one of London's famous black cabs for the past London's famous black cabs for the past London's famous black cabs for the past 34 years. 34 years. 34 years. >> What's the weirdest request you've >> What's the weirdest request you've >> What's the weirdest request you've gotten from a passenger? gotten from a passenger? gotten from a passenger? >> Uh what this week or you wouldn't >> Uh what this week or you wouldn't >> Uh what this week or you wouldn't believe. There's a guy. It's a regular believe. There's a guy. It's a regular believe. There's a guy. It's a regular ride and he's got an Irish wolf hand. ride and he's got an Irish wolf hand. ride and he's got an Irish wolf hand. Dog gives you a bit of paper where the Dog gives you a bit of paper where the Dog gives you a bit of paper where the dog lives. Dog jumps in the back. One of dog lives. Dog jumps in the back. One of dog lives. Dog jumps in the back. One of the best customers I've got. Never says the best customers I've got. Never says the best customers I've got. Never says a word. Never complains about the ride. a word. Never complains about the ride. a word. Never complains about the ride. Uh but we get people Uh but we get people Uh but we get people uh hailing day in the morning. take my uh hailing day in the morning. take my uh hailing day in the morning. take my kid to school. Never seen me before in kid to school. Never seen me before in kid to school. Never seen me before in my life. Probably never see me again. my life. Probably never see me again. my life. Probably never see me again. That's the trust we get. That's the trust we get. That's the trust we get. >> The trust and confidence in cababies >> The trust and confidence in cababies >> The trust and confidence in cababies here dates back to 1865 when the here dates back to 1865 when the here dates back to 1865 when the knowledge exam was first introduced to knowledge exam was first introduced to knowledge exam was first introduced to London's horsedrawn cabin. Do you have London's horsedrawn cabin. Do you have London's horsedrawn cabin. Do you have riders testing your knowledge? riders testing your knowledge? riders testing your knowledge? >> Every ride. Which way you going, mate? >> Every ride. Which way you going, mate? >> Every ride. Which way you going, mate? And Google says this and Google says And Google says this and Google says And Google says this and Google says that. that. that. >> You're never going to beat the >> You're never going to beat the >> You're never going to beat the knowledge. knowledge. knowledge. >> Your knowledge is better than what a >> Your knowledge is better than what a >> Your knowledge is better than what a Google map will tell you to go. God, Google map will tell you to go. God, Google map will tell you to go. God, don't make me laugh. Seriously, you don't make me laugh. Seriously, you don't make me laugh. Seriously, you know, it's like comparing a a hot dog know, it's like comparing a a hot dog know, it's like comparing a a hot dog vendor to a Gordon Ramsay.

vendor to a Gordon Ramsay. vendor to a Gordon Ramsay. >> At the Transport for London office, >> At the Transport for London office, >> At the Transport for London office, nervous aspiring cabbies dress up in nervous aspiring cabbies dress up in nervous aspiring cabbies dress up in their Sunday best to take a series of their Sunday best to take a series of their Sunday best to take a series of oral exams known as appearances. oral exams known as appearances. oral exams known as appearances. >> Whenever you're ready, sir. We'll go >> Whenever you're ready, sir. We'll go >> Whenever you're ready, sir. We'll go from Soho House, 40 Greek Street to the from Soho House, 40 Greek Street to the from Soho House, 40 Greek Street to the Chantry Rosewood, please. Chantry Rosewood, please. Chantry Rosewood, please. >> Candidates are quizzed on how to get >> Candidates are quizzed on how to get >> Candidates are quizzed on how to get between two random points. uh live on between two random points. uh live on between two random points. uh live on left Greek Street, right Shbury Avenue, left Greek Street, right Shbury Avenue, left Greek Street, right Shbury Avenue, left Great Will Street, forward Hay left Great Will Street, forward Hay left Great Will Street, forward Hay Market. Market. Market. >> As examiners measure the distance, >> As examiners measure the distance, >> As examiners measure the distance, ensuring they're calling the shortest ensuring they're calling the shortest ensuring they're calling the shortest route. route. route. >> Unfortunately, sir, I can't score you >> Unfortunately, sir, I can't score you >> Unfortunately, sir, I can't score you today. today. today. >> He failed this round. But for those who >> He failed this round. But for those who >> He failed this round. But for those who do pass the knowledge, this memorization do pass the knowledge, this memorization do pass the knowledge, this memorization has proven to be so challenging it can has proven to be so challenging it can has proven to be so challenging it can change the structure of their brains. A change the structure of their brains. A change the structure of their brains. A study from University College London study from University College London study from University College London found cab drivers posterior hippocampi, found cab drivers posterior hippocampi, found cab drivers posterior hippocampi, the part of the brain linked to memory, the part of the brain linked to memory, the part of the brain linked to memory, got bigger throughout their careers. got bigger throughout their careers. got bigger throughout their careers. >> Everyone in their profession has had to >> Everyone in their profession has had to >> Everyone in their profession has had to train theirself with knowledge to be the train theirself with knowledge to be the train theirself with knowledge to be the best what they are. And that's what best what they are. And that's what best what they are. And that's what we're doing. we're doing. we're doing. >> Steven Fairbrass has been trying to pass >> Steven Fairbrass has been trying to pass >> Steven Fairbrass has been trying to pass the knowledge for eight years. Anu the knowledge for eight years. Anu the knowledge for eight years. Anu Morani for five. They showed us the Morani for five. They showed us the Morani for five. They showed us the official study guide known as the blue official study guide known as the blue official study guide known as the blue book. And these are like the points book. And these are like the points book. And these are like the points points of interest that any paying points of interest that any paying points of interest that any paying customer customer customer >> Uhhuh.

>> Uhhuh. >> Uhhuh. >> would want you to take them to. >> would want you to take them to. >> would want you to take them to. >> I mean, there's thousands. >> I mean, there's thousands. >> I mean, there's thousands. >> Thousands of them. >> Thousands of them. >> Thousands of them. >> Yeah. 6,000 of them. >> Yeah. 6,000 of them. >> Yeah. 6,000 of them. >> I just got to look at this. The Last >> I just got to look at this. The Last >> I just got to look at this. The Last Judgment PH, the Law Society Hall, the Judgment PH, the Law Society Hall, the Judgment PH, the Law Society Hall, the Londoner Hotel, the Marquee, the Mon Londoner Hotel, the Marquee, the Mon Londoner Hotel, the Marquee, the Mon Library, the National Gallery, the I Library, the National Gallery, the I Library, the National Gallery, the I mean, this is crazy that you have to mean, this is crazy that you have to mean, this is crazy that you have to know all this. You have to learn know all this. You have to learn know all this. You have to learn individual restaurants. individual restaurants. individual restaurants. >> Individual restaurants, >> Individual restaurants, >> Individual restaurants, >> public houses. >> public houses. >> public houses. >> What if a restaurant goes out of >> What if a restaurant goes out of >> What if a restaurant goes out of business? business? business? >> Then he changes names and then you learn >> Then he changes names and then you learn >> Then he changes names and then you learn a new name. a new name. a new name. >> Then it comes on the list. >> Then it comes on the list. >> Then it comes on the list. It goes on the list. It goes on the list. It goes on the list. >> It goes on the list. >> It goes on the list. >> It goes on the list. >> Now, their knowledge is being tested >> Now, their knowledge is being tested >> Now, their knowledge is being tested like never before. like never before. like never before. >> Autonomous vehicles haven't been >> Autonomous vehicles haven't been >> Autonomous vehicles haven't been approved to pick up passengers in London approved to pick up passengers in London approved to pick up passengers in London yet, but several companies are already yet, but several companies are already yet, but several companies are already trying out their cars here. Wave, a trying out their cars here. Wave, a trying out their cars here. Wave, a British startup backed by Nvidia and British startup backed by Nvidia and British startup backed by Nvidia and Microsoft, hopes to be operational later Microsoft, hopes to be operational later Microsoft, hopes to be operational later this year, as does Whimo, which is owned this year, as does Whimo, which is owned this year, as does Whimo, which is owned by Google's parent company, Alphabet. by Google's parent company, Alphabet. by Google's parent company, Alphabet. Teahedra Maakana is Whimo's co-CEO. She Teahedra Maakana is Whimo's co-CEO. She Teahedra Maakana is Whimo's co-CEO. She says putting more of its robo taxis on says putting more of its robo taxis on says putting more of its robo taxis on the roads can save lives by reducing the the roads can save lives by reducing the the roads can save lives by reducing the million traffic deaths worldwide each million traffic deaths worldwide each million traffic deaths worldwide each year. You believe driverless cars are year. You believe driverless cars are year. You believe driverless cars are safer than a human driven vehicle.

safer than a human driven vehicle. safer than a human driven vehicle. >> In the case of Whimo, we actually have >> In the case of Whimo, we actually have >> In the case of Whimo, we actually have the data that shows us that we're five the data that shows us that we're five the data that shows us that we're five times safer than a human driver. times safer than a human driver. times safer than a human driver. >> Whimo has already made significant >> Whimo has already made significant >> Whimo has already made significant inroads in the US. It first began inroads in the US. It first began inroads in the US. It first began offering rides to customers in a Phoenix offering rides to customers in a Phoenix offering rides to customers in a Phoenix suburb in 2020. Now, millions of riders suburb in 2020. Now, millions of riders suburb in 2020. Now, millions of riders across 11 major US cities are being across 11 major US cities are being across 11 major US cities are being driven by Whimos each month. driven by Whimos each month. driven by Whimos each month. >> Humans want to get in the car, send that >> Humans want to get in the car, send that >> Humans want to get in the car, send that last email they didn't get to send and last email they didn't get to send and last email they didn't get to send and check on the kid that's screaming, but check on the kid that's screaming, but check on the kid that's screaming, but we're trying to drive and do that. So, we're trying to drive and do that. So, we're trying to drive and do that. So, this really gives you the chance to take this really gives you the chance to take this really gives you the chance to take care of all of those things and then let care of all of those things and then let care of all of those things and then let the Whimo driver safely get you to from the Whimo driver safely get you to from the Whimo driver safely get you to from point A to point B. point A to point B. point A to point B. >> You call it a Whimo driver, but there's >> You call it a Whimo driver, but there's >> You call it a Whimo driver, but there's no driver. We really think it's no driver. We really think it's no driver. We really think it's important to think of it as there is a important to think of it as there is a important to think of it as there is a driver, right? This driver is the most driver, right? This driver is the most driver, right? This driver is the most experienced driver in the world. We experienced driver in the world. We experienced driver in the world. We travel over 2 million miles a week. So, travel over 2 million miles a week. So, travel over 2 million miles a week. So, humans drive about 700,000 miles in a humans drive about 700,000 miles in a humans drive about 700,000 miles in a lifetime. So, this is almost three lifetime. So, this is almost three lifetime. So, this is almost three lifetimes per week that our fleet is lifetimes per week that our fleet is lifetimes per week that our fleet is driving driving driving >> because it's been trained on every other >> because it's been trained on every other >> because it's been trained on every other ride that Whimo's given.

ride that Whimo's given. ride that Whimo's given. >> The whole fleet. Yes. Whimo's AI has >> The whole fleet. Yes. Whimo's AI has >> The whole fleet. Yes. Whimo's AI has also driven billions of miles in also driven billions of miles in also driven billions of miles in simulation to train for the countless simulation to train for the countless simulation to train for the countless rare scenarios it might face on roads rare scenarios it might face on roads rare scenarios it might face on roads like snow on the Golden Gate Bridge or like snow on the Golden Gate Bridge or like snow on the Golden Gate Bridge or even an elephant stopping traffic. even an elephant stopping traffic. even an elephant stopping traffic. >> Start ride whenever you're ready. >> Start ride whenever you're ready. >> Start ride whenever you're ready. >> In San Francisco, we took a trip in one >> In San Francisco, we took a trip in one >> In San Francisco, we took a trip in one of its robo taxis with product manager of its robo taxis with product manager of its robo taxis with product manager Chris Lewick. Chris Lewick. Chris Lewick. >> Happy Friday. >> Happy Friday. >> Happy Friday. >> It's a little freaky not to have a >> It's a little freaky not to have a >> It's a little freaky not to have a driver. You hear this all the time, but driver. You hear this all the time, but driver. You hear this all the time, but like I'm watching the wheel very, very like I'm watching the wheel very, very like I'm watching the wheel very, very carefully. carefully. carefully. >> Yep. >> Yep. >> Yep. >> But after a few minutes, the ride felt >> But after a few minutes, the ride felt >> But after a few minutes, the ride felt strangely normal. strangely normal. strangely normal. >> Feels like a very careful driver. >> Feels like a very careful driver. >> Feels like a very careful driver. >> Our goal is kind of blissfully boring. >> Our goal is kind of blissfully boring. >> Our goal is kind of blissfully boring. >> The car is outfitted with 29 cameras, >> The car is outfitted with 29 cameras, >> The car is outfitted with 29 cameras, six radars, five microphones, and five six radars, five microphones, and five six radars, five microphones, and five LAR sensors, which continuously pulse to LAR sensors, which continuously pulse to LAR sensors, which continuously pulse to measure distances, objects, and people measure distances, objects, and people measure distances, objects, and people as far as three football fields away. as far as three football fields away. as far as three football fields away. Inside a screen shows riders what the Inside a screen shows riders what the Inside a screen shows riders what the car is seeing. It sees an intersection, car is seeing. It sees an intersection, car is seeing. It sees an intersection, I don't know, 300 feet away, but because I don't know, 300 feet away, but because I don't know, 300 feet away, but because there's other cars, I can't see it, but there's other cars, I can't see it, but there's other cars, I can't see it, but it sees around these other cars.

it sees around these other cars. it sees around these other cars. >> That's right. And that's partly the >> That's right. And that's partly the >> That's right. And that's partly the design of the placement of the sensors design of the placement of the sensors design of the placement of the sensors makes it super human compared to what a makes it super human compared to what a makes it super human compared to what a human would be able to do. human would be able to do. human would be able to do. >> Whimo says the data gathered from these >> Whimo says the data gathered from these >> Whimo says the data gathered from these sensors enables the AI to respond faster sensors enables the AI to respond faster sensors enables the AI to respond faster than a human. We saw that when a woman than a human. We saw that when a woman than a human. We saw that when a woman talking on her phone crossed right in talking on her phone crossed right in talking on her phone crossed right in front of us. front of us. front of us. It's kind of crazy to see a person It's kind of crazy to see a person It's kind of crazy to see a person change their mind and how quickly the change their mind and how quickly the change their mind and how quickly the Whimo responded to like a slight motion Whimo responded to like a slight motion Whimo responded to like a slight motion of them moving forward. of them moving forward. of them moving forward. >> Exactly. System has learned to react to >> Exactly. System has learned to react to >> Exactly. System has learned to react to those subtle cues cuz that's what's those subtle cues cuz that's what's those subtle cues cuz that's what's necessary. necessary. necessary. >> Whimo's AI may have a lot of training, >> Whimo's AI may have a lot of training, >> Whimo's AI may have a lot of training, but it still makes some rookie mistakes. but it still makes some rookie mistakes. but it still makes some rookie mistakes. >> Oh my god, what the is that Whimo doing? >> Oh my god, what the is that Whimo doing? >> Oh my god, what the is that Whimo doing? >> In Los Angeles, a Whimo drove through an >> In Los Angeles, a Whimo drove through an >> In Los Angeles, a Whimo drove through an active police scene. active police scene. active police scene. >> Whimo, come on. There's also been >> Whimo, come on. There's also been >> Whimo, come on. There's also been incidents of the robo taxis getting in incidents of the robo taxis getting in incidents of the robo taxis getting in the way of emergency responders and the way of emergency responders and the way of emergency responders and illegally passing stop school buses, illegally passing stop school buses, illegally passing stop school buses, leading to a software recall and a leading to a software recall and a leading to a software recall and a federal investigation. federal investigation. federal investigation. Back in London, Whimo's robo taxis have Back in London, Whimo's robo taxis have Back in London, Whimo's robo taxis have been driving the streets to build a been driving the streets to build a been driving the streets to build a detailed 3D map to train its AI, a detailed 3D map to train its AI, a detailed 3D map to train its AI, a company standard before operating in a company standard before operating in a company standard before operating in a new area. But it does have competition.

new area. But it does have competition. new area. But it does have competition. >> We want to make sure our AI can >> We want to make sure our AI can >> We want to make sure our AI can understand every concept it might understand every concept it might understand every concept it might encounter. Alex Kendall is Waves CEO. encounter. Alex Kendall is Waves CEO. encounter. Alex Kendall is Waves CEO. Unlike Whimo, his artificial Unlike Whimo, his artificial Unlike Whimo, his artificial intelligence doesn't map out a city intelligence doesn't map out a city intelligence doesn't map out a city before driving in it. before driving in it. before driving in it. >> How is it possible you don't need to map >> How is it possible you don't need to map >> How is it possible you don't need to map a city entirely before getting your a city entirely before getting your a city entirely before getting your vehicles to drive autonomously in it? vehicles to drive autonomously in it? vehicles to drive autonomously in it? >> Well, think about how uh you and I >> Well, think about how uh you and I >> Well, think about how uh you and I learned how to drive. I learned how to learned how to drive. I learned how to learned how to drive. I learned how to go through a few traffic lights and that go through a few traffic lights and that go through a few traffic lights and that taught me how the concept of traffic taught me how the concept of traffic taught me how the concept of traffic lights works in a similar way. That's lights works in a similar way. That's lights works in a similar way. That's how our AI learns. We train it on how our AI learns. We train it on how our AI learns. We train it on millions of hours of experience driving millions of hours of experience driving millions of hours of experience driving all around the world. So this means when all around the world. So this means when all around the world. So this means when it goes somewhere it's never seen before it goes somewhere it's never seen before it goes somewhere it's never seen before or it's never been mapped. Uh it can or it's never been mapped. Uh it can or it's never been mapped. Uh it can understand what's in front of it and understand what's in front of it and understand what's in front of it and make decisions in real time. make decisions in real time. make decisions in real time. >> Waves robo taxis are still in testing >> Waves robo taxis are still in testing >> Waves robo taxis are still in testing and not yet available to the public. and not yet available to the public. and not yet available to the public. >> The products that we're building will >> The products that we're building will >> The products that we're building will use inbuilt sensors. use inbuilt sensors. use inbuilt sensors. >> But Kendall believes his AI will be able >> But Kendall believes his AI will be able >> But Kendall believes his AI will be able to more easily adapt to new to more easily adapt to new to more easily adapt to new environments. environments. environments. >> Let's go for a drive. >> Let's go for a drive. >> Let's go for a drive. >> Okay. He took us to Westminster, a >> Okay. He took us to Westminster, a >> Okay. He took us to Westminster, a district in London that's home to some district in London that's home to some district in London that's home to some of the city's most historic landmarks to of the city's most historic landmarks to of the city's most historic landmarks to show us where he's been training his show us where he's been training his show us where he's been training his fleet since Waves early days in 2019.

fleet since Waves early days in 2019. fleet since Waves early days in 2019. >> And your foot is not You're not >> And your foot is not You're not >> And your foot is not You're not >> So, I'm not touching the controls. Uh >> So, I'm not touching the controls. Uh >> So, I'm not touching the controls. Uh the AI is controlling the steering, the the AI is controlling the steering, the the AI is controlling the steering, the speed, the indicators, the brake. speed, the indicators, the brake. speed, the indicators, the brake. >> Until robo taxis are approved by the >> Until robo taxis are approved by the >> Until robo taxis are approved by the government here. A human has to sit in government here. A human has to sit in government here. A human has to sit in the driver's seat for safety. the driver's seat for safety. the driver's seat for safety. >> Here's one of the busier roundabouts in >> Here's one of the busier roundabouts in >> Here's one of the busier roundabouts in front of Westminster. Um, right in front front of Westminster. Um, right in front front of Westminster. Um, right in front of Parliament. Lots of tourists around. Different Lots of tourists around. Different vehicles. vehicles. vehicles. >> This guy just crossed into our lane. >> This guy just crossed into our lane. >> This guy just crossed into our lane. >> Now back to another lane. >> Now back to another lane. >> Now back to another lane. >> There's a bike that we're going to have >> There's a bike that we're going to have >> There's a bike that we're going to have to wait for before making the lane to wait for before making the lane to wait for before making the lane change. change. change. >> There's just such a long list of things >> There's just such a long list of things >> There's just such a long list of things that can happen on the road. Mhm. that can happen on the road. Mhm. that can happen on the road. Mhm. >> I think that's the main advantage of an >> I think that's the main advantage of an >> I think that's the main advantage of an AI driver here is that it can have the AI driver here is that it can have the AI driver here is that it can have the intelligence to deal with things that intelligence to deal with things that intelligence to deal with things that you may never expect on the roads. you may never expect on the roads. you may never expect on the roads. >> I'll go lead by Palmer left into road. >> I'll go lead by Palmer left into road. >> I'll go lead by Palmer left into road. >> Aspiring cabbie Steven Fairbrass didn't >> Aspiring cabbie Steven Fairbrass didn't >> Aspiring cabbie Steven Fairbrass didn't seem too concerned about that. seem too concerned about that. seem too concerned about that. >> Do you worry about the future of this? >> Do you worry about the future of this? >> Do you worry about the future of this? You know, autonomous vehicles driving You know, autonomous vehicles driving You know, autonomous vehicles driving around.

around. around. >> No. >> No. >> No. >> Why don't you worry? >> Why don't you worry? >> Why don't you worry? >> To me, the human brain will always be >> To me, the human brain will always be >> To me, the human brain will always be the strongest tool. the strongest tool. the strongest tool. >> Mhm. Can you imagine you're trying to >> Mhm. Can you imagine you're trying to >> Mhm. Can you imagine you're trying to howl down a vehicle with no driver in howl down a vehicle with no driver in howl down a vehicle with no driver in it? You're standing there in the rain it? You're standing there in the rain it? You're standing there in the rain trying to get home and that vehicle just trying to get home and that vehicle just trying to get home and that vehicle just drives straight past you because it drives straight past you because it drives straight past you because it hasn't got a sensor or a human brain or hasn't got a sensor or a human brain or hasn't got a sensor or a human brain or an eye to turn. So to me, human beings, an eye to turn. So to me, human beings, an eye to turn. So to me, human beings, drivers, drivers, drivers, >> always going to be needed, >> always going to be needed, >> always going to be needed, >> always. >> always. >> always. >> Anor Johnny, however, didn't seem so >> Anor Johnny, however, didn't seem so >> Anor Johnny, however, didn't seem so sure. every profession sure. every profession sure. every profession uh is being affected by AI. I don't know uh is being affected by AI. I don't know uh is being affected by AI. I don't know what it's going to do in near future but what it's going to do in near future but what it's going to do in near future but it's always there on your mind that yes it's always there on your mind that yes it's always there on your mind that yes I mean you're doing you're getting into I mean you're doing you're getting into I mean you're doing you're getting into a career not knowing what a career not knowing what a career not knowing what >> the future is >> the future is >> the future is >> the future is. >> the future is. >> the future is. >> Over the last decade London's black cab >> Over the last decade London's black cab >> Over the last decade London's black cab industry has seen a steep decline. The industry has seen a steep decline. The industry has seen a steep decline. The number of drivers has fallen from 25,000 number of drivers has fallen from 25,000 number of drivers has fallen from 25,000 to 16,000 today. So has their income as to 16,000 today. So has their income as to 16,000 today. So has their income as Uber and other ride hailing companies Uber and other ride hailing companies Uber and other ride hailing companies have been cutting into their business.

have been cutting into their business. have been cutting into their business. >> Mr. Fairbrass. >> Mr. Fairbrass. >> Mr. Fairbrass. >> Even so, hundreds still sign up for the >> Even so, hundreds still sign up for the >> Even so, hundreds still sign up for the knowledge each year. knowledge each year. knowledge each year. >> Okay, sir. Hello, sir. >> Okay, sir. Hello, sir. >> Okay, sir. Hello, sir. >> This was Steven Fairbrass's 20th >> This was Steven Fairbrass's 20th >> This was Steven Fairbrass's 20th attempt. attempt. attempt. >> We're going to go to the Riding House >> We're going to go to the Riding House >> We're going to go to the Riding House Cafe, please. Uh Riding House Cafe, sir, Cafe, please. Uh Riding House Cafe, sir, Cafe, please. Uh Riding House Cafe, sir, is on uh Great Titill Street, sir. is on uh Great Titill Street, sir. is on uh Great Titill Street, sir. >> Okay, sir. Go right into Mort Mort >> Okay, sir. Go right into Mort Mort >> Okay, sir. Go right into Mort Mort Street. Right into Nauseia Street. Left Street. Right into Nauseia Street. Left Street. Right into Nauseia Street. Left into Ryen Street. Left into into Ryen Street. Left into into Ryen Street. Left into uh Portland Place uh Portland Place uh Portland Place Street. Set down. Right. Street. Set down. Right. Street. Set down. Right. >> Okay. All right. >> Okay. All right. >> Okay. All right. >> Sorry, sir. I can't remember that other >> Sorry, sir. I can't remember that other >> Sorry, sir. I can't remember that other name of the name of the name of the >> of the Portland Police. All right. Calm >> of the Portland Police. All right. Calm >> of the Portland Police. All right. Calm down. Okay. Deep breaths. Yeah. down. Okay. Deep breaths. Yeah. down. Okay. Deep breaths. Yeah. >> Fair Brass failed this round and we'll >> Fair Brass failed this round and we'll >> Fair Brass failed this round and we'll have to try again. For Anu Morjani, this have to try again. For Anu Morjani, this have to try again. For Anu Morjani, this was his 41st try. Run me down to was his 41st try. Run me down to was his 41st try. Run me down to Ladyville station please. Ladyville station please. Ladyville station please. >> Leave by Broccley Road left Adelaide >> Leave by Broccley Road left Adelaide >> Leave by Broccley Road left Adelaide Avenue complant modly by Lady Well Road Avenue complant modly by Lady Well Road Avenue complant modly by Lady Well Road right railway terrace sedan left. right railway terrace sedan left. right railway terrace sedan left. >> Mhm. >> Mhm. >> Mhm. >> Today I'm going to score you. Okay.

>> Today I'm going to score you. Okay. >> Today I'm going to score you. Okay. >> Oh thank you sir. >> Oh thank you sir. >> Oh thank you sir. >> He passed. >> He passed. >> He passed. >> Thank you. Thank you Mr. >> Thank you. Thank you Mr. >> Thank you. Thank you Mr. >> And in May >> after 5 years of trying finally >> after 5 years of trying finally completed the knowledge. He'll now earn completed the knowledge. He'll now earn completed the knowledge. He'll now earn his license. his license. his license. There's probably some people going to be There's probably some people going to be There's probably some people going to be watching who think, you know, why spend watching who think, you know, why spend watching who think, you know, why spend years of your life studying for this years of your life studying for this years of your life studying for this exam when you could be Uber drivers much exam when you could be Uber drivers much exam when you could be Uber drivers much faster. faster. faster. >> Do you want to drive around in one of >> Do you want to drive around in one of >> Do you want to drive around in one of them famous cabs out there? them famous cabs out there? them famous cabs out there? >> Hundreds of years of world of history. >> Hundreds of years of world of history. >> Hundreds of years of world of history. >> It means a lot to people of London. It's >> It means a lot to people of London. It's >> It means a lot to people of London. It's like London without a queen. I'd say like London without a queen. I'd say like London without a queen. I'd say >> you can't have a London without a king >> you can't have a London without a king >> you can't have a London without a king or queen. You can't have London without or queen. You can't have London without or queen. You can't have London without a black cab. No. a black cab. No. a black cab. No. >> Correct. >> Correct. >> Correct. >> Impossible.