Friars turn to AI for restoration of the Basilica of Saint Francis | 60 Minutes

Saturday marked the 800th anniversary of Saturday marked the 800th anniversary of the death of one of Christianity's the death of one of Christianity's the death of one of Christianity's superstars, St. Francis of Aisi. Every superstars, St. Francis of Aisi. Every superstars, St. Francis of Aisi. Every year, millions of visitors flock to the year, millions of visitors flock to the year, millions of visitors flock to the Basilica in Aisi to celebrate the Basilica in Aisi to celebrate the Basilica in Aisi to celebrate the miracles attributed to one of Italy's miracles attributed to one of Italy's miracles attributed to one of Italy's patron saints. That the church is still patron saints. That the church is still patron saints. That the church is still standing is a miracle itself. It has standing is a miracle itself. It has standing is a miracle itself. It has survived war, fire, and flood, but survived war, fire, and flood, but survived war, fire, and flood, but nothing left more devastation than a nothing left more devastation than a nothing left more devastation than a pair of powerful earthquakes that struck pair of powerful earthquakes that struck pair of powerful earthquakes that struck in 1997, cratering the roof and leaving in 1997, cratering the roof and leaving in 1997, cratering the roof and leaving countless art treasures permanently countless art treasures permanently countless art treasures permanently damaged. Now, a team of art historians damaged. Now, a team of art historians damaged. Now, a team of art historians and software engineers have joined and software engineers have joined and software engineers have joined forces with the Franciscan friars to try forces with the Franciscan friars to try forces with the Franciscan friars to try to finish the restoration. This time to finish the restoration. This time to finish the restoration. This time with the help of digital wizardry and with the help of digital wizardry and with the help of digital wizardry and artificial intelligence. We had to find artificial intelligence. We had to find artificial intelligence. We had to find out more. Seven centuries ago, the friars knew a Seven centuries ago, the friars knew a good location when they saw it. What was good location when they saw it. What was good location when they saw it. What was once a barren hill in Umbria, where once a barren hill in Umbria, where once a barren hill in Umbria, where criminals swung from gallows, was criminals swung from gallows, was criminals swung from gallows, was transformed into this.

The Basilica of St. Francis of Aisi, the The Basilica of St. Francis of Aisi, the magnificent resting place of one of magnificent resting place of one of magnificent resting place of one of Christianity's most beloved saints. Sometimes called the original hippie, Sometimes called the original hippie, Francis rejected his family's wealth for Francis rejected his family's wealth for Francis rejected his family's wealth for a life of poverty. a life of poverty. a life of poverty. Medieval masters couldn't resist the Medieval masters couldn't resist the Medieval masters couldn't resist the story of the radical monk and lined up story of the radical monk and lined up story of the radical monk and lined up to paint it. But in 1997, to paint it. But in 1997, to paint it. But in 1997, the great church almost came crashing the great church almost came crashing the great church almost came crashing down. down. down. Two quakes hit one after another. A section of the soaring roof collapsed. A section of the soaring roof collapsed. A thick mushroom cloud filled with the A thick mushroom cloud filled with the A thick mushroom cloud filled with the soot of priceless art rolled down the soot of priceless art rolled down the soot of priceless art rolled down the aisle. Four people were killed by aisle. Four people were killed by aisle. Four people were killed by falling rubble. Everything was destroyed, was unsafe. Everything was destroyed, was unsafe. >> Really, I remember I cannot forget it. I >> Really, I remember I cannot forget it. I >> Really, I remember I cannot forget it. I saw the arch dancing like this.

saw the arch dancing like this. saw the arch dancing like this. >> A big stone arch like this. >> A big stone arch like this. >> A big stone arch like this. >> Yes. Yes. Yes. I I think people cannot >> Yes. Yes. Yes. I I think people cannot >> Yes. Yes. Yes. I I think people cannot believe it, but I saw it. believe it, but I saw it. believe it, but I saw it. >> Frier Julio Chesareo, like Julius >> Frier Julio Chesareo, like Julius >> Frier Julio Chesareo, like Julius Caesar, but with an O, he told us, was a Caesar, but with an O, he told us, was a Caesar, but with an O, he told us, was a student here at the time. student here at the time. student here at the time. Earthquakes still scare him. Earthquakes still scare him. Earthquakes still scare him. >> I am always terrified. >> I am always terrified. >> I am always terrified. If I have the impression that there is If I have the impression that there is If I have the impression that there is something shaking, maybe it's just the something shaking, maybe it's just the something shaking, maybe it's just the wind. Immediately I feel, you know, sort wind. Immediately I feel, you know, sort wind. Immediately I feel, you know, sort of cold coming from inside. of cold coming from inside. of cold coming from inside. The damage was a shock for the Italian The damage was a shock for the Italian The damage was a shock for the Italian country. country. country. >> It was a shock that galvanized a >> It was a shock that galvanized a >> It was a shock that galvanized a desperate salvage operation. Restoers desperate salvage operation. Restoers desperate salvage operation. Restoers worked to heal the broken bodies of the worked to heal the broken bodies of the worked to heal the broken bodies of the saints. It was painstaking work and not saints. It was painstaking work and not saints. It was painstaking work and not all the pieces fit. 30 years later, some of the fresco are 30 years later, some of the fresco are still pockmarked, the walls bare.

No wonder the friars jumped at the No wonder the friars jumped at the chance to use 21st century technologies chance to use 21st century technologies chance to use 21st century technologies to restore their 13th century home. to restore their 13th century home. to restore their 13th century home. >> Right now we are digitizing in a super >> Right now we are digitizing in a super >> Right now we are digitizing in a super high definition this fresco uh which is high definition this fresco uh which is high definition this fresco uh which is St. Francis talking to the arts chapter. St. Francis talking to the arts chapter. St. Francis talking to the arts chapter. >> Giovani Belli is leading the project to >> Giovani Belli is leading the project to >> Giovani Belli is leading the project to create a digital twin of the basilica. create a digital twin of the basilica. create a digital twin of the basilica. Belli is the CTO of Hala Defiion, Belli is the CTO of Hala Defiion, Belli is the CTO of Hala Defiion, a technology company that specializes in a technology company that specializes in a technology company that specializes in ultra highdefin gigapixel photography. ultra highdefin gigapixel photography. ultra highdefin gigapixel photography. >> This is no ordinary camera. It's not. >> This is no ordinary camera. It's not. >> This is no ordinary camera. It's not. No, it's not. It's an robotic camera No, it's not. It's an robotic camera No, it's not. It's an robotic camera that we use to take a super high that we use to take a super high that we use to take a super high definition images. So, you can see all definition images. So, you can see all definition images. So, you can see all the smallest details of the work of art, the smallest details of the work of art, the smallest details of the work of art, the strokes of the painting, of the the strokes of the painting, of the the strokes of the painting, of the brush. You can see everything has great brush. You can see everything has great brush. You can see everything has great detail. detail. detail. >> What is a gigapixel? >> What is a gigapixel? >> What is a gigapixel? >> You know, you have a mobile camera, it's >> You know, you have a mobile camera, it's >> You know, you have a mobile camera, it's about 50 megapixels. We are three order about 50 megapixels. We are three order about 50 megapixels. We are three order of magnitude above. We are in a billion of magnitude above. We are in a billion of magnitude above. We are in a billion pixels.

pixels. pixels. >> Wow. >> Wow. >> Wow. >> So you with your camera and the pictures >> So you with your camera and the pictures >> So you with your camera and the pictures can see things that the human eye can see things that the human eye can see things that the human eye cannot. cannot. cannot. >> Yeah. >> Yeah. >> Yeah. Using cameras, drones, and lasers, Using cameras, drones, and lasers, Using cameras, drones, and lasers, Belli's team will take hundreds of Belli's team will take hundreds of Belli's team will take hundreds of thousands of pictures, thousands of pictures, thousands of pictures, stitching them together to create the stitching them together to create the stitching them together to create the most highresolution 3D blueprint of a most highresolution 3D blueprint of a most highresolution 3D blueprint of a building ever made. If disaster strikes building ever made. If disaster strikes building ever made. If disaster strikes this earthquake zone again, restorers this earthquake zone again, restorers this earthquake zone again, restorers will have an exact road map to rebuild. will have an exact road map to rebuild. will have an exact road map to rebuild. Are you photographers or are you Are you photographers or are you Are you photographers or are you computer experts? We have both. computer experts? We have both. computer experts? We have both. >> For Sergio Fusetti, a survivor of the >> For Sergio Fusetti, a survivor of the >> For Sergio Fusetti, a survivor of the 1997 quakes and chief restorer, those 1997 quakes and chief restorer, those 1997 quakes and chief restorer, those words are bittersweet. For him, words are bittersweet. For him, words are bittersweet. For him, high-tech help arrived too late. high-tech help arrived too late. high-tech help arrived too late. He asked us to follow him down a narrow He asked us to follow him down a narrow He asked us to follow him down a narrow passageway to the hidden storage rooms passageway to the hidden storage rooms passageway to the hidden storage rooms beneath the church. The lock was rusted.

beneath the church. The lock was rusted. beneath the church. The lock was rusted. No one had been here in months. Then another dusty hallway. Another Then another dusty hallway. Another lock. lock. lock. Until finally Until finally Until finally Fusetti showed us why we were here. Fusetti showed us why we were here. Fusetti showed us why we were here. A rare look at more than 80,000 A rare look at more than 80,000 A rare look at more than 80,000 fragments from the 1997 quakes. All fragments from the 1997 quakes. All fragments from the 1997 quakes. All neatly cataloged and in purgatory. You neatly cataloged and in purgatory. You neatly cataloged and in purgatory. You have no idea where these go? have no idea where these go? have no idea where these go? >> No. >> No. >> No. >> No. >> No. >> No. >> No. He said, "We have tried everything." >> No. He said, "We have tried everything." >> No. He said, "We have tried everything." >> He showed us some of the larger pieces >> He showed us some of the larger pieces >> He showed us some of the larger pieces still stored in a box. still stored in a box. still stored in a box. >> So, it's it's like a jigsaw puzzle. >> So, it's it's like a jigsaw puzzle. >> So, it's it's like a jigsaw puzzle. >> Exactly. he said. Fetti told us he'd >> Exactly. he said. Fetti told us he'd >> Exactly. he said. Fetti told us he'd toiled for years trying to finish the toiled for years trying to finish the toiled for years trying to finish the job. But despite his best efforts, he's job. But despite his best efforts, he's job. But despite his best efforts, he's left with a heap of plaster chips, each left with a heap of plaster chips, each left with a heap of plaster chips, each an irreplaceable part of a 13th century an irreplaceable part of a 13th century an irreplaceable part of a 13th century masterpiece.

masterpiece. masterpiece. When you are able to fit a piece back When you are able to fit a piece back When you are able to fit a piece back where it belongs, does it feel like a where it belongs, does it feel like a where it belongs, does it feel like a restoration or does it feel like a restoration or does it feel like a restoration or does it feel like a resurrection? resurrection? resurrection? It was an ongoing gamble, he told us. It was an ongoing gamble, he told us. It was an ongoing gamble, he told us. Sometimes you work all day and place Sometimes you work all day and place Sometimes you work all day and place just one fragment, but sometimes we just one fragment, but sometimes we just one fragment, but sometimes we found the pieces, and it was deeply found the pieces, and it was deeply found the pieces, and it was deeply satisfying. satisfying. satisfying. >> Fusetti says he's gone as far as humanly >> Fusetti says he's gone as far as humanly >> Fusetti says he's gone as far as humanly possible. >> Only artificial intelligence can help us >> Only artificial intelligence can help us now, he told us. now, he told us. now, he told us. Upstairs, the digital cavalry was Upstairs, the digital cavalry was Upstairs, the digital cavalry was galloping on. Giovani Belli told us he galloping on. Giovani Belli told us he galloping on. Giovani Belli told us he plans on using AI to fit together the plans on using AI to fit together the plans on using AI to fit together the leftover chips and to tackle other leftover chips and to tackle other leftover chips and to tackle other problems like uh cracks in the problems like uh cracks in the problems like uh cracks in the paintings, discoloration, paintings, discoloration, paintings, discoloration, layers of paint, lifting. uh that kind layers of paint, lifting. uh that kind layers of paint, lifting. uh that kind of analysis done by hand and with the of analysis done by hand and with the of analysis done by hand and with the eyes of a physical person would require eyes of a physical person would require eyes of a physical person would require years to just do one round of the whole years to just do one round of the whole years to just do one round of the whole building and with AI building and with AI building and with AI >> with AI minutes.

>> with AI minutes. >> with AI minutes. But Borelli has more in mind than just But Borelli has more in mind than just But Borelli has more in mind than just preserving the basilica. The company hopes to use AI to make art The company hopes to use AI to make art more accessible, starting by making a more accessible, starting by making a more accessible, starting by making a trip to the museum more like the movies. >> Up and down. >> Up and down. >> The same technology is being used to >> The same technology is being used to >> The same technology is being used to open up Italy's hidden treasures. One open up Italy's hidden treasures. One open up Italy's hidden treasures. One day last June, we descended 60 ft day last June, we descended 60 ft day last June, we descended 60 ft beneath the streets of Rome. beneath the streets of Rome. beneath the streets of Rome. >> It's a very, very beautiful. >> It's a very, very beautiful. >> It's a very, very beautiful. >> This is amazing. from 200 AD. >> This is amazing. from 200 AD. >> This is amazing. from 200 AD. >> Under an ordinary parking lot was >> Under an ordinary parking lot was >> Under an ordinary parking lot was something extraordinary. The remains of something extraordinary. The remains of something extraordinary. The remains of thermal baths built by a Roman emperor. thermal baths built by a Roman emperor. thermal baths built by a Roman emperor. >> So you you bring high-tech to the >> So you you bring high-tech to the >> So you you bring high-tech to the ancient world. ancient world. ancient world. >> Yeah, exactly. >> Yeah, exactly. >> Yeah, exactly. >> A laser scanner captured details of >> A laser scanner captured details of >> A laser scanner captured details of rooms with 30foot ceilings and delicate rooms with 30foot ceilings and delicate rooms with 30foot ceilings and delicate mosaics.

mosaics. mosaics. These ultra highdefin cameras have These ultra highdefin cameras have These ultra highdefin cameras have revealed hidden chambers and passageways revealed hidden chambers and passageways revealed hidden chambers and passageways forgotten by history. forgotten by history. forgotten by history. And then there's time travel. And then there's time travel. And then there's time travel. >> Press crown to select. >> Press crown to select. >> Press crown to select. >> Okay. >> Okay. >> Okay. >> You got the menu, huh? >> You got the menu, huh? >> You got the menu, huh? >> Yeah. >> Yeah. >> Yeah. >> We ended up in ancient Pompei at a >> We ended up in ancient Pompei at a >> We ended up in ancient Pompei at a party. party. party. >> Looks like they're having fun at this >> Looks like they're having fun at this >> Looks like they're having fun at this party. The wine is flowing. With virtual party. The wine is flowing. With virtual party. The wine is flowing. With virtual reality goggles, visitors can look their reality goggles, visitors can look their reality goggles, visitors can look their ancient hosts in the eye. ancient hosts in the eye. ancient hosts in the eye. >> Somebody's playing the pipes. Somebody >> Somebody's playing the pipes. Somebody >> Somebody's playing the pipes. Somebody else is playing a harp. else is playing a harp. else is playing a harp. People getting drunk. People getting drunk. People getting drunk. >> Belli hopes to use VR headsets to allow >> Belli hopes to use VR headsets to allow >> Belli hopes to use VR headsets to allow users to step inside some of Italy's users to step inside some of Italy's users to step inside some of Italy's most famous paintings. most famous paintings. most famous paintings. >> What a room. It's like you want to step >> What a room. It's like you want to step >> What a room. It's like you want to step outside into the garden. outside into the garden. outside into the garden. This is one grand dining room. I'll tell This is one grand dining room. I'll tell This is one grand dining room. I'll tell you. you. you. >> Ah, >> Ah, >> Ah, that was fantastic. I'm back again. Nice that was fantastic. I'm back again. Nice that was fantastic. I'm back again. Nice trip to ancient Pompei.

trip to ancient Pompei. trip to ancient Pompei. >> When I founded one of the companies that >> When I founded one of the companies that >> When I founded one of the companies that built uh this kind of technologies, I built uh this kind of technologies, I built uh this kind of technologies, I was a a software engineer, a pretty uh was a a software engineer, a pretty uh was a a software engineer, a pretty uh new to the art world. And uh the main new to the art world. And uh the main new to the art world. And uh the main question uh that I was focused on is a question uh that I was focused on is a question uh that I was focused on is a kind of philosophical one. How good can kind of philosophical one. How good can kind of philosophical one. How good can the digital representation of a physical the digital representation of a physical the digital representation of a physical object be? What is missing? object be? What is missing? object be? What is missing? >> So it sounds like you're trying to put >> So it sounds like you're trying to put >> So it sounds like you're trying to put the soul into the technology. the soul into the technology. the soul into the technology. >> Yeah. Yeah. You can see you can say >> Yeah. Yeah. You can see you can say >> Yeah. Yeah. You can see you can say that. Yeah. It's nice. Borelli admits the technology can't Borelli admits the technology can't duplicate the emotional impact of duplicate the emotional impact of duplicate the emotional impact of standing in front of a work of art. Not standing in front of a work of art. Not standing in front of a work of art. Not yet. But strapping on VR goggles could yet. But strapping on VR goggles could yet. But strapping on VR goggles could make lessons like this a thing of the make lessons like this a thing of the make lessons like this a thing of the past. past. past. >> There are scenes with people sitting >> There are scenes with people sitting >> There are scenes with people sitting listening to sermons. You could actually listening to sermons. You could actually listening to sermons. You could actually enter that group. enter that group. enter that group. >> Yeah, why not? You can have a walk >> Yeah, why not? You can have a walk >> Yeah, why not? You can have a walk around, even fly around. Why be stuck to around, even fly around. Why be stuck to around, even fly around. Why be stuck to the ground? Uh you can walk uh in on the the ground? Uh you can walk uh in on the the ground? Uh you can walk uh in on the ceiling and see how the stars feels ceiling and see how the stars feels ceiling and see how the stars feels under your feet.

under your feet. under your feet. >> You can run let your fantasy run wild. >> You can run let your fantasy run wild. >> You can run let your fantasy run wild. >> I can imagine this would have made me a >> I can imagine this would have made me a >> I can imagine this would have made me a much better student. much better student. much better student. >> Me too. >> As the sun set on another Azyour sky in >> As the sun set on another Azyour sky in Aisi, we followed in the sandal steps of Aisi, we followed in the sandal steps of Aisi, we followed in the sandal steps of the friars who've walked these halls for the friars who've walked these halls for the friars who've walked these halls for centuries. We wanted to ask frier Julio centuries. We wanted to ask frier Julio centuries. We wanted to ask frier Julio Cheso if he had any qualms about using Cheso if he had any qualms about using Cheso if he had any qualms about using artificial intelligence as a custodian artificial intelligence as a custodian artificial intelligence as a custodian for the legacy of St. Francis. for the legacy of St. Francis. for the legacy of St. Francis. >> The biggest benefit for me, it's not the >> The biggest benefit for me, it's not the >> The biggest benefit for me, it's not the technology for itself. The technology is technology for itself. The technology is technology for itself. The technology is not a purpose. It's a tool. It's a tool not a purpose. It's a tool. It's a tool not a purpose. It's a tool. It's a tool to reach the goal. The goal is sharing to reach the goal. The goal is sharing to reach the goal. The goal is sharing this treasure which is a treasure of this treasure which is a treasure of this treasure which is a treasure of faith and beauty. Technology helps us to faith and beauty. Technology helps us to faith and beauty. Technology helps us to to go further away to reach more people to go further away to reach more people to go further away to reach more people than we could before and in a more than we could before and in a more than we could before and in a more efficient way. efficient way. efficient way. >> The Basilica's digital twin will be >> The Basilica's digital twin will be >> The Basilica's digital twin will be complete next year and available to the complete next year and available to the complete next year and available to the public.

>> The friars told us they are hoping it >> The friars told us they are hoping it will turbo boost the spirit of St. will turbo boost the spirit of St. will turbo boost the spirit of St. Francis both in the heavens and the Francis both in the heavens and the Francis both in the heavens and the cloud. >> Hallelujah. Hallelujah. Hallelujah. >> Hallelujah. Hallelujah. Hallelujah. Hallelujah. Hallelujah. Hallelujah. Hallelu.