Scott & Mark Learn To...Double-Check References

Let me share something with you that's Let me share something with you that's going on right now. It's going to pop going on right now. It's going to pop going on right now. It's going to pop tomorrow. I don't know if tomorrow. I don't know if tomorrow. I don't know if >> Are you for real? Are you launching >> Are you for real? Are you launching >> Are you for real? Are you launching something? something? something? >> Yeah. >> Yeah. >> Yeah. Uh so Uh so Uh so Ref Checker. Ref Checker. Ref Checker. I scanned the 5300 papers from ICLR, I scanned the 5300 papers from ICLR, I scanned the 5300 papers from ICLR, this prestigious tier one this prestigious tier one this prestigious tier one >> Uh-oh. I know where this I know exactly >> Uh-oh. I know where this I know exactly >> Uh-oh. I know where this I know exactly where this is going. where this is going. where this is going. >> Yeah. Found hundreds of hallucinated >> Yeah. Found hundreds of hallucinated >> Yeah. Found hundreds of hallucinated references. references. references. >> Okay. That means that AI researchers are >> Okay. That means that AI researchers are >> Okay. That means that AI researchers are using AI to write their AI papers and in using AI to write their AI papers and in using AI to write their AI papers and in the process slopping them up. the process slopping them up. the process slopping them up. >> That's right. >> That's right. >> That's right. >> You heard it here first, Chad. >> You heard it here first, Chad. >> You heard it here first, Chad. >> Are we >> Are we >> Are we >> [laughter] >> [laughter] >> [laughter] >> So we're we're publishing an article. So >> So we're we're publishing an article. So >> So we're we're publishing an article. So we've Yeah, we've done you know the we've Yeah, we've done you know the we've Yeah, we've done you know the disclosure to ICLR program chairs to disclosure to ICLR program chairs to disclosure to ICLR program chairs to 12 papers that have more than five five 12 papers that have more than five five 12 papers that have more than five five or more or more or more hallucinations. We've reached out to hallucinations. We've reached out to hallucinations. We've reached out to them. them. them. >> Is five the sweet spot? You don't think >> Is five the sweet spot? You don't think >> Is five the sweet spot? You don't think one is unacceptable? one is unacceptable? one is unacceptable? >> It is unacceptable. It's just uh at five >> It is unacceptable. It's just uh at five >> It is unacceptable. It's just uh at five that's um that was 12 papers. And this that's um that was 12 papers. And this that's um that was 12 papers. And this is and there's likely more is and there's likely more is and there's likely more um that were that fell below threat, you um that were that fell below threat, you um that were that fell below threat, you know. know. know. >> You know this is happening in law, too, >> You know this is happening in law, too, >> You know this is happening in law, too, right? Like it's right? Like it's right? Like it's rampant. rampant. rampant. >> It's rampant. Absolutely rampant. >> It's rampant. Absolutely rampant. >> It's rampant. Absolutely rampant. [music] >> So Okay, let me ask you this. When you >> So Okay, let me ask you this. When you do something like this, what's going to do something like this, what's going to do something like this, what's going to happen?

Is someone going to get in trouble? Is Is someone going to get in trouble? Is there going to be a meeting? there going to be a meeting? there going to be a meeting? >> Well, >> Well, >> Well, >> Is someone's boss or tenured whatever >> Is someone's boss or tenured whatever >> Is someone's boss or tenured whatever going to call them and say knock it off? going to call them and say knock it off? going to call them and say knock it off? And they're going to go, "Oh, I won't do And they're going to go, "Oh, I won't do And they're going to go, "Oh, I won't do that." that." that." >> Well, it's an interesting response. Uh >> Well, it's an interesting response. Uh >> Well, it's an interesting response. Uh the 12 papers, the 12 papers, the 12 papers, we got responses from 10 of them. we got responses from 10 of them. we got responses from 10 of them. One was like, "No, these paper these One was like, "No, these paper these One was like, "No, these paper these five papers we referenced, they're five papers we referenced, they're five papers we referenced, they're they're not yet published." they're not yet published." they're not yet published." >> Okay, that could be >> Okay, that could be >> Okay, that could be >> Well, wait, wait. We're like, "Well, are >> Well, wait, wait. We're like, "Well, are >> Well, wait, wait. We're like, "Well, are there pre-publication sites? Are they on there pre-publication sites? Are they on there pre-publication sites? Are they on the web someplace we could see?" "Well, the web someplace we could see?" "Well, the web someplace we could see?" "Well, no." no." no." >> Well, hang on, yeah, cuz Ref Checker >> Well, hang on, yeah, cuz Ref Checker >> Well, hang on, yeah, cuz Ref Checker would look in the pre-publication sites. would look in the pre-publication sites. would look in the pre-publication sites. >> So >> So >> So Yeah, we're we're suspicious of that. Yeah, we're we're suspicious of that. Yeah, we're we're suspicious of that. >> of them or two of them? >> of them or two of them? >> of them or two of them? >> That's just one. One of the one of the >> That's just one. One of the one of the >> That's just one. One of the one of the 10 responses was 10 responses was 10 responses was >> was like, "No. >> was like, "No. >> was like, "No. >> Yeah. Not at all." >> Yeah. Not at all." >> Yeah. Not at all." >> Now, the other nine were all like, "Oh, >> Now, the other nine were all like, "Oh, >> Now, the other nine were all like, "Oh, this is really bad. We screwed up." Um this is really bad. We screwed up." Um this is really bad. We screwed up." Um there were various reasons they gave, there were various reasons they gave, there were various reasons they gave, you know, using AI in the last last part you know, using AI in the last last part you know, using AI in the last last part to format the bibliography, uh having a to format the bibliography, uh having a to format the bibliography, uh having a a student put together the bibliography. a student put together the bibliography. a student put together the bibliography. Uh they There were multiple explanations Uh they There were multiple explanations Uh they There were multiple explanations like that. One of them and they and they like that. One of them and they and they like that. One of them and they and they all said, "We're going to notify ICLR. all said, "We're going to notify ICLR. all said, "We're going to notify ICLR. We're going to fix this and notify the We're going to fix this and notify the We're going to fix this and notify the conference that that this happened.

conference that that this happened. conference that that this happened. Thank you so much." One of them said, Thank you so much." One of them said, Thank you so much." One of them said, "We're withdrawing our paper." "We're withdrawing our paper." "We're withdrawing our paper." >> So, >> So, >> So, wow. wow. wow. Like, if you're a PhD postdoc Like, if you're a PhD postdoc Like, if you're a PhD postdoc researcher, writing papers is part of researcher, writing papers is part of researcher, writing papers is part of your job. your job. your job. >> Right. One of >> Right. One of >> Right. One of Yeah. One of them uh at a lab at a Yeah. One of them uh at a lab at a Yeah. One of them uh at a lab at a prestigious university said, "Please prestigious university said, "Please prestigious university said, "Please don't disclose this." don't disclose this." don't disclose this." >> Okay, so that's a good question cuz >> Okay, so that's a good question cuz >> Okay, so that's a good question cuz you're This is like when you find a bug. you're This is like when you find a bug. you're This is like when you find a bug. >> We're a young lab and we don't want our >> We're a young lab and we don't want our >> We're a young lab and we don't want our reputation to get hurt. reputation to get hurt. reputation to get hurt. >> So, are you going to do that? >> So, are you going to do that? >> So, are you going to do that? >> No, we're keeping it anonymous, which is >> No, we're keeping it anonymous, which is >> No, we're keeping it anonymous, which is why I'm not mentioning anybody. why I'm not mentioning anybody. why I'm not mentioning anybody. >> Okay. Okay. Cuz it's kind of like when >> Okay. Okay. Cuz it's kind of like when >> Okay. Okay. Cuz it's kind of like when you have like a zero-day or bug and you you have like a zero-day or bug and you you have like a zero-day or bug and you know, you know, you got to like give know, you know, you got to like give know, you know, you got to like give people a heads-up. people a heads-up. people a heads-up. >> So, we're just uh publishing stats and >> So, we're just uh publishing stats and >> So, we're just uh publishing stats and and this information about how those and this information about how those and this information about how those responses responses responses >> Okay. So, how do you do this in such a >> Okay. So, how do you do this in such a >> Okay. So, how do you do this in such a way that makes everyone appropriately way that makes everyone appropriately way that makes everyone appropriately afraid? afraid? afraid? Like, this needs to be bigger than that Like, this needs to be bigger than that Like, this needs to be bigger than that because it's it's going to happen. because it's it's going to happen. because it's it's going to happen. >> Well, it's been happening. There's been >> Well, it's been happening. There's been >> Well, it's been happening. There's been several papers that have been published several papers that have been published several papers that have been published already in academic journals about already in academic journals about already in academic journals about hallucination hallucinated references in hallucination hallucinated references in hallucination hallucinated references in in in in computer science computer science computer science conferences and other places. Um there's conferences and other places. Um there's conferences and other places. Um there's a company called GPT-3 a company called GPT-3 a company called GPT-3 >> Mm.

>> Mm. >> Mm. >> that actually >> that actually >> that actually found did a did a sampling of 300 of the found did a did a sampling of 300 of the found did a did a sampling of 300 of the submitted papers to this conference ICLR submitted papers to this conference ICLR submitted papers to this conference ICLR back in December and published an back in December and published an back in December and published an article in that article in that article in that and a blog post and a blog post and a blog post showing how they found several dozen showing how they found several dozen showing how they found several dozen hallucinations in those 300 papers. hallucinations in those 300 papers. hallucinations in those 300 papers. And then ICLR And then ICLR And then ICLR did something called desk reject, which did something called desk reject, which did something called desk reject, which is we're not even going to look at the is we're not even going to look at the is we're not even going to look at the paper, it's just rejected outright paper, it's just rejected outright paper, it's just rejected outright because you violated a policy. because you violated a policy. because you violated a policy. >> [snorts] >> [snorts] >> [snorts] >> So, >> So, >> So, it's not like if people weren't on it's not like if people weren't on it's not like if people weren't on notice notice notice already. already. already. But it still continues to happen. But it still continues to happen. But it still continues to happen. >> Oy vey. >> Oy vey. >> Oy vey. >> [sighs] >> This is messy. >> This is messy. >> Yeah, it's really >> Yeah, it's really >> Yeah, it's really >> but see, it's your job. >> but see, it's your job. >> but see, it's your job. Like just double-check your work. And Like just double-check your work. And Like just double-check your work. And this is I think this is I think this is I think you know, we talk I think I don't know you know, we talk I think I don't know you know, we talk I think I don't know if we just talked about system one if we just talked about system one if we just talked about system one thinking and system two thinking, right? thinking and system two thinking, right? thinking and system two thinking, right? System one thinking, you know, System one thinking, you know, System one thinking, you know, intuitive, go with your gut. System two, intuitive, go with your gut. System two, intuitive, go with your gut. System two, like depth and focus. System three like depth and focus. System three like depth and focus. System three thinking is this new kind of sidecar thinking is this new kind of sidecar thinking is this new kind of sidecar thinking, which is you just thinking, which is you just thinking, which is you just Let the let the AI do it.

Let the let the AI do it. Let the let the AI do it. >> Cognitive surrender. >> Cognitive surrender. >> Cognitive surrender. It's called. It's called. It's called. >> Ooh, that's good. The Sorry, I >> Ooh, that's good. The Sorry, I >> Ooh, that's good. The Sorry, I >> Did you see the paper about system three >> Did you see the paper about system three >> Did you see the paper about system three thinking? thinking? thinking? >> Yeah. Yeah, that's what I'm bringing up. >> Yeah. Yeah, that's what I'm bringing up. >> Yeah. Yeah, that's what I'm bringing up. >> Well, that's what they call they coined >> Well, that's what they call they coined >> Well, that's what they call they coined the term the term the term >> Cognitive surrender. >> Cognitive surrender. >> Cognitive surrender. >> Yeah. >> Yeah. >> Yeah. >> I um >> I um >> I um I used the example at a university I I used the example at a university I I used the example at a university I spoke at a couple of days ago that, you spoke at a couple of days ago that, you spoke at a couple of days ago that, you know, we all really need to go lift know, we all really need to go lift know, we all really need to go lift weights. It's really important to go weights. It's really important to go weights. It's really important to go lift weights, otherwise things are going lift weights, otherwise things are going lift weights, otherwise things are going to to to things are going to start to atrophy. things are going to start to atrophy. things are going to start to atrophy. And I said, well, let's uh I have an And I said, well, let's uh I have an And I said, well, let's uh I have an idea. Let's send a forklift to the gym. idea. Let's send a forklift to the gym. idea. Let's send a forklift to the gym. >> Yeah. >> Yeah. >> Yeah. >> And it'll lift the weights. And then >> And it'll lift the weights. And then >> And it'll lift the weights. And then someone will say, "Did you lift the someone will say, "Did you lift the someone will say, "Did you lift the weights?" And they'll say, "Yeah, the weights?" And they'll say, "Yeah, the weights?" And they'll say, "Yeah, the weights were lifted." weights were lifted." weights were lifted." That's happening to our brains. That's happening to our brains. That's happening to our brains. >> Yeah. >> Yeah. >> Yeah. >> And it's cognitive surrender becomes >> And it's cognitive surrender becomes >> And it's cognitive surrender becomes being subcognitive. being subcognitive. being subcognitive. And that's scary. And that's scary. And that's scary. >> Yeah, I agree. >> Yeah, I agree. >> Yeah, I agree. >> And I'm feeling it in some of the my >> And I'm feeling it in some of the my >> And I'm feeling it in some of the my little vibe coded projects. It's just little vibe coded projects. It's just little vibe coded projects. It's just Oh, did you Did you see some of the the Oh, did you Did you see some of the the Oh, did you Did you see some of the the rave reviews about my Windows? Okay. So, rave reviews about my Windows? Okay. So, rave reviews about my Windows? Okay. So, um um um you know that I've I'm deeply jealous of you know that I've I'm deeply jealous of you know that I've I'm deeply jealous of Sysinternals and I won't I won't last Sysinternals and I won't I won't last Sysinternals and I won't I won't last until I make something better.

until I make something better. until I make something better. >> in the jealousy of me. >> in the jealousy of me. >> in the jealousy of me. >> Yeah, ultimately it is a a deep envy. >> Yeah, ultimately it is a a deep envy. >> Yeah, ultimately it is a a deep envy. Yeah. A envy-ness. So, uh, I let me let Yeah. A envy-ness. So, uh, I let me let Yeah. A envy-ness. So, uh, I let me let me show you this one here. This is good. me show you this one here. This is good. me show you this one here. This is good. So, I've been vibe coding little apps So, I've been vibe coding little apps So, I've been vibe coding little apps that make Windows better. that make Windows better. that make Windows better. >> Mhm. >> Mhm. >> Mhm. >> Usually for people who, um, >> Usually for people who, um, >> Usually for people who, um, uh, like uh, like uh, like >> They they're moving from a Mac and they >> They they're moving from a Mac and they >> They they're moving from a Mac and they like want Windows to behave like a Mac. like want Windows to behave like a Mac. like want Windows to behave like a Mac. So, like one of them is like if you So, like one of them is like if you So, like one of them is like if you click on the desktop, all the windows click on the desktop, all the windows click on the desktop, all the windows get out of the way, then you can see get out of the way, then you can see get out of the way, then you can see your desktop and then you click and then your desktop and then you click and then your desktop and then you click and then they come back. they come back. they come back. >> And, um, here is some of the reviews. >> And, um, here is some of the reviews. >> And, um, here is some of the reviews. Uh, Uh, Uh, let's go to LinkedIn and I'll show you. let's go to LinkedIn and I'll show you. let's go to LinkedIn and I'll show you. These are pretty exciting. Uh, Uh, I'm sharing my screen. I'm sharing my screen. I'm sharing my screen. And click. And click. And click. Okay. So, let's go to posts. Okay. So, let's go to posts. Okay. So, let's go to posts. I I still can't find my posts on I I still can't find my posts on I I still can't find my posts on LinkedIn. LinkedIn. LinkedIn. >> I can't either. It's so annoying. >> I can't either. It's so annoying. >> I can't either. It's so annoying. >> It's obnoxious. We wish we knew >> It's obnoxious. We wish we knew >> It's obnoxious. We wish we knew >> I thought it was just me. The other day >> I thought it was just me. The other day >> I thought it was just me. The other day when I'm like, "Let me go find that when I'm like, "Let me go find that when I'm like, "Let me go find that post." and you're like, "Oh, click here, post." and you're like, "Oh, click here, post." and you're like, "Oh, click here, here, there." here, there." here, there." >> it's awful. Okay, here we go. Here's a >> it's awful. Okay, here we go. Here's a >> it's awful. Okay, here we go. Here's a good one.

good one. good one. Uh, you'll appreciate this. Uh, you'll appreciate this. Uh, you'll appreciate this. So, this is peak desktop. Click, get So, this is peak desktop. Click, get So, this is peak desktop. Click, get your desktop. Surely this is indicative your desktop. Surely this is indicative your desktop. Surely this is indicative of the user's inability to organize. of the user's inability to organize. of the user's inability to organize. This [laughter] is a desk full of crap This [laughter] is a desk full of crap This [laughter] is a desk full of crap that you can't bring yourself to clean that you can't bring yourself to clean that you can't bring yourself to clean up. Who encourages this and any up. Who encourages this and any up. Who encourages this and any Microsoft vice president should know Microsoft vice president should know Microsoft vice president should know better. better. better. So, why are you commenting on my So, why are you commenting on my So, why are you commenting on my >> That was me. >> That was me. >> That was me. >> That was >> That was >> That was so you. You have long ago hated my so you. You have long ago hated my so you. You have long ago hated my desktop. desktop. desktop. Uh, this was another great one. I can't Uh, this was another great one. I can't Uh, this was another great one. I can't stand that feature. That was good. I stand that feature. That was good. I stand that feature. That was good. I felt good about that one. felt good about that one. felt good about that one. Uh, here's another one. These personal Uh, here's another one. These personal Uh, here's another one. These personal vibe coded tools are just noise. vibe coded tools are just noise. vibe coded tools are just noise. >> [laughter] >> [laughter] >> [laughter] >> Is this really worth it? The I like this >> Is this really worth it? The I like this >> Is this really worth it? The I like this term. Actually, I really like this. I'm term. Actually, I really like this. I'm term. Actually, I really like this. I'm not I'm not just trolling this person. not I'm not just trolling this person. not I'm not just trolling this person. >> Yeah. >> Yeah. >> Yeah. >> The pre-AI is this really worth it >> The pre-AI is this really worth it >> The pre-AI is this really worth it friction was not a bad thing. friction was not a bad thing. friction was not a bad thing. You got to ask yourself though, like you You got to ask yourself though, like you You got to ask yourself though, like you and I have have vibed a bunch of stuff. and I have have vibed a bunch of stuff. and I have have vibed a bunch of stuff. And then we've sculpted other things. And then we've sculpted other things. And then we've sculpted other things. Some of them are vibes. some of them are Some of them are vibes. some of them are Some of them are vibes. some of them are sculpting. sculpting. sculpting. Um Um Um I think that having less friction I think that having less friction I think that having less friction means that it allows me to figure out if means that it allows me to figure out if means that it allows me to figure out if the idea is good or not, if the idea has the idea is good or not, if the idea has the idea is good or not, if the idea has legs.

legs. legs. >> agree. >> agree. >> agree. >> Yeah. So, yeah, I'm going to disagree. >> Yeah. So, yeah, I'm going to disagree. >> Yeah. So, yeah, I'm going to disagree. By the way, if you've made some tools, By the way, if you've made some tools, By the way, if you've made some tools, have you gone to Tiny Tool Town? have you gone to Tiny Tool Town? have you gone to Tiny Tool Town? >> No. This is your site. >> No. This is your site. >> No. This is your site. >> Yeah, I made Tiny Tool Town. So, this is >> Yeah, I made Tiny Tool Town. So, this is >> Yeah, I made Tiny Tool Town. So, this is a place for dumb tools. Uh except most a place for dumb tools. Uh except most a place for dumb tools. Uh except most of yours are actually useful, so Ref of yours are actually useful, so Ref of yours are actually useful, so Ref Checker is probably not dumb. Checker is probably not dumb. Checker is probably not dumb. But, yeah, so you go to Tiny Tool Town But, yeah, so you go to Tiny Tool Town But, yeah, so you go to Tiny Tool Town and it's got just tools like my desktop and it's got just tools like my desktop and it's got just tools like my desktop thing, Bluetooth Audio Manager for thing, Bluetooth Audio Manager for thing, Bluetooth Audio Manager for Windows. It's got dozens and dozens. Windows. It's got dozens and dozens. Windows. It's got dozens and dozens. >> Three Three Yeah, this is all real. >> Three Three Yeah, this is all real. >> Three Three Yeah, this is all real. >> These are all Wait, are the you coded >> These are all Wait, are the you coded >> These are all Wait, are the you coded all these things? all these things? all these things? >> Uh No, no, no. This is a great point. >> Uh No, no, no. This is a great point. >> Uh No, no, no. This is a great point. These are not my tools. These are not my tools. These are not my tools. >> Yeah. >> Yeah. >> Yeah. >> These are some These are tools by >> These are some These are tools by >> These are some These are tools by people. So, if we go to my section and people. So, if we go to my section and people. So, if we go to my section and then click on Scott, you can just see my then click on Scott, you can just see my then click on Scott, you can just see my tools. So, I've got like tools. So, I've got like tools. So, I've got like >> How many do you >> How many do you >> How many do you >> Oh, shoot, I don't know. >> Oh, shoot, I don't know. >> Oh, shoot, I don't know. >> Wait, scroll to the top cuz I thought it >> Wait, scroll to the top cuz I thought it >> Wait, scroll to the top cuz I thought it was a number. was a number. was a number. >> Uh Oh, this is good. I got a bug now. I >> Uh Oh, this is good. I got a bug now. I >> Uh Oh, this is good. I got a bug now. I need to figure out how many show. need to figure out how many show. need to figure out how many show. >> 316 >> 316 >> 316 >> I have 13 on the site. There's 316. This >> I have 13 on the site. There's 316. This >> I have 13 on the site. There's 316. This is wrong. is wrong. is wrong. >> Oh, this is good. Hang on. >> Oh, this is good. Hang on. >> Oh, this is good. Hang on. So, this should show So, this should show So, this should show This should show the number. This is a This should show the number. This is a This should show the number. This is a good bug.

Tiny Tool Town Tiny Tool Town Hey, when someone clicks on an author Hey, when someone clicks on an author Hey, when someone clicks on an author name or they're in the search, it shows name or they're in the search, it shows name or they're in the search, it shows the full number of all tools and not the the full number of all tools and not the the full number of all tools and not the number of that's the result of the number of that's the result of the number of that's the result of the search. For example, looking for Scott search. For example, looking for Scott search. For example, looking for Scott Hanselman should show 13 tools and it Hanselman should show 13 tools and it Hanselman should show 13 tools and it shows 316. Let's fix that. shows 316. Let's fix that. shows 316. Let's fix that. >> All right, do you think that's obvious? >> All right, do you think that's obvious? >> All right, do you think that's obvious? >> That's deeply obvious, but I never >> That's deeply obvious, but I never >> That's deeply obvious, but I never never been to this page before. never been to this page before. never been to this page before. >> No, I mean >> No, I mean >> No, I mean AI should have said, "Well, obviously AI should have said, "Well, obviously AI should have said, "Well, obviously when somebody does that when somebody does that when somebody does that >> Oh, >> Oh, >> Oh, >> You know. >> You know. >> You know. >> See, that's a great point. Like, that's >> See, that's a great point. Like, that's >> See, that's a great point. Like, that's asking the AI to do something I never asking the AI to do something I never asking the AI to do something I never asked it to, which is understand the asked it to, which is understand the asked it to, which is understand the complete requirements complete requirements complete requirements of the app and look for obvious mis of the app and look for obvious mis of the app and look for obvious mis >> See previous episode. >> See previous episode. >> See previous episode. >> Yeah, see previous episode. Like, you're >> Yeah, see previous episode. Like, you're >> Yeah, see previous episode. Like, you're right. right. right. >> Is that Wait, so is three showing 316 >> Is that Wait, so is three showing 316 >> Is that Wait, so is three showing 316 there is the total, but when you've got there is the total, but when you've got there is the total, but when you've got a filter, it's a filter, it's a filter, it's >> Oh, look. That's That's the bug. >> Oh, look. That's That's the bug. >> Oh, look. That's That's the bug. >> What? >> What? >> What? >> Okay, look. If you visit it, >> Okay, look. If you visit it, >> Okay, look. If you visit it, >> Mhm. >> Mhm. >> Mhm. >> it shows 313. >> it shows 313. >> it shows 313. I'm showing the right number, but only I'm showing the right number, but only I'm showing the right number, but only on key down. on key down. on key down. >> Key down.

>> Key down. >> Key down. >> Scratch that. It's a first load issue >> Scratch that. It's a first load issue >> Scratch that. It's a first load issue because uh we're only showing the number because uh we're only showing the number because uh we're only showing the number uh 13 of 316 when we uh 13 of 316 when we uh 13 of 316 when we uh change focus or key down in the text uh change focus or key down in the text uh change focus or key down in the text box in the search box. That's the issue, see? That's the issue, see? >> Uh okay. >> Uh okay. >> Uh okay. >> Cuz look, >> Cuz look, >> Cuz look, >> Yeah. >> Yeah. >> Yeah. >> I knew that I'd done this. >> I knew that I'd done this. >> I knew that I'd done this. If I go Hanselman, 13 If I go Hanselman, 13 If I go Hanselman, 13 >> really You explicitly did it? You didn't >> really You explicitly did it? You didn't >> really You explicitly did it? You didn't >> No, I did that explicitly because I >> No, I did that explicitly because I >> No, I did that explicitly because I >> So, why did you have to? We're going >> So, why did you have to? We're going >> So, why did you have to? We're going going back to going back to going back to We're on a tangent now, but We're on a tangent now, but We're on a tangent now, but >> This is good. >> This is good. >> This is good. >> Yeah, digression. But >> Yeah, digression. But >> Yeah, digression. But You know, the the AI can just code You know, the the AI can just code You know, the the AI can just code everything. You don't need humans to everything. You don't need humans to everything. You don't need humans to guide it. It'll just pop it out. Like, guide it. It'll just pop it out. Like, guide it. It'll just pop it out. Like, something like that. something like that. something like that. Showing the blank of blank. Showing the blank of blank. Showing the blank of blank. Is that an obvious thing? You would an Is that an obvious thing? You would an Is that an obvious thing? You would an AI is just going to get good enough to AI is just going to get good enough to AI is just going to get good enough to go, "You know what? go, "You know what? go, "You know what? Scott didn't tell me it should be blank Scott didn't tell me it should be blank Scott didn't tell me it should be blank of blank, but I'll make it blank you of blank, but I'll make it blank you of blank, but I'll make it blank you know, X of Y because that's just the know, X of Y because that's just the know, X of Y because that's just the obvious thing to do." obvious thing to do." obvious thing to do." >> issue is that the AI is not a user. It's >> issue is that the AI is not a user. It's >> issue is that the AI is not a user. It's not a tester. It's not the not a tester. It's not the not a tester. It's not the uh the audience.

uh the audience. uh the audience. How could it know this? How could it know this? How could it know this? >> Well, >> Well, >> Well, >> I'm not sure if you're pro or anti in >> I'm not sure if you're pro or anti in >> I'm not sure if you're pro or anti in this argument. this argument. this argument. >> I'm actually being provocative. >> I'm actually being provocative. >> I'm actually being provocative. I'm just asking. I'm just asking. I'm just asking. >> Oh, well, good job being provocative. >> Oh, well, good job being provocative. >> Oh, well, good job being provocative. >> I'm just asking. Uh I personally think >> I'm just asking. Uh I personally think >> I'm just asking. Uh I personally think that this is an example of that this is an example of that this is an example of you know what? The AI can't know what it you know what? The AI can't know what it you know what? The AI can't know what it should be. >> Well, it can't know because as a human >> Well, it can't know because as a human it would need exposure to these it would need exposure to these it would need exposure to these experiences with her which are temporal. experiences with her which are temporal. experiences with her which are temporal. Temporal. Temporal. Temporal. >> But also you you're you're you could >> But also you you're you're you could >> But also you you're you're you could say, "You know what? At the top, I say, "You know what? At the top, I say, "You know what? At the top, I always wanted to show the total number." always wanted to show the total number." always wanted to show the total number." Because Because Because >> I see. I could have a dumb requirement, >> I see. I could have a dumb requirement, >> I see. I could have a dumb requirement, but you're right. It's still my but you're right. It's still my but you're right. It's still my requirement. requirement. requirement. >> Is it dumb? >> Is it dumb? >> Is it dumb? >> Well, that's a good question. Like, we >> Well, that's a good question. Like, we >> Well, that's a good question. Like, we made a filter here. I type in Q equals made a filter here. I type in Q equals made a filter here. I type in Q equals mark. mark. mark. It doesn't work. It doesn't work. It doesn't work. >> tool shown. Okay, but that's fine. All >> tool shown. Okay, but that's fine. All >> tool shown. Okay, but that's fine. All right. right. right. All right. All right. All right. >> What's that? >> What's that? >> What's that? >> Um it's because you say tool shown. >> Um it's because you say tool shown. >> Um it's because you say tool shown. But But But >> Oh, I see what you're saying. >> Oh, I see what you're saying. >> Oh, I see what you're saying. Yeah. Yeah. Yeah. But I I I I still think that it's But I I I I still think that it's But I I I I still think that it's for today's for today's models, it's a for today's for today's models, it's a for today's for today's models, it's a stretch.

stretch. stretch. >> Yeah. >> Yeah. >> Yeah. Well, is it going to Are we headed Well, is it going to Are we headed Well, is it going to Are we headed towards a world where it'll just know towards a world where it'll just know towards a world where it'll just know the answers to all of that? >> Oh, man. >> Oh, man. >> The right ones. >> The right ones. >> The right ones. >> But see, if we if we are headed towards >> But see, if we if we are headed towards >> But see, if we if we are headed towards a world where it just knows that, then a world where it just knows that, then a world where it just knows that, then we're going to be stuck where we are, we're going to be stuck where we are, we're going to be stuck where we are, and this is the web that we have, and and this is the web that we have, and and this is the web that we have, and we're never going to do anything we're never going to do anything we're never going to do anything interesting again. interesting again. interesting again. Then the web is broken, and no new ideas Then the web is broken, and no new ideas Then the web is broken, and no new ideas are going to happen. are going to happen. are going to happen. >> Yeah, but you had to tell it. >> Yeah, but you had to tell it. >> Yeah, but you had to tell it. Show blank, so X or Y. Show blank, so X or Y. Show blank, so X or Y. Even though this is like a main like Even though this is like a main like Even though this is like a main like like that web page right there is just a like that web page right there is just a like that web page right there is just a web UI on top of a database. web UI on top of a database. web UI on top of a database. >> Well, there's even there's not even a >> Well, there's even there's not even a >> Well, there's even there's not even a database on this. This is the other database on this. This is the other database on this. This is the other thing I'm very clever about this thing I'm very clever about this thing I'm very clever about this particular particular particular There This is entirely static site. There This is entirely static site. There This is entirely static site. >> Uh >> Uh >> Uh >> I never showed you this architecture. >> I never showed you this architecture. >> I never showed you this architecture. I'm actually quite proud of it. When you I'm actually quite proud of it. When you I'm actually quite proud of it. When you submit it to the new tool, yeah, you are submit it to the new tool, yeah, you are submit it to the new tool, yeah, you are submitting it via GitHub issue. submitting it via GitHub issue. submitting it via GitHub issue. >> Wow. >> Wow. >> Wow. >> Yeah. So, you submit the tool by >> Yeah. So, you submit the tool by >> Yeah. So, you submit the tool by visiting GitHub.

visiting GitHub. visiting GitHub. And then you fill it out, and I made a And then you fill it out, and I made a And then you fill it out, and I made a whole like a whole issue form here. So, whole like a whole issue form here. So, whole like a whole issue form here. So, if you say new issue if you say new issue if you say new issue See this here? This is custom GitHub-y See this here? This is custom GitHub-y See this here? This is custom GitHub-y thing. thing. thing. You put in your tool, your repository. You put in your tool, your repository. You put in your tool, your repository. >> pick it up, and then it adds something >> pick it up, and then it adds something >> pick it up, and then it adds something to a file? to a file? to a file? >> So, then I I have a I have an agentic >> So, then I I have a I have an agentic >> So, then I I have a I have an agentic um um um You can still see the screen, right? You can still see the screen, right? You can still see the screen, right? >> Yeah. Uh-huh. >> Yeah. Uh-huh. >> Yeah. Uh-huh. >> I have an agentic repository uh scanner >> I have an agentic repository uh scanner >> I have an agentic repository uh scanner that by Don Syme and Peli de Allyu that by Don Syme and Peli de Allyu that by Don Syme and Peli de Allyu who um who um who um uh will go and tag it with all this uh will go and tag it with all this uh will go and tag it with all this stuff, so it does triage. stuff, so it does triage. stuff, so it does triage. And then I go and I have a uh a skill And then I go and I have a uh a skill And then I go and I have a uh a skill that works through the triage with me. that works through the triage with me. that works through the triage with me. Oops. Oops. Oops. And if it has 90% confidence, it'll do And if it has 90% confidence, it'll do And if it has 90% confidence, it'll do stuff. Otherwise, it will ask questions. stuff. Otherwise, it will ask questions. stuff. Otherwise, it will ask questions. So, here this person put in a So, here this person put in a So, here this person put in a repository. My action said there's no repository. My action said there's no repository. My action said there's no license detected. Then it replied as me license detected. Then it replied as me license detected. Then it replied as me saying this looks great, but I need a saying this looks great, but I need a saying this looks great, but I need a license. license. license. So, I have a whole workflow. But if you So, I have a whole workflow. But if you So, I have a whole workflow. But if you look at my issues look at my issues look at my issues >> try to prompt inject your >> try to prompt inject your >> try to prompt inject your >> Oh, yeah. You should totally do that. I >> Oh, yeah. You should totally do that. I >> Oh, yeah. You should totally do that. I mean, don't delete the site, please, but mean, don't delete the site, please, but mean, don't delete the site, please, but yeah. [laughter] yeah. [laughter] yeah. [laughter] If you could prompt inject it, that'd be If you could prompt inject it, that'd be If you could prompt inject it, that'd be great because great because great because um if you go down here under GitHub um if you go down here under GitHub um if you go down here under GitHub under workflows, these are all of my under workflows, these are all of my under workflows, these are all of my >> Yeah.

>> Yeah. >> Yeah. >> workflows? >> workflows? >> workflows? >> Uh-huh. >> Uh-huh. >> Uh-huh. >> And then if you go under actions >> And then if you go under actions >> And then if you go under actions look at this. look at this. look at this. I've got all these workflows. So, the I've got all these workflows. So, the I've got all these workflows. So, the stars, the sorting, the thumbnails, it's stars, the sorting, the thumbnails, it's stars, the sorting, the thumbnails, it's entirely abusing GitHub. entirely abusing GitHub. entirely abusing GitHub. >> That is pretty cool. >> That is pretty cool. >> That is pretty cool. >> It is pretty cool. >> It is pretty cool. >> It is pretty cool. >> You come up with that architecture >> You come up with that architecture >> You come up with that architecture yourself? yourself? yourself? >> Yeah, why? >> Yeah, why? >> Yeah, why? Oh, are you trying to imply that I just Oh, are you trying to imply that I just Oh, are you trying to imply that I just like like like >> [laughter] >> [laughter] >> [laughter] >> Hey, make me a site. So, I I am um >> Hey, make me a site. So, I I am um >> Hey, make me a site. So, I I am um uh uh uh I am known for uh I am known for uh I am known for uh liking static stuff. I think we've liking static stuff. I think we've liking static stuff. I think we've talked about this a little bit. talked about this a little bit. talked about this a little bit. >> stuff like you don't have a >> stuff like you don't have a >> stuff like you don't have a >> need a database. That's my whole thing. >> need a database. That's my whole thing. >> need a database. That's my whole thing. For 20 years, 25 years, you don't need a For 20 years, 25 years, you don't need a For 20 years, 25 years, you don't need a database. database. database. Just hold it in memory. Just hold it in memory. Just hold it in memory. >> Well, >> Well, >> Well, how big is how big is how big is >> How big is memory? Right. So, like my >> How big is memory? Right. So, like my >> How big is memory? Right. So, like my blog uh is running today in a Linux blog uh is running today in a Linux blog uh is running today in a Linux container on .NET. It's been sitting container on .NET. It's been sitting container on .NET. It's been sitting around for 22 years, 25 years. We keep around for 22 years, 25 years. We keep around for 22 years, 25 years. We keep moving it forward. It's a great .NET moving it forward. It's a great .NET moving it forward. It's a great .NET great example of .NET modernization. But great example of .NET modernization. But great example of .NET modernization. But every single blog post is stored in an every single blog post is stored in an every single blog post is stored in an XML file. And 22 years of blogging XML file. And 22 years of blogging XML file. And 22 years of blogging is 300 megs is 300 megs is 300 megs in memory.

in memory. in memory. Just hold it in memory. Just hold it in memory. Just hold it in memory. It's all read-only. It's all read-only. It's all read-only. >> Uh, what if you want to >> Uh, what if you want to >> Uh, what if you want to search efficiently? search efficiently? search efficiently? >> It's It's a big old hash table. I can go >> It's It's a big old hash table. I can go >> It's It's a big old hash table. I can go bananas. It's 300 megs. It's like I can bananas. It's 300 megs. It's like I can bananas. It's 300 megs. It's like I can do nothing. How can you not search 300 do nothing. How can you not search 300 do nothing. How can you not search 300 megs efficiently? megs efficiently? megs efficiently? >> But no, no. Like >> But no, no. Like >> But no, no. Like you're you're just doing you do string you're you're just doing you do string you're you're just doing you do string scans through the whole 300 megs. Like, scans through the whole 300 megs. Like, scans through the whole 300 megs. Like, "Hey, I want to find episodes that "Hey, I want to find episodes that "Hey, I want to find episodes that mention Mark." mention Mark." mention Mark." >> So, when I search my blog, I search the >> So, when I search my blog, I search the >> So, when I search my blog, I search the Google index. >> [laughter] >> [laughter] >> That's true. >> That's true. >> That's true. It's stupid. It's stupid. It's stupid. >> Do you have to pay for the >> Do you have to pay for the >> Do you have to pay for the >> I don't have to pay for anything. >> I don't have to pay for anything. >> I don't have to pay for anything. >> How does So, how do you search >> How does So, how do you search >> How does So, how do you search efficiently? efficiently? efficiently? >> very proud of this. >> very proud of this. >> very proud of this. Do you understand that I am cheap? I I I Do you understand that I am cheap? I I I Do you understand that I am cheap? I I I am not paying am not paying am not paying >> You could call Google search without >> You could call Google search without >> You could call Google search without paying for it. paying for it. paying for it. >> Yeah, I'll show you how you do it. >> Yeah, I'll show you how you do it. >> Yeah, I'll show you how you do it. >> Are you like scraping the webpage or >> Are you like scraping the webpage or >> Are you like scraping the webpage or with some with some with some >> You Yeah, you just You just go like >> You Yeah, you just You just go like >> You Yeah, you just You just go like this. this. this. >> [laughter] >> It's so dumb. >> It's so dumb. Russenovitch Russenovitch Russenovitch >> So, what are you doing right there when >> So, what are you doing right there when >> So, what are you doing right there when you you you >> I'm searching my blog.

>> I'm searching my blog. >> I'm searching my blog. >> Yeah. >> Yeah. >> Yeah. Oh, you actually do the search embedded Oh, you actually do the search embedded Oh, you actually do the search embedded [laughter] [laughter] [laughter] web browser webpage in it. web browser webpage in it. web browser webpage in it. >> Yes. >> Wow. >> Wow. >> [laughter] >> [laughter] >> [laughter] >> Oh, what is this? >> But >> But uh, wow. uh, wow. uh, wow. And you're restricted to your site. And you're restricted to your site. And you're restricted to your site. >> Yep. >> Yep. >> Yep. Look at me. Look at me asking for help Look at me. Look at me asking for help Look at me. Look at me asking for help from you and going un unearned. from you and going un unearned. from you and going un unearned. >> that page. >> that page. >> that page. >> Maybe you can jump in now, 20 years >> Maybe you can jump in now, 20 years >> Maybe you can jump in now, 20 years later, later, later, and explain Vista reparse points cuz we and explain Vista reparse points cuz we and explain Vista reparse points cuz we were suffering wondering were suffering wondering were suffering wondering >> Did we talk about it? >> Did we talk about it? >> Did we talk about it? >> Uh, I don't know. Windows upgraded NTFS >> Uh, I don't know. Windows upgraded NTFS >> Uh, I don't know. Windows upgraded NTFS >> Yeah. >> Yeah. >> Yeah. >> uh, [snorts] 20 years ago and you never >> uh, [snorts] 20 years ago and you never >> uh, [snorts] 20 years ago and you never you never jumped in here to help out. you never jumped in here to help out. you never jumped in here to help out. That's when junction points came out. That's when junction points came out. That's when junction points came out. >> Yeah. >> Yeah. >> Yeah. >> Oh, look Look Look at me using Junction. >> Oh, look Look Look at me using Junction. >> Oh, look Look Look at me using Junction. Wow. Wow. Wow. Beginning of a 20-year long love affair. Beginning of a 20-year long love affair. Beginning of a 20-year long love affair. >> That your first system internal tool? >> That your first system internal tool? >> That your first system internal tool? >> What's that? >> What's that? >> What's that? >> That your first system internal tool? >> That your first system internal tool? >> That your first system internal tool? >> Uh >> Uh >> Uh I didn't I've never written a first Have I didn't I've never written a first Have I didn't I've never written a first Have I written a I've never written one.

I written a I've never written one. I written a I've never written one. >> Was that the first time you used >> Was that the first time you used >> Was that the first time you used >> Oh, my first one I've ever used? Oh, >> Oh, my first one I've ever used? Oh, >> Oh, my first one I've ever used? Oh, that's a good question. that's a good question. that's a good question. When is my first system internal When is my first system internal When is my first system internal >> We're like off three >> We're like off three >> We're like off three >> Oh, they love this stuff. Relax. >> Oh, they love this stuff. Relax. >> Oh, they love this stuff. Relax. My first My first My first >> Do you remember what we started talking >> Do you remember what we started talking >> Do you remember what we started talking about? >> [laughter] >> [laughter] >> What was >> What was >> What was >> You pushed so many things on the stack. >> You pushed so many things on the stack. >> You pushed so many things on the stack. You've overflowed it. >> What if we talked What did we start >> What if we talked What did we start talking about? talking about? talking about? >> Ref checker. >> Ref checker. >> Ref checker. >> Oh, yeah. >> Oh, yeah. >> Oh, yeah. Congratulations on your tool, bud. >> [laughter] >> [laughter] >> Congratulations on your tool. Okay, what >> Congratulations on your tool. Okay, what >> Congratulations on your tool. Okay, what are going to happen to these people? Are are going to happen to these people? Are are going to happen to these people? Are they in trouble? they in trouble? they in trouble? >> No. Uh well, I don't know what >> No. Uh well, I don't know what >> No. Uh well, I don't know what Iclear hasn't indicated they're going to Iclear hasn't indicated they're going to Iclear hasn't indicated they're going to do anything with the papers or the do anything with the papers or the do anything with the papers or the authors. authors. authors. >> Man, oh man, oh man. Okay, so how endemic is this problem? Okay, so how endemic is this problem? I think it is going to be massive. I think it is going to be massive. I think it is going to be massive. >> It's It is It's massive. Um in fact, I'm >> It's It is It's massive. Um in fact, I'm >> It's It is It's massive. Um in fact, I'm refining the hallucination flagging to refining the hallucination flagging to refining the hallucination flagging to be more precise, and I think I'll find a be more precise, and I think I'll find a be more precise, and I think I'll find a lot more lot more lot more >> Okay.

>> Okay. >> Okay. >> than I found in the first scan. It's a >> than I found in the first scan. It's a >> than I found in the first scan. It's a tough tough tough >> It is a tough problem to find. And and >> It is a tough problem to find. And and >> It is a tough problem to find. And and there's some there's some there's some you know, nuance and you know, nuance and you know, nuance and >> I think the thing that offends me the >> I think the thing that offends me the >> I think the thing that offends me the most is the doubling down. most is the doubling down. most is the doubling down. >> Yeah, that one That That one was like, >> Yeah, that one That That one was like, >> Yeah, that one That That one was like, "What are you doing?" Oh, there was "What are you doing?" Oh, there was "What are you doing?" Oh, there was another one that's like, another one that's like, another one that's like, "Yeah, yeah, we do we do have five "Yeah, yeah, we do we do have five "Yeah, yeah, we do we do have five hallucinated references you caught, but hallucinated references you caught, but hallucinated references you caught, but you know, here's the thing. you know, here's the thing. you know, here's the thing. Um Um Um the other papers you found had way fewer the other papers you found had way fewer the other papers you found had way fewer citations than ours. So, you So, your citations than ours. So, you So, your citations than ours. So, you So, your threshold of five seems arbitrary. It threshold of five seems arbitrary. It threshold of five seems arbitrary. It should be a percent. And if you look at should be a percent. And if you look at should be a percent. And if you look at percentage-wise, that's only 4% of our percentage-wise, that's only 4% of our percentage-wise, that's only 4% of our references. So, and I'm like references. So, and I'm like references. So, and I'm like What [laughter] is that enough like What [laughter] is that enough like What [laughter] is that enough like >> than a single reference is is >> than a single reference is is >> than a single reference is is unacceptable. unacceptable. unacceptable. >> so there was that argument, too, which >> so there was that argument, too, which >> so there was that argument, too, which is is is >> Well, I've got a I've got a friend, >> Well, I've got a I've got a friend, >> Well, I've got a I've got a friend, actually. I'll put this Remind me, actually. I'll put this Remind me, actually. I'll put this Remind me, producer Rob, to put this in the producer Rob, to put this in the producer Rob, to put this in the in the chat uh who is doing a survey, in the chat uh who is doing a survey, in the chat uh who is doing a survey, Cynthia Dunlop, is doing a survey on why Cynthia Dunlop, is doing a survey on why Cynthia Dunlop, is doing a survey on why do people do people do people use LLMs to write blogs?

use LLMs to write blogs? use LLMs to write blogs? I am starting to get pretty frustrated I am starting to get pretty frustrated I am starting to get pretty frustrated that when I go and Google for stuff that when I go and Google for stuff that when I go and Google for stuff 90% of the material is just clearly not 90% of the material is just clearly not 90% of the material is just clearly not written by a human. written by a human. written by a human. >> Okay, so let me ask you >> Okay, so let me ask you >> Okay, so let me ask you this. How much Are we over time? this. How much Are we over time? this. How much Are we over time? >> Oh, we're way over time. >> Oh, we're way over time. >> Oh, we're way over time. >> Okay. >> Okay. >> Okay. Then I want to ask you. Then I want to ask you. Then I want to ask you. >> No, ask me. >> No, ask me. >> No, ask me. Do it. Do it. Do it. >> So >> So >> So So, yeah, I believe very much in the So, yeah, I believe very much in the So, yeah, I believe very much in the effort for value, you know, return on, effort for value, you know, return on, effort for value, you know, return on, you know, what is it worth? you know, what is it worth? you know, what is it worth? What is the effort worth? What is the effort worth? What is the effort worth? >> Okay. >> Okay. >> Okay. >> Um and if I can get something good >> Um and if I can get something good >> Um and if I can get something good enough enough enough I'll I'll look for the to to hit my bar I'll I'll look for the to to hit my bar I'll I'll look for the to to hit my bar of here's what I have the min bar of of here's what I have the min bar of of here's what I have the min bar of what I want what I want what I want >> Mhm. >> Mhm. >> Mhm. >> as cheaply and efficiently as possible. >> as cheaply and efficiently as possible. >> as cheaply and efficiently as possible. I mean, you you've demonstrated some of I mean, you you've demonstrated some of I mean, you you've demonstrated some of the the same kind of the the same kind of the the same kind of >> I just argued that you should do it >> I just argued that you should do it >> I just argued that you should do it because the by the barrier to entry. So, because the by the barrier to entry. So, because the by the barrier to entry. So, that just means slop it up. that just means slop it up. that just means slop it up. >> Okay, no, I don't mean So, >> Okay, no, I don't mean So, >> Okay, no, I don't mean So, what I'll do um for a LinkedIn post, for what I'll do um for a LinkedIn post, for what I'll do um for a LinkedIn post, for example, is I'll say, "Here are the example, is I'll say, "Here are the example, is I'll say, "Here are the bullets of what I and points that I want bullets of what I and points that I want bullets of what I and points that I want to make. to make. to make. Now, it Copilot go off go write the the Now, it Copilot go off go write the the Now, it Copilot go off go write the the post based on this." And then I look at post based on this." And then I look at post based on this." And then I look at it and I'm like, "No, I don't like that.

it and I'm like, "No, I don't like that. it and I'm like, "No, I don't like that. Tweak that." Tweak that." Tweak that." But I use it as the you know But I use it as the you know But I use it as the you know flesh it in. I don't want to type on all flesh it in. I don't want to type on all flesh it in. I don't want to type on all these words myself, uh but I know the these words myself, uh but I know the these words myself, uh but I know the substance of what I want conveyed. substance of what I want conveyed. substance of what I want conveyed. And that for something like that, it's And that for something like that, it's And that for something like that, it's just just just that's that's the level of that's that's the level of that's that's the level of effort that that think is justified. effort that that think is justified. effort that that think is justified. >> So, it's not fair to say you are using >> So, it's not fair to say you are using >> So, it's not fair to say you are using it to write your LinkedIn post, but it it to write your LinkedIn post, but it it to write your LinkedIn post, but it is fair to say you are using it to is fair to say you are using it to is fair to say you are using it to kickstart kickstart kickstart >> Yeah. >> Yeah. >> Yeah. >> 50-60% of your LinkedIn post. >> 50-60% of your LinkedIn post. >> 50-60% of your LinkedIn post. >> even more than that. >> even more than that. >> even more than that. More than that. More than that. More than that. >> That's interesting cuz I have not >> That's interesting cuz I have not >> That's interesting cuz I have not thought thought thought >> Basically, I'm saying, "Here are the >> Basically, I'm saying, "Here are the >> Basically, I'm saying, "Here are the things to include in this order." things to include in this order." things to include in this order." >> Right, right, right. But the reason I'm >> Right, right, right. But the reason I'm >> Right, right, right. But the reason I'm asking this is that I have not thought asking this is that I have not thought asking this is that I have not thought I have not clocked I have not clocked I have not clocked that you did that. that you did that. that you did that. >> Yeah. To your credit. >> Yeah. To your credit. >> Yeah. To your credit. Yeah, it's cuz I I'm Yeah, it's cuz I I'm Yeah, it's cuz I I'm I'm trying to you know, I'm trying to you know, I'm trying to you know, make it something that I would that that make it something that I would that that make it something that I would that that I'm happy representing me. I'm happy representing me. I'm happy representing me. >> Right. So, then the problem is if I >> Right. So, then the problem is if I >> Right. So, then the problem is if I can't tell, do I have a reason to be can't tell, do I have a reason to be can't tell, do I have a reason to be offended?

offended? offended? >> You shouldn't. Like, what does it >> You shouldn't. Like, what does it >> You shouldn't. Like, what does it matter? It's a tool I'm using a tool. matter? It's a tool I'm using a tool. matter? It's a tool I'm using a tool. >> Right. >> Right. >> Right. >> Yeah. Like, you should be offended that >> Yeah. Like, you should be offended that >> Yeah. Like, you should be offended that I have no spelling mistakes in my I have no spelling mistakes in my I have no spelling mistakes in my LinkedIn post? LinkedIn post? LinkedIn post? >> I like to leave one as an Easter egg. >> I like to leave one as an Easter egg. >> I like to leave one as an Easter egg. Yeah. Is it cheating to use to use it to Yeah. Is it cheating to use to use it to Yeah. Is it cheating to use to use it to write text? Because this is the thing, write text? Because this is the thing, write text? Because this is the thing, here I am here I am here I am being being being precious and saying, "Well, it's not precious and saying, "Well, it's not precious and saying, "Well, it's not cheating to write code, but it is cheating to write code, but it is cheating to write code, but it is cheating to write prose." cheating to write prose." cheating to write prose." >> Yeah. >> Yeah. >> Yeah. I I I I view it as a tool used properly, it's I view it as a tool used properly, it's I view it as a tool used properly, it's an accelerator. Uh an accelerator. Uh an accelerator. Uh >> But then how far do we accelerate? Like, >> But then how far do we accelerate? Like, >> But then how far do we accelerate? Like, if I don't need to if I don't need to if I don't need to if I don't need to if I don't need to if I don't need to write it and you don't need to read it, write it and you don't need to read it, write it and you don't need to read it, then your bot will read my bot's stuff then your bot will read my bot's stuff then your bot will read my bot's stuff and then what happens? and then what happens? and then what happens? >> Well, >> Well, >> Well, I still you still like the input side I still you still like the input side I still you still like the input side doesn't go away. doesn't go away. doesn't go away. I don't I don't I don't >> So, then now we have to read more than >> So, then now we have to read more than >> So, then now we have to read more than ever. So, ever. So, ever. So, >> I mean, you know what I mean? There's >> I mean, you know what I mean? There's >> I mean, you know what I mean? There's still like, "Oh, I'll just have AI still like, "Oh, I'll just have AI still like, "Oh, I'll just have AI summarize it." Well, you're going to summarize it." Well, you're going to summarize it." Well, you're going to miss a lot if you just have AI summarize miss a lot if you just have AI summarize miss a lot if you just have AI summarize it. it. it. >> Well, to >> Well, to >> Well, to Today, we were in a meeting an hour Today, we were in a meeting an hour Today, we were in a meeting an hour meeting with you. meeting with you. meeting with you. >> Mhm. >> Mhm. >> Mhm. >> Reading a document for 40 minutes.

>> Reading a document for 40 minutes. >> Reading a document for 40 minutes. >> Yeah. And I I made a joke at the >> Yeah. And I I made a joke at the >> Yeah. And I I made a joke at the beginning I should just have Copilot beginning I should just have Copilot beginning I should just have Copilot summarize it for me. summarize it for me. summarize it for me. >> But then you insisted that we all >> But then you insisted that we all >> But then you insisted that we all >> Yeah. >> Yeah. >> Yeah. >> turn off our mics, turn off our cameras, >> turn off our mics, turn off our cameras, >> turn off our mics, turn off our cameras, and everybody read for, you know, half and everybody read for, you know, half and everybody read for, you know, half an hour plus. an hour plus. an hour plus. >> Yep. >> So, >> So, was that document written by an AI or is was that document written by an AI or is was that document written by an AI or is that written by Ryan? that written by Ryan? that written by Ryan? >> I think multiple people wrote that >> I think multiple people wrote that >> I think multiple people wrote that document, but I also document, but I also document, but I also >> That was a lot of humans in that >> That was a lot of humans in that >> That was a lot of humans in that >> Yeah, and I also believe that AI >> Yeah, and I also believe that AI >> Yeah, and I also believe that AI probably probably probably filled in part of it for them. filled in part of it for them. filled in part of it for them. >> Probably hunted down some of the >> Probably hunted down some of the >> Probably hunted down some of the bulleted lists. bulleted lists. bulleted lists. >> Yeah. >> Yeah. >> Yeah. Or fleshed in some of the, you know, Or fleshed in some of the, you know, Or fleshed in some of the, you know, here's the bullets. Fill fill in the here's the bullets. Fill fill in the here's the bullets. Fill fill in the paragraph. paragraph. paragraph. >> There's definitely a reckoning coming. >> There's definitely a reckoning coming. >> There's definitely a reckoning coming. >> Yeah. >> Yeah. >> Yeah. >> But you know, the thing is on when I'm >> But you know, the thing is on when I'm >> But you know, the thing is on when I'm reviewing my LinkedIn post, I've got reviewing my LinkedIn post, I've got reviewing my LinkedIn post, I've got judgment based on judgment based on judgment based on my long experience writing. my long experience writing. my long experience writing. >> Well, so then this gets to This is >> Well, so then this gets to This is >> Well, so then this gets to This is another Maybe that's another show. another Maybe that's another show. another Maybe that's another show. >> Yeah. >> Yeah. >> Yeah. >> Because >> Because >> Because if you have good taste, if you have good taste, if you have good taste, then you can steer a AI to write good then you can steer a AI to write good then you can steer a AI to write good code.

code. code. >> Yep. >> Yep. >> Yep. >> If you are a good writer, can you steer >> If you are a good writer, can you steer >> If you are a good writer, can you steer an AI to write well? an AI to write well? an AI to write well? >> can. >> can. >> can. >> Write gooder. >> Write gooder. >> Write gooder. >> Yeah. >> Yeah. >> Yeah. >> More better. [snorts] >> More better. [snorts] >> More better. [snorts] I'll get it right one day. I'll get it right one day. I'll get it right one day. >> Yeah. >> Yeah. >> Yeah. >> That's that's a whole That's a whole >> That's that's a whole That's a whole >> That's that's a whole That's a whole thing. thing. thing. >> you just have to look at it as a tool, >> you just have to look at it as a tool, >> you just have to look at it as a tool, but you've got an And we Oh, you know I but you've got an And we Oh, you know I but you've got an And we Oh, you know I you when I pinged you you when I pinged you you when I pinged you uh a few weeks ago and I said, "Scott, uh a few weeks ago and I said, "Scott, uh a few weeks ago and I said, "Scott, I'm looking for an analogy that can help I'm looking for an analogy that can help I'm looking for an analogy that can help drive this point home. What is a tool, drive this point home. What is a tool, drive this point home. What is a tool, an example of a tool an example of a tool an example of a tool that is only useful in the hands of an that is only useful in the hands of an that is only useful in the hands of an expert?" And we talked about a lathe, expert?" And we talked about a lathe, expert?" And we talked about a lathe, I think. I think. I think. >> Yeah. Yeah. >> Yeah. Yeah. >> Yeah. Yeah. My dad has two lathes. My dad has two lathes. My dad has two lathes. >> Yeah. >> Yeah. >> Yeah. That that tool you put in the hands of a That that tool you put in the hands of a That that tool you put in the hands of a novice, even if they're turning novice, even if they're turning novice, even if they're turning >> They they will lose a finger. >> They they will lose a finger. >> They they will lose a finger. >> Yeah. >> Yeah. >> Yeah. >> [laughter] >> [laughter] >> [laughter] >> Well, they could teach them how to use >> Well, they could teach them how to use >> Well, they could teach them how to use the lathe, but the lathe, but the lathe, but they don't know the basics of they don't know the basics of they don't know the basics of woodworking and design, and they're not woodworking and design, and they're not woodworking and design, and they're not going to going to going to do anything useful with the lathe. do anything useful with the lathe. do anything useful with the lathe. >> 100% No, and and when I'm talking about >> 100% No, and and when I'm talking about >> 100% No, and and when I'm talking about the danger, like the danger, like the danger, like woodworking is a classic example.

woodworking is a classic example. woodworking is a classic example. >> Yeah. Well, I don't know about the So, >> Yeah. Well, I don't know about the So, >> Yeah. Well, I don't know about the So, here I think the analogy that I'm here I think the analogy that I'm here I think the analogy that I'm looking for would be they create a table looking for would be they create a table looking for would be they create a table with the lathe with with the lathe with with the lathe with legs that are fragile. legs that are fragile. legs that are fragile. >> Yeah. Yeah, okay. >> Yeah. Yeah, okay. >> Yeah. Yeah, okay. That works. Although, losing fingers is That works. Although, losing fingers is That works. Although, losing fingers is more dramatic than more dramatic than more dramatic than >> Yeah, but that's losing like what are >> Yeah, but that's losing like what are >> Yeah, but that's losing like what are you going to How are you going to hurt you going to How are you going to hurt you going to How are you going to hurt yourself using, you know, GitHub yourself using, you know, GitHub yourself using, you know, GitHub Copilot? Copilot? Copilot? >> You're going to write software that's >> You're going to write software that's >> You're going to write software that's going to delete your data base. going to delete your data base. going to delete your data base. >> But that But that like while you're >> But that But that like while you're >> But that But that like while you're writing this while you're writing writing this while you're writing writing this while you're writing >> all right. All right. >> all right. All right. >> all right. All right. Well, your brain will rot. >> It's a longer-term, more slow >> It's a longer-term, more slow >> Yeah, it's a slow rot. >> Yeah, it's a slow rot. >> Yeah, it's a slow rot. >> Yeah, it's a slow rot. >> Yeah, it's a slow rot. >> Yeah, it's a slow rot. >> Oh. >> Oh. >> Oh. Here By the way, we're at the end of the Here By the way, we're at the end of the Here By the way, we're at the end of the show. I had We have another idea for show. I had We have another idea for show. I had We have another idea for you. you. you. >> Yeah. >> Yeah. >> Yeah. >> Okay, you ready for this? >> Okay, you ready for this? >> Okay, you ready for this? You play Battlefield You play Battlefield You play Battlefield >> Who's we? >> Who's we? >> Who's we? >> Me and producer Rob. >> Me and producer Rob. >> Me and producer Rob. >> [laughter] >> [laughter] >> [laughter] >> I play Battlefield. >> I play Battlefield. >> I play Battlefield. >> Okay. >> Okay. >> Okay. >> Yeah. >> Yeah. >> Yeah. >> We need to do a Market Scott learn to >> We need to do a Market Scott learn to >> We need to do a Market Scott learn to play Battlefield where we're you and I play Battlefield where we're you and I play Battlefield where we're you and I are loaded in are loaded in are loaded in >> and I crush you. >> and I crush you. >> and I crush you. >> We live stream you destroy us all >> We live stream you destroy us all >> We live stream you destroy us all and while we talk about tech. and while we talk about tech. and while we talk about tech. >> Yeah, all right. I'm in. >> Yeah, all right. I'm in. >> Yeah, all right. I'm in. >> Is that awesome? >> Is that awesome? >> Is that awesome? >> Yeah.

>> Yeah. >> Yeah. >> Okay, cool. >> Okay, cool. >> Okay, cool. Do you game on the same PC or do you Do you game on the same PC or do you Do you game on the same PC or do you have like a gaming PC or have like a gaming PC or have like a gaming PC or >> I game on this PC. Although, it's it's >> I game on this PC. Although, it's it's >> I game on this PC. Although, it's it's unstable right now on Battlefield 6 and unstable right now on Battlefield 6 and unstable right now on Battlefield 6 and so I'm like I don't know. It's weird. so I'm like I don't know. It's weird. so I'm like I don't know. It's weird. Why? Video video card driver? Why? Video video card driver? Why? Video video card driver? Uh I don't know. I mean, it'll I I'll Uh I don't know. I mean, it'll I I'll Uh I don't know. I mean, it'll I I'll I I I It's rare that it'll finish a whole game It's rare that it'll finish a whole game It's rare that it'll finish a whole game round without either crashing to the round without either crashing to the round without either crashing to the desktop or spontaneously rebooting the desktop or spontaneously rebooting the desktop or spontaneously rebooting the machine. So, I think it's probably Yeah, machine. So, I think it's probably Yeah, machine. So, I think it's probably Yeah, it's probably a memory problem. it's probably a memory problem. it's probably a memory problem. >> Spontaneously rebooting? Is that >> Spontaneously rebooting? Is that >> Spontaneously rebooting? Is that anti-cheat or are you think you've got a anti-cheat or are you think you've got a anti-cheat or are you think you've got a bad driver? No, I think it's a hardware bad driver? No, I think it's a hardware bad driver? No, I think it's a hardware problem. problem. problem. >> So, I'm like I could troubleshoot it, >> So, I'm like I could troubleshoot it, >> So, I'm like I could troubleshoot it, but I think I needed to just give it to but I think I needed to just give it to but I think I needed to just give it to a PC repair shop and have them figure it a PC repair shop and have them figure it a PC repair shop and have them figure it out. out. out. >> The irony of you doing that and not >> The irony of you doing that and not >> The irony of you doing that and not figuring it out yourself. figuring it out yourself. figuring it out yourself. >> Well, in the old days I would have, but >> Well, in the old days I would have, but >> Well, in the old days I would have, but >> You know who could fix that for you? >> You know who could fix that for you? >> You know who could fix that for you? Damian Edwards. Damian Edwards. Damian Edwards. >> Who's that? >> Who's that? >> Who's that? >> Damian Edwards is the .NET architect who >> Damian Edwards is the .NET architect who >> Damian Edwards is the .NET architect who built my PC with me. We had live built my PC with me. We had live built my PC with me. We had live streamed the whole thing. streamed the whole thing. streamed the whole thing. Freaking loves this kind of stuff. Freaking loves this kind of stuff. Freaking loves this kind of stuff. >> Yeah, should I just ping him? >> Yeah, should I just ping him? >> Yeah, should I just ping him? >> give him like you give him a dollar >> give him like you give him a dollar >> give him like you give him a dollar amount and he will build you a machine.

amount and he will build you a machine. amount and he will build you a machine. He's got a whole website that he puts up He's got a whole website that he puts up He's got a whole website that he puts up on PC Part Picker on PC Part Picker on PC Part Picker >> Yeah. >> Yeah. >> Yeah. >> to make like the ultimate PC with the >> to make like the ultimate PC with the >> to make like the ultimate PC with the right amount of money. He's made right amount of money. He's made right amount of money. He's made dozen PCs. dozen PCs. dozen PCs. >> Yeah. >> Yeah. >> Yeah. >> He'd be a great guest. He knows more >> He'd be a great guest. He knows more >> He'd be a great guest. He knows more about this stuff than anybody and he's about this stuff than anybody and he's about this stuff than anybody and he's super fun to hang out with. super fun to hang out with. super fun to hang out with. Huh. Okay. Yeah, but Battlefield live Huh. Okay. Yeah, but Battlefield live Huh. Okay. Yeah, but Battlefield live streaming Battlefield. If you like that streaming Battlefield. If you like that streaming Battlefield. If you like that idea, chat. idea, chat. idea, chat. Uh we'll figure I don't know how it Uh we'll figure I don't know how it Uh we'll figure I don't know how it would work in Riverside. We might need would work in Riverside. We might need would work in Riverside. We might need to move to Twitch, Producer Rob. to move to Twitch, Producer Rob. to move to Twitch, Producer Rob. Uh Uh Uh >> [snorts] >> [snorts] >> [snorts] >> but we'll stream on my Twitch and my Tik >> but we'll stream on my Twitch and my Tik >> but we'll stream on my Twitch and my Tik Tok and it'll be me and Mark playing Tok and it'll be me and Mark playing Tok and it'll be me and Mark playing Battlefield and talking about Battlefield and talking about Battlefield and talking about technology. technology. technology. So you're Do you Are you mouse and So you're Do you Are you mouse and So you're Do you Are you mouse and keyboard? keyboard? keyboard? >> Yeah. >> Yeah. >> Yeah. >> You're just like WASD and >> You're just like WASD and >> You're just like WASD and >> I Totally. >> I Totally. >> I Totally. >> Twitch Twitch Twitch. >> Twitch Twitch Twitch. >> Twitch Twitch Twitch. >> I can't play with Xbox controller. >> Really? >> Really? >> Yeah. >> Yeah. >> Yeah. >> Now, are you twitchy? Are you like >> Now, are you twitchy? Are you like >> Now, are you twitchy? Are you like >> I don't know if I haven't watched >> I don't know if I haven't watched >> I don't know if I haven't watched >> you like >> you like >> you like Do you like you can tell when the DPI is Do you like you can tell when the DPI is Do you like you can tell when the DPI is wrong on your mouse? wrong on your mouse? wrong on your mouse? >> Yeah, for sure. >> Yeah, for sure. >> Yeah, for sure. >> Okay. Interesting. This is going to be This is going to be This is going to be This is going to be a good episode. You watch. We're going a good episode. You watch. We're going a good episode. You watch. We're going to do this.

to do this. to do this. Going to We're going to rack up the Going to We're going to rack up the Going to We're going to rack up the guests. People are going to be excited guests. People are going to be excited guests. People are going to be excited to come on the show now. to come on the show now. to come on the show now. All right. All right. All right. People are wondering where I am in this People are wondering where I am in this People are wondering where I am in this other meeting. All right. This is good. other meeting. All right. This is good. other meeting. All right. This is good. >> I thought you were going to flip out. >> I thought you were going to flip out. >> I thought you were going to flip out. >> Like and subscribe, right? >> Like and subscribe, right? >> Like and subscribe, right? >> I thought we were having a one-on-one. >> I thought we were having a one-on-one. >> I thought we were having a one-on-one. >> Oh, we got to talk about it after this. >> Oh, we got to talk about it after this. >> Oh, we got to talk about it after this. Okay. We'll do our one-on-one. Okay. We'll do our one-on-one. Okay. We'll do our one-on-one. Bye. Bye. Bye. >> Bye. >> Bye. >> Bye. >> [laughter]