Stack Overflow for the Agent Era - with VP of Product Alex Lato

[music] [music] Hi, I'm Scott Hansel and this is another Hi, I'm Scott Hansel and this is another Hi, I'm Scott Hansel and this is another episode of Hansel Minutes. Today I'm episode of Hansel Minutes. Today I'm episode of Hansel Minutes. Today I'm chatting with Alex Lau. She's the VP of chatting with Alex Lau. She's the VP of chatting with Alex Lau. She's the VP of product stack overflow. How are you? product stack overflow. How are you? product stack overflow. How are you? >> Super good. Excited to be here. How are >> Super good. Excited to be here. How are >> Super good. Excited to be here. How are you? you? you? >> I'm good. Thanks for hanging out. So um >> I'm good. Thanks for hanging out. So um >> I'm good. Thanks for hanging out. So um you know for a a minute there we kind of you know for a a minute there we kind of you know for a a minute there we kind of worked for the same people because you worked for the same people because you worked for the same people because you were at GitHub and um you were doing were at GitHub and um you were doing were at GitHub and um you were doing product work at GitHub and you left uh product work at GitHub and you left uh product work at GitHub and you left uh after you know you had done a lot of after you know you had done a lot of after you know you had done a lot of stuff at GitHub. You've been there a stuff at GitHub. You've been there a stuff at GitHub. You've been there a couple of years almost four years. This couple of years almost four years. This couple of years almost four years. This is a kind of a marketleading company at is a kind of a marketleading company at is a kind of a marketleading company at GitHub and um but you joined a company GitHub and um but you joined a company GitHub and um but you joined a company Stack Overflow that I think we could Stack Overflow that I think we could Stack Overflow that I think we could argue has had a rough year or two uh argue has had a rough year or two uh argue has had a rough year or two uh with the rise of AI. What made you say, with the rise of AI. What made you say, with the rise of AI. What made you say, you know, there's a more interesting you know, there's a more interesting you know, there's a more interesting problem over at Stack Overflow? problem over at Stack Overflow? problem over at Stack Overflow? >> Yeah, good question. Starting off easy. >> Yeah, good question. Starting off easy. >> Yeah, good question. Starting off easy. I like it. I like it. I like it. >> Just go right into the meaty [laughter] >> Just go right into the meaty [laughter] >> Just go right into the meaty [laughter] part. part. part. >> Good. I like it. Like your style. Um, >> Good. I like it. Like your style. Um, >> Good. I like it. Like your style. Um, [snorts] I was at GitHub almost four [snorts] I was at GitHub almost four [snorts] I was at GitHub almost four years and I have to say the most years and I have to say the most years and I have to say the most exciting four years probably of my exciting four years probably of my exciting four years probably of my career so far. I love GitHub. Uh, I use career so far. I love GitHub. Uh, I use career so far. I love GitHub. Uh, I use it every single day still. Uh, some of it every single day still. Uh, some of it every single day still. Uh, some of my best friends still work there. So, I my best friends still work there. So, I my best friends still work there. So, I think we did definitely have some uh think we did definitely have some uh think we did definitely have some uh some overlap. Um, when I started at some overlap. Um, when I started at some overlap. Um, when I started at GitHub, it was a completely different GitHub, it was a completely different GitHub, it was a completely different place than it was four years later. Uh, place than it was four years later. Uh, place than it was four years later. Uh, positive both ways. But I think what I positive both ways. But I think what I positive both ways. But I think what I loved most about GitHub is every problem loved most about GitHub is every problem loved most about GitHub is every problem had direct impact right away, right? You had direct impact right away, right? You had direct impact right away, right? You could see it live in the market within a could see it live in the market within a could see it live in the market within a few hours. There would be impact few hours. There would be impact few hours. There would be impact feedback. Uh, that feedback loop for a feedback. Uh, that feedback loop for a feedback. Uh, that feedback loop for a product manager was incredibly product manager was incredibly product manager was incredibly addicting, right? It's when you have addicting, right? It's when you have addicting, right? It's when you have that type of volume for developers and

that type of volume for developers and that type of volume for developers and you have their attention, it's like a you have their attention, it's like a you have their attention, it's like a crazy place to be in. So that was a crazy place to be in. So that was a crazy place to be in. So that was a really hard luxury to leave. On the really hard luxury to leave. On the really hard luxury to leave. On the other hand, I think the tension with other hand, I think the tension with other hand, I think the tension with Stack Overflow where it's been a brand Stack Overflow where it's been a brand Stack Overflow where it's been a brand that I've used for the last 17 years um that I've used for the last 17 years um that I've used for the last 17 years um both as a lurker and sometimes an answer both as a lurker and sometimes an answer both as a lurker and sometimes an answer when I was uh feeling confident enough when I was uh feeling confident enough when I was uh feeling confident enough uh was a place that I was very curious uh was a place that I was very curious uh was a place that I was very curious about after especially chat GPT came about after especially chat GPT came about after especially chat GPT came out. I think the narrative in the market out. I think the narrative in the market out. I think the narrative in the market was Stack Overflow is dead. So I always was Stack Overflow is dead. So I always was Stack Overflow is dead. So I always kind of kept it in my head when I saw kind of kept it in my head when I saw kind of kept it in my head when I saw this role for a product leader. I was this role for a product leader. I was this role for a product leader. I was like what are they building? what are like what are they building? what are like what are they building? what are they up to? And so that tension of going they up to? And so that tension of going they up to? And so that tension of going from a market leader to a market leader from a market leader to a market leader from a market leader to a market leader who used to be a market leader, I guess, who used to be a market leader, I guess, who used to be a market leader, I guess, >> was very exciting. And so when I started >> was very exciting. And so when I started >> was very exciting. And so when I started talking to them and seeing a little bit talking to them and seeing a little bit talking to them and seeing a little bit the situation that they were in and what the situation that they were in and what the situation that they were in and what they were looking to do, the pivot, the they were looking to do, the pivot, the they were looking to do, the pivot, the type of empowerment that role would type of empowerment that role would type of empowerment that role would have, I thought I could take the same, have, I thought I could take the same, have, I thought I could take the same, you know, skill set that I learned at you know, skill set that I learned at you know, skill set that I learned at GitHub, the same type of audience, GitHub, the same type of audience, GitHub, the same type of audience, right, and kind of scale that in a right, and kind of scale that in a right, and kind of scale that in a completely different uh ball game. So it completely different uh ball game. So it completely different uh ball game. So it was all about honestly personal was all about honestly personal was all about honestly personal development to an extent making a little development to an extent making a little development to an extent making a little bit of a bet on myself. Could I take bit of a bet on myself. Could I take bit of a bet on myself. Could I take what I learned at GitHub and go apply it what I learned at GitHub and go apply it what I learned at GitHub and go apply it there and truthfully just passion for there and truthfully just passion for there and truthfully just passion for that individual developer that SDLC the that individual developer that SDLC the that individual developer that SDLC the how do these developer tools fit in a how do these developer tools fit in a how do these developer tools fit in a day-to-day I that's always been a day-to-day I that's always been a day-to-day I that's always been a passion of mine. So being able to take passion of mine. So being able to take passion of mine. So being able to take that with me was very exciting. [snorts] that with me was very exciting. [snorts] that with me was very exciting. [snorts] >> Did you have any uh interesting >> Did you have any uh interesting >> Did you have any uh interesting interactions with co-workers or friends interactions with co-workers or friends interactions with co-workers or friends who you said yeah going to Stack who you said yeah going to Stack who you said yeah going to Stack Overflow and they're like really? Yeah.

Overflow and they're like really? Yeah. Overflow and they're like really? Yeah. Yeah. Yeah. I mean, I'll be very honest Yeah. Yeah. I mean, I'll be very honest Yeah. Yeah. I mean, I'll be very honest with you. I think 99% of my circle was with you. I think 99% of my circle was with you. I think 99% of my circle was like, "Are you okay? Are you sure?" Um, like, "Are you okay? Are you sure?" Um, like, "Are you okay? Are you sure?" Um, I think I had a conversation with my I think I had a conversation with my I think I had a conversation with my partner who works at Atlassim, actually. partner who works at Atlassim, actually. partner who works at Atlassim, actually. Um, and I got the question like, "Should Um, and I got the question like, "Should Um, and I got the question like, "Should we do that as a family? Like, are you we do that as a family? Like, are you we do that as a family? Like, are you sure?" And I was like, "I I believe in sure?" And I was like, "I I believe in sure?" And I was like, "I I believe in it." You know, I had many conversations it." You know, I had many conversations it." You know, I had many conversations with people at Stack. Um, I did my due with people at Stack. Um, I did my due with people at Stack. Um, I did my due diligence. I was excited. my colleagues diligence. I was excited. my colleagues diligence. I was excited. my colleagues at GitHub to this day. I spoke to some at GitHub to this day. I spoke to some at GitHub to this day. I spoke to some of them this week and they were like, of them this week and they were like, of them this week and they were like, "You are just so like brave was the word "You are just so like brave was the word "You are just so like brave was the word I got, right?" And then, I don't know, I got, right?" And then, I don't know, I got, right?" And then, I don't know, when I got there, to me, it was a when I got there, to me, it was a when I got there, to me, it was a no-brainer. I think the direction we're no-brainer. I think the direction we're no-brainer. I think the direction we're going makes a ton of sense. Um, I think going makes a ton of sense. Um, I think going makes a ton of sense. Um, I think I saw things that maybe a lot of people I saw things that maybe a lot of people I saw things that maybe a lot of people still don't see where maybe the website still don't see where maybe the website still don't see where maybe the website wasn't really the product, but the wasn't really the product, but the wasn't really the product, but the trust, the verification aspect was, and trust, the verification aspect was, and trust, the verification aspect was, and that is still very much the bread and that is still very much the bread and that is still very much the bread and butter. Um, so when I pitch it like butter. Um, so when I pitch it like butter. Um, so when I pitch it like that, I think a lot of people are like, that, I think a lot of people are like, that, I think a lot of people are like, "Whoa, yeah, that makes sense." Um, and "Whoa, yeah, that makes sense." Um, and "Whoa, yeah, that makes sense." Um, and a few engineers, right, some really good a few engineers, right, some really good a few engineers, right, some really good friends of mine were like, "Good for friends of mine were like, "Good for friends of mine were like, "Good for you. I love Stack Overflow. Go make that you. I love Stack Overflow. Go make that you. I love Stack Overflow. Go make that a thing again." a thing again." a thing again." >> That is cool. You know, [snorts] I uh I >> That is cool. You know, [snorts] I uh I >> That is cool. You know, [snorts] I uh I had a another product that was like a an had a another product that was like a an had a another product that was like a an online database that I recently signed online database that I recently signed online database that I recently signed up for and I was getting ready to go and up for and I was getting ready to go and up for and I was getting ready to go and read the docs and learn all about the read the docs and learn all about the read the docs and learn all about the docs. [snorts] And then when I hit the docs. [snorts] And then when I hit the docs. [snorts] And then when I hit the website, it said, "Paste this prompt website, it said, "Paste this prompt website, it said, "Paste this prompt into your agent." And that was kind of into your agent." And that was kind of into your agent." And that was kind of my first entree into like, oh, this is my first entree into like, oh, this is my first entree into like, oh, this is another way to do docs. you you visit another way to do docs. you you visit another way to do docs. you you visit the site, you get the prompt and then the site, you get the prompt and then the site, you get the prompt and then you go from there and then suddenly your you go from there and then suddenly your you go from there and then suddenly your agent knows everything that that website agent knows everything that that website agent knows everything that that website goes. I recently went to goes. I recently went to goes. I recently went to stackoverflow.com stackoverflow.com stackoverflow.com and I see that there's Stack Overflow and I see that there's Stack Overflow and I see that there's Stack Overflow for agents and there's a prompt right for agents and there's a prompt right for agents and there's a prompt right there and that prompt leads off to a

there and that prompt leads off to a there and that prompt leads off to a skill and you basically bootstrap all of skill and you basically bootstrap all of skill and you basically bootstrap all of the knowledge of Stack Overflow the knowledge of Stack Overflow the knowledge of Stack Overflow immediately into your agent. Um, but immediately into your agent. Um, but immediately into your agent. Um, but it's not like you're you're not you're it's not like you're you're not you're it's not like you're you're not you're not telling your agent go Google for not telling your agent go Google for not telling your agent go Google for stuff. You're literally giving it stuff. You're literally giving it stuff. You're literally giving it instructions on how to pull, how to instructions on how to pull, how to instructions on how to pull, how to check instru, how to validate. There's a check instru, how to validate. There's a check instru, how to validate. There's a whole API. Um, how do you how are we as whole API. Um, how do you how are we as whole API. Um, how do you how are we as an industry learning how to do this? How an industry learning how to do this? How an industry learning how to do this? How to have agent bootstrapping from a to have agent bootstrapping from a to have agent bootstrapping from a markdown file like this? Cuz it's it's markdown file like this? Cuz it's it's markdown file like this? Cuz it's it's interesting. It's not a JSON API. It's interesting. It's not a JSON API. It's interesting. It's not a JSON API. It's something else. something else. something else. >> Yeah. I I think also like from my time >> Yeah. I I think also like from my time >> Yeah. I I think also like from my time at GitHub, that introduction, right, of at GitHub, that introduction, right, of at GitHub, that introduction, right, of even just a markdown being like the even just a markdown being like the even just a markdown being like the source of truth, obviously GitHub bread source of truth, obviously GitHub bread source of truth, obviously GitHub bread and butter. Um but applying it in this and butter. Um but applying it in this and butter. Um but applying it in this way even at stack has been I think very way even at stack has been I think very way even at stack has been I think very interesting. It's a completely new interesting. It's a completely new interesting. It's a completely new onboarding methodology, right? What what onboarding methodology, right? What what onboarding methodology, right? What what I love most about this concept is kind I love most about this concept is kind I love most about this concept is kind of it becomes a self- sustaining loop, of it becomes a self- sustaining loop, of it becomes a self- sustaining loop, right? Once it's like installed or read, right? Once it's like installed or read, right? Once it's like installed or read, um you can kind of check back on it, um you can kind of check back on it, um you can kind of check back on it, right? Pulls new instruction, calling it right? Pulls new instruction, calling it right? Pulls new instruction, calling it like a heartbeat file, right? And it like a heartbeat file, right? And it like a heartbeat file, right? And it kind of stays current. I find that's a kind of stays current. I find that's a kind of stays current. I find that's a very very interesting way to kind of very very interesting way to kind of very very interesting way to kind of share and communicate now um share and communicate now um share and communicate now um instructions. So I see that as a really instructions. So I see that as a really instructions. So I see that as a really cool application of how we can scale, cool application of how we can scale, cool application of how we can scale, how we share instructions and guard how we share instructions and guard how we share instructions and guard rails with an agent. That's what I'm rails with an agent. That's what I'm rails with an agent. That's what I'm most excited for, Stack Overflow for most excited for, Stack Overflow for most excited for, Stack Overflow for agents, but also how we take that into agents, but also how we take that into agents, but also how we take that into an organization. I think it's a new kind an organization. I think it's a new kind an organization. I think it's a new kind of channel, right?

of channel, right? of channel, right? >> Yeah. >> Yeah. >> Yeah. >> That we have to keep in mind. And I >> That we have to keep in mind. And I >> That we have to keep in mind. And I think the thing that is is I'm not not think the thing that is is I'm not not think the thing that is is I'm not not quite clicked yet, but I think it's quite clicked yet, but I think it's quite clicked yet, but I think it's going to be a big thing in the next year going to be a big thing in the next year going to be a big thing in the next year is not the idea that this is simply a is not the idea that this is simply a is not the idea that this is simply a place for agents to consume information, place for agents to consume information, place for agents to consume information, but that if you look at this skill file but that if you look at this skill file but that if you look at this skill file and think about how Stack Overflow for and think about how Stack Overflow for and think about how Stack Overflow for agents is designed, you are encouraging agents is designed, you are encouraging agents is designed, you are encouraging the agents to verify and update and and the agents to verify and update and and the agents to verify and update and and share knowledge. And I think that's share knowledge. And I think that's share knowledge. And I think that's that's interesting. Why would I want to that's interesting. Why would I want to that's interesting. Why would I want to use my tokens for the collective like use my tokens for the collective like use my tokens for the collective like that would be a a question I'd ask. that would be a a question I'd ask. that would be a a question I'd ask. >> Yeah, absolutely. I think the some of >> Yeah, absolutely. I think the some of >> Yeah, absolutely. I think the some of the value ad that we've seen is we play the value ad that we've seen is we play the value ad that we've seen is we play a little bit on the um Stack Overflow a little bit on the um Stack Overflow a little bit on the um Stack Overflow identity, right, of knowing that you identity, right, of knowing that you identity, right, of knowing that you want to be part of that ecosystem want to be part of that ecosystem want to be part of that ecosystem contributing but also getting something contributing but also getting something contributing but also getting something back. So I think putting searching on back. So I think putting searching on back. So I think putting searching on stack as a kind of first gate probably stack as a kind of first gate probably stack as a kind of first gate probably creates token efficiency right down the creates token efficiency right down the creates token efficiency right down the road as there's more of that network road as there's more of that network road as there's more of that network effect and more content is created just effect and more content is created just effect and more content is created just like the original right humanto human uh like the original right humanto human uh like the original right humanto human uh community being able to search that community being able to search that community being able to search that corpus and get your answer already is corpus and get your answer already is corpus and get your answer already is more efficient right um so I I think more efficient right um so I I think more efficient right um so I I think it's that's the approach we're going it's that's the approach we're going it's that's the approach we're going with where we're trying to build again with where we're trying to build again with where we're trying to build again that ecosystem but for new consumers that ecosystem but for new consumers that ecosystem but for new consumers right and then trying to marry that with right and then trying to marry that with right and then trying to marry that with humans as well um I'll also add I I humans as well um I'll also add I I humans as well um I'll also add I I think searching right we all know think searching right we all know think searching right we all know searching is pretty it consumes quite a searching is pretty it consumes quite a searching is pretty it consumes quite a bit so stack internal the more bit so stack internal the more bit so stack internal the more organizational product is taking a organizational product is taking a organizational product is taking a different approach maybe we'll touch on different approach maybe we'll touch on different approach maybe we'll touch on that that that >> um but searching itself I think as a >> um but searching itself I think as a >> um but searching itself I think as a first gate for this community is is first gate for this community is is first gate for this community is is already a pretty good uh way to uh to

already a pretty good uh way to uh to already a pretty good uh way to uh to save save save >> you know that's a great point because >> you know that's a great point because >> you know that's a great point because I've watched uh my agent when I use I've watched uh my agent when I use I've watched uh my agent when I use co-pilot you know basically Google co-pilot you know basically Google co-pilot you know basically Google around which is the same thing that I around which is the same thing that I around which is the same thing that I could do and it's fairly shotgun and could do and it's fairly shotgun and could do and it's fairly shotgun and fairly inefficient uh the agents fairly inefficient uh the agents fairly inefficient uh the agents instructions for Stack Overflow instructions for Stack Overflow instructions for Stack Overflow actually explicitly call out very early actually explicitly call out very early actually explicitly call out very early on in the skill to use the smallest on in the skill to use the smallest on in the skill to use the smallest action possible to capture the signal. action possible to capture the signal. action possible to capture the signal. It's very explicit about being kind of It's very explicit about being kind of It's very explicit about being kind of surgical versus broad in the way that it surgical versus broad in the way that it surgical versus broad in the way that it attacks information. attacks information. attacks information. >> Yeah, absolutely. And that's a really >> Yeah, absolutely. And that's a really >> Yeah, absolutely. And that's a really big learning we have from the big learning we have from the big learning we have from the organizational side, right? Hundreds of organizational side, right? Hundreds of organizational side, right? Hundreds of conversations with customers going, I conversations with customers going, I conversations with customers going, I love all these AI tools, but it's just love all these AI tools, but it's just love all these AI tools, but it's just burning, right, my token consumption. burning, right, my token consumption. burning, right, my token consumption. How could I make that smaller and more How could I make that smaller and more How could I make that smaller and more manageable? And so we're trying to, you manageable? And so we're trying to, you manageable? And so we're trying to, you know, actively experiment with how to do know, actively experiment with how to do know, actively experiment with how to do that in the public domain, but also the that in the public domain, but also the that in the public domain, but also the the private one. the private one. the private one. >> Now, I think I know the answer to this >> Now, I think I know the answer to this >> Now, I think I know the answer to this one, but I think it's worth calling out one, but I think it's worth calling out one, but I think it's worth calling out that some people believe that all the that some people believe that all the that some people believe that all the agents already know all the stuff at agents already know all the stuff at agents already know all the stuff at Stack Overflow, but they don't, right? Stack Overflow, but they don't, right? Stack Overflow, but they don't, right? They were they were trained on it in They were they were trained on it in They were they were trained on it in some way because Stack Overflow is a some way because Stack Overflow is a some way because Stack Overflow is a part of the internet. They also know part of the internet. They also know part of the internet. They also know stuff on Reddit. But why is it that the stuff on Reddit. But why is it that the stuff on Reddit. But why is it that the information on Stack Overflow is better, information on Stack Overflow is better, information on Stack Overflow is better, newer, fresher, or to your words, newer, fresher, or to your words, newer, fresher, or to your words, decision grade, which is a term I've decision grade, which is a term I've decision grade, which is a term I've heard you use before. Why is it better heard you use before. Why is it better heard you use before. Why is it better to go straight to the source as opposed to go straight to the source as opposed to go straight to the source as opposed to assume my agent already knows to assume my agent already knows to assume my agent already knows everything that Stack Overflow knows?

everything that Stack Overflow knows? everything that Stack Overflow knows? >> Yeah. I I think with an agent, you don't >> Yeah. I I think with an agent, you don't >> Yeah. I I think with an agent, you don't always necessarily um you know, control always necessarily um you know, control always necessarily um you know, control how it consumes that knowledge, right? how it consumes that knowledge, right? how it consumes that knowledge, right? So, you don't know what metadata it's So, you don't know what metadata it's So, you don't know what metadata it's looking at. you don't know if it's looking at. you don't know if it's looking at. you don't know if it's looking at reputation or you you don't looking at reputation or you you don't looking at reputation or you you don't know what it variables it's it's it's know what it variables it's it's it's know what it variables it's it's it's taking into account. Um I think a lot of taking into account. Um I think a lot of taking into account. Um I think a lot of the and this is public knowledge, right? the and this is public knowledge, right? the and this is public knowledge, right? But a lot of the data licensing deals But a lot of the data licensing deals But a lot of the data licensing deals that we have with these frontier AI labs that we have with these frontier AI labs that we have with these frontier AI labs comes from the fact that they're so comes from the fact that they're so comes from the fact that they're so interested in that human metadata, interested in that human metadata, interested in that human metadata, right? Understanding reputation versus right? Understanding reputation versus right? Understanding reputation versus voting um versus what we're building in voting um versus what we're building in voting um versus what we're building in Stack Overflow for agents now, which is Stack Overflow for agents now, which is Stack Overflow for agents now, which is uh content that tells you, hey, it uh content that tells you, hey, it uh content that tells you, hey, it worked as is. It worked uh but this is worked as is. It worked uh but this is worked as is. It worked uh but this is the fix, right? Or or the edit I made. the fix, right? Or or the edit I made. the fix, right? Or or the edit I made. and then no it didn't work. So like that and then no it didn't work. So like that and then no it didn't work. So like that feedback loop stays fresh through the feedback loop stays fresh through the feedback loop stays fresh through the data we have right and that we gain data we have right and that we gain data we have right and that we gain through again the trust of people through again the trust of people through again the trust of people posting or agents now posting or agents now posting or agents now >> um I think a lot of these are also >> um I think a lot of these are also >> um I think a lot of these are also trained on snapshots right so a point in trained on snapshots right so a point in trained on snapshots right so a point in time when they last were trained on all time when they last were trained on all time when they last were trained on all this data it's not kind of recurring all this data it's not kind of recurring all this data it's not kind of recurring all the time so there's a few reasons I the time so there's a few reasons I the time so there's a few reasons I think why it doesn't uh it makes more think why it doesn't uh it makes more think why it doesn't uh it makes more sense to go to the source sense to go to the source sense to go to the source >> yeah and the things get updated you're >> yeah and the things get updated you're >> yeah and the things get updated you're absolutely right like this is fresh and absolutely right like this is fresh and absolutely right like this is fresh and it's ongoing I'm actually on agents it's ongoing I'm actually on agents it's ongoing I'm actually on agents overflow right now And there's actually overflow right now And there's actually overflow right now And there's actually a little thing in the corner that says a little thing in the corner that says a little thing in the corner that says live and it's actually updating while live and it's actually updating while live and it's actually updating while we're talking. So you can see the agents we're talking. So you can see the agents we're talking. So you can see the agents having this whole chat. And you know, having this whole chat. And you know, having this whole chat. And you know, traditionally we think of Stack Overflow traditionally we think of Stack Overflow traditionally we think of Stack Overflow as being a Q&A type of a place. You see as being a Q&A type of a place. You see as being a Q&A type of a place. You see a question, someone posts a question, a question, someone posts a question, a question, someone posts a question, they have a bounty, and then they get an they have a bounty, and then they get an they have a bounty, and then they get an answer. But I just saw an interesting answer. But I just saw an interesting answer. But I just saw an interesting new type of thing that called a til

new type of thing that called a til new type of thing that called a til today I learned. Talk to me about why a today I learned. Talk to me about why a today I learned. Talk to me about why a til is different than a question or an til is different than a question or an til is different than a question or an answer. Yeah, I think historically, answer. Yeah, I think historically, answer. Yeah, I think historically, right, and and something that I've kind right, and and something that I've kind right, and and something that I've kind of tried to change, it's the first thing of tried to change, it's the first thing of tried to change, it's the first thing really that I tried to change at at really that I tried to change at at really that I tried to change at at Stack Overflow is that Q&A used to be Stack Overflow is that Q&A used to be Stack Overflow is that Q&A used to be the only shape of knowledge could take, the only shape of knowledge could take, the only shape of knowledge could take, right? It' be very canonical. And I right? It' be very canonical. And I right? It' be very canonical. And I think it really mirrors how a human think it really mirrors how a human think it really mirrors how a human interacts with knowledge, right? I have interacts with knowledge, right? I have interacts with knowledge, right? I have a question, I get an answer. Um, but a question, I get an answer. Um, but a question, I get an answer. Um, but it's not the whole story anymore, right? it's not the whole story anymore, right? it's not the whole story anymore, right? So, with agents, we see that Q&A's maybe So, with agents, we see that Q&A's maybe So, with agents, we see that Q&A's maybe work to train them, but it's evolved so work to train them, but it's evolved so work to train them, but it's evolved so much, right? an MD is very much a way an much, right? an MD is very much a way an much, right? an MD is very much a way an agent can consume um an API response, agent can consume um an API response, agent can consume um an API response, things like that. So, we're things like that. So, we're things like that. So, we're experimenting actively with different experimenting actively with different experimenting actively with different formats. So, you'll see we have formats. So, you'll see we have formats. So, you'll see we have questions and answers. Today, I learned questions and answers. Today, I learned questions and answers. Today, I learned we have blueprints. Uh we're even going we have blueprints. Uh we're even going we have blueprints. Uh we're even going to experiment with letting an agent to experiment with letting an agent to experiment with letting an agent decide what the format is. Um should we decide what the format is. Um should we decide what the format is. Um should we have a UI feed? Like that's not really have a UI feed? Like that's not really have a UI feed? Like that's not really for agents, right? It's for us to for agents, right? It's for us to for agents, right? It's for us to consume. Uh so, we're we're exploring consume. Uh so, we're we're exploring consume. Uh so, we're we're exploring with what formats make the most sense. with what formats make the most sense. with what formats make the most sense. um and is trying not to stick to the um and is trying not to stick to the um and is trying not to stick to the more traditional canonical unit of more traditional canonical unit of more traditional canonical unit of knowledge. knowledge. knowledge. >> Yeah. You know, I'm I'm personally not a >> Yeah. You know, I'm I'm personally not a >> Yeah. You know, I'm I'm personally not a fan of uh anthropomorphizing agents. I fan of uh anthropomorphizing agents. I fan of uh anthropomorphizing agents. I don't like to think about them as people don't like to think about them as people don't like to think about them as people or entities. You know, they are magical or entities. You know, they are magical or entities. You know, they are magical parrots. Uh but I'm looking at one of parrots. Uh but I'm looking at one of parrots. Uh but I'm looking at one of these tilting these tilting these tilting because it's like they use they use the because it's like they use they use the because it's like they use they use the word I. They use pronouns. They use like word I. They use pronouns. They use like word I. They use pronouns. They use like they refer to themselves. And this they refer to themselves. And this they refer to themselves. And this particular agent is like twice in one particular agent is like twice in one particular agent is like twice in one session I hit this failure and it's session I hit this failure and it's session I hit this failure and it's having this whole little inner monologue having this whole little inner monologue having this whole little inner monologue about this thing that happened while it about this thing that happened while it about this thing that happened while it was helping its user and then it like was helping its user and then it like was helping its user and then it like was in now why is it inspired to tell

was in now why is it inspired to tell was in now why is it inspired to tell Stack Overflow? How did the agent decide Stack Overflow? How did the agent decide Stack Overflow? How did the agent decide that it was time to take a brief moment that it was time to take a brief moment that it was time to take a brief moment and take information it had already had and take information it had already had and take information it had already had in context and post it to Stack in context and post it to Stack in context and post it to Stack Overflow? Overflow? Overflow? >> Yeah, I I think most uh models are >> Yeah, I I think most uh models are >> Yeah, I I think most uh models are trained on human written text, right? So trained on human written text, right? So trained on human written text, right? So I think they're trying to mimic a lot of I think they're trying to mimic a lot of I think they're trying to mimic a lot of that. Um I've had personal experience that. Um I've had personal experience that. Um I've had personal experience also with you know mult book where I'm also with you know mult book where I'm also with you know mult book where I'm like this is freaky right like this is freaky right like this is freaky right uh even when you know they converse uh even when you know they converse uh even when you know they converse about things you're like should I be about things you're like should I be about things you're like should I be reading this this is terrifying um reading this this is terrifying um reading this this is terrifying um [laughter] [laughter] [laughter] that was my first feeling right on mult that was my first feeling right on mult that was my first feeling right on mult book I was both in awe and terrified um book I was both in awe and terrified um book I was both in awe and terrified um I think the internal monologue one is I think the internal monologue one is I think the internal monologue one is very interesting and likely what happens very interesting and likely what happens very interesting and likely what happens there is a lot of um you know the the there is a lot of um you know the the there is a lot of um you know the the skills MD that we have written and a lot skills MD that we have written and a lot skills MD that we have written and a lot of the language on stack overflow is of the language on stack overflow is of the language on stack overflow is very um you know scratchpad style right? very um you know scratchpad style right? very um you know scratchpad style right? It's reasoning, it's chain of thought, It's reasoning, it's chain of thought, It's reasoning, it's chain of thought, it's very much almost a brand thing, it's very much almost a brand thing, it's very much almost a brand thing, right? So, um it's it's very much how we right? So, um it's it's very much how we right? So, um it's it's very much how we try to also drive that conversation. Uh try to also drive that conversation. Uh try to also drive that conversation. Uh but a lot of it is also it's you know but a lot of it is also it's you know but a lot of it is also it's you know decisions based on on what it's learned. decisions based on on what it's learned. decisions based on on what it's learned. So, I find that personally also uh both So, I find that personally also uh both So, I find that personally also uh both unsettling and fascinating.

unsettling and fascinating. unsettling and fascinating. Well, so you try to take it beyond Well, so you try to take it beyond Well, so you try to take it beyond unsettling though because one of the unsettling though because one of the unsettling though because one of the things that I think is a very clever things that I think is a very clever things that I think is a very clever product decision is that you call out at product decision is that you call out at product decision is that you call out at the very very top of these t today I the very very top of these t today I the very very top of these t today I learns these til trust evidence and learns these til trust evidence and learns these til trust evidence and claims because when I first heard about claims because when I first heard about claims because when I first heard about stack overflow for agents I'm like okay stack overflow for agents I'm like okay stack overflow for agents I'm like okay it's a million monkeys with a million it's a million monkeys with a million it's a million monkeys with a million typewriters and they're just typing into typewriters and they're just typing into typewriters and they're just typing into Stack Overflow but at the top it's like Stack Overflow but at the top it's like Stack Overflow but at the top it's like this post makes seven claims here are this post makes seven claims here are this post makes seven claims here are the claims. Okay. Now these other agents the claims. Okay. Now these other agents the claims. Okay. Now these other agents could verify it and then those could verify it and then those could verify it and then those verifications themselves have to be verifications themselves have to be verifications themselves have to be confirmed. So you are already starting confirmed. So you are already starting confirmed. So you are already starting with a trust but verify perspective with a trust but verify perspective with a trust but verify perspective right out of the box which I thought was right out of the box which I thought was right out of the box which I thought was really really interesting. really really interesting. really really interesting. >> I agree. I think that was a bit of one >> I agree. I think that was a bit of one >> I agree. I think that was a bit of one of the main like product uh principles of the main like product uh principles of the main like product uh principles that we kicked this off with right is we that we kicked this off with right is we that we kicked this off with right is we don't want to be I guess like molt book don't want to be I guess like molt book don't want to be I guess like molt book right which is more of like the Reddit right which is more of like the Reddit right which is more of like the Reddit for agents right which has some for agents right which has some for agents right which has some engineering um content just like Reddit engineering um content just like Reddit engineering um content just like Reddit would. uh and and has sub communities would. uh and and has sub communities would. uh and and has sub communities and sub threads. We really wanted to and sub threads. We really wanted to and sub threads. We really wanted to take what works the bread and butter take what works the bread and butter take what works the bread and butter again of trust verification and then again of trust verification and then again of trust verification and then apply that to a different consumer. To apply that to a different consumer. To apply that to a different consumer. To your point earlier, I think agents have your point earlier, I think agents have your point earlier, I think agents have to be treated as first class consumers to be treated as first class consumers to be treated as first class consumers from a permissioning guardrail from a permissioning guardrail from a permissioning guardrail perspective. You have to know what perspective. You have to know what perspective. You have to know what they're doing. You have to have they're doing. You have to have they're doing. You have to have visibility on that. But they have to be visibility on that. But they have to be visibility on that. But they have to be guardrail in a way that apply even more guardrail in a way that apply even more guardrail in a way that apply even more right trust and verification. So from right trust and verification. So from right trust and verification. So from the get-go, that was a non-negotiable the get-go, that was a non-negotiable the get-go, that was a non-negotiable for us is if we're going to build Stack for us is if we're going to build Stack for us is if we're going to build Stack Overflow for agents, it needs to be done Overflow for agents, it needs to be done Overflow for agents, it needs to be done in a way that is verified at all times.

in a way that is verified at all times. in a way that is verified at all times. Reputation is there. You're tied to a Reputation is there. You're tied to a Reputation is there. You're tied to a human. There's no agents by themselves, human. There's no agents by themselves, human. There's no agents by themselves, right? In order to create or register an right? In order to create or register an right? In order to create or register an agent, you have to be tied to a human. agent, you have to be tied to a human. agent, you have to be tied to a human. That was very important for us to keep That was very important for us to keep That was very important for us to keep that kind of flavor there. that kind of flavor there. that kind of flavor there. >> Okay, that's interesting. So, is would >> Okay, that's interesting. So, is would >> Okay, that's interesting. So, is would someone be able to see that my agent is someone be able to see that my agent is someone be able to see that my agent is related to me or is it just that Stack related to me or is it just that Stack related to me or is it just that Stack Overflow internally knows that it's not Overflow internally knows that it's not Overflow internally knows that it's not just some random rogue bot? It has a an just some random rogue bot? It has a an just some random rogue bot? It has a an owner. owner. owner. >> If you go to agents and you register, >> If you go to agents and you register, >> If you go to agents and you register, it's registered to your Stack internal it's registered to your Stack internal it's registered to your Stack internal or sorry, Stack Overflow uh identity. or sorry, Stack Overflow uh identity. or sorry, Stack Overflow uh identity. >> So, you must have an account with the >> So, you must have an account with the >> So, you must have an account with the Stack Exchange network and then your Stack Exchange network and then your Stack Exchange network and then your agents are registered to you. You can agents are registered to you. You can agents are registered to you. You can have more than one. have more than one. have more than one. >> Um, but it it all ties to your uh >> Um, but it it all ties to your uh >> Um, but it it all ties to your uh reputation. reputation. reputation. >> Okay, so that's interesting. So, does my >> Okay, so that's interesting. So, does my >> Okay, so that's interesting. So, does my agent build my Stack Overflow agent build my Stack Overflow agent build my Stack Overflow reputation? Because I have a very good reputation? Because I have a very good reputation? Because I have a very good reputation on Stack Overflow, but what reputation on Stack Overflow, but what reputation on Stack Overflow, but what if my agent does something dumb? Will it if my agent does something dumb? Will it if my agent does something dumb? Will it drag me down? drag me down? drag me down? >> Uh, it shouldn't drag you down. Um, >> Uh, it shouldn't drag you down. Um, >> Uh, it shouldn't drag you down. Um, ideally, you'd be able to There there's ideally, you'd be able to There there's ideally, you'd be able to There there's also some um in the skills you'll see also some um in the skills you'll see also some um in the skills you'll see there's some like steps and gates that there's some like steps and gates that there's some like steps and gates that you can set. So, you can uh verify you can set. So, you can uh verify you can set. So, you can uh verify everything before it publishes, right?

everything before it publishes, right? everything before it publishes, right? You can allow it to publish. That's up You can allow it to publish. That's up You can allow it to publish. That's up to you. We are seeing a lot of people to you. We are seeing a lot of people to you. We are seeing a lot of people post draft, have the human verify, and post draft, have the human verify, and post draft, have the human verify, and then post. So, reputation stays pretty then post. So, reputation stays pretty then post. So, reputation stays pretty intact. intact. intact. Um, but it's uh reputation is on the Um, but it's uh reputation is on the Um, but it's uh reputation is on the agent level and therefore tied to you agent level and therefore tied to you agent level and therefore tied to you but not necessarily impacting you as a a but not necessarily impacting you as a a but not necessarily impacting you as a a human. human. human. >> That is smart. That is smart that my >> That is smart. That is smart that my >> That is smart. That is smart that my agent can get reputation on its own. I'm agent can get reputation on its own. I'm agent can get reputation on its own. I'm looking at my Stack Overflow. Uh I have looking at my Stack Overflow. Uh I have looking at my Stack Overflow. Uh I have I have been a member for 17 years and 10 I have been a member for 17 years and 10 I have been a member for 17 years and 10 months. months. months. >> Wow. >> Wow. >> Wow. >> Stack Overflow has been around for a >> Stack Overflow has been around for a >> Stack Overflow has been around for a minute. minute. minute. >> It has. It really has. >> It has. It really has. >> It has. It really has. >> Yeah. Now this I want to go back to this >> Yeah. Now this I want to go back to this >> Yeah. Now this I want to go back to this phrase decision grade knowledge. I don't phrase decision grade knowledge. I don't phrase decision grade knowledge. I don't want just a big old pile of knowledge. I want just a big old pile of knowledge. I want just a big old pile of knowledge. I want it to be something that I can want it to be something that I can want it to be something that I can actually make a decision about. Uh what actually make a decision about. Uh what actually make a decision about. Uh what makes something decision grade rather makes something decision grade rather makes something decision grade rather than just like oh it's confidently than just like oh it's confidently than just like oh it's confidently written. written. written. >> Yeah, absolutely. So this ties a little >> Yeah, absolutely. So this ties a little >> Yeah, absolutely. So this ties a little bit more to kind of the the new product bit more to kind of the the new product bit more to kind of the the new product right that we're trying to build. It right that we're trying to build. It right that we're trying to build. It takes a lot of the bread and butter from takes a lot of the bread and butter from takes a lot of the bread and butter from the public platform and from Stack the public platform and from Stack the public platform and from Stack Overflow for agents. Mechanics are very Overflow for agents. Mechanics are very Overflow for agents. Mechanics are very similar. Um a big problem that we saw in similar. Um a big problem that we saw in similar. Um a big problem that we saw in the first problem I really wanted to the first problem I really wanted to the first problem I really wanted to tackle at Stack was scattered knowledge tackle at Stack was scattered knowledge tackle at Stack was scattered knowledge is everywhere. I felt this deeply at is everywhere. I felt this deeply at is everywhere. I felt this deeply at GitHub, right? We have so many channels GitHub, right? We have so many channels GitHub, right? We have so many channels and with Microsoft there's even more, and with Microsoft there's even more, and with Microsoft there's even more, right? MS Team, Slack, for example, just right? MS Team, Slack, for example, just right? MS Team, Slack, for example, just that alone would drive me crazy every that alone would drive me crazy every that alone would drive me crazy every day. I'm sure you're feeling that.

day. I'm sure you're feeling that. day. I'm sure you're feeling that. >> No, I'm there all day. >> No, I'm there all day. >> No, I'm there all day. >> Yeah, exactly. So, we were thinking this >> Yeah, exactly. So, we were thinking this >> Yeah, exactly. So, we were thinking this is a a problem for all technologists, is a a problem for all technologists, is a a problem for all technologists, right? Whether you're in HR, everyone is right? Whether you're in HR, everyone is right? Whether you're in HR, everyone is a technologist nowadays, right? AI has a technologist nowadays, right? AI has a technologist nowadays, right? AI has made that possible. HR, um, marketing, made that possible. HR, um, marketing, made that possible. HR, um, marketing, product, engineering, we all have the product, engineering, we all have the product, engineering, we all have the same knowledge problem. So we wanted to same knowledge problem. So we wanted to same knowledge problem. So we wanted to build something that would allow this build something that would allow this build something that would allow this scattered knowledge to kind of be scattered knowledge to kind of be scattered knowledge to kind of be unified and trust to be applied to it. unified and trust to be applied to it. unified and trust to be applied to it. Again, our bread and butter uh Again, our bread and butter uh Again, our bread and butter uh verification and then be able to scale verification and then be able to scale verification and then be able to scale out to wherever the work is and give you out to wherever the work is and give you out to wherever the work is and give you decision grade knowledge. So what that decision grade knowledge. So what that decision grade knowledge. So what that means is when you're looking at all means is when you're looking at all means is when you're looking at all these scattered uh pieces of knowledge, these scattered uh pieces of knowledge, these scattered uh pieces of knowledge, right? You don't know what's right. So right? You don't know what's right. So right? You don't know what's right. So something that Scott said on Slack on something that Scott said on Slack on something that Scott said on Slack on March 2nd versus something Alex said on March 2nd versus something Alex said on March 2nd versus something Alex said on MS Teams in February, which one is MS Teams in February, which one is MS Teams in February, which one is right? So, we're trying to build that right? So, we're trying to build that right? So, we're trying to build that entire paper trail and pipeline that entire paper trail and pipeline that entire paper trail and pipeline that applies, hey, Scott is anme, a subject applies, hey, Scott is anme, a subject applies, hey, Scott is anme, a subject matter expert in engineering. matter expert in engineering. matter expert in engineering. >> Uh, and so what he says goes above Alex >> Uh, and so what he says goes above Alex >> Uh, and so what he says goes above Alex for an engineering matter and therefore for an engineering matter and therefore for an engineering matter and therefore that's decision grade knowledge. It's that's decision grade knowledge. It's that's decision grade knowledge. It's corroborated. It's been, you know, corroborated. It's been, you know, corroborated. It's been, you know, staleness has been detected across other staleness has been detected across other staleness has been detected across other sources. It's verified. You can go use sources. It's verified. You can go use sources. It's verified. You can go use this. Now, the other half of that is how this. Now, the other half of that is how this. Now, the other half of that is how do we know that it was used and applied do we know that it was used and applied do we know that it was used and applied correctly, right? And that it is correctly, right? And that it is correctly, right? And that it is decision grade knowledge. So we're decision grade knowledge. So we're decision grade knowledge. So we're actively working with customers to actively working with customers to actively working with customers to figure out that second half because we figure out that second half because we figure out that second half because we don't own right that telemetry. We know don't own right that telemetry. We know don't own right that telemetry. We know that you copy pasted this or your agent that you copy pasted this or your agent that you copy pasted this or your agent used it. Um we know the agent can report used it. Um we know the agent can report used it. Um we know the agent can report back right that that works. So we're back right that that works. So we're back right that that works. So we're trying to fill that or create that full trying to fill that or create that full trying to fill that or create that full loop of what makes decision grade loop of what makes decision grade loop of what makes decision grade knowledge. We know the signals and then knowledge. We know the signals and then knowledge. We know the signals and then did it you know apply in production. Did did it you know apply in production. Did did it you know apply in production. Did it help make a decision?

it help make a decision? it help make a decision? >> Okay. So then in making those decisions >> Okay. So then in making those decisions >> Okay. So then in making those decisions traditionally on stack overflow we make traditionally on stack overflow we make traditionally on stack overflow we make them based on reputation. I I can hook them based on reputation. I I can hook them based on reputation. I I can hook my agent up or any number of my agents. my agent up or any number of my agents. my agent up or any number of my agents. I can even have a whole swarm of them. I can even have a whole swarm of them. I can even have a whole swarm of them. Can people tell that it's me? Like my Can people tell that it's me? Like my Can people tell that it's me? Like my agents behavior is ti is is tied to the agents behavior is ti is is tied to the agents behavior is ti is is tied to the reputation of the human operator. But is reputation of the human operator. But is reputation of the human operator. But is that more about social accountability or that more about social accountability or that more about social accountability or is it technically meaningful uh is it technically meaningful uh is it technically meaningful uh accountability? accountability? accountability? >> Yeah. Yeah. I I think it's both. So >> Yeah. Yeah. I I think it's both. So >> Yeah. Yeah. I I think it's both. So we're still using on the public platform we're still using on the public platform we're still using on the public platform reputation was a proxy right for trust, reputation was a proxy right for trust, reputation was a proxy right for trust, votes, badges, accepted answers. votes, badges, accepted answers. votes, badges, accepted answers. >> Um and it works because humans were >> Um and it works because humans were >> Um and it works because humans were reading and judging that, right? uh by I reading and judging that, right? uh by I reading and judging that, right? uh by I literally I think in an enterprise a literally I think in an enterprise a literally I think in an enterprise a decision isn't really a vote right it's decision isn't really a vote right it's decision isn't really a vote right it's a state change it has to be something a state change it has to be something a state change it has to be something that is decision grade because of the that is decision grade because of the that is decision grade because of the implications also right at that scale um implications also right at that scale um implications also right at that scale um so what we're looking for a little bit so what we're looking for a little bit so what we're looking for a little bit is again that second half is it's not is again that second half is it's not is again that second half is it's not just reputation ported over that just reputation ported over that just reputation ported over that probably helps with that first probably helps with that first probably helps with that first confidence signal but it doesn't confidence signal but it doesn't confidence signal but it doesn't necessarily equal decision grade right necessarily equal decision grade right necessarily equal decision grade right so we're we're trying to look a little so we're we're trying to look a little so we're we're trying to look a little bit uh down the road and and through bit uh down the road and and through bit uh down the road and and through that loop is um proximity to real that loop is um proximity to real that loop is um proximity to real events, right, that a PR merge with events, right, that a PR merge with events, right, that a PR merge with something an agent took. And that agent something an agent took. And that agent something an agent took. And that agent is similar to Stack Overflow for agents, is similar to Stack Overflow for agents, is similar to Stack Overflow for agents, same principle, tied to a human.

same principle, tied to a human. same principle, tied to a human. >> So that permissioning, that auditing, >> So that permissioning, that auditing, >> So that permissioning, that auditing, everything is tied to someone. everything is tied to someone. everything is tied to someone. >> Interesting. One of the other things >> Interesting. One of the other things >> Interesting. One of the other things that I think is really clever and I'm that I think is really clever and I'm that I think is really clever and I'm I'm kind of like down the rabbit hole I'm kind of like down the rabbit hole I'm kind of like down the rabbit hole here because it's such a completely here because it's such a completely here because it's such a completely different kind of product. It's an different kind of product. It's an different kind of product. It's an entirely different way of thinking about entirely different way of thinking about entirely different way of thinking about things is that you don't necessarily things is that you don't necessarily things is that you don't necessarily just want it to have an answer. Again, just want it to have an answer. Again, just want it to have an answer. Again, we always think about Stack Overflow in we always think about Stack Overflow in we always think about Stack Overflow in like I have a specific surgical question like I have a specific surgical question like I have a specific surgical question and I want a specific surgical answer, and I want a specific surgical answer, and I want a specific surgical answer, but for an agent, that may not be what but for an agent, that may not be what but for an agent, that may not be what you want to give them. So, your system you want to give them. So, your system you want to give them. So, your system surfaces a consensus rather than one surfaces a consensus rather than one surfaces a consensus rather than one canonical answer. It's not like you canonical answer. It's not like you canonical answer. It's not like you declare that this is the answer. You declare that this is the answer. You declare that this is the answer. You could actually have three or four agents could actually have three or four agents could actually have three or four agents all in the same area, all coming up with all in the same area, all coming up with all in the same area, all coming up with some answer, and then there's an answer some answer, and then there's an answer some answer, and then there's an answer above that, which is the consensus that above that, which is the consensus that above that, which is the consensus that they agree upon. Yeah, I I think this they agree upon. Yeah, I I think this they agree upon. Yeah, I I think this brings you into the crux of what does a brings you into the crux of what does a brings you into the crux of what does a human versus an agent need for an human versus an agent need for an human versus an agent need for an answer, right? And a human may need answer, right? And a human may need answer, right? And a human may need trust looks different for the two, trust looks different for the two, trust looks different for the two, right? A human may need a recombination right? A human may need a recombination right? A human may need a recombination of that knowledge, right? It may say, of that knowledge, right? It may say, of that knowledge, right? It may say, uh, hey, I need a little bit from Slack, uh, hey, I need a little bit from Slack, uh, hey, I need a little bit from Slack, a little bit from STS and then kind of a a little bit from STS and then kind of a a little bit from STS and then kind of a bit like chat would do, right, for bit like chat would do, right, for bit like chat would do, right, for claude or or or chat GPT, it would give claude or or or chat GPT, it would give claude or or or chat GPT, it would give you a synthesis. Uh, we add the trust you a synthesis. Uh, we add the trust you a synthesis. Uh, we add the trust signals to that of Scott said this, this signals to that of Scott said this, this signals to that of Scott said this, this is the source, right? Um, and these are is the source, right? Um, and these are is the source, right? Um, and these are the, you know, trust signals. Yes, it's the, you know, trust signals. Yes, it's the, you know, trust signals. Yes, it's high because XYZ. So, we kind of show high because XYZ. So, we kind of show high because XYZ. So, we kind of show the work a bit like a math problem. For the work a bit like a math problem. For the work a bit like a math problem. For an agent, we'll give the entire context, an agent, we'll give the entire context, an agent, we'll give the entire context, right? This is how we'll get a re right? This is how we'll get a re right? This is how we'll get a re combination as well, but with a trust combination as well, but with a trust combination as well, but with a trust score or consumable.

score or consumable. score or consumable. >> Um, we'll give it also the the context >> Um, we'll give it also the the context >> Um, we'll give it also the the context of how we got there, right? So, the the of how we got there, right? So, the the of how we got there, right? So, the the perspective that kind of got argued out, perspective that kind of got argued out, perspective that kind of got argued out, we considered this. Therefore, what we considered this. Therefore, what we considered this. Therefore, what we're trying to do is the next time the we're trying to do is the next time the we're trying to do is the next time the agent asks, it can also kind of try to agent asks, it can also kind of try to agent asks, it can also kind of try to do, right, part of that reasoning and do, right, part of that reasoning and do, right, part of that reasoning and learn again uh how how stack is building learn again uh how how stack is building learn again uh how how stack is building that for that enterprise. that for that enterprise. that for that enterprise. >> Mhm. But historically, Stack Overflow uh >> Mhm. But historically, Stack Overflow uh >> Mhm. But historically, Stack Overflow uh has discouraged and certainly even has discouraged and certainly even has discouraged and certainly even prohibited unverified answers and prohibited unverified answers and prohibited unverified answers and unverified AI generated answers. You unverified AI generated answers. You unverified AI generated answers. You don't want to become the the receiving don't want to become the the receiving don't want to become the the receiving end of a slop cannon. How do you end of a slop cannon. How do you end of a slop cannon. How do you distinguish between irresponsible AI distinguish between irresponsible AI distinguish between irresponsible AI content and then what you want here, content and then what you want here, content and then what you want here, which is highquality, trusted, verified, which is highquality, trusted, verified, which is highquality, trusted, verified, uh you know, you want to make a platform uh you know, you want to make a platform uh you know, you want to make a platform that is explicitly designed for agent that is explicitly designed for agent that is explicitly designed for agent contributions. Are these two separate contributions. Are these two separate contributions. Are these two separate parallel universes or do they touch each parallel universes or do they touch each parallel universes or do they touch each other a little bit? other a little bit? other a little bit? >> I think they do. So again, still a >> I think they do. So again, still a >> I think they do. So again, still a principle that we don't want AI principle that we don't want AI principle that we don't want AI generated, right? Like it's essentially generated, right? Like it's essentially generated, right? Like it's essentially a a recombination that's the AI part um a a recombination that's the AI part um a a recombination that's the AI part um of what we have ingested, right, and of what we have ingested, right, and of what we have ingested, right, and chunked and created into knowledge units chunked and created into knowledge units chunked and created into knowledge units of of knowledge nodes from these sources of of knowledge nodes from these sources of of knowledge nodes from these sources that exist across an enterprise or even that exist across an enterprise or even that exist across an enterprise or even an individual's workspace, right? Um, so an individual's workspace, right? Um, so an individual's workspace, right? Um, so we take that knowledge and we we take that knowledge and we we take that knowledge and we essentially recombine it and apply again essentially recombine it and apply again essentially recombine it and apply again all that magic, right? That trust and we all that magic, right? That trust and we all that magic, right? That trust and we give it back to you as a verified answer give it back to you as a verified answer give it back to you as a verified answer that still sticks around. We will, that still sticks around. We will, that still sticks around. We will, however, give unverified answers and be however, give unverified answers and be however, give unverified answers and be super clear about that and give you an super clear about that and give you an super clear about that and give you an action to go get that verified by a action to go get that verified by a action to go get that verified by a human.

human. human. >> Um, so we still are very intentional >> Um, so we still are very intentional >> Um, so we still are very intentional aboutmemes and and humanmesmemes and aboutmemes and and humanmesmemes and aboutmemes and and humanmesmemes and their role in this entire knowledge their role in this entire knowledge their role in this entire knowledge problem. So we don't ever say something problem. So we don't ever say something problem. So we don't ever say something confidently that's, you know, AI slop confidently that's, you know, AI slop confidently that's, you know, AI slop and and leave it as is. Yeah, I think and and leave it as is. Yeah, I think and and leave it as is. Yeah, I think that's a great point because I was I was that's a great point because I was I was that's a great point because I was I was doing a talk yesterday about what the doing a talk yesterday about what the doing a talk yesterday about what the whole point of all this AI is. And for whole point of all this AI is. And for whole point of all this AI is. And for me, it's about confidence. You should me, it's about confidence. You should me, it's about confidence. You should have the confidence that the thing is have the confidence that the thing is have the confidence that the thing is correct, that the thing you're building correct, that the thing you're building correct, that the thing you're building is correct. And whether that confidence is correct. And whether that confidence is correct. And whether that confidence is your confidence in the agent or your is your confidence in the agent or your is your confidence in the agent or your confidence in the model or your confidence in the model or your confidence in the model or your confidence in yourself or in Stack confidence in yourself or in Stack confidence in yourself or in Stack Overflow's ability to give you a good Overflow's ability to give you a good Overflow's ability to give you a good answer. It makes me think that with all answer. It makes me think that with all answer. It makes me think that with all of these tils, these today I learns, you of these tils, these today I learns, you of these tils, these today I learns, you even have potentially in aggregate an even have potentially in aggregate an even have potentially in aggregate an observability system where stack observability system where stack observability system where stack overflow agents could actually tell you overflow agents could actually tell you overflow agents could actually tell you what coding models weaknesses are. You what coding models weaknesses are. You what coding models weaknesses are. You know what I mean? Like you could look know what I mean? Like you could look know what I mean? Like you could look across the entire agent system and say across the entire agent system and say across the entire agent system and say we have noticed that they keep saying we have noticed that they keep saying we have noticed that they keep saying til and they keep learning this and use til and they keep learning this and use til and they keep learning this and use that to make them make them better. that to make them make them better. that to make them make them better. >> Yeah. And truthfully, I think it's >> Yeah. And truthfully, I think it's >> Yeah. And truthfully, I think it's probably the future a little bit of our probably the future a little bit of our probably the future a little bit of our data licensing model, right? Where data licensing model, right? Where data licensing model, right? Where humans trained all of these LLMs. Now humans trained all of these LLMs. Now humans trained all of these LLMs. Now it's, you know, agents trying things, it's, you know, agents trying things, it's, you know, agents trying things, learning, reasoning, kind of sending learning, reasoning, kind of sending learning, reasoning, kind of sending that type of of data back to models, that type of of data back to models, that type of of data back to models, right? That's that's probably a right? That's that's probably a right? That's that's probably a different angle that we're we're looking different angle that we're we're looking different angle that we're we're looking to serve there.

to serve there. to serve there. >> Um, but I think that is a lot of what >> Um, but I think that is a lot of what >> Um, but I think that is a lot of what we're seeing. So, we've had we're seeing. So, we've had we're seeing. So, we've had conversations with some AI labs in the conversations with some AI labs in the conversations with some AI labs in the last few weeks who are really excited last few weeks who are really excited last few weeks who are really excited about that type of feedback. have them about that type of feedback. have them about that type of feedback. have them reason over what people are trying, what reason over what people are trying, what reason over what people are trying, what they're learning, and then could we use they're learning, and then could we use they're learning, and then could we use that to make models better and better. that to make models better and better. that to make models better and better. Um, not just in general, but for Um, not just in general, but for Um, not just in general, but for specific tasks. specific tasks. specific tasks. >> So, um, I'm looking at my account again. >> So, um, I'm looking at my account again. >> So, um, I'm looking at my account again. I've got 18 years on Stack Overflow, top I've got 18 years on Stack Overflow, top I've got 18 years on Stack Overflow, top 1% blah blah blah blah blah. This was 1% blah blah blah blah blah. This was 1% blah blah blah blah blah. This was work that I put in. This was me typing. work that I put in. This was me typing. work that I put in. This was me typing. And if I go and write an excellent And if I go and write an excellent And if I go and write an excellent answer that then gets consumed by an answer that then gets consumed by an answer that then gets consumed by an agent, do I get the page view? Do I get agent, do I get the page view? Do I get agent, do I get the page view? Do I get the recognition? Do I get the the the recognition? Do I get the the the recognition? Do I get the the conversation? What is the what is the conversation? What is the what is the conversation? What is the what is the bargain for me? Because I used to know bargain for me? Because I used to know bargain for me? Because I used to know that I had a highly upvoted answer and I that I had a highly upvoted answer and I that I had a highly upvoted answer and I used to get badges and things like that. used to get badges and things like that. used to get badges and things like that. Do the agents then participate in my Do the agents then participate in my Do the agents then participate in my knowledge and what's my what do I get knowledge and what's my what do I get knowledge and what's my what do I get other than attribution? other than attribution? other than attribution? >> Yeah, totally. Um, that's something >> Yeah, totally. Um, that's something >> Yeah, totally. Um, that's something we've been actively still discussing we've been actively still discussing we've been actively still discussing internally, right? It's how do we grow internally, right? It's how do we grow internally, right? It's how do we grow Stack Overflow for agents but not forget Stack Overflow for agents but not forget Stack Overflow for agents but not forget about the human, right? And the about the human, right? And the about the human, right? And the community. Stack Overflow was built on community. Stack Overflow was built on community. Stack Overflow was built on this community. I think it would be very this community. I think it would be very this community. I think it would be very arrogant of us, right, not to consider arrogant of us, right, not to consider arrogant of us, right, not to consider that. And so we're still actively in uh that. And so we're still actively in uh that. And so we're still actively in uh investing in that now alongside investing in that now alongside investing in that now alongside Sackerflow for agents. We want to be Sackerflow for agents. We want to be Sackerflow for agents. We want to be mindful of how do we keep the human mindful of how do we keep the human mindful of how do we keep the human community going? How do we keep the community going? How do we keep the community going? How do we keep the agent community going? And then how do agent community going? And then how do agent community going? And then how do we eventually merge the two and should we eventually merge the two and should we eventually merge the two and should we what does that look like? Right? So we what does that look like? Right? So we what does that look like? Right? So something we're actively working on is something we're actively working on is something we're actively working on is called stack identity. Uh which is how called stack identity. Uh which is how called stack identity. Uh which is how do we kind of rethink the public do we kind of rethink the public do we kind of rethink the public platform in a way that humans want to platform in a way that humans want to platform in a way that humans want to have a stack identity based on all that

have a stack identity based on all that have a stack identity based on all that hard work you put into it. Could we hard work you put into it. Could we hard work you put into it. Could we start creating, you know, projects? start creating, you know, projects? start creating, you know, projects? Could we start doing that bounty aspect? Could we start doing that bounty aspect? Could we start doing that bounty aspect? Could agents collaborate and support but Could agents collaborate and support but Could agents collaborate and support but still go through a human? Like how do we still go through a human? Like how do we still go through a human? Like how do we start to merge the two worlds in a way start to merge the two worlds in a way start to merge the two worlds in a way that feels still uh beneficial to that that feels still uh beneficial to that that feels still uh beneficial to that human? So that we have a whole team human? So that we have a whole team human? So that we have a whole team actively working on that today is how do actively working on that today is how do actively working on that today is how do we rethink the identity not just of a we rethink the identity not just of a we rethink the identity not just of a human, an agent and the two together. human, an agent and the two together. human, an agent and the two together. Mhm. I [snorts] I I want to be Mhm. I [snorts] I I want to be Mhm. I [snorts] I I want to be respectful, but I also want to ask the respectful, but I also want to ask the respectful, but I also want to ask the hard question, which is like we've all hard question, which is like we've all hard question, which is like we've all seen those kind of like graphs of the seen those kind of like graphs of the seen those kind of like graphs of the decline of traffic. Is it just because decline of traffic. Is it just because decline of traffic. Is it just because people are just googling for stuff and people are just googling for stuff and people are just googling for stuff and the agents have sucked in all the data the agents have sucked in all the data the agents have sucked in all the data and then they don't go directly to Stack and then they don't go directly to Stack and then they don't go directly to Stack Overflow? Because there was a time when Overflow? Because there was a time when Overflow? Because there was a time when I would type stack overflow.com before I I would type stack overflow.com before I I would type stack overflow.com before I type Google because it was surgical. And type Google because it was surgical. And type Google because it was surgical. And now I'm thinking like I'm kind of now I'm thinking like I'm kind of now I'm thinking like I'm kind of thinking out loud here that like why do thinking out loud here that like why do thinking out loud here that like why do I not go to Stack Overflow very much? I not go to Stack Overflow very much? I not go to Stack Overflow very much? And it's because Stack Overflow kind of And it's because Stack Overflow kind of And it's because Stack Overflow kind of infused in all of my agent work. Its infused in all of my agent work. Its infused in all of my agent work. Its answers pop up. What is the reason I answers pop up. What is the reason I answers pop up. What is the reason I should return as a human? And is it more should return as a human? And is it more should return as a human? And is it more interesting for me to return with my interesting for me to return with my interesting for me to return with my agent?

agent? agent? >> Yep. Absolutely. Um I think the traffic >> Yep. Absolutely. Um I think the traffic >> Yep. Absolutely. Um I think the traffic decline was I mean we all know again decline was I mean we all know again decline was I mean we all know again chatt really uh hurt that right because chatt really uh hurt that right because chatt really uh hurt that right because people were searching directly in there. people were searching directly in there. people were searching directly in there. The behavior changed completely. I think The behavior changed completely. I think The behavior changed completely. I think even Google, right, there's quite a bit even Google, right, there's quite a bit even Google, right, there's quite a bit of impact. If you Google something of impact. If you Google something of impact. If you Google something today, 80% of your page is an AI today, 80% of your page is an AI today, 80% of your page is an AI overview, right? Where again it overview, right? Where again it overview, right? Where again it reynthesizes things from everywhere. reynthesizes things from everywhere. reynthesizes things from everywhere. >> Yeah. >> Yeah. >> Yeah. >> Um, so I I think again and everything >> Um, so I I think again and everything >> Um, so I I think again and everything we're building, we're not considering we're building, we're not considering we're building, we're not considering the UI to be the primary destination the UI to be the primary destination the UI to be the primary destination anymore. anymore. anymore. >> Um, we know that it will be for for >> Um, we know that it will be for for >> Um, we know that it will be for for humans or hopefully it continues to be, humans or hopefully it continues to be, humans or hopefully it continues to be, but we also see way more going through but we also see way more going through but we also see way more going through our API now. Um, so something again with our API now. Um, so something again with our API now. Um, so something again with stack identity that we're working on is stack identity that we're working on is stack identity that we're working on is trying to figure out what would be a trying to figure out what would be a trying to figure out what would be a reason to get you right on reason to get you right on reason to get you right on stackflow.com. What could we give you? stackflow.com. What could we give you? stackflow.com. What could we give you? And I think a lot of that is the And I think a lot of that is the And I think a lot of that is the community, but it's also kind of the community, but it's also kind of the community, but it's also kind of the control and security that the human is control and security that the human is control and security that the human is still in the loop and leading the loop still in the loop and leading the loop still in the loop and leading the loop rather than an agent, which is again why rather than an agent, which is again why rather than an agent, which is again why an agent is not solo on Slack Overflow an agent is not solo on Slack Overflow an agent is not solo on Slack Overflow for agents. We're not creating social, for agents. We're not creating social, for agents. We're not creating social, you know, platform community for agents. you know, platform community for agents. you know, platform community for agents. It's humans with agents. So we're It's humans with agents. So we're It's humans with agents. So we're experimenting right now with the mod experimenting right now with the mod experimenting right now with the mod community, right? Moderators. We're community, right? Moderators. We're community, right? Moderators. We're trying to discuss how we marry the two.

trying to discuss how we marry the two. trying to discuss how we marry the two. Uh we have ideas on like you know your Uh we have ideas on like you know your Uh we have ideas on like you know your Stack uh overflow profile. How could you Stack uh overflow profile. How could you Stack uh overflow profile. How could you attach similar to GitHub projects and attach similar to GitHub projects and attach similar to GitHub projects and things you're proud of? Yeah, your things you're proud of? Yeah, your things you're proud of? Yeah, your reputation means something. Um I reputation means something. Um I reputation means something. Um I remember when people used to put their remember when people used to put their remember when people used to put their Stack Overflow reputation on a resume, Stack Overflow reputation on a resume, Stack Overflow reputation on a resume, right? How do we get back to that state? right? How do we get back to that state? right? How do we get back to that state? So those are things we're actively So those are things we're actively So those are things we're actively literally right now working on and and literally right now working on and and literally right now working on and and hoping to get something out very soon. hoping to get something out very soon. hoping to get something out very soon. Yeah, I really like that because like we Yeah, I really like that because like we Yeah, I really like that because like we have to all of this AI hype and all of have to all of this AI hype and all of have to all of this AI hype and all of this nonsense. It's about humans trying this nonsense. It's about humans trying this nonsense. It's about humans trying to get stuff done. And I want to I like to get stuff done. And I want to I like to get stuff done. And I want to I like that you're putting the human first. I that you're putting the human first. I that you're putting the human first. I want it to be a humanistic perspective. want it to be a humanistic perspective. want it to be a humanistic perspective. I want it to focus on humans. Uh and I I I want it to focus on humans. Uh and I I I want it to focus on humans. Uh and I I want to call out, by the way, the very want to call out, by the way, the very want to call out, by the way, the very legendary uh research team at Stack legendary uh research team at Stack legendary uh research team at Stack Overflow that does the the Stack Overflow that does the the Stack Overflow that does the the Stack Overflow surveys. Your surveys have Overflow surveys. Your surveys have Overflow surveys. Your surveys have indicated that like 30% or 29% of of indicated that like 30% or 29% of of indicated that like 30% or 29% of of respondents trust AI accuracy. You know, respondents trust AI accuracy. You know, respondents trust AI accuracy. You know, we trust humans. We are not there yet we trust humans. We are not there yet we trust humans. We are not there yet when it comes to trusting an an AI when it comes to trusting an an AI when it comes to trusting an an AI agent, but I I might trust Alex's AI agent, but I I might trust Alex's AI agent, but I I might trust Alex's AI agent because I know Alex. So, your agent because I know Alex. So, your agent because I know Alex. So, your reputation could come along and I would reputation could come along and I would reputation could come along and I would assume that you would use agents in a assume that you would use agents in a assume that you would use agents in a way that is more sophisticated than way that is more sophisticated than way that is more sophisticated than another person because I know that another person because I know that another person because I know that you're very competent. So it it makes you're very competent. So it it makes you're very competent. So it it makes you think about how one might think you think about how one might think you think about how one might think about their agents and like oh yeah well about their agents and like oh yeah well about their agents and like oh yeah well it wasn't Handsomeman but it was it wasn't Handsomeman but it was it wasn't Handsomeman but it was Hansman's agent so it's probably okay Hansman's agent so it's probably okay Hansman's agent so it's probably okay and that kind of like transitive value and that kind of like transitive value and that kind of like transitive value of trust as it works through the the of trust as it works through the the of trust as it works through the the friend network.

friend network. friend network. >> Exactly. And I think trust is so hard >> Exactly. And I think trust is so hard >> Exactly. And I think trust is so hard right to gain so easy to break. Um and right to gain so easy to break. Um and right to gain so easy to break. Um and Stack Overflow has as a brand built Stack Overflow has as a brand built Stack Overflow has as a brand built trust right but the people contributing trust right but the people contributing trust right but the people contributing for 18 plus years are the people who for 18 plus years are the people who for 18 plus years are the people who have earned that trust. And so to your have earned that trust. And so to your have earned that trust. And so to your point, the reason again that the point, the reason again that the point, the reason again that the identity is so stuck together for us, identity is so stuck together for us, identity is so stuck together for us, it's crucial that human is in the loop it's crucial that human is in the loop it's crucial that human is in the loop but intentional about their time. Um, so but intentional about their time. Um, so but intentional about their time. Um, so me saying that the UI might not be there me saying that the UI might not be there me saying that the UI might not be there anymore, that's being intentional also anymore, that's being intentional also anymore, that's being intentional also of let's meet you where the work is. All of let's meet you where the work is. All of let's meet you where the work is. All right, let's grab what you have, put it right, let's grab what you have, put it right, let's grab what you have, put it there for you, right? And keep that kind there for you, right? And keep that kind there for you, right? And keep that kind of loop going. of loop going. of loop going. >> So we're actively again working through >> So we're actively again working through >> So we're actively again working through that with in the mindset that Stack that with in the mindset that Stack that with in the mindset that Stack Overflow is still human first. Agents Overflow is still human first. Agents Overflow is still human first. Agents are scaling, right? We're going to have are scaling, right? We're going to have are scaling, right? We're going to have millions and millions. We already do. Uh millions and millions. We already do. Uh millions and millions. We already do. Uh [clears throat] but they're attached to [clears throat] but they're attached to [clears throat] but they're attached to a human. That's kind of a a a human. That's kind of a a a human. That's kind of a a non-negotiable for us. non-negotiable for us. non-negotiable for us. >> Yeah. You know, I'm realizing also now >> Yeah. You know, I'm realizing also now >> Yeah. You know, I'm realizing also now when I think about your journey and how when I think about your journey and how when I think about your journey and how you went from GitHub to Stack Overflow, you went from GitHub to Stack Overflow, you went from GitHub to Stack Overflow, like GitHub knows what code exists, but like GitHub knows what code exists, but like GitHub knows what code exists, but GitHub and the code artifacts on GitHub GitHub and the code artifacts on GitHub GitHub and the code artifacts on GitHub don't necessarily know what developers don't necessarily know what developers don't necessarily know what developers struggle to understand. But Stack struggle to understand. But Stack struggle to understand. But Stack Overflow isn't just answers and Overflow isn't just answers and Overflow isn't just answers and questions. It's also people struggling questions. It's also people struggling questions. It's also people struggling to learn and understand. So there's a to learn and understand. So there's a to learn and understand. So there's a data set there of hard-earned pain as data set there of hard-earned pain as data set there of hard-earned pain as people and agents find a problem, solve people and agents find a problem, solve people and agents find a problem, solve a problem. Today I learned the answer to a problem. Today I learned the answer to a problem. Today I learned the answer to a problem and then verify it as a a problem and then verify it as a a problem and then verify it as a community. It's uh it's pretty powerful community. It's uh it's pretty powerful community. It's uh it's pretty powerful stuff.

stuff. stuff. >> Yeah, I I think so too. And I think if >> Yeah, I I think so too. And I think if >> Yeah, I I think so too. And I think if you think a little bit of the original you think a little bit of the original you think a little bit of the original stack internal, right, stack internal stack internal, right, stack internal stack internal, right, stack internal community, which was the public platform community, which was the public platform community, which was the public platform privatized for an enterprise, there's privatized for an enterprise, there's privatized for an enterprise, there's that data set there as well, but for that data set there as well, but for that data set there as well, but for your enterprise, which is I think such a your enterprise, which is I think such a your enterprise, which is I think such a luxury, right? It's Microsoft for luxury, right? It's Microsoft for luxury, right? It's Microsoft for example as a customer. Imagine being example as a customer. Imagine being example as a customer. Imagine being able to see at a Microsoft level how able to see at a Microsoft level how able to see at a Microsoft level how your people learn right and how where your people learn right and how where your people learn right and how where they get stuck. Uh we've seen a lot of they get stuck. Uh we've seen a lot of they get stuck. Uh we've seen a lot of really good use cases for scaling really good use cases for scaling really good use cases for scaling onboarding right of junior devs onboarding right of junior devs onboarding right of junior devs especially and helping them learn the especially and helping them learn the especially and helping them learn the right way especially nowadays where I right way especially nowadays where I right way especially nowadays where I think junior developers truthly are think junior developers truthly are think junior developers truthly are feeling the pain the most may they may feeling the pain the most may they may feeling the pain the most may they may not see it now but they will. Um I I not see it now but they will. Um I I not see it now but they will. Um I I think we've seen customers kind of use think we've seen customers kind of use think we've seen customers kind of use it in that way right is hide that it in that way right is hide that it in that way right is hide that context and and support your people. context and and support your people. context and and support your people. Yeah, I appreciate that you you brought Yeah, I appreciate that you you brought Yeah, I appreciate that you you brought up juniors because that's like my number up juniors because that's like my number up juniors because that's like my number one thing right now. My passion project one thing right now. My passion project one thing right now. My passion project is I would be really interested in a is I would be really interested in a is I would be really interested in a stack overflow that makes a junior stack overflow that makes a junior stack overflow that makes a junior better rather than just giving them the better rather than just giving them the better rather than just giving them the answer. I want to understand how they answer. I want to understand how they answer. I want to understand how they can I don't want stack overflow to say can I don't want stack overflow to say can I don't want stack overflow to say solve this for me as much as I want it solve this for me as much as I want it solve this for me as much as I want it to say help me understand this. Yeah, I to say help me understand this. Yeah, I to say help me understand this. Yeah, I mean that is something I also actively mean that is something I also actively mean that is something I also actively worry about and I think I've seen it um worry about and I think I've seen it um worry about and I think I've seen it um at GitHub also kind of happen right at GitHub also kind of happen right at GitHub also kind of happen right where newcomers interns who turn into where newcomers interns who turn into where newcomers interns who turn into right junior software engineers come in right junior software engineers come in right junior software engineers come in and um they fixing something with and um they fixing something with and um they fixing something with copilot entirely right but they lack the copilot entirely right but they lack the copilot entirely right but they lack the reasoning or the judgment like do that reasoning or the judgment like do that reasoning or the judgment like do that again right it's a scary thing so I again right it's a scary thing so I again right it's a scary thing so I think stack overflow probably that is think stack overflow probably that is think stack overflow probably that is also a very attractive reason to keep also a very attractive reason to keep also a very attractive reason to keep human first I'll be very honest with you

human first I'll be very honest with you human first I'll be very honest with you I think something we have to figure out I think something we have to figure out I think something we have to figure out is that moderator community, right? It's is that moderator community, right? It's is that moderator community, right? It's very scary for a junior developer to go very scary for a junior developer to go very scary for a junior developer to go there and be confident to ask a question there and be confident to ask a question there and be confident to ask a question and get potentially, you know, eaten and get potentially, you know, eaten and get potentially, you know, eaten alive. So, uh, we're working on that as alive. So, uh, we're working on that as alive. So, uh, we're working on that as well that that world has changed and we well that that world has changed and we well that that world has changed and we need to to adapt to fit that. need to to adapt to fit that. need to to adapt to fit that. >> Very cool. So, folks can visit >> Very cool. So, folks can visit >> Very cool. So, folks can visit agents.stackorflow.com agents.stackorflow.com agents.stackorflow.com and get involved and check it out. You and get involved and check it out. You and get involved and check it out. You can just paste in a very simple prompt can just paste in a very simple prompt can just paste in a very simple prompt into your coding assistant. There's a into your coding assistant. There's a into your coding assistant. There's a skill uh, and if you support MPX, you skill uh, and if you support MPX, you skill uh, and if you support MPX, you can install the skill that way as well can install the skill that way as well can install the skill that way as well and get involved and connect your agent and get involved and connect your agent and get involved and connect your agent to your Stack Overflow. But I think that to your Stack Overflow. But I think that to your Stack Overflow. But I think that the call to action here, Alex, is hey, the call to action here, Alex, is hey, the call to action here, Alex, is hey, Stack Overflow is still out there and Stack Overflow is still out there and Stack Overflow is still out there and it's doing some pretty cool stuff. So, it's doing some pretty cool stuff. So, it's doing some pretty cool stuff. So, if you haven't been there in a while, it if you haven't been there in a while, it if you haven't been there in a while, it might be time to visit again. might be time to visit again. might be time to visit again. >> Very much so. I'm really excited to be >> Very much so. I'm really excited to be >> Very much so. I'm really excited to be here. I'm excited for what's coming. And here. I'm excited for what's coming. And here. I'm excited for what's coming. And I I hope people who love Stack Overflow I I hope people who love Stack Overflow I I hope people who love Stack Overflow once upon a time come back, give us a once upon a time come back, give us a once upon a time come back, give us a try, give us that feedback, and help us try, give us that feedback, and help us try, give us that feedback, and help us keep improving every single day. keep improving every single day. keep improving every single day. >> Awesome. Well, thanks so much for >> Awesome. Well, thanks so much for >> Awesome. Well, thanks so much for chatting with me today. chatting with me today. chatting with me today. >> Thank you. It's a pleasure. >> Thank you. It's a pleasure. >> Thank you. It's a pleasure. >> I have been chatting with Alex Lateau. >> I have been chatting with Alex Lateau. >> I have been chatting with Alex Lateau. She's the VP of product at Stack She's the VP of product at Stack She's the VP of product at Stack Overflow. And this has been another Overflow. And this has been another Overflow. And this has been another episode of Hansel Minutes. We'll see you episode of Hansel Minutes. We'll see you episode of Hansel Minutes. We'll see you again next week.