319. How To Properly Evaluate A Technology
Read full transcript 19 segments
-
The most used phrase of a senior The most used phrase of a senior software developer should be it depends. software developer should be it depends. software developer should be it depends. That's because every situation is That's because every situation is That's because every situation is different and a solution to any problem different and a solution to any problem different and a solution to any problem needs to take a number of needs to take a number of needs to take a number of situation-specific variables into situation-specific variables into situation-specific variables into account. account. account. That's why there's so many languages, That's why there's so many languages, That's why there's so many languages, frameworks, and ways of doing things in frameworks, and ways of doing things in frameworks, and ways of doing things in software development. software development. software development. But what we don't talk about as much is But what we don't talk about as much is But what we don't talk about as much is how to properly evaluate an option or a how to properly evaluate an option or a how to properly evaluate an option or a technology. technology. technology. In today's episode of Dev Questions, In today's episode of Dev Questions, In today's episode of Dev Questions, we're going to discuss how to properly we're going to discuss how to properly we're going to discuss how to properly evaluate your options without letting evaluate your options without letting evaluate your options without letting enthusiasm, pessimism, ignorance, or enthusiasm, pessimism, ignorance, or enthusiasm, pessimism, ignorance, or inertia get in the way. >> Software development is more than just >> Software development is more than just writing code. So, let's talk about the writing code. So, let's talk about the writing code. So, let's talk about the rest of it. Specifically, let's talk rest of it. Specifically, let's talk rest of it. Specifically, let's talk about properly evaluating your options. about properly evaluating your options. about properly evaluating your options. And let's start by looking at the four And let's start by looking at the four And let's start by looking at the four major categories of people.
-
major categories of people. major categories of people. Number one is the enthusiast. So, this Number one is the enthusiast. So, this Number one is the enthusiast. So, this is a person who knows all the new is a person who knows all the new is a person who knows all the new features of a thing, um how to how it's features of a thing, um how to how it's features of a thing, um how to how it's better, how it's improvement, what better, how it's improvement, what better, how it's improvement, what what's changed. They are very what's changed. They are very what's changed. They are very enthusiastic about this new thing. enthusiastic about this new thing. enthusiastic about this new thing. Now, Now, Now, you can kind of overlay that on on an you can kind of overlay that on on an you can kind of overlay that on on an ad, right? So, if if you heard the maybe ad, right? So, if if you heard the maybe ad, right? So, if if you heard the maybe the head of an LLM talk about their new the head of an LLM talk about their new the head of an LLM talk about their new thing, it's going to sound an awful lot thing, it's going to sound an awful lot thing, it's going to sound an awful lot like an enthusiast. That's not to say like an enthusiast. That's not to say like an enthusiast. That's not to say that enthusiasts are just people that enthusiasts are just people that enthusiasts are just people spouting ads. They're not. But what spouting ads. They're not. But what spouting ads. They're not. But what they've done is they have looked at all they've done is they have looked at all they've done is they have looked at all these new things and they're excited for these new things and they're excited for these new things and they're excited for it. That's the enthusiast. it. That's the enthusiast. it. That's the enthusiast. Number two is the pessimist. So, this is Number two is the pessimist. So, this is Number two is the pessimist. So, this is the person who's going to spot all the the person who's going to spot all the the person who's going to spot all the problems. And problems. And problems. And they might sound a little depressed, they might sound a little depressed, they might sound a little depressed, right? So, they they talk about oh, this right? So, they they talk about oh, this right? So, they they talk about oh, this new technology? Yeah, that that thing's new technology? Yeah, that that thing's new technology? Yeah, that that thing's got a whole bunch of security holes got a whole bunch of security holes got a whole bunch of security holes probably. It's probably not written real probably. It's probably not written real probably. It's probably not written real well. You know what? That's going to be well. You know what? That's going to be well. You know what? That's going to be the end of civilization as we know it.
-
the end of civilization as we know it. the end of civilization as we know it. Here's all the downsides, why it's going Here's all the downsides, why it's going Here's all the downsides, why it's going to fail. to fail. to fail. Now, again, this person isn't Now, again, this person isn't Now, again, this person isn't necessarily wrong. necessarily wrong. necessarily wrong. They're going to spot the issues, the They're going to spot the issues, the They're going to spot the issues, the problems, the downsides with this thing, problems, the downsides with this thing, problems, the downsides with this thing, whatever this new thing is. whatever this new thing is. whatever this new thing is. Number three is the ignore. Number three is the ignore. Number three is the ignore. This is the person who This is the person who This is the person who hasn't really looked into it. You know hasn't really looked into it. You know hasn't really looked into it. You know what? Not really passionate either way. what? Not really passionate either way. what? Not really passionate either way. Give it time. You know, it's the person Give it time. You know, it's the person Give it time. You know, it's the person that, you know, yeah, I've heard it's that, you know, yeah, I've heard it's that, you know, yeah, I've heard it's out there, but out there, but out there, but that's about it. I haven't looked into that's about it. I haven't looked into that's about it. I haven't looked into it. I kind of just it. I kind of just it. I kind of just left it off the radar. I'm just kind of left it off the radar. I'm just kind of left it off the radar. I'm just kind of ignoring it. And this person is in their ignoring it. And this person is in their ignoring it. And this person is in their own way right as well because they're own way right as well because they're own way right as well because they're not just chasing down the latest trend. not just chasing down the latest trend. not just chasing down the latest trend. They're not always disrupting They're not always disrupting They're not always disrupting everything. They're kind of picking and everything. They're kind of picking and everything. They're kind of picking and choosing when and kind of waiting for choosing when and kind of waiting for choosing when and kind of waiting for more of the tried and true over the more of the tried and true over the more of the tried and true over the bleeding edge. bleeding edge. bleeding edge. And number four type of personality is And number four type of personality is And number four type of personality is the unmoving person.
-
the unmoving person. the unmoving person. This is the person who's stuck inertia. This is the person who's stuck inertia. This is the person who's stuck inertia. They're stuck in the rut where the way They're stuck in the rut where the way They're stuck in the rut where the way they've done things is the way they're they've done things is the way they're they've done things is the way they're going to continue to do things because going to continue to do things because going to continue to do things because it works. If it does doesn't, you know, it works. If it does doesn't, you know, it works. If it does doesn't, you know, if it's not broken, then don't fix it, if it's not broken, then don't fix it, if it's not broken, then don't fix it, right? That's the the type of person right? That's the the type of person right? That's the the type of person that this person is. Um, the old way's that this person is. Um, the old way's that this person is. Um, the old way's the best ways. You know, these new the best ways. You know, these new the best ways. You know, these new things, they're they're wrong for these things, they're they're wrong for these things, they're they're wrong for these reasons. The old way was the best way of reasons. The old way was the best way of reasons. The old way was the best way of doing things. You know what? We should doing things. You know what? We should doing things. You know what? We should still be programming in still be programming in still be programming in whatever language. I don't want to whatever language. I don't want to whatever language. I don't want to offend anybody, but, you know, the the offend anybody, but, you know, the the offend anybody, but, you know, the the older languages or the older frameworks older languages or the older frameworks older languages or the older frameworks or this way was best. And, you know, or this way was best. And, you know, or this way was best. And, you know, they're not wrong either because change they're not wrong either because change they're not wrong either because change is costly. And so, there is something to is costly. And so, there is something to is costly. And so, there is something to said for not just changing all the time. said for not just changing all the time. said for not just changing all the time. >> [snorts] >> [snorts] >> [snorts] >> So, here's the truth. >> So, here's the truth. >> So, here's the truth. All four people or personality groups All four people or personality groups All four people or personality groups are correct. are correct. are correct. They just aren't fully correct. They just aren't fully correct. They just aren't fully correct. You need all four to come together to You need all four to come together to You need all four to come together to evaluate any new option. evaluate any new option. evaluate any new option. Too often people are afraid to face the Too often people are afraid to face the Too often people are afraid to face the other side of an argument where they other side of an argument where they other side of an argument where they either like it or hate it and they want either like it or hate it and they want either like it or hate it and they want to find things that affirm that rather to find things that affirm that rather to find things that affirm that rather than confront confronting the fact that than confront confronting the fact that than confront confronting the fact that there is another side.
-
there is another side. there is another side. And that fear can really hold you back. And that fear can really hold you back. And that fear can really hold you back. If you cannot confidently and honestly If you cannot confidently and honestly If you cannot confidently and honestly face the other side of an argument, face the other side of an argument, face the other side of an argument, then you don't have a strong argument. then you don't have a strong argument. then you don't have a strong argument. What you have is just What you have is just What you have is just the thing that you like. And you can the thing that you like. And you can the thing that you like. And you can like things, but it doesn't mean that like things, but it doesn't mean that like things, but it doesn't mean that you're making an honest argument. you're making an honest argument. you're making an honest argument. So, let's be clear. If you cannot So, let's be clear. If you cannot So, let's be clear. If you cannot properly and fully fill out all four properly and fully fill out all four properly and fully fill out all four four roles for any decision you make, four roles for any decision you make, four roles for any decision you make, you aren't making good decisions. you aren't making good decisions. you aren't making good decisions. You're just hoping for a happy accident. You're just hoping for a happy accident. You're just hoping for a happy accident. People often say they're evaluating the People often say they're evaluating the People often say they're evaluating the pros and cons, pros and cons, pros and cons, but they're often lying to themselves. but they're often lying to themselves. but they're often lying to themselves. The most common situation is a person is The most common situation is a person is The most common situation is a person is fully in one category and kind of fully in one category and kind of fully in one category and kind of pretending or making a half effort in pretending or making a half effort in pretending or making a half effort in the others. the others. the others. Let's go go through a relevant example Let's go go through a relevant example Let's go go through a relevant example because this has come up a lot recently, because this has come up a lot recently, because this has come up a lot recently, and that is AI. and that is AI. and that is AI. Everyone has an opinion on AI. Everyone has an opinion on AI. Everyone has an opinion on AI. I've had conversations with each of the I've had conversations with each of the I've had conversations with each of the four categories of people about AI. So, four categories of people about AI. So, four categories of people about AI. So, let's start with each category and what let's start with each category and what let's start with each category and what it might look like when it comes to AI, it might look like when it comes to AI, it might look like when it comes to AI, and then we'll and we'll narrow it down and then we'll and we'll narrow it down and then we'll and we'll narrow it down a bit to be just AI for developers a bit to be just AI for developers a bit to be just AI for developers because AI is such a broad category.
-
because AI is such a broad category. because AI is such a broad category. So, let's talk about the enthusiast. You So, let's talk about the enthusiast. You So, let's talk about the enthusiast. You know, know, know, AI makes me write code faster. I get AI makes me write code faster. I get AI makes me write code faster. I get work done I get more work done. I get to work done I get more work done. I get to work done I get more work done. I get to the market quicker. I do more with less. the market quicker. I do more with less. the market quicker. I do more with less. This is the enthusiast. They they see This is the enthusiast. They they see This is the enthusiast. They they see all the benefits of being able to have all the benefits of being able to have all the benefits of being able to have the code written for you where you just the code written for you where you just the code written for you where you just say, "I want this." And it pops out the say, "I want this." And it pops out the say, "I want this." And it pops out the other end. other end. other end. It can get a lot of work done fast. We It can get a lot of work done fast. We It can get a lot of work done fast. We see a lot of this. And you know what? see a lot of this. And you know what? see a lot of this. And you know what? There is something to be said for the There is something to be said for the There is something to be said for the fact that yes, fact that yes, fact that yes, it can make you a faster developer. It it can make you a faster developer. It it can make you a faster developer. It can help you write code better. You can can help you write code better. You can can help you write code better. You can get more work done with AI. And by the get more work done with AI. And by the get more work done with AI. And by the way, pause right here. If you are way, pause right here. If you are way, pause right here. If you are against AI or frustrated with AI, which against AI or frustrated with AI, which against AI or frustrated with AI, which I can I can get, but if you can't say I can I can get, but if you can't say I can I can get, but if you can't say honestly honestly honestly that there are positives to it, then that there are positives to it, then that there are positives to it, then again, you're you're just looking at one again, you're you're just looking at one again, you're you're just looking at one side. side. side. You've got to look at both sides. Now, You've got to look at both sides. Now, You've got to look at both sides. Now, that doesn't mean that you think that that doesn't mean that you think that that doesn't mean that you think that these are all going to be the reason to these are all going to be the reason to these are all going to be the reason to do it. You just need to acknowledge the do it. You just need to acknowledge the do it. You just need to acknowledge the fact there are reasons why fact there are reasons why fact there are reasons why it exists. There's a reason why it's it exists. There's a reason why it's it exists. There's a reason why it's positive. Okay, so that's the positive. Okay, so that's the positive. Okay, so that's the enthusiast. It writes code faster. It enthusiast. It writes code faster. It enthusiast. It writes code faster. It gets more work done. You can get to gets more work done. You can get to gets more work done. You can get to market quicker. You can do more with market quicker. You can do more with market quicker. You can do more with less. It can empower companies in a way less. It can empower companies in a way less. It can empower companies in a way that, you know, smaller businesses can that, you know, smaller businesses can that, you know, smaller businesses can actually get in the market and do custom actually get in the market and do custom actually get in the market and do custom things as opposed to just buying off the things as opposed to just buying off the things as opposed to just buying off the shelf and being limited. So, there's a shelf and being limited. So, there's a shelf and being limited. So, there's a lot of reasons you can list. I've only lot of reasons you can list. I've only lot of reasons you can list. I've only listed a few, but why you can be
-
listed a few, but why you can be listed a few, but why you can be enthusiastic about AI. enthusiastic about AI. enthusiastic about AI. Let's look at the pessimist. Let's look at the pessimist. Let's look at the pessimist. Well, Well, Well, AI coding can introduce more bugs AI coding can introduce more bugs AI coding can introduce more bugs because you're moving faster and so you because you're moving faster and so you because you're moving faster and so you miss things. So, AI doesn't always write miss things. So, AI doesn't always write miss things. So, AI doesn't always write the correct code. It writes it correct a the correct code. It writes it correct a the correct code. It writes it correct a lot of the time, but not all the time. lot of the time, but not all the time. lot of the time, but not all the time. And so, it can introduce some And so, it can introduce some And so, it can introduce some significant bugs. significant bugs. significant bugs. Also, you lose institutional knowledge Also, you lose institutional knowledge Also, you lose institutional knowledge about the code. Meaning, when the AI about the code. Meaning, when the AI about the code. Meaning, when the AI writes it and you're just reviewing it, writes it and you're just reviewing it, writes it and you're just reviewing it, well, then you're not really, you know, well, then you're not really, you know, well, then you're not really, you know, baked into why the decisions were made. baked into why the decisions were made. baked into why the decisions were made. So, you're no longer the the go-to So, you're no longer the the go-to So, you're no longer the the go-to person for the code. You might say, person for the code. You might say, person for the code. You might say, "Well, AI is." Well, yeah, but AI "Well, AI is." Well, yeah, but AI "Well, AI is." Well, yeah, but AI doesn't remember, right? Where humans doesn't remember, right? Where humans doesn't remember, right? Where humans we've gotten used to this idea that we've gotten used to this idea that we've gotten used to this idea that there's a senior developer who knows there's a senior developer who knows there's a senior developer who knows where all the bodies are buried, right? where all the bodies are buried, right? where all the bodies are buried, right? They they know why we made these They they know why we made these They they know why we made these decisions and why we made these decisions and why we made these decisions and why we made these compromises. And you don't know that as compromises. And you don't know that as compromises. And you don't know that as much. So, you also have as good of an much. So, you also have as good of an much. So, you also have as good of an understanding of your security and understanding of your security and understanding of your security and performance. And AI is not great at that performance. And AI is not great at that performance. And AI is not great at that usually. So, that's going to be a usually. So, that's going to be a usually. So, that's going to be a weak point for your company. Again, if weak point for your company. Again, if weak point for your company. Again, if you are a AI enthusiast and you're you are a AI enthusiast and you're you are a AI enthusiast and you're going, "Yeah, yeah, yeah."
-
going, "Yeah, yeah, yeah." going, "Yeah, yeah, yeah." Well, Well, Well, here's the thing. here's the thing. here's the thing. You need to I'm sorry, AI negative You need to I'm sorry, AI negative You need to I'm sorry, AI negative person towards AI. You're going, "Yes, person towards AI. You're going, "Yes, person towards AI. You're going, "Yes, yes, yes." Well, but remember, there's yes, yes." Well, but remember, there's yes, yes." Well, but remember, there's the positives as well, okay? We have to the positives as well, okay? We have to the positives as well, okay? We have to understand both sides. So, if you're an understand both sides. So, if you're an understand both sides. So, if you're an enthusiast and go, you know, those are enthusiast and go, you know, those are enthusiast and go, you know, those are those are not problems, well, then those are not problems, well, then those are not problems, well, then you're missing out. There are problems. you're missing out. There are problems. you're missing out. There are problems. You have to acknowledge it. Um this is You have to acknowledge it. Um this is You have to acknowledge it. Um this is one of the reasons why I did the AI one of the reasons why I did the AI one of the reasons why I did the AI Hurts Everything series. It wasn't just Hurts Everything series. It wasn't just Hurts Everything series. It wasn't just to be a pessimist, which is more of what to be a pessimist, which is more of what to be a pessimist, which is more of what those videos are about, is the those videos are about, is the those videos are about, is the pessimistic side, not because I'm a pessimistic side, not because I'm a pessimistic side, not because I'm a pessimist, pessimist, pessimist, but because I was but because I was but because I was kind of fearful that people weren't kind of fearful that people weren't kind of fearful that people weren't looking at that side of things, where looking at that side of things, where looking at that side of things, where they were looking at the enthusiast they were looking at the enthusiast they were looking at the enthusiast side, but not the pessimist side. side, but not the pessimist side. side, but not the pessimist side. And yes, you have to look at both of And yes, you have to look at both of And yes, you have to look at both of those. those. those. But again, there's two more to go But again, there's two more to go But again, there's two more to go through. Number three, the ignorer. through. Number three, the ignorer. through. Number three, the ignorer. So, So, So, you know, if if you're looking at AI and you know, if if you're looking at AI and you know, if if you're looking at AI and saying, "Hey, I want to look at it at saying, "Hey, I want to look at it at saying, "Hey, I want to look at it at from the role of the ignorer." Well, I'm from the role of the ignorer." Well, I'm from the role of the ignorer." Well, I'm going to look at this and go, "You know going to look at this and go, "You know going to look at this and go, "You know what? We need to wait for some dust to what? We need to wait for some dust to what? We need to wait for some dust to settle right now because the way to use settle right now because the way to use settle right now because the way to use AI today is not the way we used AI AI today is not the way we used AI AI today is not the way we used AI a month ago, a month ago, a month ago, which is not the way we used AI two which is not the way we used AI two which is not the way we used AI two months ago.
-
months ago. months ago. I mean, are are you doing loops right I mean, are are you doing loops right I mean, are are you doing loops right now? Are you doing now? Are you doing now? Are you doing agents? Are you doing skills? Are you agents? Are you doing skills? Are you agents? Are you doing skills? Are you doing MCP? Are you doing like all all doing MCP? Are you doing like all all doing MCP? Are you doing like all all things are changing and constantly things are changing and constantly things are changing and constantly evolving. evolving. evolving. And the problem is is the way you do And the problem is is the way you do And the problem is is the way you do things today won't work the same in a things today won't work the same in a things today won't work the same in a month. The prompt you write today that's month. The prompt you write today that's month. The prompt you write today that's that's perfectly customized for that that's perfectly customized for that that's perfectly customized for that version of the LM won't work as well version of the LM won't work as well version of the LM won't work as well next month. next month. next month. So, yeah, there's going to be a little So, yeah, there's going to be a little So, yeah, there's going to be a little bit of thinking about, you know, what? bit of thinking about, you know, what? bit of thinking about, you know, what? Maybe we should wait for the dust dust Maybe we should wait for the dust dust Maybe we should wait for the dust dust the dust to settle a bit on some of the dust to settle a bit on some of the dust to settle a bit on some of this. Maybe we should think about what this. Maybe we should think about what this. Maybe we should think about what we do and don't [clears throat] do when we do and don't [clears throat] do when we do and don't [clears throat] do when it comes to AI because of how fluid it it comes to AI because of how fluid it it comes to AI because of how fluid it is. is. is. Maybe we skip some of the churn of that Maybe we skip some of the churn of that Maybe we skip some of the churn of that new technology and we wait for the new technology and we wait for the new technology and we wait for the evidence to mount over what is the right evidence to mount over what is the right evidence to mount over what is the right way of doing things. Maybe let other way of doing things. Maybe let other way of doing things. Maybe let other people people people kind of get ahead and kind of learn the kind of get ahead and kind of learn the kind of get ahead and kind of learn the ropes, figure all out, and then we come ropes, figure all out, and then we come ropes, figure all out, and then we come along and build on their shoulders along and build on their shoulders along and build on their shoulders instead of trying to replicate them.
-
instead of trying to replicate them. instead of trying to replicate them. So, the ignorer has some good points as So, the ignorer has some good points as So, the ignorer has some good points as well about, you know, what? There's a well about, you know, what? There's a well about, you know, what? There's a lot of churn going on and it's going to lot of churn going on and it's going to lot of churn going on and it's going to be expensive for us to jump in right be expensive for us to jump in right be expensive for us to jump in right now. It's even more expensive because now. It's even more expensive because now. It's even more expensive because the cost of the credits. So, if we the cost of the credits. So, if we the cost of the credits. So, if we ignore it and don't just try and learn ignore it and don't just try and learn ignore it and don't just try and learn as we go and reinvent the wheel like as we go and reinvent the wheel like as we go and reinvent the wheel like everybody else is doing, we can just everybody else is doing, we can just everybody else is doing, we can just learn from others' experiences and not learn from others' experiences and not learn from others' experiences and not have to pay for them. have to pay for them. have to pay for them. And number four, the unmoving. And number four, the unmoving. And number four, the unmoving. Still doing things the way we used to. Still doing things the way we used to. Still doing things the way we used to. You know, that that could be something You know, that that could be something You know, that that could be something that is beneficial because maybe if we that is beneficial because maybe if we that is beneficial because maybe if we continue to do things the way we used continue to do things the way we used continue to do things the way we used to, if the whole market changes but it to, if the whole market changes but it to, if the whole market changes but it doesn't get better, doesn't get better, doesn't get better, so we're seeing things like there's more so we're seeing things like there's more so we're seeing things like there's more security flaws and there's worse security flaws and there's worse security flaws and there's worse performance and, performance and, performance and, you know, companies are struggling and you know, companies are struggling and you know, companies are struggling and companies go out of business because of companies go out of business because of companies go out of business because of the the push to go fast. Well, if you're the the push to go fast. Well, if you're the the push to go fast. Well, if you're unmoving, you're still doing them the unmoving, you're still doing them the unmoving, you're still doing them the same way you used to do things, you same way you used to do things, you same way you used to do things, you might actually move ahead of the pack might actually move ahead of the pack might actually move ahead of the pack because now you're the reliable one.
-
because now you're the reliable one. because now you're the reliable one. And this allows you to say, you know And this allows you to say, you know And this allows you to say, you know what? Maybe we do things the way we've what? Maybe we do things the way we've what? Maybe we do things the way we've done things because we've proven that it done things because we've proven that it done things because we've proven that it works. works. works. And it's if something that, you know, it And it's if something that, you know, it And it's if something that, you know, it wasn't broken. So, let's not try and wasn't broken. So, let's not try and wasn't broken. So, let's not try and meddle with it. Let's keep our same meddle with it. Let's keep our same meddle with it. Let's keep our same processes and technologies. Now again, processes and technologies. Now again, processes and technologies. Now again, remember, we're not looking at just one remember, we're not looking at just one remember, we're not looking at just one of those people. of those people. of those people. We want to look at all four of them. We want to look at all four of them. We want to look at all four of them. So, So, So, the reality is that too many people the reality is that too many people the reality is that too many people could only passionately argue for one of could only passionately argue for one of could only passionately argue for one of those categories. those categories. those categories. The rest they only give passing lip The rest they only give passing lip The rest they only give passing lip service to. service to. service to. So, if you're making a decision about AI So, if you're making a decision about AI So, if you're making a decision about AI for development, you should be ans- be for development, you should be ans- be for development, you should be ans- be able to answer the following questions. able to answer the following questions. able to answer the following questions. Number one, what benefits will this Number one, what benefits will this Number one, what benefits will this actually add to our team and process? actually add to our team and process? actually add to our team and process? Now, I want you to stop right there. Now, I want you to stop right there. Now, I want you to stop right there. We're not talking about what are the We're not talking about what are the We're not talking about what are the talking points. We're not talking about talking points. We're not talking about talking points. We're not talking about what are the the cool things about AI. what are the the cool things about AI. what are the the cool things about AI. Nope. We're talking about what benefits Nope. We're talking about what benefits Nope. We're talking about what benefits will this actually add to our team or will this actually add to our team or will this actually add to our team or process?
-
process? process? What's the real concrete thing it's What's the real concrete thing it's What's the real concrete thing it's going to add? And you're going to find going to add? And you're going to find going to add? And you're going to find some. You probably should. If you don't, some. You probably should. If you don't, some. You probably should. If you don't, stop right there because you're done, stop right there because you're done, stop right there because you're done, right? But number two, right? But number two, right? But number two, what downsides is this going to add to what downsides is this going to add to what downsides is this going to add to our team or process? And again, you our team or process? And again, you our team or process? And again, you should know specifically for your should know specifically for your should know specifically for your environment. Uh really quickly, one environment. Uh really quickly, one environment. Uh really quickly, one you can add is there's a cost, right? you can add is there's a cost, right? you can add is there's a cost, right? Nothing's free. And AI is not cheap and Nothing's free. And AI is not cheap and Nothing's free. And AI is not cheap and it's not getting cheaper. It's getting it's not getting cheaper. It's getting it's not getting cheaper. It's getting more expensive. So, more expensive. So, more expensive. So, that's one downside, but that's not the that's one downside, but that's not the that's one downside, but that's not the only downside. only downside. only downside. But you have to look at how is it being But you have to look at how is it being But you have to look at how is it being used in the industry and what are the used in the industry and what are the used in the industry and what are the results we're seeing and go, oh, there's results we're seeing and go, oh, there's results we're seeing and go, oh, there's some other downsides. That's why I did some other downsides. That's why I did some other downsides. That's why I did the video on how it hurts software the video on how it hurts software the video on how it hurts software development because there are some development because there are some development because there are some impacts that people aren't addressing. impacts that people aren't addressing. impacts that people aren't addressing. So, what are the downsides to this? We So, what are the downsides to this? We So, what are the downsides to this? We have the benefits listed. now we have have the benefits listed. now we have have the benefits listed. now we have the downsides kind of put on that scale the downsides kind of put on that scale the downsides kind of put on that scale to say this is starting to weigh more or to say this is starting to weigh more or to say this is starting to weigh more or less than the other. less than the other. less than the other. Now, we're not done yet though, because Now, we're not done yet though, because Now, we're not done yet though, because number three, has this been tested or number three, has this been tested or number three, has this been tested or are we rushing in?
-
are we rushing in? are we rushing in? So, have we or we implement a tested So, have we or we implement a tested So, have we or we implement a tested thing where people say this is how you thing where people say this is how you thing where people say this is how you do things or is it this is how you do do things or is it this is how you do do things or is it this is how you do things this week things this week things this week and we have to change the process over and we have to change the process over and we have to change the process over and over again. and over again. and over again. And do we even have the bandwidth to And do we even have the bandwidth to And do we even have the bandwidth to change right now? change right now? change right now? If you're in the middle of a process, in If you're in the middle of a process, in If you're in the middle of a process, in the middle middle of a system, the middle middle of a system, the middle middle of a system, upgrading just isn't the right time. You upgrading just isn't the right time. You upgrading just isn't the right time. You know, doing things differently halfway know, doing things differently halfway know, doing things differently halfway through a major project isn't the right through a major project isn't the right through a major project isn't the right time. time. time. A very simple example of this is I use A very simple example of this is I use A very simple example of this is I use recording software. I'm using recording recording software. I'm using recording recording software. I'm using recording software right now to record myself. software right now to record myself. software right now to record myself. Well, Well, Well, I get updates all the time. I get updates all the time. I get updates all the time. Unfortunately, it's faster and faster Unfortunately, it's faster and faster Unfortunately, it's faster and faster now where it will say, "Hey, there's a now where it will say, "Hey, there's a now where it will say, "Hey, there's a new update. There's a new update." Guess new update. There's a new update." Guess new update. There's a new update." Guess what I don't do. what I don't do. what I don't do. I don't upgrade right away. I don't make I don't upgrade right away. I don't make I don't upgrade right away. I don't make changes until I know I have a day or two changes until I know I have a day or two changes until I know I have a day or two to figure out the problems. Because if I to figure out the problems. Because if I to figure out the problems. Because if I say every time I see an upgrade, "Yeah, say every time I see an upgrade, "Yeah, say every time I see an upgrade, "Yeah, go ahead and do that." and then jump go ahead and do that." and then jump go ahead and do that." and then jump right into recording, I've had times right into recording, I've had times right into recording, I've had times where I've done that and then I have no where I've done that and then I have no where I've done that and then I have no sound. They have to change the default sound. They have to change the default sound. They have to change the default capture or the video looks weird or I capture or the video looks weird or I capture or the video looks weird or I have a a sync issue.
-
have a a sync issue. have a a sync issue. So, So, So, you want to make sure that you are using you want to make sure that you are using you want to make sure that you are using something that's been tested something that's been tested something that's been tested and that you have the bandwidth to do and that you have the bandwidth to do and that you have the bandwidth to do the change right now. That's number the change right now. That's number the change right now. That's number three. three. three. Number four, Number four, Number four, does this new system improve our process does this new system improve our process does this new system improve our process significantly enough? significantly enough? significantly enough? Not does it make an improvement, is it Not does it make an improvement, is it Not does it make an improvement, is it significant enough? significant enough? significant enough? It has to overcome the inertia. You have It has to overcome the inertia. You have It has to overcome the inertia. You have a process. In theory, it's working. In a process. In theory, it's working. In a process. In theory, it's working. In theory, you're putting software out theory, you're putting software out theory, you're putting software out there. So, is this change going to make there. So, is this change going to make there. So, is this change going to make your process significantly better? your process significantly better? your process significantly better? Okay? Is this going to provide enough Okay? Is this going to provide enough Okay? Is this going to provide enough gain for the pain that's going to cost? gain for the pain that's going to cost? gain for the pain that's going to cost? Because any new change is going to cause Because any new change is going to cause Because any new change is going to cause pain. pain. pain. So, you should know the answers to all So, you should know the answers to all So, you should know the answers to all these questions these questions these questions before you make an informed decision. before you make an informed decision. before you make an informed decision. Otherwise, it's not an informed Otherwise, it's not an informed Otherwise, it's not an informed decision. decision. decision. It's a uh wishful guess. It's a uh wishful guess. It's a uh wishful guess. So, once you have honestly evaluated all So, once you have honestly evaluated all So, once you have honestly evaluated all four possibilities, four possibilities, four possibilities, can you or all four positions, I guess can you or all four positions, I guess can you or all four positions, I guess you could say, um you could say, um you could say, um you can make an informed decision about you can make an informed decision about you can make an informed decision about what to do. But, you weren't done.
-
what to do. But, you weren't done. what to do. But, you weren't done. Then, you need to evaluate if you Then, you need to evaluate if you Then, you need to evaluate if you thought what was going to be true thought what was going to be true thought what was going to be true actually came true, right? So, you can't actually came true, right? So, you can't actually came true, right? So, you can't stop it we made a decision. You have to stop it we made a decision. You have to stop it we made a decision. You have to wait a month, two months, three months wait a month, two months, three months wait a month, two months, three months down the road, and then look back at down the road, and then look back at down the road, and then look back at those four questions that you answered those four questions that you answered those four questions that you answered and say, were we right about these and say, were we right about these and say, were we right about these answers? answers? answers? Did the the good things come true? Did Did the the good things come true? Did Did the the good things come true? Did the bad things happen at the level we the bad things happen at the level we the bad things happen at the level we expected them to? expected them to? expected them to? Did this benefit us much more than what Did this benefit us much more than what Did this benefit us much more than what we were currently going through? You we were currently going through? You we were currently going through? You know, answering these questions later know, answering these questions later know, answering these questions later and seeing were we correct in our and seeing were we correct in our and seeing were we correct in our assumptions? Because they are assumptions? Because they are assumptions? Because they are assumptions. assumptions. assumptions. So, So, So, are you only experiencing the downsides are you only experiencing the downsides are you only experiencing the downsides you expected? You know, are you not you expected? You know, are you not you expected? You know, are you not getting the benefits? Like, you need to getting the benefits? Like, you need to getting the benefits? Like, you need to understand how to evaluate and see, understand how to evaluate and see, understand how to evaluate and see, you know, you know, you know, just because you're doing it now doesn't just because you're doing it now doesn't just because you're doing it now doesn't mean you should keep doing it. Maybe you mean you should keep doing it. Maybe you mean you should keep doing it. Maybe you look at it and go, "Oops, we were look at it and go, "Oops, we were look at it and go, "Oops, we were wrong." wrong." wrong." Okay? So, this is important to Okay? So, this is important to Okay? So, this is important to understand. We often allow our bias to understand. We often allow our bias to understand. We often allow our bias to cloud our judgment.
-
cloud our judgment. cloud our judgment. But, that way leads to poor decisions But, that way leads to poor decisions But, that way leads to poor decisions and guesses. and guesses. and guesses. Instead, you need to actively push Instead, you need to actively push Instead, you need to actively push against your bias to get to a point against your bias to get to a point against your bias to get to a point where you can make well-informed, honest where you can make well-informed, honest where you can make well-informed, honest evaluations that can also adjust over evaluations that can also adjust over evaluations that can also adjust over time. time. time. This is one of the weird areas where I This is one of the weird areas where I This is one of the weird areas where I was very successful as a consultant was very successful as a consultant was very successful as a consultant because of the fact that I could say, because of the fact that I could say, because of the fact that I could say, "Hey, we were wrong." "Hey, we were wrong." "Hey, we were wrong." Hey, you know what? We we put that in, Hey, you know what? We we put that in, Hey, you know what? We we put that in, it didn't work the way we expected to. it didn't work the way we expected to. it didn't work the way we expected to. Let's make an adjustment. Or here's what Let's make an adjustment. Or here's what Let's make an adjustment. Or here's what I've learned over time, the positives I've learned over time, the positives I've learned over time, the positives and the negatives. And that really can and the negatives. And that really can and the negatives. And that really can have a positive impact on a department have a positive impact on a department have a positive impact on a department because you're coming in and showing the because you're coming in and showing the because you're coming in and showing the the full spectrum. Because, you know the full spectrum. Because, you know the full spectrum. Because, you know what? If you're super enthusiastic about what? If you're super enthusiastic about what? If you're super enthusiastic about something and you say, "You know what? something and you say, "You know what? something and you say, "You know what? This new widget is going to do amazing This new widget is going to do amazing This new widget is going to do amazing things. Here's all the benefits it can things. Here's all the benefits it can things. Here's all the benefits it can do." And you forget to evaluate the rest do." And you forget to evaluate the rest do." And you forget to evaluate the rest of the stuff, of the stuff, of the stuff, and you implement it, and you implement it, and you implement it, the rest of the stuff's going to show the rest of the stuff's going to show the rest of the stuff's going to show up. up. up. It's not going to be something where you It's not going to be something where you It's not going to be something where you put it in, all of a sudden everything's put it in, all of a sudden everything's put it in, all of a sudden everything's sunshine and roses because you said all sunshine and roses because you said all sunshine and roses because you said all these new positive things.
-
these new positive things. these new positive things. The negative things come along, The negative things come along, The negative things come along, whether you want them to or not. whether you want them to or not. whether you want them to or not. So, if you are informed and you inform So, if you are informed and you inform So, if you are informed and you inform people about that, they at least know up people about that, they at least know up people about that, they at least know up front, "This is what we're expecting for front, "This is what we're expecting for front, "This is what we're expecting for the downsides. This is what we're the downsides. This is what we're the downsides. This is what we're expecting for the the implementation expecting for the the implementation expecting for the the implementation time frame. This is how we expect it's time frame. This is how we expect it's time frame. This is how we expect it's going to negatively affect our process going to negatively affect our process going to negatively affect our process for a while." for a while." for a while." These things are all important to These things are all important to These things are all important to understand so you can have a proper understand so you can have a proper understand so you can have a proper viewpoint on what this change might look viewpoint on what this change might look viewpoint on what this change might look like. Because right now there are a lot like. Because right now there are a lot like. Because right now there are a lot of teams that have just of teams that have just of teams that have just dove in right in dove in I don't think dove in right in dove in I don't think dove in right in dove in I don't think that's the right word. They dived right that's the right word. They dived right that's the right word. They dived right in. There you go. They dived right into in. There you go. They dived right into in. There you go. They dived right into AI and they they put AI and they they AI and they they put AI and they they AI and they they put AI and they they told our teams, "Hey, make AI all your told our teams, "Hey, make AI all your told our teams, "Hey, make AI all your codes now on. I want you to be a project codes now on. I want you to be a project codes now on. I want you to be a project manager." They kind of just dove right manager." They kind of just dove right manager." They kind of just dove right into the the whole process without doing into the the whole process without doing into the the whole process without doing the full evaluation. And you know what? the full evaluation. And you know what? the full evaluation. And you know what? They're finding out the negatives. I'm They're finding out the negatives. I'm They're finding out the negatives. I'm not saying AI is bad for your business.
-
not saying AI is bad for your business. not saying AI is bad for your business. But, you have to make sure that you But, you have to make sure that you But, you have to make sure that you fully evaluate it to say, "Hey, you know fully evaluate it to say, "Hey, you know fully evaluate it to say, "Hey, you know what? Here's the downsides." Because what? Here's the downsides." Because what? Here's the downsides." Because there's some significant downsides that there's some significant downsides that there's some significant downsides that if you aren't prepared for, will really if you aren't prepared for, will really if you aren't prepared for, will really cause problems and get people cause problems and get people cause problems and get people frustrated, and you might even lose a frustrated, and you might even lose a frustrated, and you might even lose a good thing because they didn't expect good thing because they didn't expect good thing because they didn't expect the downsides. Where a good thing that the downsides. Where a good thing that the downsides. Where a good thing that did have more positives than negatives, did have more positives than negatives, did have more positives than negatives, but because those negatives were but because those negatives were but because those negatives were surprises, it really ends up tainting surprises, it really ends up tainting surprises, it really ends up tainting the whole process and and you lose the the whole process and and you lose the the whole process and and you lose the good thing. So, make sure to be an good thing. So, make sure to be an good thing. So, make sure to be an honest evaluator of your options. Don't honest evaluator of your options. Don't honest evaluator of your options. Don't just, you know, say it depends, but then just, you know, say it depends, but then just, you know, say it depends, but then not really be honest about the positives not really be honest about the positives not really be honest about the positives and negatives, the the way to evaluate and negatives, the the way to evaluate and negatives, the the way to evaluate if it if you should move or not. Um all if it if you should move or not. Um all if it if you should move or not. Um all these things are really important, okay? these things are really important, okay? these things are really important, okay? So, I encourage you make sure you cover So, I encourage you make sure you cover So, I encourage you make sure you cover all four categories, make sure you all four categories, make sure you all four categories, make sure you answer those questions, and make sure answer those questions, and make sure answer those questions, and make sure that you understand your decision before that you understand your decision before that you understand your decision before you just make it. All right? Thanks for you just make it. All right? Thanks for you just make it. All right? Thanks for listening, and as always, I am Tim listening, and as always, I am Tim listening, and as always, I am Tim Corey.
-
Corey. Corey. >> [music]
Summary
The main theme is how to properly evaluate technology options in software development. Key subjects include enthusiasts, pessimists, those who ignore new tech, and the importance of considering situational variables. The practical takeaway is to avoid emotional biases like enthusiasm, pessimism, ignorance, or inertia, and instead approach evaluation with a balanced perspective.