AI-Native Organisations Run on Skills: How to Structure and Scale Them — Imad Touil, QuantumBlack

Thank you for joining me today. My name Thank you for joining me today. My name is Imatel. I'm a distinguished engineer is Imatel. I'm a distinguished engineer is Imatel. I'm a distinguished engineer at Quantum Black. And today talk I want at Quantum Black. And today talk I want at Quantum Black. And today talk I want to really cover the uh how AI native to really cover the uh how AI native to really cover the uh how AI native organizations runs on skills. But before organizations runs on skills. But before organizations runs on skills. But before I really get started, um I just want to I really get started, um I just want to I really get started, um I just want to do like a quick exercise to show of do like a quick exercise to show of do like a quick exercise to show of hands. Can you raise your hand if you hands. Can you raise your hand if you hands. Can you raise your hand if you have already created and using skills? have already created and using skills? have already created and using skills? Amazing. Now can you keep your hand up Amazing. Now can you keep your hand up Amazing. Now can you keep your hand up if you are using it and sharing it if you are using it and sharing it if you are using it and sharing it within your teams? within your teams? within your teams? Great. Now keep your hands up if you Great. Now keep your hands up if you Great. Now keep your hands up if you have governed maintained skills across have governed maintained skills across have governed maintained skills across your organization. your organization. your organization. Amazing. I see a few hands. But that is Amazing. I see a few hands. But that is Amazing. I see a few hands. But that is what this talk is about. Today I'm what this talk is about. Today I'm what this talk is about. Today I'm really looking to break down why this is really looking to break down why this is really looking to break down why this is really critical, how it's important and really critical, how it's important and really critical, how it's important and how actually you can adopt it across how actually you can adopt it across how actually you can adopt it across your organization. But before I get your organization. But before I get your organization. But before I get started, what I really want to cover is started, what I really want to cover is started, what I really want to cover is actually the agentic software stack. So actually the agentic software stack. So actually the agentic software stack. So the agentic software stack has two the agentic software stack has two the agentic software stack has two loops. So the first loop is all you loops. So the first loop is all you loops. So the first loop is all you know, right? It's the code and agents or know, right? It's the code and agents or know, right? It's the code and agents or the code agents harness right the code agents harness right the code agents harness right at this you have some core components.

at this you have some core components. at this you have some core components. You will have your context manager, the You will have your context manager, the You will have your context manager, the tool and MCPS, memories and states and tool and MCPS, memories and states and tool and MCPS, memories and states and skills loader, right? But then there's skills loader, right? But then there's skills loader, right? But then there's an outer loop which is your workflows, an outer loop which is your workflows, an outer loop which is your workflows, right? Those has skills, sub aents, MCP right? Those has skills, sub aents, MCP right? Those has skills, sub aents, MCP servers that you use and some hooks. servers that you use and some hooks. servers that you use and some hooks. Sometimes you need them to have this Sometimes you need them to have this Sometimes you need them to have this running properly. You will need some running properly. You will need some running properly. You will need some enablement components at the bottom. So enablement components at the bottom. So enablement components at the bottom. So what you would have is an environment what you would have is an environment what you would have is an environment sandbox. You would have your MCP gateway sandbox. You would have your MCP gateway sandbox. You would have your MCP gateway to manage and simplify all of the MCP to manage and simplify all of the MCP to manage and simplify all of the MCP tools across your organization. a model tools across your organization. a model tools across your organization. a model gateway to again manage and optimize for gateway to again manage and optimize for gateway to again manage and optimize for all of your LMS either like you know all of your LMS either like you know all of your LMS either like you know open source like running locally or or open source like running locally or or open source like running locally or or or frontier models and also a graph or frontier models and also a graph or frontier models and also a graph knowledge graph that abstracts your IT knowledge graph that abstracts your IT knowledge graph that abstracts your IT core systems your codebase your skills core systems your codebase your skills core systems your codebase your skills registry and at the end workflow registry and at the end workflow registry and at the end workflow marketplace and then you have your marketplace and then you have your marketplace and then you have your context layer right the context layer context layer right the context layer context layer right the context layer will bring all of what is needed to get will bring all of what is needed to get will bring all of what is needed to get the task done so this is the project the task done so this is the project the task done so this is the project instruction think about it as the cloud instruction think about it as the cloud instruction think about it as the cloud code MD file the agency file your tools code MD file the agency file your tools code MD file the agency file your tools and MCP schema is actually to understand and MCP schema is actually to understand and MCP schema is actually to understand which tool to use and when your memory which tool to use and when your memory which tool to use and when your memory right conversation history with the end right conversation history with the end right conversation history with the end user the human is in the loop and user the human is in the loop and user the human is in the loop and finally the retrieved contents that's finally the retrieved contents that's finally the retrieved contents that's you can pull from either like files your you can pull from either like files your you can pull from either like files your codebase etc now what I want to really codebase etc now what I want to really codebase etc now what I want to really focus on today is the workflow right and focus on today is the workflow right and focus on today is the workflow right and I think this is where we kind of like I think this is where we kind of like I think this is where we kind of like think um it's kind of a pretty simple um think um it's kind of a pretty simple um think um it's kind of a pretty simple um uh workflow in day-to-day when you're uh workflow in day-to-day when you're uh workflow in day-to-day when you're trying to actually create an end to-end trying to actually create an end to-end trying to actually create an end to-end product software delivery life cycle in

product software delivery life cycle in product software delivery life cycle in the organization. In reality, we all the organization. In reality, we all the organization. In reality, we all have seen the four steps. specify to have seen the four steps. specify to have seen the four steps. specify to define what you want to build the design define what you want to build the design define what you want to build the design or plan to plan you know what what are or plan to plan you know what what are or plan to plan you know what what are you looking to build then you go to the you looking to build then you go to the you looking to build then you go to the tasks you break it down into tasks and tasks you break it down into tasks and tasks you break it down into tasks and then finally you start implementing then finally you start implementing then finally you start implementing right I think this looks familiar I right I think this looks familiar I right I think this looks familiar I think this is how most of our coding think this is how most of our coding think this is how most of our coding agents actually are kind of shaped today agents actually are kind of shaped today agents actually are kind of shaped today in reality that is not how it is in reality that is not how it is in reality that is not how it is composed and at scale when you look at composed and at scale when you look at composed and at scale when you look at the organization complexity the organization complexity the organization complexity this is just one step in the journey this is just one step in the journey this is just one step in the journey this is like building a product this is like building a product this is like building a product increment increment increment When you really look at the overall end When you really look at the overall end When you really look at the overall end to end life cycle of something that a to end life cycle of something that a to end life cycle of something that a business want to build to capture the business want to build to capture the business want to build to capture the value out of it all the way to ship it value out of it all the way to ship it value out of it all the way to ship it to the client, you will start first of to the client, you will start first of to the client, you will start first of all by defining your product strategy. all by defining your product strategy. all by defining your product strategy. What to build and how to build it, What to build and how to build it, What to build and how to build it, right? You set the define the success right? You set the define the success right? You set the define the success metrics. You identify and you break down metrics. You identify and you break down metrics. You identify and you break down your plan road map for your products. your plan road map for your products. your plan road map for your products. And to do this, you may need a lot of And to do this, you may need a lot of And to do this, you may need a lot of insights, right? So then you do like insights, right? So then you do like insights, right? So then you do like your market research. You do a your market research. You do a your market research. You do a competitive analysis. You bring this as competitive analysis. You bring this as competitive analysis. You bring this as an input with some customer interviews.

an input with some customer interviews. an input with some customer interviews. Then you go to the discovery side, Then you go to the discovery side, Then you go to the discovery side, right? So then you start discovering. right? So then you start discovering. right? So then you start discovering. Okay, now I understand what to build. Okay, now I understand what to build. Okay, now I understand what to build. I'm going to break this down into like I'm going to break this down into like I'm going to break this down into like some problem statements, find the some problem statements, find the some problem statements, find the solution, validate the solution, and solution, validate the solution, and solution, validate the solution, and then probably like experiment and then then probably like experiment and then then probably like experiment and then create user stories. And before we start create user stories. And before we start create user stories. And before we start building in reality actually need to building in reality actually need to building in reality actually need to prepare your data, right? In some cases, prepare your data, right? In some cases, prepare your data, right? In some cases, you will need actually to clean up your you will need actually to clean up your you will need actually to clean up your data catalog that will support the build data catalog that will support the build data catalog that will support the build of your products or maybe adjust some of of your products or maybe adjust some of of your products or maybe adjust some of the endpoint connection and integration the endpoint connection and integration the endpoint connection and integration to your core systems that will help you to your core systems that will help you to your core systems that will help you actually build your products. actually build your products. actually build your products. And this is where the data product And this is where the data product And this is where the data product delivery comes. So you build your data delivery comes. So you build your data delivery comes. So you build your data pipeline, you validate your data quality pipeline, you validate your data quality pipeline, you validate your data quality and you put your catalog your and you put your catalog your and you put your catalog your [clears throat] catalog data assets [clears throat] catalog data assets [clears throat] catalog data assets ready for development. Then we kind of ready for development. Then we kind of ready for development. Then we kind of like go back to the product increment. like go back to the product increment. like go back to the product increment. That is where we will start. But then That is where we will start. But then That is where we will start. But then building a product in every organization building a product in every organization building a product in every organization that I have been uh serving for the past that I have been uh serving for the past that I have been uh serving for the past 18 years in my career. I can see that in 18 years in my career. I can see that in 18 years in my career. I can see that in one organization you will find like one organization you will find like one organization you will find like different DLC iss kind of like uh you different DLC iss kind of like uh you different DLC iss kind of like uh you know scatterers across organization.

know scatterers across organization. know scatterers across organization. Some of it is actually for a mobile Some of it is actually for a mobile Some of it is actually for a mobile application other is a different application other is a different application other is a different department or different platform. Some department or different platform. Some department or different platform. Some of it is internal platform that is for of it is internal platform that is for of it is internal platform that is for your um employees. Other is actually your um employees. Other is actually your um employees. Other is actually customerf facing. So it is not like a customerf facing. So it is not like a customerf facing. So it is not like a one workflow that can actually build one workflow that can actually build one workflow that can actually build anything you want for your organization. anything you want for your organization. anything you want for your organization. When you figure out like what to build When you figure out like what to build When you figure out like what to build and how to build it, you need to run it. and how to build it, you need to run it. and how to build it, you need to run it. Then we come to the platform engineering Then we come to the platform engineering Then we come to the platform engineering ops, right? That is again when you have ops, right? That is again when you have ops, right? That is again when you have your provisioned infrastructure, your provisioned infrastructure, your provisioned infrastructure, thinking about how you you build your thinking about how you you build your thinking about how you you build your your infrastructure as code modules etc. your infrastructure as code modules etc. your infrastructure as code modules etc. And then you launch your products and And then you launch your products and And then you launch your products and the moment you launch it then you start the moment you launch it then you start the moment you launch it then you start kind of like the journey of optimizing kind of like the journey of optimizing kind of like the journey of optimizing the performance of your products trying the performance of your products trying the performance of your products trying to look forward like any incidents to to look forward like any incidents to to look forward like any incidents to resolve and then you start the loop resolve and then you start the loop resolve and then you start the loop again. Right? So at scale when you look again. Right? So at scale when you look again. Right? So at scale when you look at really building a digital platform at really building a digital platform at really building a digital platform not like a very simple products that you not like a very simple products that you not like a very simple products that you can you know solo build and deploy the can you know solo build and deploy the can you know solo build and deploy the landscape is way complex that is landscape is way complex that is landscape is way complex that is expected and what you're looking at here expected and what you're looking at here expected and what you're looking at here is literally like probably 10 20% of is literally like probably 10 20% of is literally like probably 10 20% of what is it and is really different from what is it and is really different from what is it and is really different from organization to organization now going organization to organization now going organization to organization now going back to the uh the stack right when you back to the uh the stack right when you back to the uh the stack right when you look at the workflows there's like four look at the workflows there's like four look at the workflows there's like four core components the first one is hooks core components the first one is hooks core components the first one is hooks MCP servers and sub aents those are kind MCP servers and sub aents those are kind MCP servers and sub aents those are kind of of of given but it doesn't really bring the given but it doesn't really bring the given but it doesn't really bring the right kind of like structured value to right kind of like structured value to right kind of like structured value to your workflows right that's why scales your workflows right that's why scales your workflows right that's why scales is one of the critical components in is one of the critical components in is one of the critical components in your workflows hooks basically what it your workflows hooks basically what it your workflows hooks basically what it does it just kind of like pre kind of does it just kind of like pre kind of does it just kind of like pre kind of like trigon events to to do something like trigon events to to do something like trigon events to to do something along your workflow the MCP service we along your workflow the MCP service we along your workflow the MCP service we all know that you know you may need an all know that you know you may need an all know that you know you may need an MCP tool but tell me like who actually

MCP tool but tell me like who actually MCP tool but tell me like who actually build a lot of MCPS we just use MCPS build a lot of MCPS we just use MCPS build a lot of MCPS we just use MCPS tools that is actually provided by the tools that is actually provided by the tools that is actually provided by the tool that we used to use before right so tool that we used to use before right so tool that we used to use before right so we don't really own we don't really own we don't really own The sub agents is just to minimize the The sub agents is just to minimize the The sub agents is just to minimize the context window. We just delegate to sub context window. We just delegate to sub context window. We just delegate to sub agent to execute a specific task what is agent to execute a specific task what is agent to execute a specific task what is needed. So at the end of the day you needed. So at the end of the day you needed. So at the end of the day you will find all of your knowhow is will find all of your knowhow is will find all of your knowhow is actually at the skills level. And if you actually at the skills level. And if you actually at the skills level. And if you don't have the right structure of your don't have the right structure of your don't have the right structure of your skills then you're not really having a skills then you're not really having a skills then you're not really having a deterministic workflow. And one thing to deterministic workflow. And one thing to deterministic workflow. And one thing to mention is workflows think about them as mention is workflows think about them as mention is workflows think about them as harness blueprints that actually shape harness blueprints that actually shape harness blueprints that actually shape the behavior of your coding harness for the behavior of your coding harness for the behavior of your coding harness for example in the runtime. Now looking at the rise of skills Now looking at the rise of skills adoption right so just eight months ago adoption right so just eight months ago adoption right so just eight months ago entropic published the first article entropic published the first article entropic published the first article about skills right two month later we about skills right two month later we about skills right two month later we had this standard an open standard that had this standard an open standard that had this standard an open standard that is adopted and starts a lot of agent is adopted and starts a lot of agent is adopted and starts a lot of agent harnesses starts adopting this new harnesses starts adopting this new harnesses starts adopting this new standard [snorts] around February um standard [snorts] around February um standard [snorts] around February um this year we have seen most of the this year we have seen most of the this year we have seen most of the actually agents adopted this even though actually agents adopted this even though actually agents adopted this even though you don't see them right if you pay you don't see them right if you pay you don't see them right if you pay attention when the the uh the agent is attention when the the uh the agent is attention when the the uh the agent is thinking And you can see that he's thinking And you can see that he's thinking And you can see that he's pulling skills um as he's going and pulling skills um as he's going and pulling skills um as he's going and doing the task. The other implication doing the task. The other implication doing the task. The other implication here that you need to pay attention to here that you need to pay attention to here that you need to pay attention to is actually the number of skills is actually the number of skills is actually the number of skills created. Right? This is just like created. Right? This is just like created. Right? This is just like literally a snapshot that I did across literally a snapshot that I did across literally a snapshot that I did across some public GitHub repost, some public some public GitHub repost, some public some public GitHub repost, some public skills registries, right? There's way skills registries, right? There's way skills registries, right? There's way more than this publicly and within your more than this publicly and within your more than this publicly and within your organizations, right? So the de the organizations, right? So the de the organizations, right? So the de the creation of skills and the demand is creation of skills and the demand is creation of skills and the demand is rising. But we need to understand why

rising. But we need to understand why rising. But we need to understand why in the latest skills bench comparing the in the latest skills bench comparing the in the latest skills bench comparing the latest models against like you know latest models against like you know latest models against like you know running the same task against auto running the same task against auto running the same task against auto engineering and cyber security without engineering and cyber security without engineering and cyber security without skills it did well right because that's skills it did well right because that's skills it did well right because that's what expected and it's going to continue what expected and it's going to continue what expected and it's going to continue to be improving day after day right but to be improving day after day right but to be improving day after day right but then when we applied skills that's our then when we applied skills that's our then when we applied skills that's our more deterministics the outcome was more deterministics the outcome was more deterministics the outcome was clearly higher than than That's it. clearly higher than than That's it. clearly higher than than That's it. Now if you think about now like how like Now if you think about now like how like Now if you think about now like how like the anatomy of skills and how you the anatomy of skills and how you the anatomy of skills and how you actually design and implement skills in actually design and implement skills in actually design and implement skills in your organization. This is not like a your organization. This is not like a your organization. This is not like a new problem that we are trying to solve new problem that we are trying to solve new problem that we are trying to solve here, right? We have solved this with here, right? We have solved this with here, right? We have solved this with the microser kind of movements, right? the microser kind of movements, right? the microser kind of movements, right? So your microservices need to have all So your microservices need to have all So your microservices need to have all of these design principles, right? This of these design principles, right? This of these design principles, right? This is like a software kind of like you know is like a software kind of like you know is like a software kind of like you know problem that we use to solve is is problem that we use to solve is is problem that we use to solve is is similar. So skills need to be reusable, similar. So skills need to be reusable, similar. So skills need to be reusable, right? Need to be modular, need to be right? Need to be modular, need to be right? Need to be modular, need to be disco like you can discover your skills. disco like you can discover your skills. disco like you can discover your skills. So if you are sitting in one team and So if you are sitting in one team and So if you are sitting in one team and you need the skills you actually can you need the skills you actually can you need the skills you actually can automatically discover and capture the automatically discover and capture the automatically discover and capture the skills it's portable that you can skills it's portable that you can skills it's portable that you can actually use skills across workflows but actually use skills across workflows but actually use skills across workflows but also you can use skills across harnesses also you can use skills across harnesses also you can use skills across harnesses again everyone adopted the same again everyone adopted the same again everyone adopted the same standard. So if I'm having a skill on standard. So if I'm having a skill on standard. So if I'm having a skill on cloud code and I want to move it to cloud code and I want to move it to cloud code and I want to move it to cursor, it's going to just work.

cursor, it's going to just work. cursor, it's going to just work. Specialized skills that is where the Specialized skills that is where the Specialized skills that is where the value you should not build like a one value you should not build like a one value you should not build like a one skill like a monom or again it should be skill like a monom or again it should be skill like a monom or again it should be specialized to define one tasks specialized to define one tasks specialized to define one tasks specifically. Composible uh skills need specifically. Composible uh skills need specifically. Composible uh skills need to be designed in a way that's actually to be designed in a way that's actually to be designed in a way that's actually can compose. So you don't have can compose. So you don't have can compose. So you don't have duplication across your skills when duplication across your skills when duplication across your skills when you're trying to run them conflicts each you're trying to run them conflicts each you're trying to run them conflicts each other. Consistence that is actually what other. Consistence that is actually what other. Consistence that is actually what one of the key items of skills is one of the key items of skills is one of the key items of skills is actually consistency and deterministic. actually consistency and deterministic. actually consistency and deterministic. And finally cost efficience and for cost And finally cost efficience and for cost And finally cost efficience and for cost I can go for another hour talk but it's I can go for another hour talk but it's I can go for another hour talk but it's basically the skills comes to solve a basically the skills comes to solve a basically the skills comes to solve a key problem around the context window key problem around the context window key problem around the context window right is actually putting with the right is actually putting with the right is actually putting with the disclosure pro progressive disclosure disclosure pro progressive disclosure disclosure pro progressive disclosure pattern the right skills the right pattern the right skills the right pattern the right skills the right amount of skills in the right time to amount of skills in the right time to amount of skills in the right time to solve the right problem and that's solve the right problem and that's solve the right problem and that's reduce the token usage. This define a reduce the token usage. This define a reduce the token usage. This define a new unit right that makes your knowhow new unit right that makes your knowhow new unit right that makes your knowhow in your organization executable portable in your organization executable portable in your organization executable portable and cheap. and cheap. and cheap. On the right hand side, you just a very On the right hand side, you just a very On the right hand side, you just a very simple example of data retention policy. simple example of data retention policy. simple example of data retention policy. Right? When it came to regulation, you Right? When it came to regulation, you Right? When it came to regulation, you need to understand and make sure to need to understand and make sure to need to understand and make sure to instruct your agents while you instruct your agents while you instruct your agents while you manipulating. For example, um your manipulating. For example, um your manipulating. For example, um your customer data, you should make sure that customer data, you should make sure that customer data, you should make sure that this data manipulates according to the this data manipulates according to the this data manipulates according to the regulation, right? And that bring me to regulation, right? And that bring me to regulation, right? And that bring me to the next example.

the next example. the next example. On the left hand side, you can see that On the left hand side, you can see that On the left hand side, you can see that there's like a think about like a a there's like a think about like a a there's like a think about like a a catalog of skills. And in the right hand catalog of skills. And in the right hand catalog of skills. And in the right hand side is your harness and the output is side is your harness and the output is side is your harness and the output is on the right hand side. Right? So the on the right hand side. Right? So the on the right hand side. Right? So the composible skills at the regulation composible skills at the regulation composible skills at the regulation level. You have the skill that I just level. You have the skill that I just level. You have the skill that I just showed earlier which is the retention showed earlier which is the retention showed earlier which is the retention policy. But you will need disclosure policy. But you will need disclosure policy. But you will need disclosure standards. You will need the GDPR rules standards. You will need the GDPR rules standards. You will need the GDPR rules that need to be respected. You will need that need to be respected. You will need that need to be respected. You will need the fill in templates. Right? So all of the fill in templates. Right? So all of the fill in templates. Right? So all of this kind of think about it is like this kind of think about it is like this kind of think about it is like defining how any data any feature that defining how any data any feature that defining how any data any feature that is built across your web, mobile um like is built across your web, mobile um like is built across your web, mobile um like you know different applications across you know different applications across you know different applications across your organizations is really respecting your organizations is really respecting your organizations is really respecting these rules and this gets pulled these rules and this gets pulled these rules and this gets pulled automatically by on the runtime by the automatically by on the runtime by the automatically by on the runtime by the regulatory disclosure review workflow regulatory disclosure review workflow regulatory disclosure review workflow and the outcome is expected is and the outcome is expected is and the outcome is expected is deterministic. You have an audit uh deterministic. You have an audit uh deterministic. You have an audit uh audit reports that you can actually audit reports that you can actually audit reports that you can actually store. you have um specific uh store. you have um specific uh store. you have um specific uh identification of if there's anything to identification of if there's anything to identification of if there's anything to improve and that this kind of like loop improve and that this kind of like loop improve and that this kind of like loop back to improve your your codebase.

However, if we don't govern skills, we However, if we don't govern skills, we will start creating a new class of will start creating a new class of will start creating a new class of technical depths, right? First of all, technical depths, right? First of all, technical depths, right? First of all, you will find out that you are having a you will find out that you are having a you will find out that you are having a lot of duplication in your organization. lot of duplication in your organization. lot of duplication in your organization. So if teams are not collaborating and So if teams are not collaborating and So if teams are not collaborating and everyone is think about it using the everyone is think about it using the everyone is think about it using the same technology stack the same same technology stack the same same technology stack the same infrastructure you're for sure building infrastructure you're for sure building infrastructure you're for sure building the same skills over and over again the same skills over and over again the same skills over and over again without sharing them quality. If you without sharing them quality. If you without sharing them quality. If you don't test and make sure that you're don't test and make sure that you're don't test and make sure that you're maintaining and you're validating your maintaining and you're validating your maintaining and you're validating your skills not against your task but also skills not against your task but also skills not against your task but also against the latest models that comes against the latest models that comes against the latest models that comes right then the quality starts right then the quality starts right then the quality starts degragating over time. degragating over time. degragating over time. You should be able to discover your You should be able to discover your You should be able to discover your skills in in reality without a skills in in reality without a skills in in reality without a governance you cannot really discover governance you cannot really discover governance you cannot really discover it. Think about it as the the backstage it. Think about it as the the backstage it. Think about it as the the backstage the IDP right it's come to solve a the IDP right it's come to solve a the IDP right it's come to solve a problem where okay I need to understand problem where okay I need to understand problem where okay I need to understand who owns this microser back in the days who owns this microser back in the days who owns this microser back in the days right I don't need to talk to anyone I right I don't need to talk to anyone I right I don't need to talk to anyone I just need to tap into the service just need to tap into the service just need to tap into the service catalog and immediately find who catalog and immediately find who catalog and immediately find who actually own it that is brings ownership actually own it that is brings ownership actually own it that is brings ownership part if you don't have an owner then no part if you don't have an owner then no part if you don't have an owner then no one will be able to maintain scale those one will be able to maintain scale those one will be able to maintain scale those skills skills skills composibility is not something that composibility is not something that composibility is not something that comes by default you need to have a comes by default you need to have a comes by default you need to have a governance way to to align what to build governance way to to align what to build governance way to to align what to build and how to design it is think about the and how to design it is think about the and how to design it is think about the domain driven approach that we have been domain driven approach that we have been domain driven approach that we have been taken also for for many years, right? Is taken also for for many years, right? Is taken also for for many years, right? Is similar to how you shape your skills similar to how you shape your skills similar to how you shape your skills catalog.

catalog. catalog. Security again some of uh all of us like Security again some of uh all of us like Security again some of uh all of us like we experiment with the public skills, we experiment with the public skills, we experiment with the public skills, right? But when you think about it, some right? But when you think about it, some right? But when you think about it, some skills may have some prompts injection skills may have some prompts injection skills may have some prompts injection and skills actually does have scripts and skills actually does have scripts and skills actually does have scripts because that is the deterministic part because that is the deterministic part because that is the deterministic part of it because it can run a specific of it because it can run a specific of it because it can run a specific script for a specific task. So if you script for a specific task. So if you script for a specific task. So if you don't have again a pipeline that check don't have again a pipeline that check don't have again a pipeline that check your security, you may be pulling your security, you may be pulling your security, you may be pulling something that is insecure something that is insecure something that is insecure and permissions. Not every skills is and permissions. Not every skills is and permissions. Not every skills is actually something that anyone in the actually something that anyone in the actually something that anyone in the organization should access. Some skills organization should access. Some skills organization should access. Some skills may have some business logic that is may have some business logic that is may have some business logic that is very sensitive, right? So the access very sensitive, right? So the access very sensitive, right? So the access control is is also crucial at this control is is also crucial at this control is is also crucial at this stage. stage. stage. Now how to bring this to your Now how to bring this to your Now how to bring this to your organization? First of all, you need to organization? First of all, you need to organization? First of all, you need to allow at the individual level to create, allow at the individual level to create, allow at the individual level to create, test, improve and use those skills. test, improve and use those skills. test, improve and use those skills. Again, it shouldn't be random. It should Again, it shouldn't be random. It should Again, it shouldn't be random. It should be structured way. There's a different be structured way. There's a different be structured way. There's a different tools out there. You just need to decide tools out there. You just need to decide tools out there. You just need to decide which tool actually you want to agree on which tool actually you want to agree on which tool actually you want to agree on and you use that mechanism at the and you use that mechanism at the and you use that mechanism at the individual level. The moment you create individual level. The moment you create individual level. The moment you create a skills, you need to be sharing it with a skills, you need to be sharing it with a skills, you need to be sharing it with your team, right? Your team starts your team, right? Your team starts your team, right? Your team starts collab collaborating to improve the collab collaborating to improve the collab collaborating to improve the skills and think about it. You build the skills and think about it. You build the skills and think about it. You build the same technology stack, building the same same technology stack, building the same same technology stack, building the same products. So, it's going to evolve products. So, it's going to evolve products. So, it's going to evolve really quickly. But then you move on to really quickly. But then you move on to really quickly. But then you move on to a very critical point which is the a very critical point which is the a very critical point which is the centralized platform. That is where all centralized platform. That is where all centralized platform. That is where all of what I've been covering so far come of what I've been covering so far come of what I've been covering so far come to play. You need a centralized platform to play. You need a centralized platform to play. You need a centralized platform that have a catalog with metadata in it that have a catalog with metadata in it that have a catalog with metadata in it that's actually can discover skills and that's actually can discover skills and that's actually can discover skills and could be searchable. You can have an MCP could be searchable. You can have an MCP could be searchable. You can have an MCP that's actually plugged to this cat that's actually plugged to this cat that's actually plugged to this cat catalog, search for the skill and a CLI catalog, search for the skill and a CLI catalog, search for the skill and a CLI to pull the skills back to your either to pull the skills back to your either to pull the skills back to your either your IDE if you're locally or to your um

your IDE if you're locally or to your um your IDE if you're locally or to your um sandbox in your factory. Then you have sandbox in your factory. Then you have sandbox in your factory. Then you have the dependencies. So you need to the dependencies. So you need to the dependencies. So you need to understand the dependencies between the understand the dependencies between the understand the dependencies between the skills as well. You have the versioning skills as well. You have the versioning skills as well. You have the versioning uh and and life cycle. So you understand uh and and life cycle. So you understand uh and and life cycle. So you understand which version of the skills is actually which version of the skills is actually which version of the skills is actually the latest. Um and a very good example the latest. Um and a very good example the latest. Um and a very good example when I'm using for example building a when I'm using for example building a when I'm using for example building a functionality I can the agents functionality I can the agents functionality I can the agents automatically up capture that there is a automatically up capture that there is a automatically up capture that there is a latest version of the skill and pull it latest version of the skill and pull it latest version of the skill and pull it right. So this versioning help also to right. So this versioning help also to right. So this versioning help also to pull the the the right latest changes pull the the the right latest changes pull the the the right latest changes from the skills registry access control from the skills registry access control from the skills registry access control again as I said if you don't know who is again as I said if you don't know who is again as I said if you don't know who is accessing what that is a huge uh uh gap accessing what that is a huge uh uh gap accessing what that is a huge uh uh gap and finally evaluation observ and finally evaluation observ and finally evaluation observ observability and then all of this is observability and then all of this is observability and then all of this is actually play around a governance and actually play around a governance and actually play around a governance and this is where technology stop solving this is where technology stop solving this is where technology stop solving the problem right so you figure out all the problem right so you figure out all the problem right so you figure out all of this all good now who's going to of this all good now who's going to of this all good now who's going to govern this and that is where dep you govern this and that is where dep you govern this and that is where dep you know it really depend how your know it really depend how your know it really depend how your organization is structured today that is organization is structured today that is organization is structured today that is where you should have your architects, where you should have your architects, where you should have your architects, your engineer leads, infra leads etc and your engineer leads, infra leads etc and your engineer leads, infra leads etc and cyber leads actually sitting down owning cyber leads actually sitting down owning cyber leads actually sitting down owning part of those domains and making sure part of those domains and making sure part of those domains and making sure that the skills we need to get updated that the skills we need to get updated that the skills we need to get updated is actually according to the policies is actually according to the policies is actually according to the policies you want to adhere within your you want to adhere within your you want to adhere within your organization and drive this change.

organization and drive this change. organization and drive this change. And finally when you get this right what And finally when you get this right what And finally when you get this right what you will have you would have at the you will have you would have at the you will have you would have at the organization level all of your teams organization level all of your teams organization level all of your teams pulling from one centralized place high pulling from one centralized place high pulling from one centralized place high quality skills executing them and quality skills executing them and quality skills executing them and pulling them back um to to the pulling them back um to to the pulling them back um to to the centralized platform if it is improved. centralized platform if it is improved. centralized platform if it is improved. Now what I want to bring this because Now what I want to bring this because Now what I want to bring this because it's a little bit of a inclear view. So it's a little bit of a inclear view. So it's a little bit of a inclear view. So what I created I created a simulation what I created I created a simulation what I created I created a simulation right. So think about this. This is your right. So think about this. This is your right. So think about this. This is your organization today, right? And what I organization today, right? And what I organization today, right? And what I have here, I have um just a random have here, I have um just a random have here, I have um just a random teams. I have 15 teams created um five teams. I have 15 teams created um five teams. I have 15 teams created um five to 12 like per team. Uh you have skills to 12 like per team. Uh you have skills to 12 like per team. Uh you have skills per engineers contribution. You have the per engineers contribution. You have the per engineers contribution. You have the average skills utilization kind of like average skills utilization kind of like average skills utilization kind of like on average like how much time uh skills on average like how much time uh skills on average like how much time uh skills are being pulled per day, the are being pulled per day, the are being pulled per day, the duplication across the team kind of as a duplication across the team kind of as a duplication across the team kind of as a ratio and the skills quality and ratio and the skills quality and ratio and the skills quality and security ratio. Now if I run this across security ratio. Now if I run this across security ratio. Now if I run this across six months what's really happening and six months what's really happening and six months what's really happening and think about it this is already happening think about it this is already happening think about it this is already happening within your organization is teams are within your organization is teams are within your organization is teams are creating and using the skills right but creating and using the skills right but creating and using the skills right but we don't have visibility and skills we don't have visibility and skills we don't have visibility and skills again they're tightly coupled to your again they're tightly coupled to your again they're tightly coupled to your productivity uplift if for example the productivity uplift if for example the productivity uplift if for example the example that I shared earlier on the example that I shared earlier on the example that I shared earlier on the regulation if we don't have a skill regulation if we don't have a skill regulation if we don't have a skill about the regulation that is someone is about the regulation that is someone is about the regulation that is someone is vip coding back and forth and trying to vip coding back and forth and trying to vip coding back and forth and trying to figure out exactly how to steer the figure out exactly how to steer the figure out exactly how to steer the agent to implement it properly right agent to implement it properly right agent to implement it properly right that is burning more tokens from one that is burning more tokens from one that is burning more tokens from one side costwise but also the productivity side costwise but also the productivity side costwise but also the productivity is spending more time rather than giving is spending more time rather than giving is spending more time rather than giving in one shot the right answer and the in one shot the right answer and the in one shot the right answer and the quality and security is similar if you quality and security is similar if you quality and security is similar if you don't have clear you know skills defined don't have clear you know skills defined don't have clear you know skills defined and maintained you will have a low

and maintained you will have a low and maintained you will have a low quality in your implementation because quality in your implementation because quality in your implementation because then it's up to the human to decide this then it's up to the human to decide this then it's up to the human to decide this and different the m in the maturity from and different the m in the maturity from and different the m in the maturity from team to team you can see the difference team to team you can see the difference team to team you can see the difference and that is why for example if I look uh and that is why for example if I look uh and that is why for example if I look uh just randomly at this this is like you just randomly at this this is like you just randomly at this this is like you can see the productivity of this team is can see the productivity of this team is can see the productivity of this team is a kind of a medium right If I look at a kind of a medium right If I look at a kind of a medium right If I look at this one is a is a bit of like I don't this one is a is a bit of like I don't this one is a is a bit of like I don't know it's low medium productivity know it's low medium productivity know it's low medium productivity quality and security also medium but quality and security also medium but quality and security also medium but when it came to the cost is really high. when it came to the cost is really high. when it came to the cost is really high. Okay, now let's actually say okay how Okay, now let's actually say okay how Okay, now let's actually say okay how this looks like if I governed all of the this looks like if I governed all of the this looks like if I governed all of the my skills in my in my organizations. my skills in my in my organizations. my skills in my in my organizations. What's going to happen is of course some What's going to happen is of course some What's going to happen is of course some of them will split right and this is of them will split right and this is of them will split right and this is reality isn't going to be perfect um as reality isn't going to be perfect um as reality isn't going to be perfect um as we expect but at least what you will see we expect but at least what you will see we expect but at least what you will see you will see actually some common ground you will see actually some common ground you will see actually some common ground across all of your teams. The moment you across all of your teams. The moment you across all of your teams. The moment you govern, you publish one skill, the next govern, you publish one skill, the next govern, you publish one skill, the next engineer trying to build a new skill, engineer trying to build a new skill, engineer trying to build a new skill, the coding agent harness will identify the coding agent harness will identify the coding agent harness will identify this skill that is already available and this skill that is already available and this skill that is already available and pull it. Right? So you you almost solve pull it. Right? So you you almost solve pull it. Right? So you you almost solve all of the issues that that I covered all of the issues that that I covered all of the issues that that I covered about the governance.

And one last point is when it came to And one last point is when it came to skills, um it's just one component of skills, um it's just one component of skills, um it's just one component of your workflows as I said, right? So that your workflows as I said, right? So that your workflows as I said, right? So that doesn't mean uh if you figure out skills doesn't mean uh if you figure out skills doesn't mean uh if you figure out skills that says you're good. No, you need to that says you're good. No, you need to that says you're good. No, you need to apply the same kind of like approach and apply the same kind of like approach and apply the same kind of like approach and solution for your whole workflows. And solution for your whole workflows. And solution for your whole workflows. And you may think to apply this again if you you may think to apply this again if you you may think to apply this again if you think about it like if you have a a think about it like if you have a a think about it like if you have a a centralized platform that have all of centralized platform that have all of centralized platform that have all of your workflows, right? From one side your workflows, right? From one side your workflows, right? From one side you're centralizing the workflows which you're centralizing the workflows which you're centralizing the workflows which is also having the skills but also if is also having the skills but also if is also having the skills but also if the next engineer came and want to I the next engineer came and want to I the next engineer came and want to I don't know like provision infrastructure don't know like provision infrastructure don't know like provision infrastructure they can tap into a workflow and build they can tap into a workflow and build they can tap into a workflow and build that workflow with the required skills that workflow with the required skills that workflow with the required skills and run it and test it again. And if and run it and test it again. And if and run it and test it again. And if it's something you need to be improved it's something you need to be improved it's something you need to be improved in the workflow, you can easily push it in the workflow, you can easily push it in the workflow, you can easily push it back um to the centralized platform for back um to the centralized platform for back um to the centralized platform for your organization to use. [snorts] Now before I wrap up, um what I [snorts] Now before I wrap up, um what I want to leave you with is this is just want to leave you with is this is just want to leave you with is this is just the start the beginning. You see like the start the beginning. You see like the start the beginning. You see like this just we're talking about six to this just we're talking about six to this just we're talking about six to eight months. What's coming next and I eight months. What's coming next and I eight months. What's coming next and I would invite you to already explore is would invite you to already explore is would invite you to already explore is skills registry, right? You should have skills registry, right? You should have skills registry, right? You should have one if not already. And the good news is one if not already. And the good news is one if not already. And the good news is all of the players that's been solving all of the players that's been solving all of the players that's been solving the IDP problem like um internal the IDP problem like um internal the IDP problem like um internal developer portal they already start developer portal they already start developer portal they already start centralizing this capability right so if centralizing this capability right so if centralizing this capability right so if you don't have it today maybe in a you don't have it today maybe in a you don't have it today maybe in a couple of months you will see it coming couple of months you will see it coming couple of months you will see it coming but also there's a lot of tools that's but also there's a lot of tools that's but also there's a lot of tools that's actually solving this specific problem actually solving this specific problem actually solving this specific problem second is skills eval evaluation there's second is skills eval evaluation there's second is skills eval evaluation there's still kind of like a discussion on what still kind of like a discussion on what still kind of like a discussion on what is the right approach to to to you know is the right approach to to to you know is the right approach to to to you know to to evaluate skills the easy thing to to evaluate skills the easy thing to to evaluate skills the easy thing that I found so far very valuable is that I found so far very valuable is that I found so far very valuable is actually test like you you l static test

actually test like you you l static test actually test like you you l static test your or evaluate your skills against the your or evaluate your skills against the your or evaluate your skills against the entropic best practices. Right? If the entropic best practices. Right? If the entropic best practices. Right? If the skill is not invoked properly, if the skill is not invoked properly, if the skill is not invoked properly, if the skill is not structured properly, skill is not structured properly, skill is not structured properly, there's a high chance that it's not there's a high chance that it's not there's a high chance that it's not going to be high quality. And finally is going to be high quality. And finally is going to be high quality. And finally is auto evolving. And again, this is what auto evolving. And again, this is what auto evolving. And again, this is what everyone kind of like is is the next everyone kind of like is is the next everyone kind of like is is the next hype right now. Like yeah, I can create hype right now. Like yeah, I can create hype right now. Like yeah, I can create like a an a closed loop that can evolve like a an a closed loop that can evolve like a an a closed loop that can evolve automatically my skills. So what right? automatically my skills. So what right? automatically my skills. So what right? If you automatically start this machine, If you automatically start this machine, If you automatically start this machine, the impact will be way more than it is the impact will be way more than it is the impact will be way more than it is today because what I shared earlier is today because what I shared earlier is today because what I shared earlier is going to be just maintaining auto going to be just maintaining auto going to be just maintaining auto evolving skills without that governance evolving skills without that governance evolving skills without that governance in place that actually put the in place that actually put the in place that actually put the guardrails for your organization. guardrails for your organization. guardrails for your organization. And at this point I would leave you And at this point I would leave you And at this point I would leave you here. Thank you so much for your here. Thank you so much for your here. Thank you so much for your listening and looking forward if you listening and looking forward if you listening and looking forward if you have any question I will be in the have any question I will be in the have any question I will be in the leadership lounge. Feel free to grab me. leadership lounge. Feel free to grab me. leadership lounge. Feel free to grab me. Thank you so much. [applause]