← Back
AI Engineer September 3, 2026 21m

Tethered: Our Agents Are Us — Shu Fang, Two Sigma

Read full transcript 16 segments
  1. Great. Thanks everyone for coming. Uh Great. Thanks everyone for coming. Uh this talk is called Tethered. Our agents this talk is called Tethered. Our agents this talk is called Tethered. Our agents are us. I'm Shu Fang from Two Sigma and are us. I'm Shu Fang from Two Sigma and are us. I'm Shu Fang from Two Sigma and let's get started. let's get started. let's get started. So just a quick explanation. Two Sigma So just a quick explanation. Two Sigma So just a quick explanation. Two Sigma is a little quant fund. I will also take is a little quant fund. I will also take is a little quant fund. I will also take the opportunity to explain that the name the opportunity to explain that the name the opportunity to explain that the name ostensibly is not because we have two ostensibly is not because we have two ostensibly is not because we have two co-founders who are very online but co-founders who are very online but co-founders who are very online but because the two sigas are about the because the two sigas are about the because the two sigas are about the volatility sigma the small sigma and the volatility sigma the small sigma and the volatility sigma the small sigma and the large sigma sum. So by summing together large sigma sum. So by summing together large sigma sum. So by summing together these individual volatilities we can uh these individual volatilities we can uh these individual volatilities we can uh hedge the risk achieve differentiated hedge the risk achieve differentiated hedge the risk achieve differentiated alpha. alpha. alpha. Now because we are a hedge fund I have Now because we are a hedge fund I have Now because we are a hedge fund I have to give you all this important legal to give you all this important legal to give you all this important legal disclaimer. You don't have to read it. disclaimer. You don't have to read it. disclaimer. You don't have to read it. It just has to be in this. And the TLDDR It just has to be in this. And the TLDDR It just has to be in this. And the TLDDR is that I'm not trying to sell you on is that I'm not trying to sell you on is that I'm not trying to sell you on anything. The views are mine and not anything. The views are mine and not anything. The views are mine and not necessarily the companies. Any logos, necessarily the companies. Any logos, necessarily the companies. Any logos, any other companies I mentioned here are any other companies I mentioned here are any other companies I mentioned here are not me endorsing them or telling you to not me endorsing them or telling you to not me endorsing them or telling you to buy their stocks or anything. It is buy their stocks or anything. It is buy their stocks or anything. It is purely maybe coincidental.

  2. purely maybe coincidental. purely maybe coincidental. But that also is meant to segue into the But that also is meant to segue into the But that also is meant to segue into the fact that we are an old company. We're fact that we are an old company. We're fact that we are an old company. We're 25 years old and clearly we're a very 25 years old and clearly we're a very 25 years old and clearly we're a very regulated industry, but we've managed to regulated industry, but we've managed to regulated industry, but we've managed to run an ecosystem where everyone at the run an ecosystem where everyone at the run an ecosystem where everyone at the company has a cloud agent. And not only company has a cloud agent. And not only company has a cloud agent. And not only that, but these agents run as their own that, but these agents run as their own that, but these agents run as their own identity. So, we're going to explain how identity. So, we're going to explain how identity. So, we're going to explain how we got here and why we're actually okay we got here and why we're actually okay we got here and why we're actually okay with this. with this. with this. So, we're first going to do a little So, we're first going to do a little So, we're first going to do a little horror movie review. If any of you have horror movie review. If any of you have horror movie review. If any of you have seen us, you don't have to pay attention seen us, you don't have to pay attention seen us, you don't have to pay attention to this. defend if you haven't the TLDDR to this. defend if you haven't the TLDDR to this. defend if you haven't the TLDDR of the movie is that everyone has these of the movie is that everyone has these of the movie is that everyone has these doubles and these doubles are called doubles and these doubles are called doubles and these doubles are called tethered when the doubles decide to run tethered when the doubles decide to run tethered when the doubles decide to run loose and cause chaos and run around loose and cause chaos and run around loose and cause chaos and run around with these golden scissors they're with these golden scissors they're with these golden scissors they're called untetered and this is going to called untetered and this is going to called untetered and this is going to somehow relate into my talk somehow relate into my talk somehow relate into my talk so back in June 2025 you know cloud code so back in June 2025 you know cloud code so back in June 2025 you know cloud code GA and all that stuff people started GA and all that stuff people started GA and all that stuff people started using agents through the local computer using agents through the local computer using agents through the local computer your local machine and it's very your local machine and it's very your local machine and it's very powerful but one it was CLI constrained powerful but one it was CLI constrained powerful but one it was CLI constrained and two it was localized right we wanted and two it was localized right we wanted and two it was localized right we wanted to achieve a world where people could to achieve a world where people could to achieve a world where people could use these agents from wherever they were use these agents from wherever they were use these agents from wherever they were whether it be mobile through slack whether it be mobile through slack whether it be mobile through slack through browsers but still have the through browsers but still have the through browsers but still have the ability to run them remote and this is ability to run them remote and this is ability to run them remote and this is important not just because of the important not just because of the important not just because of the capability but many many people capability but many many people capability but many many people technical or not are not comfortable technical or not are not comfortable technical or not are not comfortable fully operating within a CLI so the

  3. fully operating within a CLI so the fully operating within a CLI so the question became Okay, how do we actually question became Okay, how do we actually question became Okay, how do we actually run these in terms of what identity they run these in terms of what identity they run these in terms of what identity they run as? run as? run as? The conventional wisdom is that you run The conventional wisdom is that you run The conventional wisdom is that you run these as some machine identity that is these as some machine identity that is these as some machine identity that is attached to your user in some way. You attached to your user in some way. You attached to your user in some way. You have a shoe and you have a shoe agent. have a shoe and you have a shoe agent. have a shoe and you have a shoe agent. But this quickly collapses and we found But this quickly collapses and we found But this quickly collapses and we found this collapsed because of all the this collapsed because of all the this collapsed because of all the reasons that you can imagine, right? reasons that you can imagine, right? reasons that you can imagine, right? It's very hard to keep permissions in It's very hard to keep permissions in It's very hard to keep permissions in sync. Anytime you're dealing with sync. Anytime you're dealing with sync. Anytime you're dealing with software licensing, now you have to deal software licensing, now you have to deal software licensing, now you have to deal with two licenses. with two licenses. with two licenses. uh there's certain systems that do not uh there's certain systems that do not uh there's certain systems that do not support multiple identities interacting support multiple identities interacting support multiple identities interacting with the same underlying data. You know, with the same underlying data. You know, with the same underlying data. You know, stuff like Google Workspace, your stuff like Google Workspace, your stuff like Google Workspace, your emails, etc. And then how some systems emails, etc. And then how some systems emails, etc. And then how some systems are going to block as a first step. So are going to block as a first step. So are going to block as a first step. So you have to you're just going over the you have to you're just going over the you have to you're just going over the barrier of entry. And then you also have barrier of entry. And then you also have barrier of entry. And then you also have to figure out how you actually manage to figure out how you actually manage to figure out how you actually manage the public and private boundaries. the public and private boundaries. the public and private boundaries. So obviously it's like why don't we just So obviously it's like why don't we just So obviously it's like why don't we just run these as the user, right? How do how run these as the user, right? How do how run these as the user, right? How do how do we run these remotely as the exact do we run these remotely as the exact do we run these remotely as the exact same user identity? And as a result, all same user identity? And as a result, all same user identity? And as a result, all the capabilities, all the access, all the capabilities, all the access, all the capabilities, all the access, all those previous constraints are no longer those previous constraints are no longer those previous constraints are no longer valid.

  4. And we already had the info for this and And we already had the info for this and I imagine a lot of you do too. If you I imagine a lot of you do too. If you I imagine a lot of you do too. If you don't, I would uh encourage investing in don't, I would uh encourage investing in don't, I would uh encourage investing in it, which is that you know you could it, which is that you know you could it, which is that you know you could have a Kubernetes cluster. You have all have a Kubernetes cluster. You have all have a Kubernetes cluster. You have all all of your clusters, your regions, etc. all of your clusters, your regions, etc. all of your clusters, your regions, etc. And you have name spaces for And you have name spaces for And you have name spaces for individuals, right? And the reason we individuals, right? And the reason we individuals, right? And the reason we had this is because we often already had this is because we often already had this is because we often already needed this capability not for the needed this capability not for the needed this capability not for the agentic purposes, but for all the agentic purposes, but for all the agentic purposes, but for all the automated operations that we need to do automated operations that we need to do automated operations that we need to do that did not suit confinement to that did not suit confinement to that did not suit confinement to someone's local machine. So we'd run someone's local machine. So we'd run someone's local machine. So we'd run automated jobs, you know, code automated jobs, you know, code automated jobs, you know, code containers usually operate on this containers usually operate on this containers usually operate on this principle, research notebooks, etc. And principle, research notebooks, etc. And principle, research notebooks, etc. And every single user already had these every single user already had these every single user already had these namespaces existing in every single namespaces existing in every single namespaces existing in every single region and everything in it runs as the region and everything in it runs as the region and everything in it runs as the user. user. user. A very simplistic way of how this works. A very simplistic way of how this works. A very simplistic way of how this works. Some trigger is going in to your Some trigger is going in to your Some trigger is going in to your controller and it's saying, "Hey, I need controller and it's saying, "Hey, I need controller and it's saying, "Hey, I need to spin up some compute resources. You to spin up some compute resources. You to spin up some compute resources. You have a separate identity service that a have a separate identity service that a have a separate identity service that a sidecar in the pod pulls down from to sidecar in the pod pulls down from to sidecar in the pod pulls down from to allow your actual containers allow your actual containers allow your actual containers to run and mount that identity and it to run and mount that identity and it to run and mount that identity and it runs as you.

  5. runs as you. runs as you. So of course there are big dangers with So of course there are big dangers with So of course there are big dangers with this right and you know the first danger this right and you know the first danger this right and you know the first danger you may imagine is an internal danger. you may imagine is an internal danger. you may imagine is an internal danger. How do you actually differentiate who or How do you actually differentiate who or How do you actually differentiate who or what took action right? You have you and what took action right? You have you and what took action right? You have you and your U agent are now the exact same your U agent are now the exact same your U agent are now the exact same identity. That's why I grew this identity. That's why I grew this identity. That's why I grew this mustache so you could tell the mustache so you could tell the mustache so you could tell the difference between us for now. But uh difference between us for now. But uh difference between us for now. But uh you really want to know that you really want to know that you really want to know that differentiation because certain actions differentiation because certain actions differentiation because certain actions that can be taken. You want to audit, that can be taken. You want to audit, that can be taken. You want to audit, you possibly want to block and you want you possibly want to block and you want you possibly want to block and you want to just have the trace, right? You want to just have the trace, right? You want to just have the trace, right? You want to have the attribution to determine, to have the attribution to determine, to have the attribution to determine, hey, was it someone operating as the hey, was it someone operating as the hey, was it someone operating as the human operating purely human actions or human operating purely human actions or human operating purely human actions or was it the agent identity doing these was it the agent identity doing these was it the agent identity doing these things? Another danger and perhaps a bigger one Another danger and perhaps a bigger one is we all know that for all of these is we all know that for all of these is we all know that for all of these capabilities and LOMs in general, it's capabilities and LOMs in general, it's capabilities and LOMs in general, it's essential you have access to the essential you have access to the essential you have access to the external web. These are point in time external web. These are point in time external web. These are point in time mathematical functions that cannot mathematical functions that cannot mathematical functions that cannot actually update based on current data.

  6. actually update based on current data. actually update based on current data. So it's like open internet access. So it's like open internet access. So it's like open internet access. That's why it's a core capability, web That's why it's a core capability, web That's why it's a core capability, web search, web fetch tools, right? The search, web fetch tools, right? The search, web fetch tools, right? The problem is once you have that problem is once you have that problem is once you have that capability, you leave yourself open to capability, you leave yourself open to capability, you leave yourself open to huge vulnerability vectors. One of which huge vulnerability vectors. One of which huge vulnerability vectors. One of which is exfiltration risk. This is one we are is exfiltration risk. This is one we are is exfiltration risk. This is one we are deeply concerned with in terms of deeply concerned with in terms of deeply concerned with in terms of possibly losing IP, you know, just possibly losing IP, you know, just possibly losing IP, you know, just exposing our sensitive information. but exposing our sensitive information. but exposing our sensitive information. but also certainly the possibility of also certainly the possibility of also certainly the possibility of untrusted content flowing back in and untrusted content flowing back in and untrusted content flowing back in and you know prompt injection just malware you know prompt injection just malware you know prompt injection just malware and vulnerabilities are all big risks and vulnerabilities are all big risks and vulnerabilities are all big risks there and then something we separately there and then something we separately there and then something we separately deal with is just the ability to make deal with is just the ability to make deal with is just the ability to make sure we don't sure we don't sure we don't u use licensed content without the right u use licensed content without the right u use licensed content without the right copyrights or actual licensing right you copyrights or actual licensing right you copyrights or actual licensing right you can map this to the golden scissors that can map this to the golden scissors that can map this to the golden scissors that they use and us so this is kind of our they use and us so this is kind of our they use and us so this is kind of our biggest fear to be honest biggest fear to be honest biggest fear to be honest So we are a finance firm and in finance So we are a finance firm and in finance So we are a finance firm and in finance there's a concept of obviously risk and there's a concept of obviously risk and there's a concept of obviously risk and return. So when we think about what is return. So when we think about what is return. So when we think about what is the positioning on the risk and return the positioning on the risk and return the positioning on the risk and return graph there's huge value in allowing graph there's huge value in allowing graph there's huge value in allowing agents to run you but also there's very agents to run you but also there's very agents to run you but also there's very high risk. What we generally want to do high risk. What we generally want to do high risk. What we generally want to do is make sure we capture as much of the is make sure we capture as much of the is make sure we capture as much of the value as possible but reduce the risk.

  7. value as possible but reduce the risk. value as possible but reduce the risk. We're optimizing that ratio of return We're optimizing that ratio of return We're optimizing that ratio of return over risk. Some of you may know the over risk. Some of you may know the over risk. Some of you may know the sharp ratio. We're looking at that from sharp ratio. We're looking at that from sharp ratio. We're looking at that from the perspective of how do we let agents the perspective of how do we let agents the perspective of how do we let agents run as users and optimize that return. run as users and optimize that return. run as users and optimize that return. And the ways we need to do this, right, And the ways we need to do this, right, And the ways we need to do this, right, are to solve those two critical are to solve those two critical are to solve those two critical problems. One, differentiating access problems. One, differentiating access problems. One, differentiating access attributed to the human versus the attributed to the human versus the attributed to the human versus the agent. And two, somehow getting safe web agent. And two, somehow getting safe web agent. And two, somehow getting safe web access in place. So the first thing we did is this So the first thing we did is this attribution step, right? attribution step, right? attribution step, right? And how we did this is we use a header And how we did this is we use a header And how we did this is we use a header and we make sure that every single agent and we make sure that every single agent and we make sure that every single agent continues to append to that header. And continues to append to that header. And continues to append to that header. And this is something we've all hopefully this is something we've all hopefully this is something we've all hopefully done in some way, right? Trace IDs. done in some way, right? Trace IDs. done in some way, right? Trace IDs. You've you've all done this in You've you've all done this in You've you've all done this in deterministic code. Making sure that deterministic code. Making sure that deterministic code. Making sure that your observability stack propagates your observability stack propagates your observability stack propagates through a trace ID through disparate through a trace ID through disparate through a trace ID through disparate systems. How we did it is very similar systems. How we did it is very similar systems. How we did it is very similar to how you would do it for trace ID to how you would do it for trace ID to how you would do it for trace ID except we are dealing with a certain except we are dealing with a certain except we are dealing with a certain difference in the control vector which difference in the control vector which difference in the control vector which is the agent itself right and you can is the agent itself right and you can is the agent itself right and you can force you know using certain HP clients force you know using certain HP clients force you know using certain HP clients using MCPS using skills to make sure using MCPS using skills to make sure using MCPS using skills to make sure that that header initially gets that that header initially gets that that header initially gets populated and everywhere else along the populated and everywhere else along the populated and everywhere else along the way continues to be populated right you way continues to be populated right you way continues to be populated right you have a lot more deterministic control have a lot more deterministic control have a lot more deterministic control over agents and the harnesses and the over agents and the harnesses and the over agents and the harnesses and the frameworks than you may ink and you can frameworks than you may ink and you can frameworks than you may ink and you can enforce it with some of the already enforce it with some of the already enforce it with some of the already existing primitives.

  8. existing primitives. existing primitives. Now this gets very interesting because Now this gets very interesting because Now this gets very interesting because this is not only giving us the proper this is not only giving us the proper this is not only giving us the proper identification of who did something identification of who did something identification of who did something right it actually goes beyond that and right it actually goes beyond that and right it actually goes beyond that and no longer are we confined by just no longer are we confined by just no longer are we confined by just knowing the act identity but we also knowing the act identity but we also knowing the act identity but we also actually get the full provenence through actually get the full provenence through actually get the full provenence through the system right as we deal with the system right as we deal with the system right as we deal with multiple steps in the system we are able multiple steps in the system we are able multiple steps in the system we are able to replay the entire chain of actions to replay the entire chain of actions to replay the entire chain of actions that actually led to some end result. So that actually led to some end result. So that actually led to some end result. So the comparison here is if we had used the comparison here is if we had used the comparison here is if we had used that shoe agent identity we wouldn't that shoe agent identity we wouldn't that shoe agent identity we wouldn't have this and we would just know that at have this and we would just know that at have this and we would just know that at some point shoe agent triggered this some point shoe agent triggered this some point shoe agent triggered this initial flow into the span but we don't initial flow into the span but we don't initial flow into the span but we don't actually know hey those subsequent actually know hey those subsequent actually know hey those subsequent actions how do we properly trace back to actions how do we properly trace back to actions how do we properly trace back to that origination point with this header that origination point with this header that origination point with this header this trace ID we get that full this trace ID we get that full this trace ID we get that full propagation and the actor is still me propagation and the actor is still me propagation and the actor is still me right it's still my identity And the second step that we needed to And the second step that we needed to fix is this web access. Right? A lot of fix is this web access. Right? A lot of fix is this web access. Right? A lot of web access these days uses indexes for web access these days uses indexes for web access these days uses indexes for search. Right? I think cloud code's search. Right? I think cloud code's search. Right? I think cloud code's native one is Brave web browser and it native one is Brave web browser and it native one is Brave web browser and it uses a Brave index. Well, we were like, uses a Brave index. Well, we were like, uses a Brave index. Well, we were like, hey, why don't we see what Google has, hey, why don't we see what Google has, hey, why don't we see what Google has, right? Google is at its core hopefully right? Google is at its core hopefully right? Google is at its core hopefully still a search company and they do this still a search company and they do this still a search company and they do this index generation already. And it turns index generation already. And it turns index generation already. And it turns out they actually do offer something out they actually do offer something out they actually do offer something specifically for regulated industries

  9. specifically for regulated industries specifically for regulated industries like ours that allows you to use their like ours that allows you to use their like ours that allows you to use their web index but within your existing VPC web index but within your existing VPC web index but within your existing VPC your you know network controls right and your you know network controls right and your you know network controls right and it's called web grounding for it's called web grounding for it's called web grounding for enterprise. It basically works like this enterprise. It basically works like this enterprise. It basically works like this where it's still within the exact same where it's still within the exact same where it's still within the exact same network boundary where you're probably network boundary where you're probably network boundary where you're probably running your cloud agents and stuff like running your cloud agents and stuff like running your cloud agents and stuff like that and offers two core capabilities that and offers two core capabilities that and offers two core capabilities search and fetch. Right? So the exact search and fetch. Right? So the exact search and fetch. Right? So the exact capabilities we want to mirror, we capabilities we want to mirror, we capabilities we want to mirror, we leverage that. We have all these leverage that. We have all these leverage that. We have all these guarantees. There's one tiny downside, guarantees. There's one tiny downside, guarantees. There's one tiny downside, which is the data is obviously not going which is the data is obviously not going which is the data is obviously not going to be completely fresh, right? And the to be completely fresh, right? And the to be completely fresh, right? And the constraints around this last I checked, constraints around this last I checked, constraints around this last I checked, it's fresh within 24 hours. And for more it's fresh within 24 hours. And for more it's fresh within 24 hours. And for more regularly updated websites, it's fresh regularly updated websites, it's fresh regularly updated websites, it's fresh within 6 hours. But for most use cases within 6 hours. But for most use cases within 6 hours. But for most use cases that you may have for agents, that's that you may have for agents, that's that you may have for agents, that's probably more than sufficient and probably more than sufficient and probably more than sufficient and completely removes this external egress completely removes this external egress completely removes this external egress vulnerability vector. Now the second question is how do we Now the second question is how do we actually ensure the agents use web actually ensure the agents use web actually ensure the agents use web grounding and again this is very grounding and again this is very grounding and again this is very simple with the existing primitives simple with the existing primitives simple with the existing primitives right you just need to make sure that right you just need to make sure that right you just need to make sure that they don't get confused and you they don't get confused and you they don't get confused and you certainly block the access itself but certainly block the access itself but certainly block the access itself but just for user experience and stuff like just for user experience and stuff like just for user experience and stuff like that you need to make sure those tools that you need to make sure those tools that you need to make sure those tools themselves that are already existing and themselves that are already existing and themselves that are already existing and primitive and native to these agent primitive and native to these agent primitive and native to these agent harnesses and frameworks and such are harnesses and frameworks and such are harnesses and frameworks and such are actually blocked right again here's actually blocked right again here's actually blocked right again here's cloud code example. I think every other cloud code example. I think every other cloud code example. I think every other hotness has the same thing. Web search, hotness has the same thing. Web search, hotness has the same thing. Web search, web fetch. We just deny those tools.

  10. web fetch. We just deny those tools. web fetch. We just deny those tools. It's like, hey, you can't even use It's like, hey, you can't even use It's like, hey, you can't even use these. These are not even in your suite these. These are not even in your suite these. These are not even in your suite of tools available to you. Instead, we of tools available to you. Instead, we of tools available to you. Instead, we use the redirection going through, you use the redirection going through, you use the redirection going through, you know, MCP CLI and actual client code know, MCP CLI and actual client code know, MCP CLI and actual client code using the supported paths, uh, skills, using the supported paths, uh, skills, using the supported paths, uh, skills, whatever to make sure that whenever whatever to make sure that whenever whatever to make sure that whenever someone does need the capabilities of someone does need the capabilities of someone does need the capabilities of web access, it goes through that web web access, it goes through that web web access, it goes through that web grounding cache index. So takeaways from this talk basically So takeaways from this talk basically make sure you ted your agents right make sure you ted your agents right make sure you ted your agents right letting them run around untetered you letting them run around untetered you letting them run around untetered you know is very dangerous we want to tar know is very dangerous we want to tar know is very dangerous we want to tar them and it's much safer to do so and in them and it's much safer to do so and in them and it's much safer to do so and in fact if we go back to that initial slide fact if we go back to that initial slide fact if we go back to that initial slide of how we consider this relative to the of how we consider this relative to the of how we consider this relative to the risk and expected return because of some risk and expected return because of some risk and expected return because of some of the things we found while doing this of the things we found while doing this of the things we found while doing this we actually believe we didn't lose we actually believe we didn't lose we actually believe we didn't lose expected value while huge hugely expected value while huge hugely expected value while huge hugely reducing the risk, right? So, the index reducing the risk, right? So, the index reducing the risk, right? So, the index certainly lags, but we get a ton more certainly lags, but we get a ton more certainly lags, but we get a ton more observability by just using that tagging observability by just using that tagging observability by just using that tagging primitive versus the actual uh just pure primitive versus the actual uh just pure primitive versus the actual uh just pure identity verification.

  11. And I think this is [sighs and gasps] And I think this is [sighs and gasps] one thing people should really consider, one thing people should really consider, one thing people should really consider, especially people working at companies, especially people working at companies, especially people working at companies, enterprises, which is that there are a enterprises, which is that there are a enterprises, which is that there are a ton of things happening in the Genai ton of things happening in the Genai ton of things happening in the Genai landscape that are probably scary to us landscape that are probably scary to us landscape that are probably scary to us that make your security teams really that make your security teams really that make your security teams really afraid that feel like, hey, they are too afraid that feel like, hey, they are too afraid that feel like, hey, they are too far on the frontier, right? You you're far on the frontier, right? You you're far on the frontier, right? You you're like, I wouldn't run this locally. I like, I wouldn't run this locally. I like, I wouldn't run this locally. I wouldn't run a open cloud agent on my wouldn't run a open cloud agent on my wouldn't run a open cloud agent on my local machine with full permissions, local machine with full permissions, local machine with full permissions, right? There's all these horror stories right? There's all these horror stories right? There's all these horror stories and you know various anecdotes about why and you know various anecdotes about why and you know various anecdotes about why this is bad. But in an enterprise again this is bad. But in an enterprise again this is bad. But in an enterprise again you can figure out how to leverage your you can figure out how to leverage your you can figure out how to leverage your enterprise resources to actually reduce enterprise resources to actually reduce enterprise resources to actually reduce those risk factors and get the real those risk factors and get the real those risk factors and get the real value out of the capabilities and this value out of the capabilities and this value out of the capabilities and this is where you should be investing that is where you should be investing that is where you should be investing that time. So what we ultimately shipped is this So what we ultimately shipped is this entire framework, right? We have the entire framework, right? We have the entire framework, right? We have the ability to run cloud agents as user ability to run cloud agents as user ability to run cloud agents as user identities uh because of all of those identities uh because of all of those identities uh because of all of those guard rails and vectors we put in place guard rails and vectors we put in place guard rails and vectors we put in place and using different kind of interface and using different kind of interface and using different kind of interface vectors to actually operate with them so vectors to actually operate with them so vectors to actually operate with them so that people who are not comfortable with that people who are not comfortable with that people who are not comfortable with CLIs can leverage them but certainly for CLIs can leverage them but certainly for CLIs can leverage them but certainly for other cases as well. And as part of other cases as well. And as part of other cases as well. And as part of that, we made sure to ship out just a that, we made sure to ship out just a that, we made sure to ship out just a managed fleet of cloud, you know, managed fleet of cloud, you know, managed fleet of cloud, you know, whatever agents for every single user in whatever agents for every single user in whatever agents for every single user in this remote fashion that they can this remote fashion that they can this remote fashion that they can already interact with so that we can already interact with so that we can already interact with so that we can continue to deploy and improve what is continue to deploy and improve what is continue to deploy and improve what is actually available to individual users.

  12. actually available to individual users. actually available to individual users. But also the core capability itself of But also the core capability itself of But also the core capability itself of being able for every anyone at the being able for every anyone at the being able for every anyone at the company to deploy an agent that runs in company to deploy an agent that runs in company to deploy an agent that runs in the cloud remotely with their full the cloud remotely with their full the cloud remotely with their full identity is there and is something we identity is there and is something we identity is there and is something we are comfortable with. So to finish up, uh, everything I talked So to finish up, uh, everything I talked about actually happened last year. So if about actually happened last year. So if about actually happened last year. So if you are interested at all in wanting to you are interested at all in wanting to you are interested at all in wanting to build and see what we're working on now, build and see what we're working on now, build and see what we're working on now, or even better, if you're like, that was or even better, if you're like, that was or even better, if you're like, that was horrible, we could do so much better. We horrible, we could do so much better. We horrible, we could do so much better. We are hiring and we encourage you to are hiring and we encourage you to are hiring and we encourage you to apply. If you have any experience in any apply. If you have any experience in any apply. If you have any experience in any of these domains, of these domains, of these domains, you can check that QR code, check that you can check that QR code, check that you can check that QR code, check that link. Yeah, that's it. Any questions? link. Yeah, that's it. Any questions? link. Yeah, that's it. Any questions? [applause] >> What do you think about local connected >> What do you think about local connected to agents for enterprises? to agents for enterprises? to agents for enterprises? >> Uh, not the views of my company, but >> Uh, not the views of my company, but >> Uh, not the views of my company, but personally I I think that is personally I I think that is personally I I think that is >> question.

  13. >> question. >> question. >> Yeah, sorry. His question was how do how >> Yeah, sorry. His question was how do how >> Yeah, sorry. His question was how do how do I view local LLMs for enterprise do I view local LLMs for enterprise do I view local LLMs for enterprise usage? And I think local in the sense usage? And I think local in the sense usage? And I think local in the sense that we manage ourselves is probably that we manage ourselves is probably that we manage ourselves is probably where we eventually want to go for a lot where we eventually want to go for a lot where we eventually want to go for a lot of our token use and inference because of our token use and inference because of our token use and inference because of cost because of deprecations because of cost because of deprecations because of cost because of deprecations because of you know every time Frontier Lab of you know every time Frontier Lab of you know every time Frontier Lab drops a new model you see some drops a new model you see some drops a new model you see some degradation. It's just there's too much degradation. It's just there's too much degradation. It's just there's too much volatility in that that we don't need to volatility in that that we don't need to volatility in that that we don't need to risk as the openweight models kind of risk as the openweight models kind of risk as the openweight models kind of become more advanced and sophisticated. >> Yeah. So as you can see the header is >> Yeah. So as you can see the header is not purely differentiating in itself. not purely differentiating in itself. not purely differentiating in itself. Someone someone could certainly populate Someone someone could certainly populate Someone someone could certainly populate that, but the actor the identity itself that, but the actor the identity itself that, but the actor the identity itself will not be me, right? So some someone will not be me, right? So some someone will not be me, right? So some someone could I guess write in that they're could I guess write in that they're could I guess write in that they're using some agent, but the core previous using some agent, but the core previous using some agent, but the core previous identity itself is not mimickable, not identity itself is not mimickable, not identity itself is not mimickable, not like actually interceptable, right? So like actually interceptable, right? So like actually interceptable, right? So we still we have both we have both the we still we have both we have both the we still we have both we have both the originating identity and that you know originating identity and that you know originating identity and that you know all of your identity ecosystems and all of your identity ecosystems and all of your identity ecosystems and chains to ensure that but also the chains to ensure that but also the chains to ensure that but also the header. part of the header.

  14. header. part of the header. header. part of the header. >> Yeah, that that that is separate. The >> Yeah, that that that is separate. The >> Yeah, that that that is separate. The header is just XSLm agent and then you header is just XSLm agent and then you header is just XSLm agent and then you still have some way you you need some still have some way you you need some still have some way you you need some way to actually determine the identity way to actually determine the identity way to actually determine the identity of who's coming. Yeah, I you know gen generally all of Yeah, I you know gen generally all of our RPC in some way has an initial entry our RPC in some way has an initial entry our RPC in some way has an initial entry point that is like point that is like point that is like populatable with that header and then populatable with that header and then populatable with that header and then once it actually goes downstream you once it actually goes downstream you once it actually goes downstream you know you make sure that same with trace know you make sure that same with trace know you make sure that same with trace ids is part of the span internally ids is part of the span internally ids is part of the span internally within the So within the So within the So >> can you clarify how the use of Google >> can you clarify how the use of Google >> can you clarify how the use of Google index addresses the prompt injection index addresses the prompt injection index addresses the prompt injection issue? issue? issue? >> Yeah. So the core things about this >> Yeah. So the core things about this >> Yeah. So the core things about this index is not only is it a cached index, index is not only is it a cached index, index is not only is it a cached index, it is it has a lot of other controls and it is it has a lot of other controls and it is it has a lot of other controls and safety guarantees around it. It is safety guarantees around it. It is safety guarantees around it. It is specifically made for these curated specifically made for these curated specifically made for these curated financial like um highly regulated financial like um highly regulated financial like um highly regulated industries. So they themselves are doing industries. So they themselves are doing industries. So they themselves are doing some of their own curation on top of it.

  15. some of their own curation on top of it. some of their own curation on top of it. Now certainly I think that creation Now certainly I think that creation Now certainly I think that creation could fail. It's probably done using Gen could fail. It's probably done using Gen could fail. It's probably done using Gen AI but the prompt injection risk is much AI but the prompt injection risk is much AI but the prompt injection risk is much far reduced because everything still far reduced because everything still far reduced because everything still remains internal. >> Yeah. I I think it's critical um in the >> Yeah. I I think it's critical um in the sense that that behavioral data is sense that that behavioral data is sense that that behavioral data is something we can further configure based something we can further configure based something we can further configure based on right like that we we do try to on right like that we we do try to on right like that we we do try to ensure that not everyone at the firm can ensure that not everyone at the firm can ensure that not everyone at the firm can see what your agents are doing right see what your agents are doing right see what your agents are doing right like there's stuff certainly work-wise like there's stuff certainly work-wise like there's stuff certainly work-wise but also more sensitive information that but also more sensitive information that but also more sensitive information that might be privileged to you. So your might be privileged to you. So your might be privileged to you. So your session data is kind of localized. Now session data is kind of localized. Now session data is kind of localized. Now that behavioral data in the session data that behavioral data in the session data that behavioral data in the session data is very powerful because it can define is very powerful because it can define is very powerful because it can define additional configuration that can be additional configuration that can be additional configuration that can be applied to these agents for the purposes applied to these agents for the purposes applied to these agents for the purposes of making the user experience better. So of making the user experience better. So of making the user experience better. So we we try to leverage that to figure out we we try to leverage that to figure out we we try to leverage that to figure out what to configure further not just based what to configure further not just based what to configure further not just based on someone's like hierarchical persona on someone's like hierarchical persona on someone's like hierarchical persona but actually based on their usage to but actually based on their usage to but actually based on their usage to make sure that their experience make sure that their experience make sure that their experience continues to improve actually based on continues to improve actually based on continues to improve actually based on what they're doing.

  16. Uh we're almost out of time. me and my Uh we're almost out of time. me and my co sorry I'll take the last question co sorry I'll take the last question co sorry I'll take the last question you're saying you have a process for you're saying you have a process for you're saying you have a process for letting individuals create their own letting individuals create their own letting individuals create their own >> yep >> yep >> yep I mean how do you go about like anybody I mean how do you go about like anybody I mean how do you go about like anybody there is a process for like agents across the is a process for like agents across the company >> yeah uh for building our own agents you >> yeah uh for building our own agents you know we we use some of the existing know we we use some of the existing know we we use some of the existing frameworks for agent building. Obviously frameworks for agent building. Obviously frameworks for agent building. Obviously all the genai harnesses are very good at all the genai harnesses are very good at all the genai harnesses are very good at using those frameworks to build agents. using those frameworks to build agents. using those frameworks to build agents. So you have a lot of agents So you have a lot of agents So you have a lot of agents proliferating based on that. In terms of proliferating based on that. In terms of proliferating based on that. In terms of provision, everything is already provision, everything is already provision, everything is already provision. All this is every single user provision. All this is every single user provision. All this is every single user at the firm has all the necessary at the firm has all the necessary at the firm has all the necessary infrastructure in place. So that's not infrastructure in place. So that's not infrastructure in place. So that's not really a worry. They can build an agent, really a worry. They can build an agent, really a worry. They can build an agent, deploy it as necessary into their deploy it as necessary into their deploy it as necessary into their namespace running as their identity. the namespace running as their identity. the namespace running as their identity. the the aspect of how do agents then become the aspect of how do agents then become the aspect of how do agents then become like a universal companywide or larger like a universal companywide or larger like a universal companywide or larger beyond a individual users uh agent you beyond a individual users uh agent you beyond a individual users uh agent you know goes through your standard kind of know goes through your standard kind of know goes through your standard kind of mechanisms right like hey is there going mechanisms right like hey is there going mechanisms right like hey is there going to be proper production support is there to be proper production support is there to be proper production support is there the right security it's like any the right security it's like any the right security it's like any application you might develop application you might develop application you might develop uh yeah so me and my colleagues will uh yeah so me and my colleagues will uh yeah so me and my colleagues will stick around here if anyone wants to stick around here if anyone wants to stick around here if anyone wants to talk further you know I guess if you're talk further you know I guess if you're talk further you know I guess if you're sticking around I can also take more sticking around I can also take more sticking around I can also take more questions but thanks for coming to this questions but thanks for coming to this questions but thanks for coming to this >> [applause]

Summary

This talk, "Tethered," explores how agents at Two Sigma function as distinct identities within their operational ecosystem. Drawing an analogy to the movie "Us" where doubles can run loose, the presentation discusses the evolution of cloud agents from local execution to remote accessibility, emphasizing the need for user-friendly interfaces beyond CLIs. The practical takeaway is the development of a cloud agent system that provides remote usability and handles identity management for greater accessibility and functionality.

View original episode ↗