← The Agile Brand with Greg Kihlström®: Expert Mode Marketing Technology, AI, & CX
The Agile Brand with Greg Kihlström®: Expert Mode Marketing Technology, AI, & CX
#804: GenLayer CEO Albert Castellana on AI's accountability gap
00:22:57
Loading summary
Transcript44 lines
- [00:01]
Strayer University Announcer
The Jack Welch Management Institute at Strayer University helps you go from I know the way to I've arrived with our top 10 ranked online MBA. Gain skills you can learn today and apply tomorrow. Get ready to go from make it happen to made it happen and keep striving. Visit strayer.edu Jack Welchmba to learn more. Strayer University is certified to operate in Virginia by Chev and its many campuses including at 2121 15th Street north in Arlington, Virginia.
- [00:30]
TJ Watt
This is pro linebacker TJ Watt and I'm back for another active drop with YPB by Abercrombie. I co designed this collection to stand up to my off season training schedule. My favorite is the Deltfit Tank. It has deeper shoulder cuts for better mobility and it's the one tank I never have to adjust mid workout. So you know we had to call it the TJ Tank Shop YPB by Abercrombie in the app, online and in stores because your personal best is greater than anything.
- [01:01]
Strayer University Announcer
The agile brand.
- [01:07]
Greg Kilstrom
Welcome to Season eight of the Agile Brand Podcast. This season we're going all in on Expert Mode, MarTech, AI and Customer Experience, talking with the people and platforms behind the brands you know and love. I'm Greg Kilstrom, your host and I help Fortune 1000 companies make sense of martech, AI and marketing ops. Hit, subscribe or follow to make sure you always get the latest episodes and leave us a rating so others can find us as well. And make sure you check out our sponsor Tech Systems, an industry leader in full stack technology services, talent services and real world applications. For more information, go to teksystems.com now let's dive in. When an agent makes a decision that
- [01:52]
costs your company millions in a lawsuit,
- [01:54]
who do you fire? Agility requires both the speed to adopt new technologies like AI agents as well
- [02:01]
as the foresight to build the guardrails that prevent that speed from driving your brand off a cliff.
- [02:06]
Today we're going to talk about the
- [02:07]
hidden crisis brewing behind the AI revolution. The Accountability gap.
- [02:12]
As companies race to replace roles with autonomous AI agents, a A critical question
- [02:16]
is being ignored when an agent makes
- [02:19]
a biased, unethical or simply wrong decision
- [02:21]
that harms a customer or an employee who's actually responsible.
- [02:26]
This isn't a future problem.
- [02:27]
It's happening right now and it poses a massive threat to brand trust, customer
- [02:32]
relationships and legal standing. To help me discuss this topic, I'd like to welcome Albert Castellana, co founder and CEO at genlayer. Albert, welcome to the show.
- [02:41]
Albert Castellana
Hey Greg, thanks for having Me here.
- [02:43]
Greg Kilstrom
Yeah, I'm looking forward to talking about this. Definitely. I think it's an often overlooked topic here and, but definitely timely and, and important. Before we dive in though, why don't you give a little background on yourself and your role at genlare?
- [02:57]
Albert Castellana
Yeah, so my background is in computer science. I've been in crypto and AI for about a decade now. Like actually crypto, I started, you know, like in 2013. Before then I had actually managed an algorithm traded fund. And then I've been essentially since the rise of ChatGPT. Right. So November 2022, I was like fascinated by the idea of having these agents, you know, being able to write code and start to interact with each other and so on. And then both things essentially turned into, you know, how do we essentially build a trustless decision making system? Right. Like, because right now we're so used to having just, you know, these AIs and these algorithms just make decisions on our behalf. Right. If you don't know what appears on YouTube, we don't know what appears on Instagram. Right. The feed is actually absolutely up to the AIs, right? Like whether you get hired or not, whether you get, you know, an insurance payment or not. Right. Everything is just kind of managed by the algorithm. It's just going to get worse. So like we're trying to basically make it. How can we make it so that it's, you know, a more trustless system, that you just don't just rely on what the AIs are doing.
- [03:56]
Greg Kilstrom
Right, yeah, yeah, love it. Well, yeah, let's, let's dive in then. And I want to start with really defining this accountability gap. And so you've talked about the need for systemic trust in the agentic economy for a marketing leader at a Fortune 500 company. What does the lack of this trust look like in practice going beyond HR examples? And what does this look like for accountability that could impact marketing, sales and customer service operations?
- [04:29]
Albert Castellana
Right. So we're all racing towards using AI. We all kind of still, I think, baffled by how strong these things are. And we're trying to really understand how to use this technology. I think that that's the mandate right now for many, many brands. Right. But the real question is that, well, what does it mean? How do you implement it? How do you really make it a reality? Right. And the problem with this that few people are talking about is, well, who's in control, right? Like, who's making the decisions? Like you're used to having, you know, like tools that just do your bidding. Right. But this is a bit of a. Bit of a different system, right? Like you basically are not in control anymore. You're saying, okay, I want this agent to be representing my brand in front of the public. But I don't even know how it's thinking, what it's doing, what promises it is making. Right. Did it hallucinate something? Right. Did it, you know, deny something? Let's say that. Deny, refund, that really should have been refunded, right. Can I get sued because of that? Am I responsible because of that? So all of that. We're in a system that's really kind of struggling from a legal perspective. The whole legal system is very struggling with the number of people in the world. There's 5 billion people that don't have access to justice. The problem is when these agents come online, they're just going to be suing each other just for fun. They're going to be able to be just patent trolling. They're going to be able to be just thinking, what are the edges of the contracts, anything that you put on top of them, how can they benefit? Right. Sometimes breaking the law, sometimes not breaking the law, but for sure, stressing the system. A system that right now it's already under stress. Right. So I think to me, like, that's the. That's the systemic trust, right? It's like trust is kind of breaking apart. It's been breaking apart for quite a while. It will just become even more. It will become worse in the moment where you have, you know, whatever, 10 billion agents out there, hundred billion agents out there that are transacting with each other at light speed for like, you know, bigger or smaller amounts. I think at the beginning will be smaller amounts, eventually will be huge amounts. Right. It will be very difficult to understand, okay, what is actually happening with my business. I've got these, you know, thousand agents dealing with other people outside and there. It's going to be quite tricky. So, yeah, that's. That's what we're looking at, right? Like, how do you reduce this risk? How do you improve, you know, the turn? How do you avoid brand damage that they can be just by hallucinating stuff?
- [06:52]
Greg Kilstrom
Yeah, well, and I think for the humans that are overseeing these things, you mentioned this briefly, but I want to dive into this a little bit more, which is we're all used to using software and using tools, as you had mentioned as well. But this shift, in addition to the legal and other implications that you mentioned, it's also a mindset shift for the humans involved in this of, instead of just, okay, I open this application and I do this thing, whatever it is. Now I'm overseeing, you know, autonomous, semi autonomous agents doing this thing. How does a leader start to teach their team to think in terms of that? Instead of, again, I do an action and there's a, there's a defined and limited action versus now. It's could be unbounded or at least relatively unbounded.
- [07:51]
Albert Castellana
I would go kind of like, what's the, what's the difference between, you know, a leader and just let's say the person that are being led. Right. Yeah. I think that humans are going to have a job like long term. Right. Which is liability, responsibility. Right. Like you are using an agent. Yes. And you spin up this agent that's going to be doing something for you. It's not like a tool. Tools just execute. Right. And that says you can oversee the tool because you're actually running the tool. It's doing something that you asked it to do. Now these agents are going to be able to be doing their decision making on their own and they're going to be doing some things wrong. So you, if you're the person that puts the system in place, that agent in place, and you don't put the, you know, the borders so that it doesn't create complexities and problems, well, you're going to be the one responsible. And I think that this is going to be long term. What do I see 10 years down the line? Humans don't really have any more baseline job, but they will have their liability, their responsibility that things go well. That's what the leaders are normally doing, taking on the responsibility and trying to manage a lot of the people. I think what's going to happen is that everybody will become leaders. Everybody will become. Their main job will be, you know, I'm responsible for this thing to happen and I've got this team of agents that are doing this thing. And then the question really for me would be, okay, how do you create the railway? Right. How do you create the borders? Right. The constraints so that things work well? How are they accountable? Right. How can you track what they're doing? How do you make sure that they don't, you know, do something off? Right. And I think that that's what most people should be right now thinking about as well. It's like, okay, we're moving really quickly towards this adoption. I'm the number one in doing that. But at the same time, like, what type of like limitations am I putting into the system to make sure that it doesn't break apart.
- [09:41]
Greg Kilstrom
Yeah, yeah, well, and I think that that's a good segue to. I want to talk a bit about your solution to, you know, at least some of this is, you know, with, with Gen Layer and something that you call global synthetic jurisdiction. So I want to, I'd love for you to unpack what that means and kind of break it down in practical
- [10:01]
Albert Castellana
terms so you can think about Gen Layer as a digital judge, right? It's only that it's not just one entity, one AI, but rather many different AIs that anybody can be part of together reaching a consensus on how to resolve a contract or how to resolve a dispute, right? So for those that are like into crypto, right, like Bitcoin is basically trustless money, right? Like you don't need the bank in order to transact, you don't need a third party in order to move money around, right? There's this other one called Ethereum, right, Which is this global computer, this world computer that can essentially be running applications in a trustless manner. And what JR is, is basically like trustless decision making. How do you enable decision making? Like you would be going to a judge, right? Like you and I have a dispute, we go to a judge, we're expecting the judge to be fair and essentially we're trusting him, her to be able to be fair between us, right? What Bitcoin and Ethereum do is that they remove that trust for technology. What Zen Layer does is also the same, right? We're removing the trust in making decisions and instead putting technology in the mix, right? What that means is that then you can essentially have disputes and contracts that can be resolved at AI speed, right? Because it's a bunch of different AI, a thousand different AI models that are basically reaching an agreement in a majority vote on whether some dispute or some agreement should be resolved one way or the other. What that amazingly means is that now you have this railway, you have this constraint, you have a system that allows you to create a contract that will be self enforced and that will be decided by this consensus. This group of AIs that will be looking into, okay, this is the evidence, this is the contract, this is the asset. What should we do? And well, if you think about it, most of the contracts in the real world are not really black and white. Most of them are not something that you can codify as a smart contract. Normally it's like, okay, you have this creator campaign and you have, did this creator do, do what we asked him to do was the content high quality did he actually get the audience? How many impressions did it get? Some of those things are something that is objective, but some of those are subjective. Right. And so what generator does is essentially enables for these fuzzy contracts. Not just very deterministic, very black and white contracts, but fuzzy contracts that you can deploy into it and then they get executed across the world.
- [12:35]
Greg Kilstrom
So I think you touched on some of this already. But you know, when a lot of people think about blockchain, they think about things that you mentioned, like Bitcoin, Ethereum or NFTs, you know, all, all sorts of things like that. So why blockchain for this as opposed to some, you know, regulatory body, government entity, tech company, you know, something like that. And what are some of the unique aspects of this that that blockchain can solve?
- [13:03]
Albert Castellana
I think one thing we've seen for the last decade or so is that trust is breaking apart. Right. There's a lot of countries that are just, you know, the governments are falling apart, companies are using their power in order to harm their users. Right? Like from, you know, like making you addicted to their platforms. Right. To just, you know, presenting you with, with things that you shouldn't even see. Basically the power has been concentrating in the hands of very few. It happened the same with money. Very few had the power over money. And that basically meant that you had to be paying multiple percentage in order to make a single transaction or that you had to be waiting for days to make a transaction by decentralizing, by making it so that it's not just one entity that has the power to be the gatekeeper, that has basically opacity. I mean, we've seen with Bernie Madoff all the lack of transparency has just created issues across the system. What we're doing is basically trying to make it so that the future of decision making. You want an AI to be making the decisions or do you want basically nobody to make the decisions for it to be a traceable, a fair and open and accessible system that everybody can essentially rely on. Right. And they don't need to be just trusting a single model with a specific bias, specific point of view and owner. Actually, we think that decentralization enables new types of use cases. That's been proven by Bitcoin and Ethereum. I think it will be equally proven through Gen layer as we are already being decided upon by many different AIs we don't know anything about. We just want to move a little bit out from that if we can.
- [14:44]
Greg Kilstrom
Yeah, yeah. So let's talk a little bit about the customer experience. And the customer dynamic here. So you know, when a human agent, an employee at a company makes a mistake, there's a clear path for escalation, apology, you know, whether that person continues to work at that organization or not. You know, all kinds of things like that. Obviously things get different when we, when we start talking about autonomous agents. And so, you know, what does this, what does a process of, you know, let's call it like recovery look like in a world that's run by autonomous or semi autonomous agents? You know, how, how can brands still manage risk and protect themselves against, you know, AI failure?
- [15:32]
Albert Castellana
Let's say for me it's quite interesting the question because like, you know, customer experience at the end of the day is because the customer is really, you know, like the one you're interfacing with. And I wonder what it will mean and I'm not, you know, expert at all. Right. So like I wonder what it will mean when the customer is really not the customer but rather an agent that's operating on behalf of the customer.
- [15:53]
Greg Kilstrom
Right.
- [15:54]
Albert Castellana
My perception is that they're going to be looking at, you know, any type of angle and any type of margin. Right. They will be trying to, okay, what is the best objective product? Not just, hey, you know, like oh, these marketing works well, they will be able to see through that. So I think that marketing will fundamentally change the moment that you have these agents working on our behalf. Right. Like, and like I think this year is the year we're going to see that. As we start to see, you know, like shopping from OpenAI, I think many people, you know, watching this or listening to this are going to be thinking, yes, I actually this year for Christmas for example, I was asking the AI to give me recommendation of what can I get? Can I give? Right. Even like trying to look at the products and give me, yeah, I think that that's going to be fundamentally changing.
- [16:41]
Greg Kilstrom
Yeah.
- [16:42]
Albert Castellana
At the end of the day, from the legal perspective, it's just going to be, you know, like, well, you will want there to be escalation levels. Right. Like you will want there to be first a system that's automated, that's giving you an input. You want that then to be some human that's giving you that input, the response. Right. And you will want to have the safeguards so that it doesn't, you know, escalate potentially into the legal world. Right, right. What Zenlier does is essentially also like offers that type of framework, but really I think that, that what you need to have is a system that can understand that okay. I'm actually dealing with an agent. I will be able, like my agent will be able to deal with it and like negotiate and like try to find common ground. Right. And so things are going to be changing very quickly on this front. I'm not an expert on cx, so like.
- [17:23]
Greg Kilstrom
Yeah, yeah, yeah, no, of course, but, and then I think to, but to, to escalate it up to the, the legal level. There, there's a, there's, there's risk here, there's brand risk. Right. I mean there's, there's the brand perception part which you know, we, we could talk about but I, I'd rather focus on the, the risk mitigation. I mean if things go so wrong, in other words, with a customer experience that it becomes a legal issue, how should brands be starting to think about, you know, measuring, you know, and managing risk in, in terms of, of, of this?
- [17:57]
Albert Castellana
I think that at the end of the day measuring will be the way. Yes. In order to measure first you need to take that data and analyze it. So making things explainable, understanding. Okay, I've got this customer service agent. One option is to just not track anything of what it's doing. The other option is to make it so that it has very enforceable rules that it needs to be acting upon. So you want it to be as deterministic as possible. These agents are non deterministic in general. They're just, you can let them do anything they want. Right now what you want is to reduce the degrees of freedom so that they create less issues. So reduce the degrees of freedom. Make it so that there's clear escalation processes again put them just like as many constraints as you can and constraints enable for completely new types of opportunities. I think ultimately the customer's agent will try to find a way to game your agent. It's going to be trying to find a way because you're a good brand and your naive agent is just going to be there for agents to be attacking to see. Okay, what's the best way I can search the whole Internet to find for ways to basically profit from this offer? Yes. And it will be able, the whole thing will change.
- [19:14]
Greg Kilstrom
Yeah. Yeah, agreed. So looking out future states, you've said AI won't wait for lawyers. Looking out over the next couple years, what's the biggest mistake that brands are currently making as they rush to adopt AI agents? Without considering some of these things that we've talked about, I think the next
- [19:39]
Albert Castellana
two, three years is when we're going to see this. We're going to see that companies are going to be deploying agents at scale, at a scale that it will be even hard to control because your competitor is deploying all these new agentic systems. Why are you not doing it? And it's just so easy and you can buy code so you can just move really, really quickly. And what I think will happen that people are not really seeing yet is that the legal system is going to be really in stress. These agents, they will be able to sue each other just for fun, do anything they want and they don't sleep. You don't know who is behind them. They're just like crazy smart, right? So I think just that the infrastructure is not ready. The infrastructure is not ready. Like you don't know if the agent that's buying your product is actually from North Korea. How are you going to do? Okay, now you need kyc. Are you used to having KYC on your chatgpt? What happens if one doesn't? Do we have this infrastructure? We don't have that right now. Right. So I think that you will see the emergence of all these adversarial agents. You will see how the legal system starts to struggle and how probably in a couple of years, right, it will be obvious that you really need to have a layer like a legal system for this future of AI, right? This AI commerce layer needs to exist because if not, well, the human legal system just kind of scaled to that level. I don't think that it's going to be replacing it. I think it's going to be like, okay, I want to offer to you this product. I will put an escrow and then the escrow will be smart enough to understand whether actually I fulfilled my promise. And then your agent will be able to say, yes, I want to enter into this contract. And then you just have maybe it's $1,000 contract. You don't need to go through hundreds of thousands of dollars of litigation a year or so to get something resolved, if not worse, just for $1,000. That's where we are right now. The customers are feeling like they're not in power, right? They are like the brands are in power. They just, you know, they, they cannot really do much for many of the things that are happening. I think that that's going to be like shifting a little bit into, into making it trustless. That's what, that's what we're working on.
- [21:47]
Greg Kilstrom
Yeah. Yeah. Well, thanks so much for, for joining. Got a couple last questions for you before we wrap up. So first, if we were having this interview one year from now, what is one thing that we would definitely be talking about?
- [22:00]
Albert Castellana
I think we will see how agentic commerce is really kicking off. I think you will see how people are just asking their agents to make money. It's just so easy to say, right, make money for me. And then the agent will have to find a way to make money. So you can think of what would you do if you were that agent?
- [22:16]
Greg Kilstrom
Yeah, yeah, definitely. Well, and last question for you. What do you do to stay agile in your role and how do you find a way to do it consistently?
- [22:25]
Albert Castellana
I'm always trying to be innovative and understand where we're heading. And on top of this I don't really have a sunk cost fallacy. Very adaptive. Always need to be tip of the spear, understanding that things are moving really quickly and ready to just change focus if you need to.
- [22:43]
Greg Kilstrom
Yeah, love it. Well again I'd like to thank Albert Castellana, co founder and CEO at genlayer for joining the show. You can learn more about Albert and
- [22:51]
genlayer by following the links in the show notes. This episode is brought to you by Tech Systems. They're leaders in full stack, tech services, talent solutions and helping companies put it all in action. You can learn more@teksystems.com and thanks again for listening to the Agile Brand podcast. If you liked the episode, hit subscribe and drop a rating so others can find the show too. And if you're interested in consulting at Advisory Work or if you need a speaker for your next event, feel free to reach out. Just visit GregKilstrom.com that's G R E G K-I H L S T R O M.com the Agile brand is produced by Missing Link, a Latina owned, strategy driven, creatively fueled production co op. From ideation to creation, they craft human connections through intelligent, engaging and informative content. Until next time, stay curious and stay agile.
- [23:53]
Strayer University Announcer
The Agile Brand. Support is available 247 with VRBoCare. We're here day or night, ready whenever you need help because a great trip starts with the right support. You know what they say, early bird gets the ultimate vacation home. Book early and save over $120 with Burbo because early gets you closer to the action. Whether it's waves lapping at the shore or snoozing in a hammock that overlooks well, whatever you want it to so you can all enjoy the payoff couple come summer with Verbo's early booking deals. Rise and shine. Average savings $141 select homes only.