AI in the Wrong Hands

Summary

Podcast Summary: Threat Vector by Palo Alto Networks

Episode: AI in the Wrong Hands
Date: May 7, 2026
Host: David Moulton
Guest: Asaf Karen (SVP & CSO, Qualtrics; Author of Lessons from the Front Lines)

---

Episode Overview

This episode, titled “AI in the Wrong Hands,” features a thoughtful conversation between David Moulton and cybersecurity leader Asaf Karen. The discussion centers on today’s real-world risks as AI-enabled attacks become more advanced, the evolving responsibilities of security teams, and practical steps for organizations to defend themselves, all while maintaining a grounded and candid perspective on leadership and professional growth.

---

Key Discussion Points & Insights

1. Career Path & Mindset in Security (01:36 – 04:20)

• Asaf’s Journey: Started in Israel, moved through startups, PayPal, now at Qualtrics. Emphasizes pursuit of experience over titles.
• Notable Advice:
  • “There was always this search for experience, not for title, that guided my career progression.” (02:35, Asaf Karen)
  • Value in stepping out of comfort zones and embracing roles that fill an “experience gap.”
• Leadership Lesson:
  • Confidence can quietly turn into liability, especially in a fast-moving field like AI security. Continuing to learn and remain curious is a necessity.

---

2. Dangers of Complacency & Fostering Curiosity (03:59 – 07:58)

• Complacency Risk:
  • Security teams are at risk of using “legacy thinking” and defaulting to saying “no” instead of engaging with AI evolution (04:20).
• Building a Curious Culture:
  • Asaf does “curiosity checkups” to catch blind spots; values teams who challenge leaders constructively.
  • “There is a superpower in being willing to look like you don’t know the answer… and ask questions like you’re stupid.” (05:36, Asaf Karen citing Leah from LinkedIn)
• Memorable Analogy:
  • David Moulton: “There’s a difference between being dumb and being stupid... If you never look dumb, you’re not really walking into situations that are going to challenge you.” (07:30)

---

3. Writing the Book: Leadership Lessons (08:33 – 10:58)

• Motivation:
  • Asaf wrote Lessons from the Front Lines to share personal stories and frameworks—focusing on curiosity, grit, psychological safety, and the unique mental challenges of working in security.
  • “None of this is groundbreaking, but… it is, I think, the first time that was written in the sense of a security leadership book... with some grounding in the life to life that we deal with.” (09:39, Asaf Karen)
• Most Important Part:
  • Emphasis on psychological safety and self-care for those in high-pressure cyber roles.

---

4. How Attackers Use AI: The Present Reality (11:49 – 15:49)

• AI not a Future Threat—It’s Present:
  • “It’s not a future conversation. The fire started in 2023 when GPT was unveiled.” (11:53, Asaf Karen)
• Attack Techniques:
  • AI is used for phishing, deepfakes, automated recon, language/culture-specific attacks (e.g., “phishing pandemic” in Japan made possible by AI language models).
• Attack Acceleration:
  • Compression of time between vulnerability discovery and exploitation.
  • “Attackers don’t have security teams telling them not to use AI. Corporates do.” (15:35, Asaf Karen)
  • The advantage attackers have is the absence of internal constraints that slow defensive adoption of AI.

---

5. Most Concerning Capabilities: Semi/Autonomous Attacks and Malware (16:22 – 17:30)

• Scale & Agentic Attacks:
  • AI-driven attacks remove constraints of human capacity, enabling rapid, thorough, and relentless reconnaissance and exploitation.
• Key Concern:
  • The rise of malware with no recognizable signature, making detection fundamentally more difficult.

---

6. What Does AI-enabled Attack Look Like at Scale? (17:30 – 19:06)

• Attack Workflow:
  • AI can enumerate vulnerable endpoints quickly, try multiple forms of attack almost instantly, potentially making the environment “noisy” but effective.
  • Extraction and persistence (living-off-the-land techniques) will be more automated and harder to spot.

---

7. Security Fundamentals: "Brilliant at the Basics" (19:43 – 22:07)

• Back to Basics:
  • Over-focusing on AI sometimes means ignoring critical foundational work.
  • Top Recommendations:
    • Minimization: Remove unnecessary internet exposure, endpoints, code, or packages.
    • Boring Architecture: Get identity, data, scoping, segmentation, business continuity, and recovery “right.”
      • “There is no good enough anymore… we’re putting AI on top of broken mechanisms.” (21:16, Asaf Karen)
• Danger of AI on Weak Foundations:
  • Non-deterministic AI on poorly constructed systems can have unpredictable, dangerous results.

---

8. Pitfalls: Skipping Steps & Critical Exposures (22:07 – 24:42)

• Most Skipped Step:
  • Identity Management—often homegrown and risky, yet foundational.
    • “Identity… that’s the baseline structure for everything else.” (23:18, Asaf Karen)
• The "Third Rail":
  • Identity is the most sensitive and dangerous function to mishandle.

---

9. Judgement under Uncertainty: Risk Decisions in Real Time (24:42 – 28:28)

• Rapid Change:
  • Risk landscape is shifting quickly; threat intelligence is often lacking.
• Effective Approach:
  • Return to fundamental principles and realistic risk assessments.
    • “When we try to block the business from using AI, we’re creating more risk than value.” (26:16, Asaf Karen)
  • Build mechanisms and guardrails, not bans.
  • Use AI for tangible, meaningful business outcomes—not because it’s trendy.

---

10. Practical First Steps for Security Leaders (29:03 – 31:18)

• Two Lenses:
  • Internal risk (AI usage within the company) and external risk (attackers using AI).
• Internal:
  • Map AI usage and vendor trustworthiness; adopt frameworks like NIST AI RMF; maintain internal transparency on risk.
• External:
  • Embrace automation (with or without AI) to shrink attack surface and increase speed.
• Catchy Practice:
  • “Attack Surface Diet”—actively minimize your digital exposure.
    • “Get your attack surface on a healthy diet. Shrink down, man.” (31:46, David Moulton)

---

11. Optimism for the Future (32:24 – 34:06)

• Short-term Pessimist, Long-term Optimist:

  • “I think in the end this technology is so exciting that we’re going to be able to do something… free up people to do people work and not manual labor tasks.” (32:29, Asaf Karen)
  • Over time, defenders can leverage AI for meaningful work and overcome attacker advantages.

• Hopeful Analogy:

  • From manual labor on potato farms (old security model) to efficient, modern vertical hydro-farms (future, AI-driven security).
    • Shift from endless toil to high control, productivity, and creativity.

---

Notable Quotes & Memorable Moments

• “There is a superpower in being willing to look like you don’t know the answer or willing to look like you’re stupid and ask questions like you’re stupid.”
  —Asaf Karen (05:36)

• “If you never look dumb, you’re not really walking into situations that are going to challenge you.”
  —David Moulton (07:45)

• “Attackers don’t have security teams telling them not to use AI. Corporates do.”
  —Asaf Karen (15:35)

• “If it doesn’t need to be on the Internet, it shouldn’t be on the Internet.”
  —Asaf Karen (19:47)

• “We’re putting AI on top of broken mechanisms.”
  —Asaf Karen (21:16)

• “Identity… that’s the baseline structure for everything else.”
  —Asaf Karen (23:18)

• “When we try to block the business from using AI, we’re creating more risk than value.”
  —Asaf Karen (26:16)

• “Attack Surface Diet”—actively minimize your digital exposure.
  —Coined by David Moulton (31:18), adopted by Asaf Karen

• “Short-term pessimist, long-term optimist.” (Phil Venables quote adopted by Asaf, 32:24)

---

Timestamps for Key Segments

• Asaf’s Career Path Philosophy – 02:02 – 04:20
• Curiosity & Team Culture – 05:28 – 07:59
• Book Writing Process & Importance of Mental Health – 08:33 – 10:58
• Current Use of AI by Attackers – 11:49 – 15:49
• Scale of AI-enabled Attacks – 16:22 – 19:06
• Security Fundamentals & Dangers – 19:43 – 22:07
• Critical Step: Identity Management – 23:00 – 24:42
• Judging AI Risk in Real Time – 24:42 – 28:28
• Steps Leaders Can Take – 29:03 – 31:18
• Hope for Defenders & The Future – 32:24 – 34:06

---

Takeaways for Security Professionals

• Embrace curiosity; don’t fear appearing uninformed.
• Focus on experience and growth over titles.
• The AI threat is already here—prepare defenses accordingly.
• Prioritize minimization and fundamental security architecture, especially identity.
• Enable safe, outcome-driven AI adoption with strong internal guardrails.
• Keep security “brilliant at the basics.” Don’t neglect fundamentals for shiny new tools.
• Automate, shrink your attack surface, and adapt quickly.
• While daunting now, defenders have cause for long-term optimism with AI, provided fundamentals are in place.

---

For listeners seeking actionable guidance and honest perspective, “AI in the Wrong Hands” delivers clear insights on modern threat realities and timeless leadership in cybersecurity.

Transcript

[A]

You're listening to the Cyberwire Network, powered by N2K. Being a CISO feels very lonely at times, and because you carry a very unique risk for the business that a lot of times the business doesn't understand. And so building the community, reaching out, listening to stuff like this, listening to other podcasts, but creating the understanding that this is an industry that is dealing with this and the industry is fighting. We're all fighting the same fight against the same people. We're not fighting each other. And so reach out, ask for help.

[B]

I'm David Moulton, and this is Threat Vector. Today I'm speaking with Asaf Karen about AI in the wrong hands. Assaf is SVP and Chief Security Officer at Qualtrics and the author of a new book, Lessons from the Front Lines. Out now from Wiley. Here's our conversation. Assaf, welcome to threatvector. I'm really glad to have you here. I know there had been some scheduling nonsense, but we finally got it, man. We're finally on the mic together. So let's have a good conversation. Conversation.

[A]

Six, six. Rescheduling to get to this point, if I. If I count it correctly. But let's go. I'm excited.

[B]

Before we get into our topic, I'd actually like to hear a little bit about your journey. You know, I dug into it a bit and I'm sure our guests would actually find this interesting.

[A]

You've.

[B]

You've had actually a fairly long career in cybersecurity from your early work in Israel through pay with PAL and now with Qualtrics. How do you think about the path that brought you here?

[A]

There were really hard points in my career. I had to step out of the startup because I had lack of clarity and lack of cohesion with my co founders after a year. And that was really, really hard. It was probably one of the hardest years in my life, but also probably one of the years of the most learning for me. And what I would say is that I didn't know that at the time. If you look at the different decisions that I've made, I didn't know that at the time. But there was always this search for experience, not for title, that guided my career progression. So when I went to run a startup, it was, I wanted to do this thing. I want to try running a company, and I want to do that enough twice. I don't want to do that again. By the way, even leaving my second startup and going to work for PayPal, I took a roll cut. I moved from being a CTO to being a manager of four people in me ended up being the CISO in PayPal, which was great decisioning, probably in hindsight, but. But it was searching experience. It was searching the what is the experience gap that I have to make me a more full professional. And that's what I suggest to people when they come talk to me. Especially people that say, hey, I want to be a director, or I want to be a senior director, I want

[B]

to be a vp.

[A]

It's not a good pursuit. The pursuit is I want to. I want to do something I enjoy and I want to learn new things. And this is the direction that I want to go to. And I think that in hindsight, that's what's driven my career so far.

[B]

Yeah. Well, in your book you wrote about this danger of feeling like you know enough and how that confidence can become quietly become a liability in a field that's moving as fast as AI security. I think that trap feels easy to fall into. Where do you see that showing up

[A]

now, specifically with AI? I think that I'm seeing a lot of security teams not understanding how pivotal this moment is and using legacy thinking in making decisions and maybe defaulting to the default of security teams, which has been the department of. No. I think especially there is a gap of knowledge in security teams understanding AI and machine learning. I think it has been there for a while. But the. But with the explosion happening right now, that fear is dangerous. And that lack of curiosity that I'm seeing in a lot of places is bothering me because I think that we're creating more impact than good when we're doing it.

[B]

How do you catch yourself from falling into that trap?

[A]

Sometimes successful, sometimes I'm not. By the way, I don't want to make it sound like I'm always curious, but I do curiosity checkups. I sit down and I generally say to myself, what did I miss? There is a friend of mine, Leah, who's the CISO of LinkedIn and they wrote on LinkedIn that. Something I agree with completely, that there is a superpower in willing to look like you don't know the answer or willing to look like you're stupid and ask questions like you're stupid. And. Sometimes I'm successful, sometimes I'm not. In the day to day, like the accelerated day to day pace that we're in a lot of time, it's just easy to come in and say, hey, this is the answer. Move on.

[B]

Right.

[A]

And I do have a good team around me that knows to also challenge me when I'm that way. And tell me, Asaf, you're wrong here. Let's have a conversation. And that's really, really humbling. And it's great to have that support structure.

[B]

Yeah. I have concluded that there's a difference between being dumb and being stupid. And I think being dumb is acceptable. It is a natural state. It's all of us are dumb. And when we refuse to learn or refuse to learn the lessons that whatever the situation is, tries to teach us, that's being stupid. So you touch the stove the first time. Sorry, kid, kind of dumb. Now you know better. You touch it the third, fourth time. Now it's just getting kind of stupid. So I think that it's okay to look dumb. In fact, if you never look dumb, you're not really walking into situations that are going to challenge you. I think it's when you look stupid later on, when you had that opportunity to go learn or to understand or to be curious and dig in, that's when we end up looking stupid. And I think that's what we try to avoid. Not realizing that there's a.

[A]

There's.

[B]

There's. I'm grateful when I'm in a room and I'm the dumbest one means I'm about to learn some things and maybe have, you know, a lot of time to reflect and think and ask good questions. I like the idea that you have a team that's around you that can push you, too. I think that's a sign of a strong leader when your team can push back on you and say, we got to rethink this. All right, a quick question for you before we get into the deeper topic. You've had this really long career. Obviously, you've got tons of stories to tell. Why this book? Why now?

[A]

So I've been wanting to write a book just for the experience of writing a book for about five, six years.

[B]

Okay.

[A]

And I kept hitting a wall of, what do you have to add to literature that wasn't already written and that's valuable for other people? And it got to the point where, like, okay, I'll start writing something and then stop, and then start writing something and then stop. And I said, well, you know what? My stories are my stories, and I like to tell them. Maybe I write a book based on my stories. So I sat down, wrote a lot of different stories that I have,

[B]

and

[A]

then start framing frameworks in my mind, like curiosity, grit, and optimism and the diplomacy, business acumen, change management, and execution frameworks that I use when I talk to people all the time on how to build things or how to build teams or how to behave. And I said, okay, now I have stories, now I have frameworks. It comes together into a book that is based on my personal experience. And none of this is groundbreaking, but it is, I think, the first time that was written in the sense of a security leadership book and with some grounding in the life to life that we deal with, which is a bit different. And the part I'm proud of the most is actually the last part of the book that is a lot about psychological safety and taking care of yourself and acknowledging the mental challenge that is working insecurity that is very different to other roles that other people play. And that came together really, really nicely into a book. And so the actual act of writing the book, that was a few months. It was pretty easy once I had the structure in place, but getting there took me years. I'm hoping that people find it useful. I don't know, we'll see.

[B]

I recently interviewed Ali Mellon about her new book, Code War, and her big lesson was be aware of time management when she put the book together and she said she learned a lesson that she didn't have her time management as tight as she wanted. And it sounds like yours was finding that truth that you wanted and then it flowed out of you. Well, Asaf, let's get concrete on this one. I appreciate you letting us go behind the scenes and get to know a little bit about you, but let's talk about what happens when AI gets in the wrong hands and what that actually looks like today. Maybe not like a future scenario, but what are you seeing attackers doing with these tools right now?

[A]

Great timing. Just published a blog post about the whole mythos thing and I said in that blog post, it's not a future conversation. The fire started in 2023 when, when GPT was unveiled. Initially, what we saw was the basic things, phishing, deep fakes, those kinds of discussions. I think a month ago Amazon has published that they've seen an attacker go in and do it in Cloud Takeover, go in and utilize AI agents to do discovery within the network or within the customer environment. We're definitely seeing condensation of the time frame from. Vulnerability to execution of the vulnerability. AI red teaming is a real thing. And if AI red teaming is a real thing, where AI attacking is also a real thing and all of these things are reality right now. And the interesting piece about what happened with the anthropic mythos publication is that everybody say, oh, this is going to be a bad no, it's Bad already. And I think a great example of how this shifts things drastically. I had a conversation in RSA already a month ago. Oh my God. I had a conversation, RSA with a founder of an email security company. And I asked him how it's going because they raised a seed and they were going, and usually when you raise a seed, you go to the US market and you start there. And he said, we're actually big in Japan. I told him, why Japan out of all places? And he said, look, one, the Japanese culture is very trusting. It's one of the safest places on the planet. You can leave your wallet on a desk at lunch and nobody will touch it. Inherently, it's a very trusting culture and that's great. But they have had a language and a culture moat around phishing all of these years, and now they don't have that anymore because GPT and other models are able to mimic Japanese well enough. So fishing now has become a pandemic and the government is very focused on that. So we're getting a lot of traction in Japan and we're going to see a lot of these shifts in which the assumptions that we've made on things that will keep us secure are going to be null and void and we will need to change the way we think to building better cultures and better systems. And that's the reality right now. Now, will it get worse in the future? Yes, it will get worse in the future as we improve models. I like to say when I talk to people, attackers don't have security teams telling them not to use AI. Corporates do. And we're the security teams who are making this bad for our companies, but they will continue using it.

[B]

So when you think about like AI generated fishing, you mentioned that with the Japanese market losing that sort of natural, or just that, that defense they had because there was the language barrier, LLM, assisted recon, deep fakes, right. Like there's all these different tactics and things that AI is helping an attacker with. Is there a capability that really stands out to you more than the others?

[A]

I think, I think that we are already seeing semi autonomous, if not fully autonomous, agentic attacks. And that means that. What it means is that the scale and scope, the economic pressure on people that the attackers have, is going to reduce the scale, scope of what they can try is going to be or already is accelerated, and they're going to get to vulnerable endpoints quicker. So it's about how fast they can move, which is scary because we can say as much as we want to say Security by obscurity is not a thing, but security by obscurity is a thing. And unless we take a really strong stance against it, then we're going to be bit in the ass by these attackers that now don't have people constraints in doing fully autonomous recon. The other thing that I'm worried about is dedicated or dedicated crafted malware that does not have signatures.

[B]

Okay, I want to get into both of those, but my first question for you would be what does that AI assisted or agentic attack look like at scale? I've tried to look back at some of the big attacks in the past and imagine a world where they weren't human capacity constrained. And it's unsettling for me to think about that. But like walk through that for me,

[A]

I think one is once you're in the crosshair of an attacker, then the enumeration and discovery of the endpoints that allow entry into your environment is going to be very fast and very thorough. And then the attempt to hijack those endpoints is going to be very fast and very far. Probably noisy at start, which is where we have some level of ferocity, maybe speed of ferocity of them going and accessing data and taking that data away and exfiltrating is something that we've never seen before. And you have seen like living off the land type of attacks where people were trying to install OpenClaw on devices after they breached them, but OpenClaw that they managed. So getting to persistency through AI, which is also very, very interesting.

[B]

So Asaf, one of the things that you may have noticed, and I certainly have, and it's counterintuitive to, to think this way, I think, is that there's a lot of focus on AI and I think that that is warranted. On the other hand, have we pulled so much of our focus away from some of the basics that seem like we need to be able to go in and deal with the discipline and grit work that isn't all that sexy and new, but needs to be done such that the attack that you're talking about isn't so deep. Damned easy.

[A]

Yes, yes, thank you for that. We need to say this more. The best solution, two good solutions for AI attacks. One is minimization. If it doesn't need to be on the Internet, it shouldn't be on the Internet. If it doesn't need to be on the endpoint, it doesn't need to be on the endpoint. If it doesn't need to be in a package, in the source repo, it shouldn't be there. And we have been in a world where we're maximizing things. We need to minimize, we need to reduce the attack surface to a point where the attack is not possible, not get to the point where we're trying to defend a growing attack surface. And the other is baseline boring architecture. We need to do identity, right, we need to do data, right. We need to do scoping, right. We need to do network segmentation, right. We need to do recovery bcp. Right. And these are hard things. And we've been glossing as an industry, we've been glossing over them with mitigating controls and good enough and all of the. There is no good enough anymore because what we're doing is even worse than attackers using AI. We're putting AI on top of broken mechanisms. So we're putting a non deterministic engine on top of a broken deterministic architecture that can go and do whatever it wants. And our ability to control a non deterministic engine is very, very low right now. Until we get into the world where there is runtime security for the AI solutions that we provide to our customers, there has to be very strong architectural guardrails on the bottom. And if we put on an AI agent on bad identity infrastructure, it will find a way through prompt injection, through other means, through I don't know, to get to the data that it wants to get to or the attacker wants to get to using our own bad infrastructure. So completely agree with you. There is in my mind, a whole resurgence of being brilliant at the basics.

[B]

Yeah, I mean, sometimes this idea of if everyone's going to zig, it's time to zag and a lot of oxygen is used up worrying about a version of a problem that we see coming and then we're distracted from the problem that we have. You know, this security debt, technical debt, whatever you want to call it, where that's just sitting there. And I think you've said publicly that when you bring an AI tool into your environment, you have less slack. I think that was what you're just describing and that you can't skip the steps. And I know you mentioned some of them, but I want to, I want to hammer home on this. What steps do most organizations skip and which one of those exposures do you think is going to end up being the one that haunts organizations the most?

[A]

Identity. Identity is probably the hardest, especially in product. If you're a SaaS company or if you're even consumer, company identity is probably the hardest piece in a lot of Places Identity was homegrown years ago, Customer identity was homegrown years ago. And there are best practices there. And there is not a lot of people that know how to build it right. And if people miss identity, that's the baseline structure for everything else.

[B]

Years ago a CISO told me that there are three rails and the third rail is identity. In any CISO's job, and I want to say data was one piece and network was another. But like those were not the ones that if you touched them, the business would zap you. It was identity because you had three, four different identity systems. Some of them worked for the executive owner. They didn't all work together and they certainly didn't work well for security. And it seems like now we're at a point where that being the third rail as a mental model for a security leader, it has to flip around. It has to be the first thing that you're looking at and getting right and getting right really quickly or you remained exposed.

[A]

The second is data, by the way. Like it's very close. Second. Yeah, but identity, I would go after identity first.

[B]

So I know a lot of security leaders are being asked to make decisions about AI risk faster than guidelines can be issued or updated as things change. What does good judgment actually look like in this environment where the threat intelligence on AI is drafted? Maybe it's being written, it's coming. And over the weekend, out of a user group who felt the need to put something together, right, this stuff is not tried, true, tested, public comments are done. Right. It's, it's really fresh. How, how do you operate?

[A]

It's also changing very quickly. Yeah, it's also changing very quickly on the, on a, on an ongoing basis. So what you've done a week ago can change next week because new model, new capability, new thinking. I think that going back to basic principles is important. What are we trying to solve? Where are we trying to solve it? I think that being realistic about the risk is important and understanding because we as a community, we have a tendency to over exaggerate risk because we don't understand it because it's changing so fast. Because it's this new thing and there is hero on fire and people running around when industry that is steeped in FUD and we need to fight it also we need to understand that it's not going away. I know security leaders that in 2023 said, yeah, yeah, this will be a fad, will go away. No, no, it's not going away. This is part of the future. We need to lean into it and not way around. I think when we try to block the business from using AI, we're creating more risk than value. We need to sit and create mechanisms in place to allow the business to use AI in a secure and reliable manner, knowing that we're taking risks. But we need to enable the business to use AI. We need to build guardrails around that. Now, there isn't a lot of enterprise software that is there yet that is doing all of the things that we need to do. So we're going to need to do a mix of vendors or a mix of internally built stuff and a mix of externally built stuff and open source and stuff like that. But building the guardrails to make us feel good about or better not good about where we are from a risk perspective is important. So in a lot of places, what I'm hearing from peers is that use AI to use AI, because the board said use AI, which is a wrong framing for that conversation. You use AI to get to an outcome that is a better outcome with AI. And so I think what we've managed to do internally is say, hey, we want to do these things. We want to automatically triage all of our SOC incidents with AI, or we want to do vulnerability triage with AI, or we want to do questionnaires, customer questionnaires with AI to free up people so that our people can do bigger and better things. Those are really important outcomes. But I don't feel the push on, oh, just use AI for AI sake. It's kind of like you said something that I'm fortunate about.

[B]

Yeah, you know, don't go for the next job title because it's the next job title. Right. Like it doesn't make sense to apply that logic on using AI, especially when it is a tool for an outcome, not the outcome itself. Let's just say that a security leader is listening right now and they're not sure how exposed their organization really is. Maybe they heard you say that we are over indexing on the risks and hopefully that's true for them. But they're trying to figure out where to start, what's the first thing they need to do.

[A]

So two lenses to this. This is the internal AI exposure. People are using AI or products using AI within the constraints of their organization. And then the attackers when we talk about the internal piece is get an understanding of usage because you're going to trust some vendors and you're not going to trust other vendors. And this is very similar to what we've had when the cloud came in you're going to need to make decisions on which vendors or which hyperscalers or AI vendors you're going to trust or which SaaS companies you're going to trust and which SaaS companies you're not going to trust or which upscales you're not going to trust because you don't think they have the right controls in place or they have the right structures in place, or they're responsible enough. Not responsible enough. There are a lot of different ways to skin that cat, but understanding usage is extremely important and starting to build guardrails on that usage. And if you're building your own models, if nothing else, you can go do ISO 4201. But if nothing else, look at the NIST AI risk management framework and start looking at how you build your model inventory and how you build your model risk scorecard, which is extremely important. And try to at least publish it internally so that people understand the different risks in using different models. Bias, ethics, Operational risk, not operational risk. These are baseline things. So that's what I would say for the internal risk, for the external risk. Attackers using AI to attack companies, I would ask where are the places where you can be much faster if you utilize automation? Go and automate with AI. Without AI, I don't care. But go and automate. Where are the places where you can be better? If you are reducing attack surface and you can do it fast, go and do that. Start building both speed and reduction of the attack surface as soon as you can because those are the things that are going to save you. The other things are.

[B]

Yeah, Attack Surface Diet.

[A]

Attack surface Diet. I like that. I'm going to use that.

[B]

Yeah, he got it.

[A]

I do.

[B]

I'm stealing Brilliant on the basics from you.

[A]

Yeah, Well, I stole it from a guy called Shishi Vananda that was my boss in PayPal, so let's go. I think he stole it from a guy called Wassamo. That was our head officere. I do a weekly post to my extended leadership team. So Attack Surfer's Diet is going on the next one.

[B]

I mean, it's good practice and it's maybe now required practice. Get your attack surface on a healthy diet. Shrink down, man.

[A]

Attack surface Calorie counting.

[B]

Yeah. Get that beachbody Attack surface before summer.

[A]

Summer is coming.

[B]

Yeah, yeah, there you go. AI, Summer is coming quick. I want to end on hopefully a positive note, Right? You've written this book about what it takes to lead in this field long term. You're watching everything that's going on with AI, right? Now, is there anything that gives you confidence that defenders may come out ahead in this era?

[A]

Yeah. To steal a quote from Phil Venables, I'm a short term pessimist, long term optimist. I think that the next couple of years are going to be either hilarious or daunting, depending on who you are. But I think in the end this technology is so exciting that we're going to be able to do something that we've been trying to do for years and years and years unsuccessfully, which is to free up people to do people work and not to do manual labor tasks. And we're going to have. We're already at the deficiency of the amount of people in the profession. And people are burning out because they need to handle incidents on a day by day basis or copy paste answers into questionnaires or do third party risk management things that, that don't bring value but are part of the process. And we're going to be able to automate a lot of these processes and reduce the amount of time people are actually doing stuff like vuln triage or incident triage and have them work on the larger picture that it's going to be much easier. Not easier, it's going to be much more exciting to be a security professional in two years than it is right now because you're going to work on big picture stuff more than you are today. And I think that that's exciting. And I think we will get ahead of the curve. We need to adopt the technology as fast as attackers. That will not happen. So that's why we have two years of catching up. Do I think we'll catch up in the end?

[B]

So I've been trying to think about the future and what it might look like. And I found this image of a 1920s potato farm. And there were laborers and digging and working in the field. And then I contrasted this with a vertical hydro farm. And they are as far apart worldwide as jobs go. They're both farms. But I do wonder, are we in a moment where we are laboring and digging and trying to keep that potato farm going and we're going to transform into one where it's a controlled environment, we have incredible productivity, some level of, you know, small team being able to handle that vertical farm of the future for security? And I'm hopeful for that. Right. And I look at the potential. But I think that the first thing that has to happen is we think differently about those basics, those fundamentals. We go on that attack surface diet, we put together, you know, a different model that allows us to control the environment and flourish rather than try to work harder and longer and not have much effect. So I'm hopeful and I like to hear that you think that it's going to be two years and we're through it. Given the time lately. Maybe it's two, maybe it's two months, maybe it's two years.

[A]

Yeah, we'll see.

[B]

We'll see. Asaf, thanks for the great conversation today. I really appreciate you sharing your perspective on AI in the wrong hands, but also letting me get a glimpse of your path, your art, your wife's art. Folks, SAF's written a new book, Lessons on the Front Line Insights From a Cybersecurity Career. It's published by Wiley, it's out and available. We'll have a link in the show Notes along with the blog that you mentioned earlier. And I appreciate you coming on Threat Vector today and having this conversation with me.

[A]

Thank you very much. Appreciate it was a lot of fun.

[B]

That's it for today. If you like what you've heard, please subscribe wherever you listen and leave us a review on Apple Podcast or Spotify. Those reviews and your feedback really do help me understand what you want to hear about. If you want to reach out to me directly about the show, email me at threatvectoraloaltonetworks.com I want to thank our executive producer, Michael Heller. Original mix and music by Elliot Peltzman. We'll be back next week. Until then, stay secure, stay vigilant. Goodbye for now.

[A]

Sam.