Podcast Episode 66

Episode 066 31 min

AI Expert Michal Pechoucek: How AI Is Targeting Your Mind Now

with Michal Pechoucek

0:00 / 31:00

Also on Spotify, Apple Podcasts, YouTube, Podbean, Player FM

Episode 66 of The Security Podcast of Silicon Valley, published April 8, 2025 and recorded in October 2024. Hosts Jon McLachlan and Sasha Sinkevich, co-founders of YSecurity, talk with Michal Pechoucek, an AI professor at the Czech Technical University in Prague, founder director of its Artificial Intelligence Center and a venture partner at Evolution Equity Partners at the time of the recording. Michal explains why AI security isn't new, starting with his first startup, Cognitive Security, which used machine learning on NetFlow network data and was bought by Cisco, and lays out the four kinds of AI security problems he sees: AI-powered attacks, attacks on AI systems, software built with AI, and cyber warfare moving from computers to people's cognition. They cover MITRE ATLAS, a thought experiment about regulating social networks in 2000, the EU AI Act and what it costs European innovation, why AI security has to think ahead, behavioral data, the gap between AI progress and AI safety investment, one-year and ten-year horizons, why no deepfake detector stays ahead, who you're talking to on a video call, AI-created reality, the five people closest to you, a rumor about TikTok in China, black boxes, transparency and choice, closed platforms, education, investing in AI safety, chatbot search and freedom, Google as a verb, what-if data, the Turing Award he didn't win, and a billion-dollar fund for the climate. About 31 minutes.

Episode notes

AI is no longer just writing code or generating images—it’s shaping how we think.

In this episode, we sit down with AI researcher, professor, and investor Michal Pechoucek to explore how artificial intelligence is shifting from targeting systems to targeting human cognition. Michal outlines four emerging threats that are redefining AI security and explains why deepfakes, behavioral data, and black-box models are putting trust itself at risk.

We also discuss the growing gap between AI innovation and AI safety, how China is approaching behavioral data, and what this shift means for founders, defenders, and the future of digital trust.

Hosted by Jon McLachlan and Sasha Sinkevich — co-founders of YSecurity.

The deep dive

Cyber warfare is moving to people's cognition

Michal Pechoucek, AI professor at the Czech Technical University and an investor with Evolution Equity, with Jon and Sasha on why AI security isn't new, a startup that found attackers in NetFlow data, the four kinds of AI security problems, ATLAS, a software shift as big as the web and the cloud, attacks on what people think, regulating social networks in 2000, the EU AI Act, thinking ahead, behavioral data, the safety investment gap, why deepfakes scare him most, who are you on a video call, AI-created reality, the five people closest to you, TikTok in China, black boxes, transparency and choice, closed platforms, education, investing in AI safety, chatbot search and freedom, what-if data, a Turing Award, and a billion-dollar fund for the climate.

Episode 66 of The Security Podcast of Silicon Valley aired on April 8, 2025, with Jon McLachlan and Sasha Sinkevich hosting. The guest was Michal Pechoucek (Pěchouček in Czech), an AI researcher, professor and investor (Podbean). His first line set the tone.

“And thank you for pronouncing my name with such precision.”

Michal Pechoucek, at 0:17

Jon’s introduction covered the three hats he wore at the time.

“For all of our listeners, Michal is a venture partner at Evolution Equity Partners.”

Jon McLachlan, at 0:23

“You’re the founder director of the Artificial Intelligence Center there, as well as an AI professor in the Department of Computer Science.”

Jon McLachlan, at 0:35

Listen · Jon McLachlan on episode 66, from 0:21
About 30 seconds: Jon introduces Michal: Evolution Equity, the Czech Technical University and a long list of angel investments. The clip stops on its own. Read the full transcript.

His LinkedIn fills in the dates. He founded the Artificial Intelligence Center at the Faculty of Electrical Engineering of the Czech Technical University in Prague in 2000 and directed it until January 2026, he has been a professor in its computer science department since 2009, and he was a venture partner at Evolution Equity Partners from 2017, a partner from January 2025, and a venture partner again since January 2026 (LinkedIn). Evolution’s team page lists him as a partner (Evolution Equity Partners). He also co-founded prg.ai, a nonprofit initiative to make Prague a significant European AI hub, and chaired its executive board from 2019 to 2026 (prg.ai, LinkedIn).

The Czech Wikipedia adds his training and the industry years. He studied technical cybernetics at the Czech Technical University, earned a master’s in artificial intelligence at the University of Edinburgh in 1996 and a doctorate back in Prague, and spent five years as chief technology officer, at Avast from 2019 and then at Gen Digital until 2024 (Wikipedia). Gen Digital is the company Avast joined when it merged with NortonLifeLock in September 2022, now co-headquartered in Tempe, Arizona, and Prague, with Norton, Avast, LifeLock and AVG among its brands (Wikipedia, Wikipedia). And since February 1, 2026 he has been the rector of the Czech Technical University, after the academic senate nominated him in October 2025 (Wikipedia). The university is one of the oldest institutes of technology in Central Europe (Wikipedia).

The conversation was recorded in October 2024, six months before it aired. The tape fits: Michal calls California’s failed AI bill recent news, and the governor vetoed it on September 29, 2024 (Wikipedia).

This page is the rest of it: a section for each part of the conversation with the sources beside it, sixteen figures, twenty-five clips from the tape, the full transcript, and five tools: a quiz, a scorecard for whether your AI security thinks ahead, a calculator for how much of your AI budget goes to safety, a timeline from 1996 to 2027, and a to-do list.

A note before the sections. Michal speaks English as a second language and thinks out loud, so a few lines on the tape are hard to hear. Where the decodes disagree, the transcript marks its best guess in brackets, and the page doesn’t quote those lines. When he passes on something he has heard rather than knows, like how TikTok works in China, the page says so.

Thank you for pronouncing my name with such precision

Jon’s answer to the thank-you was the show’s rule for names.

“You know, it’s the least that we can do.”

Jon McLachlan, at 0:21

The rest of the introduction was a list. Jon pointed at Michal’s angel investments and advisor roles, and his LinkedIn shows how long it is: an investor in GetReal, the deepfake-protection company, since March 2025, an angel investor and advisor in several startups since 2019, and a co-founder and board member of Blindspot Solutions from 2014 to 2026 (LinkedIn). The thread through all of it is the one he named later in the episode: using AI and making it safe.

Three outlined boxes for Michal's roles at the recording: Evolution Equity, venture partner from 2017. The AI Center, founded in 2000, directed to 2026. Czech Technical University, professor since 2009. An arrow points down to a filled box: rector of the Czech Technical University, since February 1, 2026, nominated by the academic senate in October 2025. A list of other roles: chief technology officer at Avast from 2019, then at Gen Digital until 2024. Co-founder of prg.ai, the Prague AI initiative, and chair of its executive board from 2019 to 2026. Co-founder and board member of Blindspot Solutions, 2014 to 2026. Investor and technical advisory board member at GetReal, the deepfake-protection company, since March 2025. Jon's line at 0:23: For all of our listeners, Michal is a venture partner at Evolution Equity Partners.
Three hats at the recording, and the rector's chair since.

AI security is not as new topic as it may sound

Jon opened with the obvious question about a field that changes every week. What comes to mind when you think about security and AI?

“This is an exciting question because, in my opinion, and when it comes to my experience, AI security and security and AI is not as new topic as it may sound.”

Michal Pechoucek, at 1:18

“For fact, the attackers have been using AI for a long time, I will even say a decade plus.”

Michal Pechoucek, at 1:31

And defenders, he said, have a tradition of their own. His proof was his own first company.

“One of my first startups that I started with my PhD students was Cognitive Security.”

Michal Pechoucek, at 1:48

Listen · Michal Pechoucek on episode 66, from 1:48
About 40 seconds: Michal on Cognitive Security, machine learning on network data, and the exit to Cisco. The clip stops on its own. Read the full transcript.

Cognitive Security came out of his research group at the university, with his doctoral student Martin Rehák, in work funded in part by the US Army, according to the Czech Wikipedia (Wikipedia). The idea, in Michal’s telling, was to borrow machine learning techniques from computer vision and point them at NetFlow, the network data. NetFlow is the feature Cisco introduced on its routers around 1996 to record IP traffic as it enters or leaves an interface, so administrators can see who talks to whom (Wikipedia). The target was the kind of intruder an advanced persistent threat describes: a stealthy attacker, often state-backed, who gets into a network and stays undetected for a long time (Wikipedia).

“It was very successful. We were able to exit in Cisco and be able to service millions of customers with this technology.”

Michal Pechoucek, at 2:11

Cisco’s list of acquisitions dates the deal to January 29, 2013, filed under cyber threat protection, Czech Republic (Wikipedia). Michal dates the start to 2008, which makes his “15 years back” about right for a conversation in 2024.

Three boxes joined by arrows: computer vision, machine learning techniques. NetFlow data, records of network traffic. Persistent threats, intruders who stay hidden, filled. Below, a timeline. Around 1996, NetFlow: Cisco introduces the feature on its routers to record IP traffic in and out of an interface. 2008, Cognitive Security starts: Michal and his PhD students, by his account on the tape. 2013, Cisco buys it: January 29, 2013, filed under cyber threat protection, Czech Republic. Michal's line at 2:11: It was very successful. We were able to exit in Cisco and be able to service millions of customers with this technology.
Cognitive Security, by Michal's account and the public record: machine learning on NetFlow data, and a Cisco exit in 2013.

Four different things

Then he laid out the field as he sees it now.

“And I see AI security as kind of four different things.”

Michal Pechoucek, at 2:36

The first is attackers using AI.

“The most important one is AI-powered attacks, and us as defenders to be able to sustain AI-powered attacks.”

Michal Pechoucek, at 2:41

He named the techniques: game theory, automated reasoning and large models, used to design malicious payloads that are hard to detect. Game theory is the mathematics of strategic interaction between players, and automated reasoning is the branch of AI that lets programs reason on their own (Wikipedia, Wikipedia). The second is attackers going after the AI itself, the third is what AI does to the way software gets built, and the fourth, the one closest to his own work, is attacks on people’s minds. The next three sections take them one at a time.

Listen · Michal Pechoucek on episode 66, from 2:37
About 35 seconds: Michal's first of four: AI-powered attacks, built with game theory, automated reasoning and large models. The clip stops on its own. Read the full transcript.
Four boxes in a grid. 1, AI-powered attacks: malware designed with AI to be hard to detect. 2, attacks on AI systems: a net new class of cybersecurity problems. 3, AI-built software: a software change as big as the internet. 4, filled, attacks on people's cognition: the closest to his own expertise. Notes: attackers' tools he named are game theory, automated reasoning and large models. In the first three, he can imagine technologists working shoulder to shoulder against attackers, as they have for 30 years. In the fourth, deepfakes, he says he doesn't have an answer. Michal's line at 2:36: And I see AI security as kind of four different things.
Michal's four kinds of AI security problems, the last one the closest to his expertise.

We wrote about the first one in AI cyberattacks are going autonomous, and about attackers and defenders using the same tools in AI agents are now on both sides of the breach.

A net new class of cybersecurity problems

The second problem is attackers attacking our AI systems.

“AI systems are becoming a very, very important part of the software supply chain.”

Michal Pechoucek, at 3:24

“And to be able to protect the AI systems, it is like a net new class of cybersecurity problems.”

Michal Pechoucek, at 3:37

A software supply chain is every component, library, tool and process that goes into building and publishing a piece of software (Wikipedia), and a model is now one of those components. Michal pointed to how the field’s standard reference responded. MITRE, the not-for-profit that runs federally funded research centers for the US government, released ATT&CK in 2013 as a way to classify and describe cyberattacks (Wikipedia, Wikipedia). Alongside it, MITRE built ATLAS, which it describes as a living knowledge base of adversary tactics and techniques involving AI, from attacks on AI-enabled systems to misuse of AI capabilities. As of November 2026, its site lists 16 tactics, 221 techniques, 44 mitigations and 77 case studies (MITRE ATLAS).

“So kind of big, big stuff and very important.”

Michal Pechoucek, at 3:57

Adversarial machine learning, the study of attacks on machine learning and the defenses against them, is the research field under ATLAS (Wikipedia). Prompt injection is its most famous example today: inputs crafted so a language model can’t tell a developer’s instructions from a user’s (Wikipedia). Our AI Product Red Teaming team tests AI features this way, and episode 65 with Yaron Singer of Robust Intelligence goes deep on why models break under small changes.

Two boxes. Outlined: ATT&CK, MITRE, released 2013, for cyberattacks. Filled: ATLAS, MITRE's knowledge base for attacks involving AI. Four numbers for ATLAS: 16 tactics, 221 techniques, 44 mitigations, 77 case studies. Notes: attacks against AI-enabled systems, and misuse of AI capabilities, as ATLAS describes its scope. Adversarial machine learning: the research field that studies attacks on machine learning and the defenses against them. Prompt injection: inputs crafted so a language model can't tell a developer's instructions from a user's. Michal's line at 3:37: And to be able to protect the AI systems, it is like a net new class of cybersecurity problems.
ATT&CK classifies attacks on computers. ATLAS does the same for attacks involving AI.

A massive software change

The third problem is the one every engineering team is living through.

“The third one is the fact that we are using AI in building software systems is changing the software system as such.”

Michal Pechoucek, at 4:02

“And from my perspective, this is a massive software change, similar software change as we saw when computers got connected through the internet.”

Michal Pechoucek, at 4:13

Listen · Michal Pechoucek on episode 66, from 4:02
About 40 seconds: Michal on AI-built software as the next paradigm shift, after the internet, web apps, the cloud and mobile. The clip stops on its own. Read the full transcript.

Each shift he listed brought its own class of bugs. Web applications, built on web technologies and run in a browser, emerged in the late 1990s (Wikipedia). Cloud computing put shared, elastic resources behind network access (Wikipedia). Mobile apps moved software onto phones, tablets and watches (Wikipedia). Defenders caught up with each one after the fact. Michal’s point is that AI-written software is the same kind of shift, and the vulnerabilities are coming whether or not anyone has named them yet.

“Again, AI security piece.”

Michal Pechoucek, at 4:47

We wrote about the practical side in how to stop AI agents from shipping vulnerable code, and our Secure AI SDLC & Engineering work is built for teams writing software this way.

Five boxes in a row joined by arrows: the internet, computers connect. Web apps, late 1990s. The cloud, shared resources. Mobile, phones and tablets. AI-built code, the next shift, filled. Under each of the first four, a dashed box: new bugs, after the fact. Under AI-built code, a filled box: new bugs, coming. Michal's lines: at 4:13, And from my perspective, this is a massive software change, similar software change as we saw when computers got connected through the internet. At 4:47, Again, AI security piece.
Every paradigm shift in software created new vulnerabilities, and Michal puts AI-built software in the same line.

To people’s cognition

The fourth problem was the one he cared about most, the one closest to his own work.

“the fact that cyber warfare is moving big times from computers, desktops, mobile devices, network, cloud, to people’s eyes, to people’s cognition, to what people think, what people do online, how people behave, what actions people execute.”

Michal Pechoucek, at 4:58

“The precision and the scale and the availability and the cost of the human-centered attacks is just unprecedented.”

Michal Pechoucek, at 5:24

Listen · Michal Pechoucek on episode 66, from 4:58
About 35 seconds: Michal on cyber warfare moving from computers to people's cognition. The clip stops on its own. Read the full transcript.

Security already has words for the old version. Social engineering is using psychological pressure to get people to act or hand over information, and phishing is its most common form (Wikipedia). What’s new is the cost: Wikipedia’s phishing article now notes that large language models can automate personalized phishing at low cost (Wikipedia). The military word for the bigger version is information warfare, manipulating information a target trusts so the target decides against its own interest without knowing it (Wikipedia). Michal’s list runs from the eyes to the actions, which is the whole chain from what someone sees to what someone does.

Two lists with an arrow between them. From: computers, desktops, mobile devices, network, cloud. To: people's eyes, people's cognition, what people think, what people do online, how people behave, what actions people execute. Below, three boxes for the older words: social engineering, pressure that gets people to act. Phishing, its most common form. Information warfare, the military word for it. Notes: large language models can now automate personalized phishing at low cost, as Wikipedia's phishing article notes. Michal's line at 5:24: The precision and the scale and the availability and the cost of the human-centered attacks is just unprecedented.
Where the attacks land: from machines to people's eyes, cognition and actions.

Would you agree with AI regulation?

That brought him to the question people ask him most.

“Often people ask me, would you agree with AI regulation?”

Michal Pechoucek, at 5:49

He knows it’s a controversial topic in Silicon Valley, he said, and he pointed at California, where an AI bill had just failed on the governor’s desk. The bill was SB 1047, the Safe and Secure Innovation for Frontier Artificial Intelligence Models Act. It would have required developers of the largest models, those costing more than $100 million to train, to assess risks before release, and it would have protected whistleblowers. California’s governor vetoed it on September 29, 2024, saying a rule based only on a model’s computing size ignored whether a model is deployed somewhere risky (Wikipedia). Michal answered with a thought experiment from Europe.

“And I often say, imagine in 2000, when there would be a regulation that somebody would say, you know, in the future, there’s going to be this thing, a social network.”

Michal Pechoucek, at 6:06

Listen · Michal Pechoucek on episode 66, from 5:49
About 40 seconds: Michal's thought experiment: a rule written in 2000 for social networks that didn't exist yet. The clip stops on its own. Read the full transcript.

The imagined rule would have banned political campaigning on those networks. His verdict on it was blunt.

“I think it’d be a great piece of regulation, but at the time, we didn’t know, so we didn’t regulate.”

Michal Pechoucek, at 6:24

The example he didn’t need to name is Cambridge Analytica, the British political consulting firm founded in 2013 that became known through the Facebook data scandal (Wikipedia). His conclusion was a modest one: we still don’t understand the full implications of adopting AI, so it’s only fair for people to try to regulate and protect.

Three boxes joined by arrows: a dashed box, imagine 2000, a rule for networks to come. An outlined box, ban political campaigning on those networks. A filled box, a great piece of regulation, but nobody knew to write it. Below, a timeline. 2013, Cambridge Analytica: the British political consulting firm later known for the Facebook data scandal is founded. September 29, 2024, SB 1047 vetoed: California's frontier AI bill, aimed at models costing more than $100 million to train, fails on the governor's desk. October 2024, the recording: Michal calls the veto recent news, and says it's only fair for people to try to regulate and protect. Michal's line at 6:24: I think it'd be a great piece of regulation, but at the time, we didn't know, so we didn't regulate.
Michal's thought experiment, and the 2024 bill that didn't pass.

Regulate ourselves from a leading edge innovation

Sasha picked up the European side, the EU AI Act.

“You guys went a little bit further and a little bit faster, making sure that AI systems are not in a position to make decisions that will influence people’s lives, whereas it’s not the case everywhere else in the world.”

Sasha Sinkevich, at 6:52

“This is correct.”

Michal Pechoucek, at 7:07

Then he named the cost, as a European. The disadvantage of the European approach, he said, is that Europe will likely regulate itself out of leading-edge innovation,

“which kind of goes against the advancement of the European AI sector and innovation as such.”

Michal Pechoucek, at 7:18

Listen · Sasha Sinkevich on episode 66, from 6:48
About 40 seconds: Sasha on the EU AI Act, and Michal on what it costs European innovation. The clip stops on its own. Read the full transcript.

The AI Act entered into force on August 1, 2024, two months before the recording. It sorts AI into four risk levels, unacceptable, high, limited and minimal, plus a category for general-purpose AI, and bans the unacceptable ones outright, including social scoring of people by public or private actors. Its provisions phase in: six months for the bans, 12 months for general-purpose AI, 24 months for most of the rest, and 36 months for some high-risk obligations. Breaking the bans can cost up to €35 million or 7% of worldwide turnover (Wikipedia). Our AI EU Compliance Program helps companies that sell into Europe work through it.

Four stacked boxes, narrow at the top: unacceptable risk, banned, social scoring among them, filled. High risk. Limited risk. Minimal risk. Beside them, a dashed box: general-purpose AI, a category of its own. Below, the schedule. August 1, 2024, in force, two months before the recording. February 2025, six months: the bans apply. August 2025, 12 months: the rules for general-purpose AI apply. August 2026, 24 months: most of the remaining provisions are set to apply. August 2027, 36 months: some high-risk obligations. A large figure: 35 million euros or 7% of worldwide turnover, the most a breach of the bans can cost. Michal's line at 7:18: which kind of goes against the advancement of the European AI sector and innovation as such.
The EU AI Act's risk levels and the schedule that started two months before the recording.

In AI security, we need to think ahead

Michal drew the line between the two fields.

“AI security is a very special kind of discipline in cybersecurity, because in cybersecurity, we as defenders are very responsive.”

Michal Pechoucek, at 7:26

“While in AI security, we need to think ahead.”

Michal Pechoucek, at 7:43

Listen · Michal Pechoucek on episode 66, from 7:26
About 30 seconds: Michal on why AI security has to think ahead. The clip stops on its own. Read the full transcript.

Thinking ahead means guessing what the technology will become, how it can be misused, and what guardrails to build before anyone needs them. That’s hard, he said, because people disagree about the future itself.

“Somebody argues that the future is going to be very safe and effective.”

Michal Pechoucek, at 8:10

Somebody else presents a doom perspective, he went on, and the argument doesn’t stay technical.

“it’s also kind of getting political.”

Michal Pechoucek, at 8:19

Europe, the US and China worry about different futures, he said, and that is the key difference from cybersecurity as we know it. The field that works on this is AI safety, which covers preventing accidents, misuse and other harmful consequences of AI, and includes alignment, the work of steering AI systems toward the goals people intend (Wikipedia, Wikipedia).

Two boxes. Outlined: cybersecurity, defenders are very responsive. Below it: an attack shows up, then defenders respond, as defensive and as responsive as they can be. Filled: AI security, defenders need to think ahead. Below it: what the technology implies, how it can be misused, how it can evolve, which guardrails and defenses to build for the future. Two dashed boxes for views of the future: very safe and effective, and a doom perspective. Notes: Europe, the US and China worry about different futures, he said, so the argument gets political. Michal's line at 7:43: While in AI security, we need to think ahead.
Cybersecurity responds. AI security has to think ahead.

AI will be asking for behavioral data

Michal gave one example of thinking ahead, and it was about data.

“I would say kind of one of the future examples is going to be kind of the data, the data piece, because AI as it’s trained today is drawing out the data.”

Michal Pechoucek, at 8:34

“And believe me, AI will be asking for behavioral data, data about how things happen, what is going on, trying to understand and predict behavior”

Michal Pechoucek, at 8:46

Listen · Michal Pechoucek on episode 66, from 8:33
About 35 seconds: Michal on the coming hunt for behavioral data. The clip stops on its own. Read the full transcript.

China is ahead, he said, because it has been collecting this kind of data for years.

“They’ve been collecting behavioral data for ages.”

Michal Pechoucek, at 9:06

The public record is more careful than the popular picture. Wikipedia describes China’s social credit system as a broad governance strategy to track businesses, individuals and government institutions, and notes widespread misconceptions about a single national score that rewards and punishes people (Wikipedia). The commercial version is closer to home. Surveillance capitalism is the term for the widespread collection and commodification of personal data by companies, which grew out of advertising (Wikipedia). Michal’s twist is who will want the data next.

“not necessarily against people, but against machines”

Michal Pechoucek, at 9:18

That’s the privacy problem he expects AI security to inherit: protecting behavior from machines that are excited to understand it. The EU AI Act already bans one use of behavioral data outright, social scoring of people by public or private actors (Wikipedia). We wrote about tracking what data reaches which model in the AI data bill of materials, and our Training Data PII & Secret Scrubbing team keeps personal data out of the models you train.

This symmetry doesn’t exist

Then Michal said where he stands, which is not where a reader of the last few sections might expect.

“I’m a techno-optimist, right?”

Michal Pechoucek, at 9:27

“I really want AI to kind of grow as quickly as we can”

Michal Pechoucek, at 9:30

Hard societal problems need it, he said. The problem is the money around it. In cybersecurity, spending on defense grew alongside the attacks.

“Hence, we’ve got this big cybersecurity sector that is well funded, but it’s protecting the world from cyber attacks.”

Michal Pechoucek, at 9:55

“This symmetry doesn’t exist in AI development”

Michal Pechoucek, at 10:02

“And then the investment in AI safety is minimalistic in comparison, right?”

Michal Pechoucek, at 10:16

Listen · Michal Pechoucek on episode 66, from 9:41
About 40 seconds: Michal on why spending on AI safety hasn't kept pace with AI the way security spending kept pace with attacks. The clip stops on its own. Read the full transcript.

His fix is simple to state: investment in AI safety and security should be proportional to AI progress. He gave no numbers on the tape, so the calculator below lets you put in your own.

Two bar pairs with no numbers. Cybersecurity: attacks and security spending, about the same height, grew together. AI: a tall bar for AI progress and a short filled bar for AI safety spending, minimalistic in comparison. Michal's lines: at 9:55, Hence, we've got this big cybersecurity sector that is well funded, but it's protecting the world from cyber attacks. At 10:02, This symmetry doesn't exist in AI development.
Michal's asymmetry: security spending grew with the attacks, and AI safety spending hasn't grown with AI.

One-year horizon or ten-year horizon

Sasha offered a reason for the gap.

“It’s perhaps, it’s reward driven. At the moment, there is a lot more reward attached to pushing the technology forward and not really paying attention to what potentially should be considered as equally important.”

Sasha Sinkevich, at 10:32

Michal turned it into a question of time. The horizon, he said, is very important.

Listen · Sasha Sinkevich on episode 66, from 10:31
About 40 seconds: Sasha on rewards, and Michal on one-year and ten-year horizons. The clip stops on its own. Read the full transcript.

Do we think in one-year horizons or ten-year ones? He argued for more focus on the long term, because the near term pays so well.

“We can take a massive advantage and massive yields out of AI in the near future”

Michal Pechoucek, at 11:00

The risk, he said, is driving ourselves into huge problems in the midterm. Sasha noted the same pattern shows up over and over in things we do as humans, and Michal agreed.

“Yeah, I agree.”

Michal Pechoucek, at 11:22

Give the good guys an unfair advantage

Jon ran back through the four problems before going on: AI-powered attacks, attackers attacking AI systems, AI changing how we build, and cyber warfare moving into the human space, which he called just kind of scary. Then he said what he likes about the work.

“And I love thinking through ways to give the good guys an unfair advantage.”

Jon McLachlan, at 11:59

“And I’m sure that’s what you look for”

Jon McLachlan, at 12:05

That’s an investor’s question, and Michal answered it later, in Seen as an overhead.

Give me a deepfake and I can build you a detector

Jon’s recap set up the question Michal had been waiting for.

“If you ask me what out of those four is the problem that kind of worries me the most, where I can see that I don’t have an answer”

Michal Pechoucek, at 12:10

The first three, he said, he can imagine technologists fighting shoulder to shoulder against attackers, the way defenders have for 30 years. The fourth is different.

“in the space of deepfakes, I’m actually really scared, because I’m seeing this from a scientific perspective”

Michal Pechoucek, at 12:33

“give me a deepfake and I can build you a detector. Give me a detector that is unbeatable by next deepfake. It’s impossible.”

Michal Pechoucek, at 12:40

Listen · Michal Pechoucek on episode 66, from 12:39
About 30 seconds: Michal on why no detector stays ahead of the next deepfake. The clip stops on its own. Read the full transcript.

That’s the arms race in two sentences. A deepfake is an image, video or audio clip edited or generated with AI, a form of synthetic media, and an audio deepfake is a voice clone that says things a real person never said (Wikipedia, Wikipedia). Every detector teaches the next generator what to avoid. Michal’s answer isn’t a better detector. It’s investment, creativity, infrastructure and trust, built on the inside,

“to minimize the impact of deepfakes and manipulated reality.”

Michal Pechoucek, at 13:02

“I think this is very hard. It’s going to be very hard.”

Michal Pechoucek, at 13:08

We made the same argument in deepfake attacks keep working because we keep detecting instead of proving, and episode 92 with Jasson Casey of Beyond Identity makes the case that identity, not detection, is the boundary. For the detection side, listen to Ben Colman of Reality Defender on episode 71.

Three boxes joined by arrows: a deepfake, image, video or a cloned voice. A detector, built to catch it. The next deepfake, trained to beat it, filled. A dashed arrow loops back to the detector: and again. A dashed box: a detector the next deepfake can't beat, impossible, in Michal's words. Two lists. What he'd put in instead: investment, creativity, infrastructure building, trust creation on the inside. What works on a call today: a call back to a number you already have, a shared secret, a second person who approves the transfer. Michal's line at 12:40: give me a deepfake and I can build you a detector. Give me a detector that is unbeatable by next deepfake. It's impossible.
Give me a deepfake and I can build a detector. A detector the next deepfake can't beat doesn't exist.

Who are you?

Jon put the problem in everyday terms.

“I guess, in some sense, we’ve had this problem for a long time.”

Jon McLachlan, at 13:11

“And we have this idea in our head that, like, oh, if we jump on a Zoom, I can see you, I can hear you, you’re talking like a human being, but now a machine can do all of those things too.”

Jon McLachlan, at 13:21

Listen · Jon McLachlan on episode 66, from 13:10
About 20 seconds: Jon on the old question of who you're talking to, and why seeing and hearing someone no longer answers it. The clip stops on its own. Read the full transcript.

Seeing and hearing someone used to answer the question. It doesn’t anymore, which is why the practical defenses move to channels a cloned voice or face can’t reach: a call back to a number you already have, a shared secret, a second person who approves the transfer.

AI-created reality

Michal said his own view had changed.

“I thought that the biggest problem of society are the AI and recommendation systems”

Michal Pechoucek, at 13:41

A recommender system filters what each person sees, and on social media it’s what people mean when they say “the algorithm.” It analyzes behavior and preferences to build a personalized feed (Wikipedia). The worry he described is a filter bubble, the intellectual isolation that comes from algorithms choosing what each user sees (Wikipedia). Even three years earlier, he said, he would have called that the biggest problem of AI on the internet. Not anymore.

“There are things that are even more scary than AI-driven life on the internet, and this is AI-created reality.”

Michal Pechoucek, at 14:09

Listen · Michal Pechoucek on episode 66, from 13:41
About 40 seconds: Michal on why AI-created reality scares him more than recommendation systems. The clip stops on its own. Read the full transcript.

A recommender picks from what exists. Generative AI makes new things, text, images, video, audio and code, from patterns in its training data (Wikipedia), so a feed can be filled with content made for one viewer.

Left: a grid of twelve outlined squares with one filled, and an arrow to a circle for the viewer: recommendation picks from what exists. A recommender filters what each person sees, the thing people call the algorithm. A filter bubble is the isolation that comes from algorithms choosing for you. Right: a box, a generator trained on patterns, with an arrow to a new filled square and on to the viewer: generative AI makes new text, images, video, audio and code from patterns in its training data, so a feed can be filled with content made for one viewer. Michal's line at 14:09: There are things that are even more scary than AI-driven life on the internet, and this is AI-created reality.
Recommendation picks from what exists. AI-created reality makes what you'll see.

The sum of the five people

Jon pushed on it with a saying.

“You’ve heard that saying, maybe, that you’re the sum of the five people that you keep closest to you.”

Jon McLachlan, at 14:20

“But do you think we’ll move into a world where, like, one or two of them will become an AI”

Jon McLachlan, at 14:27

An AI model fine-tuned for you, he meant, one that helps you lead a better life. Michal tied it back to his point.

“but recommendation to kind of created stuff.”

Michal Pechoucek, at 14:44

“Yeah, this is quite likely.”

Michal Pechoucek, at 14:47

Then he passed on something he had heard, and said so.

“I don’t know whether it’s true or rumor”

Michal Pechoucek, at 14:51

The rumor is that TikTok works differently in China.

“That in China, TikTok recommenders are more recommending educational videos”

Michal Pechoucek, at 14:58

Listen · Michal Pechoucek on episode 66, from 14:49
About 25 seconds: Michal on a rumor about TikTok in China, and what educational recommendations could turn into. The clip stops on its own. Read the full transcript.

In Europe and the US, he said, the recommendations favor short, disruptive, erratic content. Here is what the record does say. TikTok is blocked in mainland China, where ByteDance runs Douyin instead, and the two share an interface but operate separately (Wikipedia). Wikipedia doesn’t say what either one recommends, so the educational claim stays a rumor, as Michal said it was. His real point was about the future: educational content can be constructed too, and sometimes it can be misleading, or train you in skills someone else wants you to have.

It’s just a tool

Jon took the optimistic side.

“We’re optimistic about this, right?”

Jon McLachlan, at 15:39

“So I imagine, like, those tools can be used and deployed for good if there’s a conscious choice”

Jon McLachlan, at 15:44

His example was a life coach that keeps track of exercise, food and time, and nudges you toward being more productive and building closer relationships with people. If a thing does that, why not let it? The key word in his version is choice, and it’s the word Michal came back to in Transparency and choice.

LLMs are essentially black boxes

Sasha raised the catch.

“However, it’s a lot more complex tool than a hammer or something that I can understand by looking at it.”

Sasha Sinkevich, at 16:10

“LLMs are essentially black boxes, and you don’t really know what went into the composition of that black box.”

Sasha Sinkevich, at 16:19

Listen · Sasha Sinkevich on episode 66, from 16:10
About 40 seconds: Sasha on black boxes, and who controls the data that goes into them. The clip stops on its own. Read the full transcript.

We put a lot of trust in the output of a function we can’t see inside, Sasha said, and then came the question that matters for security.

“who controls the data input that goes into the training”

Sasha Sinkevich, at 16:38

In science and engineering, a black box is a system you can only see through its inputs and outputs, and in AI it means a model whose workings are opaque even to the people using it (Wikipedia). A large language model is a model trained on a vast amount of text to generate language, which is the part Sasha was asking about: whose text (Wikipedia).

Transparency and choice

Michal’s answer had two parts.

“One is transparency, and the second one is choice.”

Michal Pechoucek, at 16:51

“I kind of need to know what is going on”

Michal Pechoucek, at 16:58

How the software is constructed, what data it was trained on, and why it suggests what it suggests. He acknowledged that not everybody wants that, and then made the case that transparency alone isn’t enough.

“what good does explainability give me if I cannot choose, right?”

Michal Pechoucek, at 17:31

“And choices have been removed from us lately.”

Michal Pechoucek, at 17:36

Listen · Michal Pechoucek on episode 66, from 16:57
About 40 seconds: Michal on the two things he needs from AI: transparency and choice. The clip stops on its own. Read the full transcript.

Explainable AI is the research field that gives people intellectual oversight of AI decisions, the reasoning behind a prediction, against the black-box tendency in which even a model’s designers can’t say why it decided something (Wikipedia). Michal’s point is that an explanation you can’t act on doesn’t give you much.

Two boxes. Outlined: transparency, know what is going on. Below it: how the software is constructed, what data it was trained on, why it suggests what it suggests. Filled: choice, pick who you trust. Below it: pick one security product over another, the way customers once did. Take your security expectations from one product to another. Dashed: on social networks, impossible today, the platforms are closed. Then explainability without a choice, with an arrow to a dashed box: doesn't give you much, an explanation you can't act on. Michal's lines: at 17:31, what good does explainability give me if I cannot choose, right? At 18:16, These days, it's impossible. Platforms are closed.
Michal's two needs, and why explainability without choice isn't enough.

Platforms are closed

He gave the security version. In the past, a customer could pick one security product over another because they trusted one brand more. On social platforms, that choice is gone.

“Why there is not an independent new cybersecurity firm that is focused only on scamming social media?”

Michal Pechoucek, at 18:03

“And me as a customer, I cannot choose who is protecting my life on social networks.”

Michal Pechoucek, at 18:11

“These days, it’s impossible. Platforms are closed.”

Michal Pechoucek, at 18:16

Listen · Michal Pechoucek on episode 66, from 17:53
About 30 seconds: Michal on closed platforms and why nobody can pick who protects them on social networks. The clip stops on its own. Read the full transcript.

It’s very difficult, he said, to take your security expectations from one product to another.

“So I don’t have the choice.”

Michal Pechoucek, at 18:24

Part of that gap has been filled from the outside in. Episode 5 with Leigh Honeywell of Tall Poppy is about protecting employees from online harassment, the personal security a whole industry skipped. Sasha closed the thought with a line about the platforms themselves.

“But they tell us to trust them, and that sounds good enough.”

Sasha Sinkevich, at 18:37

Michal agreed.

If you’re not paying for the product

Jon added the business side of the data question.

“one of the interesting things about LLMs and data is not just, like, the transparency and giving us the choice, but the value from a company’s perspective of data has just gone through the roof”

Jon McLachlan, at 18:46

“if you’re not paying for the product, maybe you are the product.”

Jon McLachlan, at 19:11

Michal tied it back to his TikTok point and then to his day job. The answer, he said, is education: people trained to be inquisitive, to dig deep,

“and kind of questioning and asking for reasons”

Michal Pechoucek, at 19:29

Jon said he was happy that the younger people he talks to are asking those questions, and Michal said that’s the best part of his work.

“To me, kind of being a university professor is the most exciting part of the job.”

Michal Pechoucek, at 19:47

“these days we are underestimating some of the problems that this generation is not underestimating, and they will remind us in the future.”

Michal Pechoucek, at 20:01

“Yes, they will. I hear, like, I told you so coming here pretty soon.”

Jon McLachlan, at 20:10

Listen · Michal Pechoucek on episode 66, from 19:47
About 25 seconds: Michal on teaching, and the generation that will say I told you so. The clip stops on its own. Read the full transcript.

Seen as an overhead

Sasha asked the question every security leader gets in the budget meeting.

“In general, when we talk within a business with leadership teams about security and compliance subjects, often they are seen as an overhead.”

Sasha Sinkevich, at 20:15

“However, it’s very important that we structure the dialogue such that it’s not seen as an overhead, but rather as a core component of the system and of the product that we are delivering into the market.”

Sasha Sinkevich, at 20:27

How does Michal make the case that research and development matters, but so do the consequences of doing it wrong? He answered as an investor.

“So one remark I want to make is that as an investor, we just are investing for the purpose of generating returns, right?”

Michal Pechoucek, at 20:54

“And you can generate return while solving important societal problems.”

Michal Pechoucek, at 21:11

“And I chose to kind of invest in AI, and mainly in AI, in such a way that I’m focused on problems that would reduce risks of AI explosion.”

Michal Pechoucek, at 21:16

Listen · Michal Pechoucek on episode 66, from 21:15
About 35 seconds: Michal on investing in AI safety and security, and why he feels it's his duty. The clip stops on its own. Read the full transcript.

Then he said why.

“And this is partly because I’m an AI scientist for the last 30 years.”

Michal Pechoucek, at 21:29

“And even though I haven’t invented anything related to LLMs, I still feel I’ve contributed to the AI progress”

Michal Pechoucek, at 21:35

“it’s my duty to kind of think about the negative consequences”

Michal Pechoucek, at 21:43

Five months after the recording he put money behind that, as an investor and technical advisory board member at GetReal (LinkedIn), a company that sells real-time protection against deepfakes and AI-powered identity attacks and counts Evolution Equity among its backers (LinkedIn). Sasha’s question has a practical answer too. Security stops looking like overhead when it closes deals, which is the work of our vCISO Services, and we wrote about the AI questions buyers now ask in the 10 AI security questions your first enterprise buyer will ask.

It all boils down to the UX

Sasha liked the answer and offered a theory of how security gets adopted.

“I love that answer. We believe that it all boils down to the UX, the user experience.”

Sasha Sinkevich, at 21:53

“But once you roll up your sleeves and come up with a solution that is elegant and solves a very specific pain point, everyone wants it.”

Sasha Sinkevich, at 22:10

Michal agreed and took it further. We’re entering a phase, he said, where the work is composition: taking great capabilities other people built and delivering them in the most seamless, safest and most natural way to the user. Better interfaces will increase the adoption of AI. Then he named the catch.

“Unfortunately, there is also a silver lining, which is some of the interfaces can be not such a great thing.”

Michal Pechoucek, at 23:03

His example was search, and asking a chatbot instead.

“it’s easy, it’s nice, it’s elegant.”

Michal Pechoucek, at 23:16

“this type of interface precisely removed some freedom”

Michal Pechoucek, at 23:22

Listen · Michal Pechoucek on episode 66, from 23:22
About 30 seconds: Michal on how chatbot search took away the freedom of doing your own research. The clip stops on its own. Read the full transcript.

When you did the research yourself, it was more laborious, but you got better results,

“because you were able to moderate the result”

Michal Pechoucek, at 23:35

and you could catch the hallucinations yourself. A hallucination is a response from AI that presents false or misleading information as fact (Wikipedia). A chatbot is software built to hold a conversation, and today’s are mostly built on fine-tuned large language models (Wikipedia). That’s the reason, he said, he’s excited about AI safety and security: every AI-enabled chatbot has negative consequences that come with wider adoption.

Two columns. Outlined: your own research, you search, and you read. Filled: asking a chatbot, easy, nice, elegant. Four rows. Effort: more laborious, versus easy. Results: better results, in his view, versus you type a question, it tells you. Control: you moderate the result, versus some freedom removed. Errors: you remove hallucinations yourself, versus false answers can arrive as fact. Michal's lines: at 23:22, this type of interface precisely removed some freedom. At 23:35, because you were able to moderate the result.
Doing your own research versus asking a chatbot: what you gain, and the freedom you give up.

It almost became a verb

Jon agreed and reached for the last time this happened.

“almost became a verb to know how to use them effectively.”

Jon McLachlan, at 24:49

He meant Google, and the search engines that came with it. To google became a transitive verb for searching the web. The American Dialect Society chose it as the most useful word of 2002, and it was added to the Oxford English Dictionary on June 15, 2006 (Wikipedia). Jon expects the same thing to happen again.

“I think maybe we’ll see very similar new skills develop, like, around the way that we interact with this new type of LLM interface”

Jon McLachlan, at 25:01

“It seems to be reading the entire internet, like, six or seven times over.”

Jon McLachlan, at 25:22

Listen · Jon McLachlan on episode 66, from 24:44
About 30 seconds: Jon on Google becoming a verb, and the new skills an LLM interface will need. The clip stops on its own. Read the full transcript.

And then, he said, we put security layers in front of it, behind it, on top of it and on the side.

What-if data

Michal came back to data, with a prediction.

“we are entering the era of new families of data.”

Michal Pechoucek, at 25:35

The first family is the one he’d already described: behavioral data, about what is happening and what people are doing, and even the causalities behind events. The second is new.

“I actually see there is another class of data it’s coming, and this is the what-if data, data about things that didn’t happen or things that may happen.”

Michal Pechoucek, at 25:54

“So I actually think that there is this new huge era of kind of AI simulation”

Michal Pechoucek, at 26:03

Listen · Michal Pechoucek on episode 66, from 25:55
About 30 seconds: Michal on what-if data and an era of AI simulation. The clip stops on its own. Read the full transcript.

Synthetic data is the established term for the nearest thing: data generated by algorithms rather than real events, used to validate and train models (Wikipedia). Michal’s version goes further, into simulators that tell us what happens if things happen. And he named a third family, from software itself: AI running programs, analyzing how they behave and suggesting new ways to program, so that generated software stops being only an aggregation of human knowledge.

“the data that is coming from execution”

Michal Pechoucek, at 27:12

That, he said, is a new vector of data that will feed the next generation of models.

Three boxes with arrows down to one filled box. Behavioral data: what happens, what people do. What-if data, filled: what didn't or may happen. Execution data: from AI running software. All three feed the next generation of models, a new vector of data, in his words. Notes: behavioral data includes the causalities behind events, and China, he says, has been collecting it for years. What-if data comes from simulators that tell us what happens if things happen, an era of AI simulation. Execution data comes from AI running programs and analyzing how they behave, so generated software stops being only an aggregation of human knowledge. Michal's line at 25:54: I actually see there is another class of data it's coming, and this is the what-if data, data about things that didn't happen or things that may happen.
Michal's new families of data: behavioral, what-if and execution.

I didn’t win a Turing Award

Jon asked his closing question: if you could meet your younger self, what would you say? Michal’s first answer was the obvious one.

“a recommendation to do less things and focus more.”

Michal Pechoucek, at 28:09

Then he thought about it and changed his mind.

“At the same time, I didn’t win a Turing Award, right? Which I regret very much.”

Michal Pechoucek, at 28:26

Listen · Michal Pechoucek on episode 66, from 28:03
About 30 seconds: Michal on the advice he'd give his younger self, and the Turing Award he didn't win. The clip stops on its own. Read the full transcript.

The Turing Award is the Association for Computing Machinery’s annual prize for lasting contributions to computer science, often called the Nobel Prize of computing (Wikipedia). A hardcore career in one narrow discipline might have won it. He wouldn’t trade.

“I did enjoy kind of collecting a dissimilar experience that the life was there to offer me.”

Michal Pechoucek, at 28:47

What he tells others is the opposite of what he did, and he knows it.

“So I’m actually advising people to focus more and to go deeper”

Michal Pechoucek, at 29:11

“That’s an incredibly compassionate answer for yourself, for your younger self.”

Jon McLachlan, at 29:27

A billion-dollar fund

Jon’s last question was what Michal wishes someone would build.

“So if I would kind of sit on a billion-dollar fund”

Michal Pechoucek, at 30:14

“I’ll be kind of really kind of helping a scientific discovery”

Michal Pechoucek, at 30:22

Listen · Michal Pechoucek on episode 66, from 30:14
About 30 seconds: Michal on a billion-dollar fund for climate science. The clip stops on its own. Read the full transcript.

Discovery for the climate, he said, even though it’s not a trendy topic these days.

“I still think that we owe it to the generation of young leaders that is coming”

Michal Pechoucek, at 30:31

His reason was timing: it’s easier to do this work now than in ten years. Present-day climate change is driven by human activities, especially burning fossil fuels, and the atmosphere now holds roughly 50% more carbon dioxide than at the end of the pre-industrial era (Wikipedia).

After the tape

Michal’s titles changed. In January 2025 he became a partner at Evolution Equity Partners, and in March 2025 he joined GetReal as an investor and technical advisory board member (LinkedIn). On October 22, 2025 the Czech Technical University’s academic senate nominated him for rector, and he took office on February 1, 2026 (Wikipedia). He is a venture partner at Evolution again and chairs the board of the Artificial Intelligence Center he founded (LinkedIn).

On the EU AI Act’s own schedule, the bans applied six months after it took effect, the general-purpose AI rules at 12 months, and most of the rest at 24 months, in August 2026, with some high-risk obligations set for 36 months (Wikipedia). And in September 2026 he wrote about AI in science, where he expects AI to speed up grand discoveries and wants scientists to keep their agency.

humans need to stay in control as much as possible

Michal Pechoucek · September 12, 2026
Michal on why he signed a statement about AI in mathematics: AI will speed up discovery, and scientists have to keep the ability to choose their problems and understand the answers. View on LinkedIn.

It’s the same argument he made on the show, aimed at a different field: grow AI as fast as you can, and keep people in a position to choose.

A timeline. October 2024, the recording: two months into the AI Act, soon after California's veto. January 2025, partner: Michal becomes a partner at Evolution Equity Partners. February 2025, the bans apply: six months into the AI Act, social scoring among them. March 2025, GetReal: he joins the deepfake-protection company as an investor and technical advisory board member. April 8, 2025, episode 66 airs on Podbean, Apple Podcasts and Spotify. August 2025, general-purpose AI: the 12-month mark for the AI Act's rules. October 22, 2025, nominated rector by the Czech Technical University's academic senate. January 2026, a new mix of roles: venture partner at Evolution again, and he chairs the board of the AI Center he founded. February 1, 2026, rector: he takes office at the head of the university. August 2026, most of the AI Act: the 24-month mark for most of the remaining provisions. September 12, 2026, AI in science: his post on keeping scientists' agency as AI speeds up discovery. August 2027, high-risk obligations: the 36-month mark, set for some of the Act's high-risk rules. Michal on LinkedIn, September 12, 2026: humans need to stay in control as much as possible.
After the tape: new roles for Michal, the AI Act's schedule, and his post on AI in science.

Did you catch it? A six-question quiz

Six questions from the episode. Each answer links the moment in the transcript.

Quiz · six questions

Did you catch it?

Pick an answer for each. The explanation shows once you choose.

  1. Which company bought Michal's first startup, Cognitive Security?

    1. Cisco
    2. Avast
    3. MITRE

    a. "It was very successful. We were able to exit in Cisco and be able to service millions of customers with this technology." Transcript, 2:11.

  2. How many kinds of AI security problems does Michal lay out?

    1. Two
    2. Three
    3. Four

    c. "And I see AI security as kind of four different things." Transcript, 2:36.

  3. Which of them worries him the most?

    1. Attackers going after AI systems
    2. Deepfakes and attacks on people's minds
    3. AI-written software

    b. "in the space of deepfakes, I'm actually really scared, because I'm seeing this from a scientific perspective" Transcript, 12:33.

  4. What two things does Michal say he needs from AI?

    1. Speed and scale
    2. Transparency and choice
    3. Privacy and a lower price

    b. "One is transparency, and the second one is choice." Transcript, 16:51.

  5. What new class of data does he expect?

    1. What-if data
    2. Dark data
    3. Metadata

    a. "I actually see there is another class of data it's coming, and this is the what-if data, data about things that didn't happen or things that may happen." Transcript, 25:54.

  6. Which award does Michal say he regrets not winning?

    1. The Nobel Prize
    2. The Fields Medal
    3. The Turing Award

    c. "At the same time, I didn't win a Turing Award, right? Which I regret very much." Transcript, 28:26.

Is your AI security thinking ahead?

Michal’s line between the two fields is that cybersecurity responds and AI security has to think ahead. Eight questions on which side your company is on.

Scorecard · eight questions

Is your AI security thinking ahead?

Answer for how your company works today. If two answers fit, pick the lower one.

  1. Do you know which AI models and AI features your company uses, and what data reaches each one?

    • Not really
    • For the tools we bought, not the ones people brought
    • Yes, a written inventory we keep current

    "who controls the data input that goes into the training" See LLMs are essentially black boxes.

  2. If a familiar voice or face asks for money, credentials or access, does your team confirm it on a second channel first?

    • No, we'd trust a call from the boss
    • For wire transfers only
    • Yes, a written callback rule for money and access

    "give me a deepfake and I can build you a detector. Give me a detector that is unbeatable by next deepfake. It's impossible." See Give me a deepfake and I can build you a detector.

  3. Do you threat-model your AI features against attacks on the AI itself, with a framework like MITRE ATLAS?

    • No
    • Informally, when something new ships
    • Yes, and we test the findings

    "And to be able to protect the AI systems, it is like a net new class of cybersecurity problems." See A net new class of cybersecurity problems.

  4. Does code written with AI get the same review and testing as code people write?

    • It ships if it runs
    • Some of it gets reviewed
    • Yes, the same gates for all code

    "And from my perspective, this is a massive software change, similar software change as we saw when computers got connected through the internet." See A massive software change.

  5. Does your security training cover AI-written phishing, cloned voices and fake video calls?

    • No
    • Phishing only
    • Yes, with examples people have actually seen

    "The precision and the scale and the availability and the cost of the human-centered attacks is just unprecedented." See To people's cognition.

  6. Do you know which AI rules apply in the markets you sell into, like the EU AI Act?

    • Not yet
    • For our home market
    • Yes, for every market we sell into

    "You guys went a little bit further and a little bit faster, making sure that AI systems are not in a position to make decisions that will influence people's lives, whereas it's not the case everywhere else in the world." See Regulate ourselves from a leading edge innovation.

  7. Do you collect only the behavioral data you need, and keep it away from models that don't need it?

    • We collect everything, just in case
    • We try to
    • Yes, and we check what each model can see

    "not necessarily against people, but against machines" See AI will be asking for behavioral data.

  8. Does your security budget grow when your AI budget does?

    • No
    • Sometimes, after an incident
    • Yes, we plan them together

    "And then the investment in AI safety is minimalistic in comparison, right?" See This symmetry doesn't exist.

Very responsive

You're defending the way cybersecurity always has, after the fact. This month, write down which AI tools you use and what data reaches them, and set a callback rule for any request for money or access.

A one-year horizon

The basics are in place. Next, threat-model your AI features with ATLAS, review AI-written code like any other, and train people on cloned voices and AI-written phishing.

Thinking ahead

You're building guardrails before you need them. Keep the security budget in step with the AI budget, track the AI rules in each market, and red-team your AI features before your customers do.

How much of your AI budget goes to safety?

Michal’s fix for the asymmetry is to keep spending on AI safety and security in proportion to AI progress. He gave no numbers, so this calculator uses yours. Every default here is our example, not a benchmark.

Calculator

How much of your AI budget goes to safety?

Three numbers: what you spend on AI in a year, the share of it that goes to AI security and safety today, and the share you'd want.

–$ thousands a year today
–$ thousands a year at your target
–$ thousands a year to close the gap
–$ thousands a month

At $500K a year on AI, 2% is $10.0K for AI security and safety. At 10% it would be $50.0K, a gap of $40.0K, or about $3.3K a month.

Michal gave no numbers on the tape. The $500,000, the 2% and the 10% are our examples, not benchmarks. Put in your own.

From NetFlow to the AI Act and after

Everything on this page sits on one timeline, from NetFlow in the 1990s to the last AI Act deadline in 2027. Filter it by thread.

Timeline · 1996 to 2027

From NetFlow to the AI Act and after

Filter by thread. Dates are from the public record except where marked as Michal's account or part of this show.

  1. NetFlow

    Cisco introduces the traffic-recording feature on its routers (Wikipedia, on this show).

  2. Edinburgh

    Michal earns a master's in artificial intelligence at the University of Edinburgh (Wikipedia, on this show).

  3. Web applications

    Software that runs in a browser emerges, the first of the shifts Michal lists (Wikipedia, on this show).

  4. The Artificial Intelligence Center

    Michal founds it at the Czech Technical University and directs it until 2026 (LinkedIn, on this show).

  5. To google

    The American Dialect Society names it the most useful word of the year (Wikipedia, on this show).

  6. Associate professor

    In the university's Department of Cybernetics (LinkedIn, on this show).

  7. Google, the verb

    Added to the Oxford English Dictionary (Wikipedia, on this show).

  8. Cognitive Security

    Michal and his doctoral students start the company, by his account on the tape (on this show).

  9. Professor

    In the computer science department, where he still teaches (LinkedIn, on this show).

  10. Cisco buys Cognitive Security

    Filed under cyber threat protection, Czech Republic (Wikipedia, on this show).

  11. ATT&CK

    MITRE releases its way to classify and describe cyberattacks (Wikipedia, on this show).

  12. Cambridge Analytica

    The political consulting firm behind the Facebook data scandal is founded (Wikipedia, on this show).

  13. Douyin

    ByteDance launches the Chinese app that runs separately from TikTok (Wikipedia, on this show).

  14. Evolution Equity Partners

    Michal becomes a venture partner (LinkedIn, on this show).

  15. prg.ai

    He co-founds the initiative to make Prague a European AI hub and chairs its executive board (prg.ai, on this show).

  16. Avast

    He becomes chief technology officer, later at Gen Digital until 2024 (Wikipedia, on this show).

  17. Gen Digital

    NortonLifeLock completes its merger with Avast and takes the name Gen Digital (Wikipedia, on this show).

  18. The EU AI Act

    Enters into force, with its provisions phasing in over six to 36 months (Wikipedia, on this show).

  19. SB 1047 vetoed

    California's governor vetoes the frontier AI bill (Wikipedia, on this show).

  20. The recording

    Jon and Sasha talk with Michal, soon after the veto (on this show).

  21. Partner

    Michal becomes a partner at Evolution Equity Partners (LinkedIn, on this show).

  22. The bans apply

    The six-month mark, when the AI Act's prohibited practices, social scoring among them, take effect (Wikipedia, on this show).

  23. GetReal

    He joins the deepfake-protection company as an investor and technical advisory board member (LinkedIn, on this show).

  24. Episode 66 airs

    On Podbean, Apple Podcasts and Spotify (Podbean, on this show).

  25. General-purpose AI

    The 12-month mark, when the AI Act's rules for general-purpose AI apply (Wikipedia, on this show).

  26. Nominated rector

    By the Czech Technical University's academic senate (Wikipedia, on this show).

  27. Rector

    Michal takes office at the head of the university (Wikipedia, on this show).

  28. Most of the AI Act

    The 24-month mark, when most of the remaining provisions are set to apply (Wikipedia, on this show).

  29. AI in science

    Michal writes about keeping scientists' agency as AI speeds up discovery (LinkedIn, on this show).

  30. ATLAS

    MITRE's AI knowledge base lists 16 tactics, 221 techniques and 77 case studies (MITRE, on this show).

  31. High-risk obligations

    The 36-month mark, set for some of the AI Act's high-risk rules (Wikipedia, on this show).

What to do this week

Five things, in the order the episode suggests.

  1. Find out how far ahead you’re looking. Take the scorecard with whoever owns security and whoever owns AI, and compare answers.
  2. Write a callback rule. Any request for money, credentials or access that arrives by voice or video gets confirmed on a second channel you already trust. No detector is a substitute, as Michal said.
  3. List what data reaches which AI. One page: every AI tool and feature in use, and the data each one can see. Our guide to shadow AI governance has a starting point.
  4. Threat-model one AI feature, and price the gap. Walk one AI feature through MITRE ATLAS, then run the calculator on what fixing it would take.
  5. Get help with the parts you can’t staff. Our AI Product Red Teaming team tests AI features the way attackers would, our AI EU Compliance Program maps you to the AI Act, our Corporate Shadow-AI Detection & Mitigation team finds the AI tools already in use, and you can book 15 minutes with us.

Key takeaways

  1. AI security isn't new

    Attackers have used AI for more than a decade, and so have defenders. Michal's first startup, Cognitive Security, used machine learning from computer vision to find attackers in network data, and Cisco bought it.

  2. Four kinds of AI security problems

    AI-powered attacks, attacks on AI systems, AI changing how software is built, and attacks that move from computers to people's cognition, the one closest to Michal's own work.

  3. Models are part of the supply chain

    AI systems are becoming an important part of the software supply chain, which makes protecting them a net new class of cybersecurity problems. MITRE answered with ATLAS, next to ATT&CK.

  4. AI-built software is a paradigm shift

    Michal compares it to computers connecting through the internet, web apps, the cloud and mobile. Each shift created new vulnerabilities that defenders had to answer.

  5. The attack surface is now human

    Cyber warfare is moving from devices, networks and the cloud to what people see, think and do, and AI makes human-centered attacks precise, scalable, available and cheap.

  6. Regulating what doesn't exist yet

    A rule written in 2000 to ban political campaigning on social networks would have been great regulation, but nobody knew. Michal thinks people should try to regulate and protect while AI's implications are still unclear.

  7. Europe's trade-off

    The EU AI Act went further and faster to keep AI from deciding things about people's lives, and Michal worries Europe will regulate itself out of leading-edge innovation.

  8. AI security has to think ahead

    Cybersecurity responds to attacks. AI security has to anticipate the technology's implications, misuse and evolution, and build guardrails first, even though people disagree about the future.

  9. Behavioral data is next

    AI will ask for data about how things happen and how people behave. Michal expects privacy problems where the threat isn't people but machines eager to understand behavior.

  10. Safety spending should match AI progress

    Security spending grew in parallel with cyberattacks. Investment in AI safety hasn't kept pace with AI, and Michal wants it proportional to AI progress.

  11. Look past the near term

    The near-term yields from AI are massive, which is why Michal wants more focus on the long-term horizon, so we don't drive ourselves into huge problems in the midterm.

  12. No detector stays ahead

    Give him a deepfake and he can build a detector, but a detector the next deepfake can't beat is impossible. What helps is investment, creativity, infrastructure and trust built on the inside.

  13. AI-created reality is the bigger worry

    Three years earlier, Michal saw recommendation systems as society's biggest AI problem. Now he finds content created by AI even more scary.

  14. Transparency needs choice

    Michal wants to know how AI is built, what it was trained on and why it suggests what it suggests, and he wants the freedom to choose, because explainability without choice doesn't help.

  15. Easy interfaces can remove freedom

    Chatbot search is easy, nice and elegant, but doing your own research let you moderate the results and remove hallucinations yourself.

  16. Returns and duty can line up

    As an investor, Michal looks for returns that also reduce the risks of AI. As an AI scientist for 30 years, he sees thinking about AI's negative consequences as his duty.

  17. New families of data

    Beyond behavioral data, Michal expects what-if data from AI simulators and data from AI executing programs to feed the next generation of models.

Chapters

Tap a chapter to play from there.

Pull quotes

“Hello, everyone, and welcome to another episode of the Security Podcast of Silicon Valley.”

Jon McLachlan ·

“And thank you for pronouncing my name with such precision.”

Michal Pechoucek ·

“You know, it's the least that we can do.”

Jon McLachlan ·

“For all of our listeners, Michal is a venture partner at Evolution Equity Partners.”

Jon McLachlan ·

“You're the founder director of the Artificial Intelligence Center there, as well as an AI professor in the Department of Computer Science.”

Jon McLachlan ·

“And on your LinkedIn, you have an amazing list of angel investments and advisor roles that you've taken with several startups.”

Jon McLachlan ·

“You know, AI is breaking ground left and right. It's difficult to keep up with the rate of change.”

Jon McLachlan ·

“This is an exciting question because, in my opinion, and when it comes to my experience, AI security and security and AI is not as new topic as it may sound.”

Michal Pechoucek ·

“For fact, the attackers have been using AI for a long time, I will even say a decade plus.”

Michal Pechoucek ·

“One of my first startups that I started with my PhD students was Cognitive Security.”

Michal Pechoucek ·

“It was very successful. We were able to exit in Cisco and be able to service millions of customers with this technology.”

Michal Pechoucek ·

“And I see AI security as kind of four different things.”

Michal Pechoucek ·

“The most important one is AI-powered attacks, and us as defenders to be able to sustain AI-powered attacks.”

Michal Pechoucek ·

“The second big problem is attackers attacking our AI systems.”

Michal Pechoucek ·

“AI systems are becoming a very, very important part of the software supply chain.”

Michal Pechoucek ·

“And to be able to protect the AI systems, it is like a net new class of cybersecurity problems.”

Michal Pechoucek ·

“The third one is the fact that we are using AI in building software systems is changing the software system as such.”

Michal Pechoucek ·

“And from my perspective, this is a massive software change, similar software change as we saw when computers got connected through the internet.”

Michal Pechoucek ·

“That was a massive change. It created new vulnerabilities.”

Michal Pechoucek ·

“the fact that cyber warfare is moving big times from computers, desktops, mobile devices, network, cloud, to people's eyes, to people's cognition, to what people think, what people do online, how people behave, what actions people execute.”

Michal Pechoucek ·

“The precision and the scale and the availability and the cost of the human-centered attacks is just unprecedented.”

Michal Pechoucek ·

“Often people ask me, would you agree with AI regulation?”

Michal Pechoucek ·

“I think it'd be a great piece of regulation, but at the time, we didn't know, so we didn't regulate.”

Michal Pechoucek ·

“You guys went a little bit further and a little bit faster, making sure that AI systems are not in a position to make decisions that will influence people's lives, whereas it's not the case everywhere else in the world.”

Sasha Sinkevich ·

“which kind of goes against the advancement of the European AI sector and innovation as such.”

Michal Pechoucek ·

“AI security is a very special kind of discipline in cybersecurity, because in cybersecurity, we as defenders are very responsive.”

Michal Pechoucek ·

“While in AI security, we need to think ahead.”

Michal Pechoucek ·

“Somebody argues that the future is going to be very safe and effective.”

Michal Pechoucek ·

“So it's also kind of getting political.”

Michal Pechoucek ·

“And believe me, AI will be asking for behavioral data, data about how things happen, what is going on, trying to understand and predict behavior, also people's behavior, right?”

Michal Pechoucek ·

“China is ahead. They've been collecting behavioral data for ages.”

Michal Pechoucek ·

“I really want AI to kind of grow as quickly as we can, because we have hard societal problems that I believe can be resolved by future AI.”

Michal Pechoucek ·

“Hence, we've got this big cybersecurity sector that is well funded, but it's protecting the world from cyber attacks.”

Michal Pechoucek ·

“This symmetry doesn't exist in AI development”

Michal Pechoucek ·

“And then the investment in AI safety is minimalistic in comparison, right?”

Michal Pechoucek ·

“It's perhaps, it's reward driven.”

Sasha Sinkevich ·

“We can take a massive advantage and massive yields out of AI in the near future, but we may be driving ourselves into huge problems in the midterm.”

Michal Pechoucek ·

“And this pattern just shows over and over and over in things that we do as humans in general.”

Sasha Sinkevich ·

“And I love thinking through ways to give the good guys an unfair advantage.”

Jon McLachlan ·

“In the last one, in the space of deepfakes, I'm actually really scared, because I'm seeing this from a scientific perspective”

Michal Pechoucek ·

“Give me a detector that is unbeatable by next deepfake. It's impossible.”

Michal Pechoucek ·

“I think this is very hard. It's going to be very hard.”

Michal Pechoucek ·

“I guess, in some sense, we've had this problem for a long time.”

Jon McLachlan ·

“And we have this idea in our head that, like, oh, if we jump on a Zoom, I can see you, I can hear you, you're talking like a human being, but now a machine can do all of those things too.”

Jon McLachlan ·

“Even three years ago, I was thinking that the biggest problem of a society is different.”

Michal Pechoucek ·

“There are things that are even more scary than AI-driven life on the internet, and this is AI-created reality.”

Michal Pechoucek ·

“You've heard that saying, maybe, that you're the sum of the five people that you keep closest to you.”

Jon McLachlan ·

“Yeah, this is quite likely.”

Michal Pechoucek ·

“That in China, TikTok recommenders are more recommending educational videos, unlike in Europe and in the US, where the recommendation is kind of focused on short content, disruptive content, kind of erratic content.”

Michal Pechoucek ·

“So what if in the future the educational content is going to be constructed, and sometimes it can be misleading?”

Michal Pechoucek ·

“We're optimistic about this, right?”

Jon McLachlan ·

“However, it's a lot more complex tool than a hammer or something that I can understand by looking at it.”

Sasha Sinkevich ·

“LLMs are essentially black boxes, and you don't really know what went into the composition of that black box.”

Sasha Sinkevich ·

“We put a lot of trust into the output that is a result of a function that happens inside the black box.”

Sasha Sinkevich ·

“One is transparency, and the second one is choice.”

Michal Pechoucek ·

“I kind of need to know what is going on, how the software is constructed”

Michal Pechoucek ·

“what good does explainability give me if I cannot choose, right?”

Michal Pechoucek ·

“And choices have been removed from us lately.”

Michal Pechoucek ·

“And me as a customer, I cannot choose who is protecting my life on social networks.”

Michal Pechoucek ·

“These days, it's impossible. Platforms are closed.”

Michal Pechoucek ·

“But they tell us to trust them, and that sounds good enough.”

Sasha Sinkevich ·

“And it goes back to this idea that if you're not paying for the product, maybe you are the product.”

Jon McLachlan ·

“I actually think it goes back to education, that we should be trained to be inquisitive and kind of questioning and asking for reasons, and being trained so that we dig deep.”

Michal Pechoucek ·

“To me, kind of being a university professor is the most exciting part of the job.”

Michal Pechoucek ·

“Yes, they will. I hear, like, I told you so coming here pretty soon.”

Jon McLachlan ·

“In general, when we talk within a business with leadership teams about security and compliance subjects, often they are seen as an overhead.”

Sasha Sinkevich ·

“And you can generate return while solving important societal problems.”

Michal Pechoucek ·

“And this is partly because I'm an AI scientist for the last 30 years.”

Michal Pechoucek ·

“And even though I haven't invented anything related to LLMs, I still feel I've contributed to the AI progress, and it's my duty to kind of think about the negative consequences of the AI progress.”

Michal Pechoucek ·

“I love that answer. We believe that it all boils down to the UX, the user experience.”

Sasha Sinkevich ·

“Everyone knows there is a problem. Everyone wants to solve it.”

Sasha Sinkevich ·

“Unfortunately, there is also a silver lining, which is some of the interfaces can be not such a great thing.”

Michal Pechoucek ·

“But this type of interface precisely removed some freedom”

Michal Pechoucek ·

“When we build things, if they're not easy to understand, if they're not easy to use, if they're not solving problems that real people actually face, like, what are we doing?”

Jon McLachlan ·

“And just like when Google came out, and all of the search engines came out, it almost became a verb to know how to use them effectively.”

Jon McLachlan ·

“It seems to be reading the entire internet, like, six or seven times over.”

Jon McLachlan ·

“I think that we are entering the era of new families of data.”

Michal Pechoucek ·

“I actually see there is another class of data it's coming, and this is the what-if data, data about things that didn't happen or things that may happen.”

Michal Pechoucek ·

“So I'm actually thinking that the data that is coming from execution is a new vector of data”

Michal Pechoucek ·

“If you could go back in time and meet a younger version of yourself, would you?”

Jon McLachlan ·

“So I often think that maybe I would kind of give myself a recommendation to do less things and focus more.”

Michal Pechoucek ·

“At the same time, I didn't win a Turing Award, right? Which I regret very much.”

Michal Pechoucek ·

“So I'm actually advising people to focus more and to go deeper”

Michal Pechoucek ·

“That's an incredibly compassionate answer for yourself, for your younger self.”

Jon McLachlan ·

“It was a great discussion, and I really appreciate your empathetic questions and your kind of deep interest in my thoughts”

Michal Pechoucek ·

“Is there anything that doesn't exist that you wish someone just would just sit down and build, maybe with that sense of focus that you're talking about?”

Jon McLachlan ·

“Because even though it's not a trendy topic these days, I still think that we owe it to the generation of young leaders that is coming in 10 years from now.”

Michal Pechoucek ·

About the guest

Michal Pechoucek, Venture Partner, Evolution Equity Partners

Michal Pechoucek (Pěchouček in Czech) is an AI researcher, professor and investor. He founded the Artificial Intelligence Center at the Czech Technical University in Prague in 2000 and directed it until January 2026, has been a professor in its computer science department since 2009, and since February 1, 2026 has been the university's rector. He co-founded Cognitive Security, which Cisco bought in 2013, was chief technology officer at Avast and then Gen Digital from 2019 to 2024, and has been with Evolution Equity Partners since 2017, as a venture partner, as a partner from January 2025, and as a venture partner again since January 2026. He co-founded prg.ai and invests in GetReal, a deepfake-protection company.

About the host

Jon McLachlan and Sasha Sinkevich are co-founders of YSecurity, the on-demand cybersecurity team for startups, and of Cyberbase.ai. The Security Podcast of Silicon Valley is hosted by Jon McLachlan and Sasha Sinkevich. Jon McLachlan on LinkedIn ↗Sasha Sinkevich on LinkedIn ↗

Context and sources

  • Michal Pechoucek's LinkedIn experience: rector of the Czech Technical University since January 2026, professor in its computer science department since August 2009, founder and director of the Artificial Intelligence Center from May 2000 to January 2026 and chairman of its board since, venture partner at Evolution Equity Partners from March 2017, partner from January 2025 and venture partner again from January 2026, co-founder and chairman of prg.ai's executive board from 2019 to 2026, investor and technical advisory board member at GetReal since March 2025, and co-founder and board member of Blindspot Solutions from 2014 to 2026. Source ↗
  • The Czech Wikipedia on Michal Pěchouček: technical cybernetics at the Czech Technical University, a master's in artificial intelligence at the University of Edinburgh in 1996 and a doctorate in Prague, research with his doctoral student Martin Rehák funded in part by the US Army, Cognitive Security and its sale to Cisco in 2013, five years as chief technology officer at Avast from 2019 and then at Gen Digital until 2024, and his nomination as rector on October 22, 2025, effective February 1, 2026. Source ↗
  • Episode 66 on Podbean, April 8, 2025, with show notes on AI shifting from targeting systems to targeting human cognition, four emerging threats, deepfakes, behavioral data, black-box models, the gap between AI innovation and AI safety, and how China approaches behavioral data. Source ↗
  • Evolution Equity Partners' team page, which lists Michal Pěchouček as a partner. Source ↗
  • prg.ai: a nonprofit initiative to make Prague a significant European AI hub, supporting talent and business, connecting research and application, and informing the public about AI's benefits and risks. Source ↗
  • GetReal's LinkedIn page: real-time protection against deepfakes and AI-powered identity attacks, with Evolution Equity and Cisco among its backers. Source ↗
  • Michal Pechoucek on LinkedIn, September 12, 2026, on why he signed a statement about AI in mathematics: AI will speed up scientific discovery, and humans need to stay in control as much as possible. Source ↗
  • MITRE ATLAS: a living knowledge base of adversary tactics and techniques involving AI, from attacks against AI-enabled systems to misuse of AI capabilities. In November 2026 its site listed 16 tactics, 221 techniques, 44 mitigations and 77 case studies. Source ↗
  • Wikipedia on the Czech Technical University in Prague: one of the oldest institutes of technology in Central Europe. Source ↗
  • Wikipedia on Gen Digital: co-headquartered in Tempe, Arizona, and Prague, with Norton, Avast, LifeLock and AVG among its brands, and named Gen Digital after NortonLifeLock completed its merger with Avast in September 2022. Source ↗
  • Wikipedia on Avast: a Czech cybersecurity software company in Prague, now a subsidiary of Gen Digital. Source ↗
  • Wikipedia's list of acquisitions by Cisco: Cognitive Security, January 29, 2013, cyber threat protection, Czech Republic. Source ↗
  • Wikipedia on NetFlow: a feature Cisco introduced on its routers around 1996 to collect IP traffic as it enters or leaves an interface. Source ↗
  • Wikipedia on advanced persistent threats: stealthy attackers, often state-backed, who gain access to a network and stay undetected for a long time. Source ↗
  • Wikipedia on game theory: the mathematics of strategic interaction between players. Source ↗
  • Wikipedia on automated reasoning: the field of AI that lets programs reason on their own. Source ↗
  • Wikipedia on the software supply chain: the components, libraries, tools and processes used to build and publish software. Source ↗
  • Wikipedia on ATT&CK: MITRE's guideline for classifying and describing cyberattacks, released in 2013. Source ↗
  • Wikipedia on the Mitre Corporation: an American not-for-profit that manages federally funded research and development centers. Source ↗
  • Wikipedia on adversarial machine learning: the study of attacks on machine learning algorithms and the defenses against them. Source ↗
  • Wikipedia on prompt injection: inputs crafted to make a language model behave in ways its developers didn't intend. Source ↗
  • Wikipedia on web applications, which emerged in the late 1990s. Source ↗
  • Wikipedia on cloud computing: shared, elastic resources reached over a network. Source ↗
  • Wikipedia on mobile apps: software for phones, tablets and watches. Source ↗
  • Wikipedia on social engineering: psychological pressure that gets people to act or hand over information, with phishing as a type. Source ↗
  • Wikipedia on phishing, which notes that large language models can automate personalized phishing at low cost. Source ↗
  • Wikipedia on information warfare: manipulating information a target trusts, so the target decides against its own interest without knowing it. Source ↗
  • Wikipedia on SB 1047, the Safe and Secure Innovation for Frontier Artificial Intelligence Models Act: aimed at models costing more than $100 million to train, with pre-release risk assessments and whistleblower protections, vetoed by California's governor on September 29, 2024. Source ↗
  • Wikipedia on Cambridge Analytica: a British political consulting firm founded in 2013, known for the Facebook data scandal. Source ↗
  • Wikipedia on the Artificial Intelligence Act: in force since August 1, 2024, four risk levels plus general-purpose AI, a ban on social scoring by public or private actors, fines up to €35 million or 7% of worldwide turnover, and provisions phasing in at six, 12, 24 and 36 months. Source ↗
  • Wikipedia on AI safety: preventing accidents, misuse and other harmful consequences of AI. Source ↗
  • Wikipedia on AI alignment: steering AI systems toward the goals, preferences or ethical principles people intend. Source ↗
  • Wikipedia on China's social credit system: a broad governance strategy to track businesses, individuals and government institutions, with widespread misconceptions about a single score. Source ↗
  • Wikipedia on surveillance capitalism: the widespread collection and commodification of personal data by companies. Source ↗
  • Wikipedia on deepfakes: images, video or audio edited or generated with AI, a form of synthetic media. Source ↗
  • Wikipedia on audio deepfakes: voice cloning that makes a person say things they never said. Source ↗
  • Wikipedia on recommender systems: information filtering that suggests items, informally called the algorithm, and builds personalized feeds from behavior and preferences. Source ↗
  • Wikipedia on the filter bubble: the intellectual isolation that comes from personalized recommendations and algorithmic curation. Source ↗
  • Wikipedia on generative AI: models that generate text, images, video, audio and code from patterns in their training data. Source ↗
  • Wikipedia on TikTok: blocked in mainland China, where ByteDance runs Douyin, launched September 20, 2016, with a similar interface but separate operations. Source ↗
  • Wikipedia on black boxes: systems seen only through their inputs and outputs, and in AI, models whose workings are opaque to the people using them. Source ↗
  • Wikipedia on large language models: models trained on vast amounts of text to generate language. Source ↗
  • Wikipedia on explainable AI: methods that give people intellectual oversight of AI decisions, against the black-box tendency. Source ↗
  • Wikipedia on AI hallucinations: responses that present false or misleading information as fact. Source ↗
  • Wikipedia on chatbots: software built to hold a conversation, today mostly on fine-tuned large language models. Source ↗
  • Wikipedia on google as a verb: the American Dialect Society's most useful word of 2002, added to the Oxford English Dictionary on June 15, 2006. Source ↗
  • Wikipedia on synthetic data: data generated by algorithms rather than real-world events, used to validate and train models. Source ↗
  • Wikipedia on the Turing Award: the Association for Computing Machinery's annual prize, often called the Nobel Prize of computing. Source ↗
  • Wikipedia on climate change: driven by human activities, with about 50% more carbon dioxide in the atmosphere than at the end of the pre-industrial era. Source ↗

Transcript

Automatic transcription. Jon McLachlan and Sasha Sinkevich host this episode with Michal Pechoucek, an AI professor at the Czech Technical University in Prague and an investor with Evolution Equity Partners. There is no diarization on the tape, so speaker labels were assigned from the content and checked against reference recordings of each voice from this episode, passage by passage and on the short turns, and a few short lines may sit with the wrong speaker. Names and product names were normalized where the recognizer misheard them (Jon McLachlan, Sasha Sinkevich, Michal Pechoucek, Evolution Equity Partners, Czech Technical University, Cognitive Security, Cisco, NetFlow, MITRE ATT&CK, ATLAS, EU AI Act, TikTok, LLMs, Turing Award). Words in [brackets] are best guesses where the audio is unclear. Answers are transcribed as spoken, with repeated words and false starts trimmed. Short backchannels such as "yeah" and "right" are left out where they overlap the other speaker.

Read the full transcript 4,752 words

Jon McLachlan

Hello, everyone, and welcome to another episode of the Security Podcast of Silicon Valley. I'm one of the hosts, Jon McLachlan. I'm joined with Sasha Sinkevich, the other host. And we have an amazing guest today, Michal Pechoucek.

Michal Pechoucek

Thank you. Thank you for having me. And thank you for pronouncing my name with such precision.

Jon McLachlan

You know, it's the least that we can do. For all of our listeners, Michal is a venture partner at Evolution Equity Partners. They're also involved very heavily with the Czech Technical University in Prague. You're the founder director of the Artificial Intelligence Center there, as well as an AI professor in the Department of Computer Science. And on your LinkedIn, you have an amazing list of angel investments and advisor roles that you've taken with several startups. Welcome to the show, Michal.

Michal Pechoucek

Thank you for having me. I'm excited.

Jon McLachlan

So let's chat about security and AI. This is a new space. There are a lot of developments underway. You know, AI is breaking ground left and right. It's difficult to keep up with the rate of change. And when we think about security, what's some of the things that come to mind?

Michal Pechoucek

This is an exciting question because, in my opinion, and when it comes to my experience, AI security and security and AI is not as new topic as it may sound. For fact, the attackers have been using AI for a long time, I will even say a decade plus. And when it comes to defenders, there's a tradition of the defenders to kind of use AI to its fullest to be able to deliver best in class safety to our users. One of my first startups that I started with my PhD students was Cognitive Security. We started that in 2008, okay, more than a decade ago. [It was] precisely the idea how we can use a machine learning from computer vision to be able to detect advanced [persistent] threats in NetFlow, network data. It was very successful. We were able to exit in Cisco and be able to service millions of customers with this technology. So even 15 years back, people were kind of delivering on the promise of AI and cybersecurity. Fast forward today, the world is different, and people really kind of think different things when it comes to AI security, AI safety. And I see AI security as kind of four different things. The most important one is AI-powered attacks, and us as defenders to be able to sustain AI-powered attacks. So we see kind of attackers kind of using different types of advanced AI, game theory, automated reasoning, large [language] models to be able to kind of design [malware] and kind of malicious payload in a way that is [very lethal] and it's hard to be detected. Okay? So to me, this is, us defenders to be able to respond, this is an AI security problem. The second big problem is attackers attacking our AI systems. AI systems are becoming a very, very important part of the software supply chain. In the future, kind of most of our software stack will be in one or the other way AI enabled. And to be able to protect the AI systems, it is like a net new class of cybersecurity problems. And [perfect], MITRE has responded by, besides the ATT&CK taxonomy, also designing the ATLAS taxonomy, which is specific to AI system. So kind of big, big stuff and very important. The third one is the fact that we are using AI in building software systems is changing the software system as such. And from my perspective, this is a massive software change, similar software change as we saw when computers got connected through the internet. That was a massive change. It created new vulnerabilities. When we [built] web apps, when we deployed software on the cloud, when we brought mobile, those kind of paradigm shifts in software created new software vulnerabilities against which we as defenders need to respond. These are massive technical shifts in [software] industry that creates vulnerabilities. Again, AI security piece. And the last thing that I think is kind of closest to my expertise and to what I've been doing is the fact that cyber warfare is moving big times from computers, desktops, mobile devices, network, cloud, to people's eyes, to people's cognition, to what people think, what people do online, how people behave, what actions people execute. And those kind of human-centered attacks are now [AI-powered]. The precision and the scale and the availability and the cost of the human-centered attacks is just unprecedented. I regard this as one of the most kind of difficult problems, where we as attackers need to protect people against negative consequences of AI, or the attackers using AI for high precision [bulk] human-centered attacks. Often people ask me, would you agree with AI regulation? I know it's like a controversial topic in Silicon Valley, because in California, this didn't go recently through Gavin Newsom. But I'm from Europe, and we have a different perspective on AI regulation. And I often say, imagine in 2000, when there would be a regulation that somebody would say, you know, in the future, there's going to be this thing, a social network. And you know what? [We will be] banning political campaigning on those networks. Would it be a good piece of regulation? I think it'd be a great piece of regulation, but at the time, we didn't know, so we didn't regulate. And actually, I think this kind of applies to current days. There's this kind of new piece of tech that we want to use and develop, and we still don't understand the full implications of adoption. So I think it's only fair for people to try to kind of regulate and protect.

Sasha Sinkevich

You mentioned the EU AI Act. You guys went a little bit further and a little bit faster, making sure that AI systems are not in a position to make decisions that will influence people's lives, whereas it's not the case everywhere else in the world.

Michal Pechoucek

This is correct. And I actually think that the disadvantage of the European approach is that we very likely would regulate ourselves from a leading edge innovation, which kind of goes against the advancement of the European AI sector and innovation as such. AI security is a very special kind of discipline in cybersecurity, because in cybersecurity, we as defenders are very responsive. We are responding and we are building kind of tools and technologies to be as defensive, as responsive as we can be, right? While in AI security, we need to think ahead. We need to kind of understand what are the implications of the technology, how the technology can be misused, how the technology can evolve, and what guardrails and defensive mechanisms we ought to build for the future. And this is very difficult, because people have different views of the future. People can argue that the future will evolve different ways. Somebody argues that the future is going to be very safe and effective. Somebody presents a doom's perspective on the future. So it's also kind of getting political. Like, Europe has got different perspective of the worries for the future than the US and than China. So I think this is the key difference from kind of cybersecurity as we know it. I would say kind of one of the future examples is going to be kind of the data, the data piece, because AI as it's trained today is drawing out the data. So there'll be a big push for kind of new classes of data. And believe me, AI will be asking for behavioral data, data about how things happen, what is going on, trying to understand and predict behavior, also people's behavior, right? So there'll be kind of lots of hunt for kind of getting good quality behavioral data. China is ahead. They've been collecting behavioral data for ages. But we have. And I actually think that there'll be lots of AI security problems around protecting kind of privacy, not necessarily against people, but against machines who would be kind of excited to understand the behavior. And also, [I just wanted] to say that I'm a techno-optimist, right? I really want AI to kind of grow as quickly as we can, because we have hard societal problems that I believe can be resolved by future AI. However, at the same time, we kind of need to continue investing in the safety of AI, the same way how in the past, investment in cyber attacks were sort of parallel to the investment in cybersecurity. Hence, we've got this big cybersecurity sector that is well funded, but it's protecting the world from cyber attacks. This symmetry doesn't exist in AI development, which in a way, or AI progress, which in a way represents an opportunity for AI misuse or AI danger. And then the investment in AI safety is minimalistic in comparison, right? And actually, I think this is kind of one of the problems that we need to fix, that the investment in the AI safety, AI security is proportional to AI progress.

Sasha Sinkevich

It's perhaps, it's reward driven. At the moment, there is a lot more reward attached to pushing the technology forward and not really paying attention to what potentially should be considered as equally important.

Michal Pechoucek

I more focus on the horizon. I think the horizon is very important. We either think one-year horizon or we think ten-year horizon, actually. And I think that there needs to be quite some focus to think about the long-term horizon. We can take a massive advantage and massive yields out of AI in the near future, but we may be driving ourselves into huge problems in the midterm.

Sasha Sinkevich

Yeah, I think some might call it sustainable. And this pattern just shows over and over and over in things that we do as humans in general.

Michal Pechoucek

Yeah, I agree. Agree more.

Jon McLachlan

It's interesting. And the four problems that you sort of laid out very methodically in the beginning, to just run through them one more time. Those are AI-powered attacks. They're attackers attacking AI systems. That's number two. Number three is like using AI to build new things, which is very interesting space, right? And then the last ones, cyber warfare moving off of machines and more into the human space, which is just kind of scary. I'm totally with you in being an optimist. And I love thinking through ways to give the good guys an unfair advantage. And I'm sure that's what you look for as a partner at Evolution Equity as well.

Michal Pechoucek

If you ask me what out of those four is the problem that kind of worries me the most, where I can see that I don't have an answer, I think in the first three, I can imagine the kind of technologists kind of working shoulder to shoulder against attackers, as we've been doing for the last 30 years. In the last one, in the space of deepfakes, I'm actually really scared, because I'm seeing this from a scientific perspective, where give me a deepfake and I can build you a detector. Give me a detector that is unbeatable by next deepfake. It's impossible. And it's only a matter of how much investment and creativity and kind of infrastructure building and trust creation on the inside that we would be willing to give to minimize the impact of deepfakes and manipulated reality. I think this is very hard. It's going to be very hard.

Jon McLachlan

I guess, in some sense, we've had this problem for a long time. Like, the answer to the question, who are you, is supposed to be [offhand]. And we have this idea in our head that, like, oh, if we jump on a Zoom, I can see you, I can hear you, you're talking like a human being, but now a machine can do all of those things too.

Michal Pechoucek

This is kind of, for me, it is a new perspective. I actually didn't think this way. Even three years ago, I was thinking that the biggest problem of a society is different. I thought that the biggest problem of society are the AI and recommendation systems, that AI is recommending what we do, how we live, what we think, what we read, who do we be friends with, is driving kind of who we are. I feel this is the biggest problem of AI on the internet that we should really focus on and try to kind of fight. Truth is that perspective [changed], you know. There are things that are even more scary than AI-driven life on the internet, and this is AI-created reality.

Jon McLachlan

Right. You've heard that saying, maybe, that you're the sum of the five people that you keep closest to you. And hopefully, like, those are all human beings. But do you think we'll move into a world where, like, one or two of them will become an AI LLM that is just fine-tuned for you, and it helps you lead, like, a better life?

Michal Pechoucek

It's one of the perspectives, kind of coming back to recommendation, but not recommendation to existing stuff, but recommendation to kind of created stuff. Yeah, this is quite likely. I've been hearing, I don't know whether it's true or rumor, that TikTok works differently in China and in the West. That in China, TikTok recommenders are more recommending educational videos, unlike in Europe and in the US, where the recommendation is kind of focused on short content, disruptive content, kind of erratic content. So what if in the future the educational content is going to be constructed, and sometimes it can be misleading? Sometimes it can be training things that you just want to be trained on, giving you skills that [are] manipulative to have. Yeah. [Not very] optimistic, right?

Jon McLachlan

We're optimistic about this, right? And, you know, maybe those technologies, it's just a tool, right? So I imagine, like, those tools can be used and deployed for good if there's a conscious choice of, like, someone is like, oh, I would love a life coach to keep track of, like, how much exercise I have, or what I'm eating, or the way that I spend my time. I would like to be more productive. I would like to build more close relationships with humans. Like, and if a thing, like, nudges me towards these goals, why not have the thing do that? You know?

Sasha Sinkevich

However, it's a lot more complex tool than a hammer or something that I can understand by looking at it. LLMs are essentially black boxes, and you don't really know what went into the composition of that black box. We put a lot of trust into the output that is a result of a function that happens inside the black box. The question is, who controls the data input that goes into the training of these models, and who, in general, is in control of the quality of these LLMs?

Michal Pechoucek

I need two things. One is transparency, and the second one is choice. Okay? I need both. The transparency is really important. I kind of need to know what is going on, how the software is constructed, what kind of data it is being trained on, and why it's suggesting what it's suggesting, why it's kind of generating what it's generating, this why. And for me, this is very important. I acknowledge that not for everybody, right? Not everybody kind of strives for freedom on the internet. The second one is choice. If I know, I need to have an opportunity to choose. What does it, you know, what good does explainability give me if I cannot choose, right? And choices have been removed from us lately. And if we go back to cybersecurity for a minute, you know, in the past, there were crowds of choice, that I can use this solution over that solution because I trust this brand better than the other brand. Now, when we are seeing this, that cybersecurity is moving to attacking humans' mind, the most danger is on closed platforms. Why there is not an independent new cybersecurity firm that is focused only on scamming social media? And me as a customer, I cannot choose who is protecting my life on social networks. These days, it's impossible. Platforms are closed. It's very difficult to kind of transfer my security expectation from product to product. So I don't have the choice. Okay? So I think that we need both things, transparency, [understand what is it] that we are doing, and then [plethora], plentiful of choices to choose when we live online.

Sasha Sinkevich

But they tell us to trust them, and that sounds good enough.

Michal Pechoucek

Yeah. True.

Jon McLachlan

Well, one of the interesting things about LLMs and data is not just, like, the transparency and giving us the choice, but the value from a company's perspective of data has just gone through the roof, because you can do all of these amazing things now with data from their perspective that you couldn't do before, right? This is opening new doors. And it goes back to this idea that if you're not paying for the product, maybe you are the product.

Michal Pechoucek

It goes kind of back to my [earlier] point about TikTok in China and in Europe. I actually think it goes back to education, that we should be trained to be inquisitive and kind of questioning and asking for reasons, and being trained so that we dig deep. Through this, we [are] kind of gaining more freedom.

Jon McLachlan

I'm really happy, you know, the conversations that I've had with younger folks, that they're asking those questions.

Michal Pechoucek

To me, kind of being a university professor is the most exciting part of the job. You know, I'm in touch with the generation, and I can kind of see [firsthand how] they think. And trust me, these days we are underestimating some of the problems that this generation is not underestimating, and they will remind us in the future.

Jon McLachlan

Yes, they will. I hear, like, I told you so coming here pretty soon.

Sasha Sinkevich

In general, when we talk within a business with leadership teams about security and compliance subjects, often they are seen as an overhead. However, it's very important that we structure the dialogue such that it's not seen as an overhead, but rather as a core component of the system and of the product that we are delivering into the market. Having said that, what are your thoughts? How do you usually approach the discussion of, the research and development is important, but we need to think about the implications if we don't do it the right way?

Michal Pechoucek

So one remark I want to make is that as an investor, we just are investing for the purpose of generating returns, right? But at the same time, there is a number of ways how returns can be generated, and people are kind of using different ways how to generate returns. And you can generate return while solving important societal problems. And I chose to kind of invest in AI, and mainly in AI, in such a way that I'm focused on problems that would reduce risks of AI explosion. And this is partly because I'm an AI scientist for the last 30 years. And even though I haven't invented anything related to LLMs, I still feel I've contributed to the AI progress, and it's my duty to kind of think about the negative consequences of the AI progress. So this is why investing precisely in the space of AI safety, AI security.

Sasha Sinkevich

I love that answer. We believe that it all boils down to the UX, the user experience. All of the systems are solvable. Cybersecurity in itself is already very complex. There is a lot of noise, there is a lot of data. But once you roll up your sleeves and come up with a solution that is elegant and solves a very specific pain point, everyone wants it. Everyone knows there is a problem. Everyone wants to solve it. You just have to come up with a solution that is elegant.

Michal Pechoucek

I actually think that we are entering a phase where you can kind of worry about composition. How am I composing the great capabilities that other people kind of came up with to deliver a layer that will make those composed parts of the system available in the seamless, safest, most exciting and natural way to the user to solve their problems. I totally buy this. And kind of improving in the world of interfaces can increase the adoption of AI. Unfortunately, there is also a silver lining, which is some of the interfaces can be not such a great thing. Like, when you use chatbot for search, it's easy, it's nice, it's elegant. You just type question, chatbot tells you. But this type of interface precisely removed some freedom, because in the past, when you kind of did your search yourself and did your research, it was kind of more laborious, but you got better results, because you were able to moderate the result, you were able to remove hallucinations, and you contributed. This new level of interface took away this freedom, and it's kind of [pulling your legs] with things that are not always 100% secure and safe. And precisely, this is why I'm excited about the AI safety, security, because once you are building an AI system, like AI-enabled or LLM-enabled chatbot, there are some negative consequences of the wider adoption that you, I think it's fun to build [a tech] that shows to people.

Jon McLachlan

Yeah, I agree 100% on all of those points. When we build things, if they're not easy to understand, if they're not easy to use, if they're not solving problems that real people actually face, like, what are we doing? You know, technology is great, but you're going to see the adoption when it solves real problems. And depending on how we deliver that technology, it will be more seamless, less seamless. It'll fit into our lives in new ways. And just like when Google came out, and all of the search engines came out, it almost became a verb to know how to use them effectively. And now, I'm Googling something, it's like a very common phrase, and it takes a little bit of skill to know how to use that tool effectively. I think maybe we'll see very similar new skills develop, like, around the way that we interact with this new type of LLM interface, which is really, it's just an interface, right? And it's interesting and a little bit scary, because you can put as much data in there as possible, and it can come from anywhere. And we, you know, at the moment, it's not very clear where it's all coming from. It seems to be reading the entire internet, like, six or seven times over. And then we put some security layers in front of it, behind it, on top of it, on the side.

Michal Pechoucek

I actually think that, I guess we've touched on this. I think that we are entering the era of new families of data. I spoke about one, which is the behavioral models, kind of data about what is happening and what people are doing, and even kind of [laws] of physics and stuff. You know, what are the kind of causalities in the events that we see around? I actually see there is another class of data it's coming, and this is the what-if data, data about things that didn't happen or things that may happen. So I actually think that there is this new huge era of kind of AI simulation, with different types of jobs and works and kind of intellectual kind of problems, where AI will be kind of building all these kind of non-trivial, non-explainable, actually, simulators that would tell us what happens if things happen. And actually, I think that maybe we will be even kind of discovering new things using AI. Also, in things like software generation, maybe we will see that some things can be solved in ways that we didn't think, that there are maybe new programming patterns that we as people didn't use, that kind of software generation will not be only aggregation of human knowledge, but [there'll] be new traits of knowledge that is generated through AI running and executing programs, and kind of doing good quality analysis of the behavior of different types of programs, and then kind of suggesting new ways how to program. So I'm actually thinking that the data that is coming from execution is a new vector of data that I think will be feeding a new generation of [LLMs].

Jon McLachlan

I love it. And your 30 years of experience in the AI field and overlapping with security, I really feel the deep care. And I'm entirely, I'm just filled with gratitude to know that folks like yourself are thinking through some of these problems and on the forefront of, like, really where the tip of the spear is, in terms of these world-changing technologies that are just, they're evolving so quickly now. A quick question for you. If you could go back in time and meet a younger version of yourself, would you? And if you would, like, what would you, well, what message would you have for your younger self?

Michal Pechoucek

So I often think that maybe I would kind of give myself a recommendation to do less things and focus more. But when I kind of think about this recommendation kind of deeply, then I come to a conclusion that I wouldn't. You know, unlike many other people, I was doing many different things. At the same time, I didn't win a Turing Award, right? Which I regret very much. But the truth is, if I'd be choosing, like, a career, kind of hardcore computer scientist in one very narrow discipline, and not being distracted by startups and other things, I wouldn't, because I did enjoy kind of collecting a dissimilar experience that the life was there to offer me. And I actually think that at the age of 52, when I'm making choices, I'm making better choices. And when people are asking me for advice, I think I'm giving better advice comparing to my other trajectory that I could choose. So I'm actually advising people to focus more and to go deeper, kind of respecting that, you know, I'm where I am precisely because I took a trajectory of life that kind of gave me a [diverse] experience.

Jon McLachlan

That's an incredibly compassionate answer for yourself, for your younger self. And I believe wholeheartedly, like, the things that happen to us and the choices that we make around those, they shape us. And, yeah, and you're an incredible human being. So, you know, all the gratitude in the world for sharing openly and [honestly] with us.

Michal Pechoucek

Well, thank you. Thank you. It was a great discussion, and I really appreciate your empathetic questions and your kind of deep interest in my thoughts, and helping me to evolve thinking while debating those exciting topics. Thank you for this.

Jon McLachlan

Absolutely. One super leading question. Is there anything that doesn't exist that you wish someone just would just sit down and build, maybe with that sense of focus that you're talking about?

Michal Pechoucek

So if I would kind of sit on a billion-dollar fund that I'll be only investing myself, you know, I'll be kind of really kind of helping a scientific discovery that would help with the climates. Because even though it's not a trendy topic these days, I still think that we owe it to the generation of young leaders that is coming in 10 years from now. And if we do this now, it would be easier than kind of working on this in 10 years from now.

Jon McLachlan

Oh, yeah. That's spectacular. All of the gratitude in the world for coming on the Security Podcast of Silicon Valley. I'm one of the hosts, Jon McLachlan. I was joined today by Sasha Sinkevich, the other host, and our esteemed guest. And thank you to all of our listeners for tuning in for another episode of the Security Podcast.

FAQ

Questions this episode answers

Who is Michal Pechoucek?
Michal Pechoucek (Pěchouček in Czech) is an AI researcher, professor and investor. He founded the Artificial Intelligence Center at the Czech Technical University in Prague in 2000, has been a professor there since 2009, was chief technology officer at Avast and then Gen Digital from 2019 to 2024, and has been with Evolution Equity Partners since 2017. Since February 1, 2026 he has been the university's rector.
What was Cognitive Security?
Michal's first startup, which he says he started with his PhD students in 2008. It used machine learning techniques from computer vision to detect attackers in NetFlow network data, and Cisco acquired it on January 29, 2013.
What are the four kinds of AI security problems?
AI-powered attacks, attackers attacking AI systems, AI changing the way software is built, and cyber warfare moving from computers to people's cognition. Michal says the fourth is the closest to his own expertise.
What is MITRE ATLAS?
ATLAS is MITRE's living knowledge base of adversary tactics and techniques involving AI, from attacks on AI-enabled systems to misuse of AI capabilities. In November 2026 its site listed 16 tactics, 221 techniques, 44 mitigations and 77 case studies. It sits beside ATT&CK, which MITRE released in 2013 to classify cyberattacks.
Why does Michal compare AI-built software to the internet?
Every paradigm shift in software, from computers connecting through the internet to web apps, the cloud and mobile, created new vulnerabilities that defenders had to answer. He sees software built with AI as the same kind of shift.
What does it mean that cyber warfare is moving to people's cognition?
Attacks are moving from computers, desktops, mobile devices, networks and the cloud to people's eyes, their cognition, what they think and do online and the actions they take. Michal says AI makes these human-centered attacks unprecedented in precision, scale, availability and cost.
Does Michal support AI regulation?
He answers with a thought experiment. A rule written in 2000 to ban political campaigning on social networks would have been a great piece of regulation, but nobody knew, so nobody regulated. Since we still don't understand AI's full implications, he thinks people should try to regulate and protect.
What does Michal think of the EU AI Act?
Sasha noted that Europe went further and faster to keep AI from making decisions that influence people's lives. Michal agreed, and said the disadvantage is that Europe will likely regulate itself out of leading-edge innovation, against the advancement of its own AI sector.
What is the EU AI Act?
An EU regulation that entered into force on August 1, 2024. It sorts AI into four risk levels plus a category for general-purpose AI, bans unacceptable-risk uses such as social scoring, and phases in over six to 36 months. Breaking the bans can cost up to €35 million or 7% of worldwide turnover.
Why does AI security have to think ahead?
In cybersecurity, defenders respond to attacks. With AI, Michal says, we need to understand the technology's implications, how it can be misused and how it can evolve, and build guardrails for the future, even though people disagree about what that future is.
Why does AI safety get less money than AI?
Michal says cybersecurity spending grew in parallel with cyberattacks, but that symmetry doesn't exist in AI, where safety investment is minimalistic in comparison. Sasha suggested it's reward driven. Michal wants safety and security investment proportional to AI progress.
Can deepfake detection keep up?
Not by itself, Michal says. Give him a deepfake and he can build a detector, but a detector the next deepfake can't beat is impossible. What helps is investment, creativity, infrastructure and trust built on the inside.
What is AI-created reality?
Michal's term for content generated by AI rather than picked from what already exists. Three years earlier he thought recommendation systems were society's biggest AI problem. Now he finds AI-created reality even more scary.
Does TikTok recommend educational videos in China?
Michal passed it on as something he had heard and said he didn't know whether it's true or rumor. Wikipedia says TikTok is blocked in mainland China, where ByteDance runs Douyin separately, and doesn't say what either app recommends.
What two things does Michal want from AI?
Transparency, meaning how the software is built, what data it was trained on and why it suggests what it suggests, and choice. Without choice, he asks, what good does explainability do? On closed social platforms, he can't choose who protects him.
What is what-if data?
Michal's term for data about things that didn't happen or may happen, produced by AI simulators. He expects it, along with behavioral data and data from AI executing programs, to feed the next generation of models.
What advice would Michal give his younger self?
His first thought was to do fewer things and focus more, but he wouldn't trade the varied experience life offered him, even without a Turing Award. He still advises other people to focus more and go deeper.
What would Michal build with a billion-dollar fund?
He would back scientific discovery for the climate, even though it's not a trendy topic, because we owe it to the coming generation of young leaders, and the work is easier now than it will be in ten years.
Keep reading on the YSecurity blog
Related episodes
New episodes every other Tuesday

Got a story like this one?

We're always looking for practitioners who've been in the room when it mattered.