Podcast Episode 91

Episode 091 36 min

Why Asking Developers To Fix Everything Is... A Bad Idea

with Neatsun Ziv

0:00 / 36:00

Watch on YouTube Listen on Spotify, Apple Podcasts, Podbean, Player FM

Episode 91 of The Security Podcast of Silicon Valley, published March 24, 2026. Hosts Jon McLachlan and Sasha Sinkevich, co-founders of YSecurity, talk with Neatsun Ziv, co-founder and chief executive officer of OX Security, the application security company he started in 2021 with Lior Arzi after almost ten years at Check Point. Neatsun explains why OX was founded on the problem statement that shift left had failed, why the five million findings a company can show up with are mostly not relevant, why 600 developers agreed to fix two of 20 prioritized defects, and why the details a developer needs should arrive with the finding. They cover giving the context to the vibe coding agent before it writes code, VibeSec, burning the bridge behind you as a founder, meeting a co-founder two weeks apart, milestones as the best and the worst day, why wanting no risk is a bad answer, detection without fixing, SOC 2 as a starting point, the CISO as the economic buyer, training as mission impossible, everybody becoming a manager, threat models that keep up, the mobile platforms that owned the store, fraud as an abuse of trust, typosquatting against vibe coding environments, the token economy between attackers and defenders, the law of unintended consequences, managing expectations, and gambling on three years rather than eighteen months. About 36 minutes.

Episode notes

Is your security team drowning in noise while your developers struggle to keep up? Neatsun Ziv, CEO of Ox Security, explains why traditional "Shift Left" strategies have failed and how applying business context can help your team focus on the vulnerabilities that actually matter. Listen to the full episode to learn how to turn security into a competitive advantage.

Hosted by Jon McLachlan and Sasha Sinkevich — co-founders of YSecurity.

The deep dive

With the right context

Neatsun Ziv co-founded OX Security in 2021 on the problem statement that shift left had failed. On this episode he tells Jon and Sasha why five million findings mostly don't matter, why 600 developers agreed to fix two, why the context belongs in front of the coding agent before the code is written, and why the hardest new problems are about trust. Here is the conversation with the public record beside it.

Neatsun Ziv didn’t open with a product pitch. Asked what OX Security is up to, he opened with the idea the company was built to replace.

“OX was formed with the problem statement that shift left as a concept failed us for years. We’ve been trying to make it work, but it’s just that everybody’s got their priorities.”

Neatsun Ziv, at 1:43

Listen · Neatsun on episode 91, from 1:43
About 15 seconds: Neatsun on the problem statement OX started from. The clip stops on its own. Read the full transcript.

Neatsun is the co-founder and chief executive officer of OX Security, which he started in October 2021 (LinkedIn). Before that he spent almost ten years at Check Point, first as director of its secure cloud work from December 2011 and then, from June 2016 to July 2021, as vice president of threat prevention and intelligence. Earlier he founded and ran Vanadium Security for eight years, and his first jobs were in software development, at Scitex, at Motorola and in the Israel Defense Forces. He co-founded OX with Lior Arzi, now its chief product officer, and the two met at Check Point (TechCrunch, OX Security).

A timeline of seven entries. Open, 1996 to 1998, Scitex, then Motorola, his first jobs, in software development. Open, 1998 to 2003, Israel Defense Forces, a software developer. Open, 2003 to 2011, Vanadium Security, his first company, as founder and chief executive officer. Filled, 2011 to 2016, Check Point, director for secure cloud from December 2011, and Lior Arzi joins two weeks apart. Filled, 2016 to 2021, Check Point, vice president of threat prevention and intelligence, to July 2021. Dashed, 2021, OX Security, co-founded with Lior Arzi in October, in New York and Tel Aviv. Dashed, 2026, this episode, aired on March 24, with Jon and Sasha.
Neatsun's path to OX, from his LinkedIn experience.

OX describes its mission as “a world where software secures itself,” and sells an application security platform that runs from the prompt to the runtime (OX Security). In May 2025 it raised a $60 million Series B led by DTCP, with IBM Ventures, Microsoft, Swisscom Ventures, Evolution Equity Partners and Team8, for $94 million raised in total. TechCrunch reported about 200 customers and 150 employees at the time, with OX analyzing more than 100 million lines of code a day (TechCrunch).

Where we sit, so you can weigh what follows: YSecurity helps startups pass the security reviews enterprise buyers run, and our vulnerability remediation program works on the same backlog problem OX sells software for, from the services side. Jon McLachlan and Sasha Sinkevich host the show together, and the episode aired on March 24, 2026. Our companion posts, Why Shift-Left Security Keeps Failing and Vibe Coding Security, turn the episode’s ideas into plans for a young company. This page stays with the tape.

Shift left failed us for years

Shift left is the habit of moving testing earlier in the life of a piece of software, and the phrase goes back to Larry Smith, who wrote about it in Dr. Dobb’s Journal in September 2001 (Wikipedia). In application security it came to mean scanning code as it’s written and handing the findings to the developers who wrote it. Neatsun’s complaint is with how that handoff worked in practice. Developers have their own priorities, and security arrived as one more item on a list that was already full.

“It is super hard to try and fix security as we go along. And as technologies emerged, we started saying, hey, let’s prioritize, let’s do this, let’s do this, and constantly trying to push it towards the cutting edge of making sure that application security and product security actually work from the moment you start thinking about code up until it’s running in the cloud.”

Neatsun Ziv, at 1:55

That span, from the first thought about code to the code running in the cloud, is the scope OX set for itself. Each new technology widens it, and Neatsun said the latest one changes the size of the problem.

“So that’s a basic concept, but every year you see new technologies, especially now with AI coming into the equation. It just becomes mind-blowing.”

Neatsun Ziv, at 2:15

Five million issues

Sasha picked up on how much there is to cover and asked the question every security team faces sooner or later.

“There are so many things we could be solving every day, but we cannot spread too thin. How do you guys figure out the question, what is the biggest pain point that we need to focus as a team?”

Sasha Sinkevich, at 2:30

Neatsun answered with what you find when you look closely at a company’s findings.

“You get a situation where you get the companies and you actually see that they’ve got like five million issues, and you say, oh, well, this is really bad. And then you go one over one, just sample them, and you see that most of them are not relevant.”

Neatsun Ziv, at 2:43

Then he described what “not relevant” looks like. A scanner flags a password in the source code, and a comment in front of it says it’s an example. A scanner flags a critical open source library, and the library sits in a test application that never reaches production.

“Or you see a lot of those cases where you’re saying, hey, you’ve got this open source Log4j, super critical, it will crash your system, but it’s in a test application that is not running in production. There is no way to get there.”

Neatsun Ziv, at 3:12

The Log4j example is a deliberate one. Log4Shell, the remote code execution flaw in the Log4j logging library, was reported in November 2021 and got its CVE identifier on December 10, 2021, and it had sat unnoticed in the code since 2013 (Wikipedia). It’s about as critical as a finding gets. A copy of it inside a test project nobody deploys is still a finding a professional would set aside, and Neatsun spelled out how that professional thinks.

“So what a professional would do is they would go through a process to start triaging it, saying, you know what, this is not connected to the internet, this is not exploitable, this is not real risk, this is just a test project. Just understand the context.”

Neatsun Ziv, at 3:26

A filled box at the top, like five million issues, what a company's findings can add up to. An arrow leads down to an open box, sample them, one over one, and most of them are not relevant. Below, three dashed boxes. An example password, a comment says it's an example. Log4j in a test app, not running in production. A container issue, internal, not exposed, a lab. Then two quotes. Just understand the context. There is no way to get there.
What "not relevant" looks like, in Neatsun's examples from the tape.

They’re going to ignore you

The cost of skipping that triage is paid in trust. Hand developers everything the scanners produce, and they learn that most of it doesn’t matter.

“If you’re going to push a lot of noise towards developers and ask them to fix things, what you’re going to get back is actually they’re going to ignore you.”

Neatsun Ziv, at 3:40

He had tested it himself, on a team of about 600 developers.

“I used to manage a team of about 600 developers, and we’ve done this exercise, and it sounded very simple. Just take the defects and fix them. And out of the 20 prioritized, they said, we are willing to fix two.”

Neatsun Ziv, at 3:47

Listen · Neatsun on episode 91, from 3:39
About 20 seconds: Neatsun on the 600 developers and the two fixes. The clip stops on its own. Read the full transcript.

The developers weren’t refusing to work. They were answering the questions the list hadn’t. That one is a container issue, that one isn’t exposed to the internet, that one lives in a lab. Every answer was a detail somebody could have looked up before the list went out.

There’s a long-running conversation on this show about the same gap. Jack Cable found on episode 84 that customers needed to know which findings to fix before they needed help fixing them, and on episode 87 Venkat Thiruvengadam described the ticket trap, the way infrastructure work arrives as tickets that someone else has to pick up.

The Science Behind Alert Fatigue in Security Teams, and How to Beat It, an hour-long session on OX Security's YouTube channel from April 23, 2025, with Matt Johansen of Vulnerable U and Professor Moshe Bar of Bar-Ilan University. It's OX's own production. Watch on YouTube.

Bring the details for them

OX’s starting idea came from turning that exchange around. If every finding comes back with the same questions, the security side can answer them first.

“What we had in mind is, why are we expecting somebody else to bring these details? Why don’t we just go in and bring these details for you? It’s very easy for us to know. Is it live? Is it exposing API? Is this right now exposed to the cloud? Is this a live Kubernetes agent?”

Neatsun Ziv, at 4:08

None of those answers is secret. Deployment records, cloud configuration and the cluster itself already hold them. The trouble, in Neatsun’s telling, is where the work of collecting them lands.

“Just all of this information is available, but we are just shifting it to somebody else to fix, and nobody’s taking care of that.”

Neatsun Ziv, at 4:22

Three numbers. 600 developers on the team. 20 defects prioritized for them. 2 they were willing to fix. Below, the details that decide it, in four dashed boxes. Is it live? Is it exposing API? Exposed to the cloud? A live Kubernetes agent? An arrow leads down to a filled box, bring the details for them, the security side answers before the developer has to ask. Then a quote. Just all of this information is available, but we are just shifting it to somebody else to fix, and nobody's taking care of that.
The questions behind every finding, and who answers them.

Jon summed it up as context making security problems “a little bit more relevant, a little bit more focused,” and asked whether AI was the way to speed it along.

Coming blind

Neatsun’s yes came with a qualification. Context has always been the answer. What’s been missing is access to it.

“First of all, yes. I think for years we know it’s all about the context.”

Neatsun Ziv, at 4:44

He made the point with a bank account. Give someone the account number and the password, and guessing their way in is easy. Most people looking at a finding have nothing like that.

“But the challenge is most of us are coming blind to those questions. Saying, is it deployed to the cloud? I don’t know. Is it right now exploitable, exposing any APIs? What does it mean? We’re blind to that.”

Neatsun Ziv, at 4:58

Why wait for the wrong code?

Then he moved the context somewhere new. Instead of collecting it for the developer after the code exists, give it to the agent that writes the code.

“So yes, it is context, but I think one of the advancements that we’ve seen recently is actually taking it to the developer and saying, maybe we could take it not to the developer itself, maybe we can take it to the context of the vibe coding agent.”

Neatsun Ziv, at 5:10

The logic follows. A scanner finds problems in code that’s already written. An agent that knows the environment before it writes can avoid writing the problem at all.

“And as part of this journey, we started getting to play, saying, hey, if you’ve got the context in advance, why wait for the wrong code to be actually written?”

Neatsun Ziv, at 5:24

Listen · Neatsun on episode 91, from 5:24
About 10 seconds: Neatsun on giving the coding agent the context first. The clip stops on its own. Read the full transcript.

He listed what that context would say, in the voice of a reviewer briefing the agent before it starts.

“If we can load upfront the context, saying, hey, you are going to touch right now with this request an API that is externally exposed. These are the databases that this app is connected to. Those are the microservices that’s going to be deployed in connection with. We want you to have those security restrictions and this rate limit and this sanitization.”

Neatsun Ziv, at 5:33

And the agent can do the work a ticket would have asked for.

“And I’ve already found a few passwords. Why don’t I just move them to your vault, and just do the work, instead of shifting it to the developer that is already loaded?”

Neatsun Ziv, at 5:54

Two columns of three boxes. After the code, open boxes. Code gets written, with whatever the agent knew. A scanner finds the flaw, after the fact. A ticket reaches a developer, who is already loaded. Before the code, filled boxes. Context loads upfront, exposure, data, services, rules. The agent writes inside it, the wrong code never gets written. The agent does the work, passwords move to the vault. Below, what the context says, in Neatsun's list. An API that is externally exposed. The databases this app is connected to. The microservices it will be deployed with. Security restrictions, a rate limit, sanitization. Then a quote. Hey, if you've got the context in advance, why wait for the wrong code to be actually written?
Two orders of work: the scanner after the code, and the context before it.

This is the idea our vibe coding security post builds on, and it’s the reason a security context file checked into the repository is one of the cheapest controls a startup can add. Michael Nov argued on episode 76 that the design stage is where most startups skip security. Context in front of the agent moves the design decisions to the moment the code is written.

A big enough lever

Neatsun closed the thought with a line borrowed from antiquity.

“So with the right context, you can do marvelous things. I’m not sure what’s the equivalent of the sentence, give me a big enough lever and I’ll move a planet, to AI context. But I’m sure that there is such a thing.”

Neatsun Ziv, at 6:07

Listen · Neatsun on episode 91, from 6:07
About 10 seconds: Neatsun on the lever and the planet. The clip stops on its own. Read the full transcript.

The sentence he was reaching for is Archimedes’. Pappus of Alexandria attributed to him the remark “Give me a place to stand on, and I will move the Earth,” about the law of the lever, which Archimedes proved (Wikipedia). The art at the top of this page is that lever. A small, well-placed weight on the long arm moves something far heavier on the other side, and in Neatsun’s version the weight is context.

Security that vibes

Jon was sure there’s an equivalent too, and found one in OX’s own words.

“Just looking at OX Security, it’s like VibeSec, security that vibes the way that software is built. Unless you’ve been living under a rock, the software engineering space is absolutely changing.”

Jon McLachlan, at 6:20

Listen · Jon on episode 91, from 6:20
About 10 seconds: Jon on VibeSec and the changing work of engineers. The clip stops on its own. Read the full transcript.

OX says VibeSec “prevents insecure code and destructive scenarios in AI coding tools” (OX Security), and the company introduced it in a video titled Meet VibeSec on September 30, 2025 (YouTube). Vibe coding itself is younger than OX. The computer scientist Andrej Karpathy coined the term in February 2025, and Collins English Dictionary named it its word of the year for 2025 (Wikipedia).

Jon described what the change means for the people doing the work.

“And now, as an engineer, we’re a little bit more like almost managing these agents as they produce a lot of the code that ends up in production systems. And I guess the timing smells perfect to like revisit all of these hard security problems that we’ve been like manually slugging through, everything in our rearview mirror, all of our past histories.”

Jon McLachlan, at 6:36

Then he asked about the moment Neatsun decided to start a company. “We have to be a little bit crazy to start a company, a little bit crazy to be a founder,” Jon said, and asked what that spark felt like.

Burn the bridge

Neatsun’s answer started with what he gave up. At Check Point he had, in his words, everything he wanted.

“Yep. Okay, so before starting OX, VP, large security company, big department, like huge budget, accountability from sales to product, like everything that I wanted. But at a certain point, you do understand that large companies have this disadvantage, that you can’t do everything that you’re doing and still focus on new projects.”

Neatsun Ziv, at 7:17

A new project, as he described it, needs the kind of focus a big company can’t give it, and a founder has to remove the way back.

“But you basically need this absolute focus, and you need to be in a situation where there is no regrets, no undo. It’s like you can’t go back. You actually need to burn the bridge behind you.”

Neatsun Ziv, at 7:46

Listen · Neatsun on episode 91, from 7:46
About 15 seconds: Neatsun on burning the bridge behind you. The clip stops on its own. Read the full transcript.

The way back stays tempting, and he was candid about the doubt that followed.

“After my partner and myself left the company [we] worked for and started OX, it’s like you get to those moments in time that you’re saying, oh my God, what have I done?”

Neatsun Ziv, at 8:03

“And I’m sure you heard it from a lot of founders, but a founder’s life, it’s like a roller coaster. It’s like you never know if you’re going up next minute or down. You just know that it’s going somewhere that you don’t expect.”

Neatsun Ziv, at 8:14

Two weeks apart

Jon asked how Neatsun met his co-founder. They started at the same company within two weeks of each other, and that company was Check Point (TechCrunch).

“So we work together at the same company. We actually joined the company with a two weeks difference from each other. So we actually worked together for almost fourteen years now.”

Neatsun Ziv, at 8:34

Listen · Neatsun on episode 91, from 8:33
About 10 seconds: Neatsun on meeting his co-founder. The clip stops on its own. Read the full transcript.

“So you’re kind of like work spouses,” Jon said, and Neatsun agreed. These days the partnership spans two continents, and they build in time away from the work.

“I’m New York based, he’s Israel based, so we are actually trying to do like at least twice a year, do like a hike together, usually in the US or Europe. And it gives us like a few good days to hash things out.”

Neatsun Ziv, at 8:49

Jon pointed out that a roller coaster needs a foundation of trust under it. Neatsun’s description of what makes the pairing work was short.

“So, yeah, well, he’s got this amazing trait not to get excited from anything. And I’m exactly the opposite. So it’s like he balances me off.”

Neatsun Ziv, at 9:12

A field they had always overlapped with

Jon asked whether the two founders complement each other in skills too, and whether both are security experts. Neatsun said yes, with a twist.

“But one of the things, I think, is that actually the field that we’re working in right now, it’s a field that we always were in overlap with, but we never worked in this field.”

Neatsun Ziv, at 9:39

Learning it properly, he said, meant owning it.

“Just to own every detail, saying, you know what? I can do this better. Like, I’ve tested other products. I know why they failed miserably, and we have a shot at doing something better.”

Neatsun Ziv, at 9:58

Jon heard a founder’s edge in that. “It’s almost like you feel that pain firsthand,” he said, “and that’s maybe part of your superpower in this space.”

The best and the worst day

Then Jon asked about the proudest day so far. Neatsun answered with a pattern rather than a day.

“I’d probably say that every time that we’re getting to a new milestone, it’s like the best and the worst day. The moment that you see that the goal that you set is actually achievable, you haven’t reached it yet, but you can feel it, and it might be a quarter away, but you can actually say, you know what, I’m in the right trajectory to get there. That’s the high.”

Neatsun Ziv, at 10:27

Listen · Neatsun on episode 91, from 10:27
About 20 seconds: Neatsun on the best and the worst day. The clip stops on its own. Read the full transcript.

The low arrives a second later, when the next goal comes into view.

“And the next goal is not going to be like, okay, we moved from 10 million dollar to 20. It’s going to be from 20 to 50. So the next one is like way higher. And then you’re just like, I have no idea how to do that one.”

Neatsun Ziv, at 10:54

He didn’t say on the tape which of those numbers OX had reached. Ten months before the episode aired, TechCrunch reported OX was “generating around $10 million in annual recurring revenue,” a figure Neatsun expected to double by the end of 2025 (TechCrunch).

Three columns rising from left to right, labeled 10, 20 and 50, millions of dollars, in Neatsun's example of the next goal. The first two are open, the third filled. To the right, two dashed boxes. TechCrunch, May 2025, around $10 million in recurring revenue. Neatsun's expectation, double by the end of the year. Then two quotes. That's the high. So the next one is like way higher.
Neatsun's next goal, beside the revenue TechCrunch reported in May 2025.

What comes after the low is a restart.

“It’s like you need to scrape yourself from the floor and start from the beginning. And every founder that I had this conversation with goes through this journey and say, yes, it happens in a few interesting points.”

Neatsun Ziv, at 11:12

He described the way through as effort plus something nobody controls, and when Jon suggested being in the right place at the right time, he raised his estimate.

“It’s like you don’t need a bit of luck, you need a lot of luck.”

Neatsun Ziv, at 11:46

Andrew Rubin of Illumio put the same idea another way on episode 88, where luck and timing turned out to be one thing.

What are you trying to achieve?

Sasha brought the conversation back to the noise, and to the customer conversations that cut through it.

“And Neatsun, you mentioned that it’s important to have those conversations with your customers in order to distill away all of the noise and focus on what actually matters, the actual pain point that, if solved, will deliver huge benefit. What does this process look like for OX Security and your partners?”

Sasha Sinkevich, at 11:58

Neatsun’s process starts with the plainest question there is, and he admitted it’s harder to answer than it sounds.

“Usually it starts with a very basic question, which is, what are you trying to achieve? I know it’s very mundane, but just getting to a very crystal answer on this one, it’s usually a very hard exercise.”

Neatsun Ziv, at 12:20

He worked an example live. Imagine a company with a thousand employees, 20 years old, that makes a lot of its money through what it exposes to the internet. Ask what it’s trying to achieve, and the first answer is usually the wrong one.

“So the basic answer is simply, I don’t want any risks. And that is usually a bad answer. It’s like, you will need to accept risks, and you kind of need to understand where it is that you feel comfortable.”

Neatsun Ziv, at 12:48

Listen · Neatsun on episode 91, from 12:48
About 10 seconds: Neatsun on why "I don't want any risks" is a bad answer. The clip stops on its own. Read the full transcript.

The comfortable place sits on a line. At one end a company invests nothing and expects nothing. At the other it expects a lot and pays for it. Most companies, in Neatsun’s experience, pick a spot in the middle and describe it in people and money.

“I don’t want to pay too much for this. I kind of have like three people to put on the problem and this amount of budget. And now, what’s the best you can do for me?”

Neatsun Ziv, at 13:14

A dashed box at the top left, I don't want any risks, usually a bad answer, not on the line at all. Below, a horizontal line from invest zero, expect zero, on the left to expect a lot, pay for it a lot, on the right, with a filled segment in the middle, the comfortable zone, three people and this amount of budget. Then the measure, in three open boxes. The backlog, how many items right now? A million? It's like, bad. Half a million? Is good, in his example. Then two quotes. It's not canceling the risk. There is always going to be a risk.
The line Neatsun drew, from investing nothing to paying for a lot.

Is a million good or bad?

“The best you can do for me” still needs a measure. Customers reach for the one they have, the size of the backlog, and Neatsun walked through what happens next.

“Okay, how many items do you have right now in the backlog? Saying, a million. Saying, a million is good or bad? It’s like, bad. What a good number, it looks like? Like, half a million is good.”

Neatsun Ziv, at 13:29

A count of open items is easy to measure and hard to interpret, and the conversation about what good looks like is where customers find the real goal.

“And most understand really early into the process that the AppSec program is a way to reduce the risk. It’s not canceling the risk. There is always going to be a risk. And the best thing you can do is just think smart about what’s probable, what’s going to hit you, how am I engaging with the developer to actually fix it.”

Neatsun Ziv, at 13:44

Listen · Neatsun on episode 91, from 13:43
About 10 seconds: Neatsun on reducing risk rather than canceling it. The clip stops on its own. Read the full transcript.

Our post on why shift-left security keeps failing walks the public data on how few published vulnerabilities are ever exploited, which is the statistical version of the same point.

Great detection, nobody fixing

The last part of that answer, engaging the developer, is where Neatsun sees most programs stall. A team can find everything and still have done nothing.

“You see this and you’re saying, this is very good, I’ve got great detection. But then nobody’s actually picking up the phone and fixing that. You hadn’t done anything, really.”

Neatsun Ziv, at 14:20

The fix itself competes with everything else on a developer’s plate.

“Now, fixing, I know it sounds very easy, but you need to go to a developer that has product managers, Jira backlog, performance issues, UI issues, customers, and you say, oh, I need you right now to stop everything and fix a million issues. Like, yeah, that’s not going to happen.”

Neatsun Ziv, at 14:33

Listen · Neatsun on episode 91, from 14:23
About 25 seconds: Neatsun on detection without fixing. The clip stops on its own. Read the full transcript.

He has watched teams try incentives, a developer of the month with a small prize, and seen those programs grow into a different question.

“It’s about how do I drive execution on where I want to draw the attention? How do I focus my attention and understanding what is important, and then making sure the right person is actually associated with it?”

Neatsun Ziv, at 15:08

Seven months after the episode aired, OX measured that gap at internet scale, in the hours after an emergency patch. It’s in what happened after the tape.

Just get me through this

Not every customer is building a program. Some are on a deadline.

“For others, it’s a different journey, saying, okay, I just need to pass SOC 2. This is everything that I need to do. It’s like, I don’t care more than that. Just get me through this.”

Neatsun Ziv, at 15:32

Neatsun didn’t treat that as a lesser goal. It’s a starting point that grows a component at a time.

“If you just need to do that for now, all you have to do is like check the box on those five things. Easy. The year afterwards, they’re saying, okay, I just need to add one more component. So great, let’s do this, let’s add that. So everybody has a different risk profile, and we’re just helping them with this journey.”

Neatsun Ziv, at 15:42

A SOC 2 report describes the controls a company runs and, for a Type 2, whether they operated over a period, so a first report can be small and honest and still grow from year to year. Our guide to what a SOC 2 actually is covers the basics, and agentic code review and your SOC 2 Type 2 audit covers what changes when agents write the code.

Sasha tied the thread together with a question about who pays.

“But at the end of the day, it needs to be aligned with business initiatives, and the question is, who is your economical buyer at that point in the company’s journey?”

Sasha Sinkevich, at 15:57

Listen · Sasha on episode 91, from 15:57
About 10 seconds: Sasha on business alignment and the economic buyer. The clip stops on its own. Read the full transcript.

Who buys, who evaluates, who fixes

Neatsun’s answer described three seats, and only one of them belongs to security.

“So I would say that the economic buyer in larger companies is usually the CISO of the organization. And the technical evaluator and the people that actually need to work on the system are more on the AppSec and DevSecOps guys. But the guys that need to solve the problem are actually from engineering and DevOps. So you’ve got this flow from strategic to operational, to actually hammering down issues one by one.”

Neatsun Ziv, at 16:28

Three boxes stacked with arrows between them, from strategic at the top to operational at the bottom. Filled, the CISO, the economic buyer in larger companies. Open, AppSec and DevSecOps, the technical evaluators. Dashed, engineering and DevOps, the people who solve the problem. Then a quote. So you've got this flow from strategic to operational, to actually hammering down issues one by one.
Three seats in Neatsun's answer, from strategic to operational.

At a startup the three seats are often one person, which is why the order of the work matters more than the org chart. The same questions still apply. Who decides what risk is acceptable, who checks the findings, and who changes the code.

What does the I stand for?

The people in the third seat, Neatsun said, usually aren’t trained for the second.

“And if you think about it, when developers see issues, even engineering managers, they are not equipped to understand what is important versus what is not important.”

Neatsun Ziv, at 16:54

The curious ones teach themselves, one acronym at a time.

“They would just type into ChatGPT and saying, what is this CSRF? What does it mean? It’s like, this is the first time that they’re encountering this concept, or SQLi. What does the I stand for? Oh, it’s SQL injection. I heard this term before.”

Neatsun Ziv, at 17:08

Listen · Neatsun on episode 91, from 17:08
About 15 seconds: Neatsun on developers learning security one acronym at a time. The clip stops on its own. Read the full transcript.

Cross-site request forgery is an attack where “unauthorized commands are submitted from a user that the web application trusts,” and SQL injection is “a code injection technique used to attack data-driven applications” (Wikipedia, Wikipedia). Both are old, well-documented classes of web vulnerability. Neatsun’s point is that training alone can’t keep up with the people it trains.

“So it’s about getting to the place saying, we need to train people, we need to educate them. But this is mission impossible. You’re training your developers, and within a year, a third of them moved away, and you’ve got somebody else to train.”

Neatsun Ziv, at 17:24

Everybody’s becoming a manager

“So, what’s the smarter and better way to do it?” Jon asked. Neatsun’s answer starts with how the job of writing code has already changed.

“I think that as we’re entering the vibe coding era, what we are seeing is that everybody’s becoming a manager. When you’re doing right now vibe coding, unlike what we had a year ago, where it wasn’t vibe coding, it was like you’re giving commands, and now you’re just describing intent.”

Neatsun Ziv, at 17:46

Listen · Neatsun on episode 91, from 17:46
About 20 seconds: Neatsun on everybody becoming a manager. The clip stops on its own. Read the full transcript.

The step after intent, he said, is structure. You describe the boundaries, and the agents work inside them.

“And some of the recent enhancement is like, do more than intent, create a policy or a structure, and we’ll work within the boundaries. And I think that as we’re evolving and saying, we’re actually taking concepts from how development teams work and start using AI to think about them as multi-agent that builds the task, verifies the task, adds analysts to it.”

Neatsun Ziv, at 18:04

Four boxes in a row with arrows between them. Open, commands, a year ago. Open, intent, what you describe now. Filled, boundaries, a policy or a structure. Filled, a team of agents, build, verify, analyze. Below, a dashed box, security on the team, maybe an agent on our behalf should be part of this game as well. Then a quote. I think that as we're entering the vibe coding era, what we are seeing is that everybody's becoming a manager.
From commands to intent to boundaries, in Neatsun's account.

If the team is made of agents, security can be one of them.

“And this is also an opportunity to take pieces of the AppSec, CloudSec, product security mentality and actually say, hey, maybe an agent on our behalf should be part of this game as well.”

Neatsun Ziv, at 18:29

Ged Ossman made a related argument on episode 99, that an agent should declare everything it will need before it runs, the way an app declares its permissions. Boundaries written down ahead of time are what make both ideas work.

A threat model that keeps up

One old practice gets a second chance in that world. Threat modeling, the work of listing what could go wrong with a design and what to do about it, has always had a maintenance problem (Wikipedia).

“Maybe part of the things that we really wanted to do always as part of security is to make sure that you’ve got a threat model for everything. But that was always like a futile exercise. Like, you’re doing this, and the implementation was never similar to the original design, and maintaining this becomes harder.”

Neatsun Ziv, at 18:42

With agents writing the code, the guidelines can travel with the work, and something can check the design’s assumptions against what got built.

“Maybe now we’ve got a different shot, saying, hey, why don’t we just give guidelines, and somebody will go over the assumptions that we have, and we’ll see how reality faces the design.”

Neatsun Ziv, at 18:58

Michael Nov talked on episode 76 about the designs nobody is looking at. Drift is the same problem after launch, and our post on the MCP server that passed review and then changed follows it into the tools agents connect to.

One layer higher

Jon summed up the direction.

“Yeah, I love it. It’s taking all of the advancement that we have at our disposal today through AI and applying it directly to these difficult problems that we face day in and day out as security professionals.”

Jon McLachlan, at 19:19

Neatsun took it a step further, to what the work becomes for the people doing it.

“Exactly. I think we’re getting to this age where a part of our mind is going to be on not just doing things, but articulating them as a context in a very clear and precise way, that somebody can take this context from us, or process from us, and actually implement it, and allowing us to move one layer higher in focusing on the design, on the concepts, on iterating and verifying.”

Neatsun Ziv, at 19:33

Listen · Neatsun on episode 91, from 19:32
About 25 seconds: Neatsun on articulating the work as context. The clip stops on its own. Read the full transcript.

He called it “one of the fastest and most impressive transformations in an industry that I’ve ever seen.” That’s a strong claim from someone who has worked in software since 1996.

Owning the store

Jon asked what the hardest new security challenge will be for the community. Neatsun answered with an analogy from the early days of smartphones, when everybody worried about mobile malware.

“And then basically the owners of the platform kind of said, you know what? We own this. We will make sure that the stores are cleaned from issues. And every time that there’s a security issue, we will patch an update and own up to it.”

Neatsun Ziv, at 20:19

The platform owners could make that promise because they controlled every layer. Code and cloud don’t work that way.

“The challenge for the mobile application is they owned everything. They owned the decision, the store, the operating system. They knew everything. When you think about code and cloud deployment, well, first of all, you don’t have the context. You don’t own everything. You actually own the repo that you’re working on right now. So this creates a context problem.”

Neatsun Ziv, at 20:45

Listen · Neatsun on episode 91, from 20:45
About 20 seconds: Neatsun on why the cloud is a context problem. The clip stops on its own. Read the full transcript.

The repository is the slice of the world a team actually controls, and it’s also all a coding agent sees unless someone gives it more. Neatsun put the stakes in two sentences.

“Because think about it. With the right context, you solve everything. With the wrong context, you’re going to get hallucinations.”

Neatsun Ziv, at 21:16

Two columns. Mobile, as the platforms ran it, three filled boxes, the decision, the store, the operating system, and below them a filled box, they patch and own it, we will patch an update and own up to it. Code and cloud deployment, one open box, the repo you're working on, then two dashed boxes, other teams' services, the cloud it deploys to, and below them an open box, a context problem, you don't own everything. Then two quotes. With the right context, you solve everything. With the wrong context, you're going to get hallucinations.
What the mobile platform owners controlled, and what a team owns in the cloud.

Augment, not replace

Jon heard his own approach to leading people in the answer.

“When you have a team, if you’re just barking orders and giving commands about what to do, you’re really like violating autonomy. But if you set up a situation where, through the context of what’s going on, you share like the difficult problems that we’re trying to solve with that context, you’re respecting people’s autonomy to allow them to go off and think about how to solve problems.”

Jon McLachlan, at 21:28

Listen · Jon on episode 91, from 21:28
About 20 seconds: Jon on context and autonomy. The clip stops on its own. Read the full transcript.

The same move works with agents, he said, and he singled out one of Neatsun’s words.

“You used a word too, augment, which is one of my favorite words these days. And it really goes back to this idea of maybe like enhancing the things that we’re already doing as humans instead of like replacing humans.”

Jon McLachlan, at 21:59

Abuse of trust

Neatsun answered with a distinction from a conversation a few days earlier, about the difference between fraud and cyber.

“And somebody told me a sentence that just placed everything in place.”

Neatsun Ziv, at 22:19

“so cyber, it’s more about abuse of system, where fraud is more of an abuse of trust.”

Neatsun Ziv, at 22:23

Listen · Neatsun on episode 91, from 22:11
About 20 seconds: Neatsun on fraud and cyber. The clip stops on its own. Read the full transcript.

He thinks AI agents bring the second kind of problem into the first kind of system. An agent starts from a set of instructions, and the attacks he expects are attempts to break out of them.

“As we’ve seen, then it’s like, okay, can I do like the equivalent of a VM escape to the basic instruction set that the agent gets? How do I hard code things? How do I make sure that the trust given to the agent is actually enforced?”

Neatsun Ziv, at 22:38

A virtual machine escape is an attack that breaks out of a virtual machine and reaches the host it runs on (Wikipedia). The agent version breaks out of its instructions and acts with whatever access it was given. That’s why access is the place to start. Our posts on least privilege for AI agents and on whether to give the agent write access at all cover the practical side.

Two things you trust

Then Neatsun described something OX’s researchers found, which he believed had already been published.

“But let’s say that you just go to GitHub and you publish the equivalent of a typosquatting. And in this typosquatting, you’re actually adding a command that one of the famous vibe coding environments just treats as, hey, if it’s on the machine, then I’m fine with it. Then you can instruct it to actually say, you know what, write a malware locally that takes everything from the machine, just uploads it.”

Neatsun Ziv, at 23:01

Listen · Neatsun on episode 91, from 23:01
About 25 seconds: Neatsun on the typosquatting research. The clip stops on its own. Read the full transcript.

Typosquatting started with web addresses, as a form of cybersquatting that “relies on mistakes such as typos made by Internet users” (Wikipedia). The same trick works on package and repository names, and a coding agent types names too. What makes Neatsun’s example dangerous is that neither half looks wrong on its own.

“It’s a name that I think I’ve trusted, downloading this package. Yes, I’ve mistaken with the hyphen, but I got this by mistake. I’ve got this environment that I trust because it’s really doing good for me. And the combination of trusting this and trusting this is really a bad idea.”

Neatsun Ziv, at 23:30

Two open boxes at the top. A name you think you trusted, a typosquat, mistaken with the hyphen. An environment you trust, if it's on the machine, it's fine with it. Arrows lead down to a filled box, the combination, write a malware locally that takes everything from the machine. Then two quotes. And the combination of trusting this and trusting this is really a bad idea. You're combining two things that you trust.
Neatsun's two trusted things, and what happens when they meet.

He expects more of these, cases where each piece passes review and the combination doesn’t.

“I think that we’re going to find a lot of those edge cases that you think about, one solution, it’s fine. You’re combining two things that you trust. I’m sure that we’re going to find a lot of quirks over there.”

Neatsun Ziv, at 23:46

Our vibe coding security post turns this into controls, starting with an allowlist of packages and a sandbox around the agent. Jon was glad to have the problem. “I mean, stuff like that to me is exciting,” he said. “We get to think through a new problem space as security professionals, as a security community.”

The token economy

Sasha turned to the other side of the fight.

“And with AI, it’s a pretty common concept and pretty common acceptance that AI allows attackers to be a lot more nimble. How do you see the defense side of the house?”

Sasha Sinkevich, at 24:12

Listen · Sasha on episode 91, from 24:12
About 15 seconds: Sasha asks about the defense side. The clip stops on its own. Read the full transcript.

Neatsun flagged his answer as an opinion he hasn’t proven, and then made the case with prices.

“It is my opinion. I haven’t proven it yet, but it actually increases the asymmetry between the attackers and the defenders. Think about token economy for a second. So in token economy, every intent that you have costs you something, let’s say tokens.”

Neatsun Ziv, at 24:40

For an attacker, a cheap request does a lot of work.

“You can actually say, you know what, take my code and scramble it so it won’t look the same. It would cost you a few tokens, a few millions of tokens, nothing big. It’s like $10, really, for a deep work.”

Neatsun Ziv, at 25:10

Listen · Neatsun on episode 91, from 25:10
About 15 seconds: Neatsun on what scrambling code costs an attacker. The clip stops on its own. Read the full transcript.

A defender pays for every look at everything, and most of what gets looked at is harmless. Neatsun cited research he’d seen putting the malicious share of traffic at “like 0.3% of malicious content, or unwanted content.” Looking at all of it with an expensive model is the naive way, and it costs the defender far more than the attacker spent.

“And as part of it, it actually puts a very, very, very high cost on the defender if you’re going to do it in a very naive way.”

Neatsun Ziv, at 25:39

OX’s answer is to spend the expensive scans where they count and let cheap patterns do the rest. The model helps write the patterns too.

“So instead of human analysts actually working on generating hundreds of what we call signatures, we can really automate this loop and just say, hey, what are the odd cases?”

Neatsun Ziv, at 25:58

“And I would just balance the cost, saying, most of the time I’m going to do pattern base. Periodically, I’m going to do like a deep scan. And you need to start thinking about things in a different way. I don’t think that we’ve figured this one out.”

Neatsun Ziv, at 26:15

Two boxes at the top. Filled, the attacker, about $10, a few million tokens to scramble code. Open, the defender, everything, about 0.3% of it malicious, in his telling. Below, how OX balances the cost, in three dashed boxes. Pattern-based, most of the time. A deep scan, periodically. AI, edge cases and new patterns. Then a quote. I don't think that we've figured this one out.
The token economy as Neatsun laid it out, with his own figures.

Rejah Rehim made a related point on episode 82, that the attackers’ models have no guardrails. Our vibe coding security post has a section on who pays for scanning.

The law of unintended consequences

Jon changed direction and asked whether Neatsun would take the chance to meet his younger self, and what he’d tell him. Neatsun found the first half the harder question.

“You meet yourself, then your younger self actually knows how your older self is going to be. So am I actually eliminating timelines that I don’t know? That’s a very tricky question.”

Neatsun Ziv, at 27:08

Jon added that there’s a self-acceptance piece to the question too, since changing yourself could leave you a different version of yourself. Neatsun thought the meeting would help, and doubted it would end well.

“I think that, yes, it will definitely augment my previous self. I’m not sure that the law of unintended consequences will actually be in my favor in this case. So I don’t know.”

Neatsun Ziv, at 27:35

The law he named is older than any software. The sociologist Robert K. Merton popularized it in the twentieth century, starting with a 1936 paper, “The Unanticipated Consequences of Purposive Social Action” (Wikipedia).

So Jon offered a version without the time travel, someone very similar to his younger self. Neatsun’s advice was about risk, and about sleeping afterwards.

“But I would probably say, at least in our space, I would probably say that it’s really about taking risks. And while keeping it safe makes a lot of sense, part of this journey is really about taking the risk and be able to go to sleep and actually sleep. It’s not as easy as it sounds.”

Neatsun Ziv, at 28:04

Listen · Neatsun on episode 91, from 28:04
About 20 seconds: Neatsun on taking risks and sleeping at night. The clip stops on its own. Read the full transcript.

All the gear all the time

Jon took the risk theme somewhere personal. He rides motorcycles.

“There’s this saying, like, all the gear all the time, which kind of goes along with our discussion around like security. We don’t need to take astronomical risks, but you need to be prepared for the inevitable.”

Jon McLachlan, at 28:44

Neatsun said motorcycles have their advantages, “not necessarily in the wintertime,” and Jon asked Sasha, who rides occasionally, to weigh in. Sasha brought it back to the work.

“Occasionally. I was going to say, isn’t that what security is all about? It’s managing the risk. It’s a scale. In any product, security is usually there for a reason, and that reason is to protect the crown jewels and protect the business.”

Sasha Sinkevich, at 29:03

Listen · Sasha on episode 91, from 29:02
About 15 seconds: Sasha on security as managing risk. The clip stops on its own. Read the full transcript.

The scale has a cost on the other side, Sasha said, because security can read as overhead and as a brake on where the business wants to go. The answer is to build it in.

“It’s very important that security is an integral part that is very seamless. It shouldn’t introduce friction, but rather it should add value while being very seamlessly integrated in the background.”

Sasha Sinkevich, at 29:37

It’s not the security that slows the business

Neatsun offered a different angle on the same point.

“I’ve got like similar, but a bit different perspective. Usually it’s not the security that is slowing the business.”

Neatsun Ziv, at 29:50

Listen · Neatsun on episode 91, from 29:50
About 15 seconds: Neatsun on what really slows a business down. The clip stops on its own. Read the full transcript.

What slows it down, in his view, is a vague decision to do or block something, made out of past experience, regulation or fear. He has seen security leaders take the opposite approach with their regulators.

“I had the opportunity to talk with a few CISOs that went into the regulator and say, hey, look, this is a really, really bad idea. I want to explain to you, this is not what I’m going to do. This is what I’m going to do. Instead, this is actually a better risk profile.”

Neatsun Ziv, at 30:09

The tool that makes that conversation possible is the compensating control, a different way of meeting the same goal when the obvious reading of a rule doesn’t fit. The constraint underneath is headcount.

“So we’re trying to put like a generic security for everybody, saying, for most people, this should work. And this is the most cost-effective thing that we can do, placing security at 300 people to one ratio, let’s say. Now, if you had security in a one to 50 ratio, hey, you can do way better than that one. But most of us don’t have this luxury.”

Neatsun Ziv, at 31:11

Michael Nov described the view from inside on episode 76, three people reviewing designs for three hundred engineers. Generic security at ratios like these is a reasonable default, and context is what lets a team do better than generic.

Life is all about managing expectations

Neatsun closed the answer with a sentence he said he has been thinking about for twenty-some years.

“I think somebody told me a sentence like twenty something years ago, and I’m still chewing on that sentence. And it said, life is all about managing expectations. And that’s like the end of the sentence. And the more you think about the sentence, it’s like it makes perfect sense.”

Neatsun Ziv, at 31:30

Listen · Neatsun on episode 91, from 31:30
About 15 seconds: Neatsun on managing expectations. The clip stops on its own. Read the full transcript.

“Well said,” Sasha said. Jon had a sentence of his own.

“I’ve heard a similar sentence, or your sentence reminds me of this one, is that everything is temporary.”

Jon McLachlan, at 31:49

“I think it’s important that we have these sorts of discussions, and we have them as a community, and we think about them individually, and we noodle on these, especially as we undergo such rapid change, right? So we can navigate that together.”

Jon McLachlan, at 31:57

Three years, not eighteen months

Sasha’s last question pulled the threads together. Security and compliance work has to fit where the business is today.

“Just like we said, there are a lot of pain points that we have to solve in the security and compliance space, but it needs to be timely, just like a lot of things in life.”

Sasha Sinkevich, at 32:27

Neatsun said he had an obvious answer and a more complicated one, and went to identity as his example. Some investments have to be made ahead of the need.

“So some places you do need to invest ahead of time, even though you’re gambling, you’re taking a bigger solution than you need right now, with the understanding that, hey, this is not like the ultimate solution that a company 10x from us will do, but we’re going to move to that space.”

Neatsun Ziv, at 33:00

The cost of guessing too small isn’t the license. It’s the migration, and the project it pushes aside.

“And painful not in the cost sense, in this needs to be prioritized over another project that I want. And you’re basically saying, oh, I need to do this again. So I’m going to waste a quarter in a year and a half from now, when I’m going to be too big for the current solution.”

Neatsun Ziv, at 33:27

His rule of thumb is a horizon.

“So three years, yes, I’m fine with gambling on, solution is fine right now. Gambling on eighteen months, I don’t know. It’s a very delicate balancing question.”

Neatsun Ziv, at 33:58

Listen · Neatsun on episode 91, from 33:57
About 10 seconds: Neatsun on the three-year horizon. The clip stops on its own. Read the full transcript.
An open box at the top, a bigger solution than you need right now, not the ultimate one a company 10x from us would choose. Below, a horizontal line from now on the left, past a dashed mark at eighteen months, gambling on it, I don't know, to a filled mark at three years on the right, fine with gambling on. Below, a dashed box, the cost of guessing too small, a migration that has to be prioritized over another project. Then a quote. It's a very delicate balancing question.
Neatsun's horizon for an identity investment.

For more on why identity sits under everything else, Jasson Casey of Beyond Identity made the case on episode 92 that identity sees everything. “There’s a time and a place for everything,” Jon said as they wrapped up, and thanked Neatsun for “all of those vulnerable and very deep moments that we get to share together.”

What happened after the tape

The episode aired on March 24, 2026, and went up on YouTube on June 17 (YouTube). The next day OX announced that the inaugural Gartner Magic Quadrant for Software Supply Chain Security named it a Leader. OX’s announcement called the software supply chain “the defining attack surface of the last five years,” naming SolarWinds, Log4Shell, XZ Utils and the self-propagating Shai-Hulud package campaign (OX Security).

OX’s researchers also spent much of 2026 on the Model Context Protocol, the standard AI agents use to connect to tools. In August, OX reported a Shai-Hulud worm payload delivered through a listing in the official MCP Registry, and in September it analyzed 15,465 MCP servers and found that 2.3 percent of their hostnames no longer resolved. Our post on the MCP server that passed review and then changed has both, with the sources. In October, Neatsun congratulated the team. Its first MCP project of the year, he wrote, had led to more than 30 disclosures and more than 10 CVEs, and its second asked what agents are being connected to.

What are we actually connecting our AI agents to?

Neatsun Ziv · October 8, 2026
Neatsun on OX's second major MCP research project of the year, an analysis of 15,465 published MCP servers. View on LinkedIn.

In September Neatsun wrote that “The AI agents we’re securing today aren’t the ones we’ll be securing tomorrow,” and argued for building security around what agents will be able to do rather than how today’s agents are built (LinkedIn). It’s the threat model problem from the episode, a design that keeps changing under the people securing it.

Then, in October, came the clearest picture yet of the gap between knowing and fixing. On October 21 the PHP project shipped emergency fixes for PHP2Shell, two critical flaws, CVE-2026-109618 and CVE-2026-109619, that allow unauthenticated remote code execution in the PHP engine. OX counted more than 2.2 million publicly visible PHP instances through Shodan. Twenty-four hours later, 14,151 of the 1,974,890 it could place in the affected range showed a patched version, 0.7 percent (OX Security).

That's an enormous gap between knowing about a critical vulnerability and actually fixing it.

Neatsun Ziv · October 22, 2026
Neatsun on OX's 24-hour count, the day after he spoke to CNBC about PHP2Shell. View on LinkedIn.

OX kept counting. Five days after disclosure, 127,430 of 1,990,772 measurable affected hosts were patched, which left 93.6 percent exposed, and about 1.33 million of the affected hosts ran end-of-life PHP branches that no longer get official fixes (OX Security).

Six bars for the share of measurable affected PHP hosts still unpatched. October 21, 245 patched, 99.99%. October 22, 14,151 patched, 99.28%. October 23, 42,978 patched, 97.81%. October 24, 83,180 patched, 95.78%. October 25, 102,201 patched, 94.80%. October 26, 127,430 patched, 93.60%.
Five days of PHP2Shell patching, from OX's daily Shodan counts.
OX's day-five update, which also lists the 24-hour figure of 99.3% unpatched. View on X.

These are OX’s numbers from public scans, measured by a company that sells application security, and they only count hosts that advertise their PHP version. They still line up with what Neatsun said on the tape seven months earlier, that great detection with nobody fixing means “You hadn’t done anything, really.” Two days later OX introduced Agent Activity, which it describes as a way to see what your AI agents are actually doing (OX Security).

A timeline of seven entries. Dashed, March 2026, episode 91 airs, on March 24, with Jon and Sasha. Dashed, June 2026, on YouTube, the episode goes up as a video on June 17. Filled, June 2026, a Leader, in the inaugural Gartner Magic Quadrant for Software Supply Chain Security, on June 18. Open, August 2026, a worm in the MCP Registry, OX reports a Shai-Hulud payload delivered through an official listing. Open, September 2026, 15,465 MCP servers, OX finds 2.3 percent of their hostnames no longer resolve. Open, October 2026, PHP2Shell, 99.3% of measurable affected PHP instances unpatched after 24 hours, 93.6% after five days. Filled, October 2026, Agent Activity, OX introduces a way to see what AI agents are actually doing.
The episode and what followed, in OX's research and Neatsun's posts.

Did you catch it? A six-question quiz

Interactive · six questions

Did you catch it?

Six questions on what Neatsun, Jon and Sasha actually said, with the timestamp for each answer. The answers are under each question for anyone reading without JavaScript.

  1. How many issues does Neatsun say companies often turn out to have?

    1. About five thousand
    2. Like five million
    3. About fifty

    b. "you actually see that they've got like five million issues" Transcript, 2:47.

  2. Out of 20 prioritized defects, how many did Neatsun's 600 developers say they were willing to fix?

    1. Two
    2. Ten
    3. All twenty

    a. "And out of the 20 prioritized, they said, we are willing to fix two." Transcript, 3:55.

  3. In the sentence Neatsun borrows for AI context, what does a big enough lever move?

    1. A mountain
    2. The market
    3. A planet

    c. "give me a big enough lever and I'll move a planet" Transcript, 6:12.

  4. In the sentence someone gave Neatsun, what is fraud an abuse of?

    1. Systems
    2. Trust
    3. Money

    b. "so cyber, it's more about abuse of system, where fraud is more of an abuse of trust." Transcript, 22:23.

  5. About what does Neatsun say it costs an attacker to have code scrambled so it won't look the same?

    1. About $10
    2. About $1,000
    3. About $100,000

    a. "It's like $10, really, for a deep work." Transcript, 25:21.

  6. For an identity investment, which horizon is Neatsun fine gambling on?

    1. Six months
    2. Eighteen months
    3. Three years

    c. "So three years, yes, I'm fine with gambling on, solution is fine right now." Transcript, 33:58.

Signal or noise?

Eight questions on whether your security findings arrive with the context a developer needs. Each one links the part of the episode it comes from.

Scorecard · eight questions

Signal or noise?

Answer for the code you ship and the systems it runs on today, not the plan. If two answers fit, pick the lower one.

  1. When a scanner flags a vulnerable dependency, what does the finding tell the developer?

    • A severity score and a package name
    • The severity plus the repository and who owns it
    • Whether the code is deployed, reachable and exposed to the internet

    "Just understand the context." See Five million issues.

  2. How many of your open findings could you show matter, today?

    • We don't know
    • We've checked the critical ones by hand
    • Every open finding is tagged with whether it's reachable and exposed

    "And then you go one over one, just sample them, and you see that most of them are not relevant." See Five million issues.

  3. Do you know which services hold customer data, take payments or handle secrets?

    • Not really
    • A few people know
    • It's written down in an inventory the tools can read

    "But the challenge is most of us are coming blind to those questions." See Coming blind.

  4. What reaches a developer when a finding is real?

    • A ticket with a severity score
    • A ticket with the context and a suggested fix
    • A pull request with the fix, ready to review

    "Just all of this information is available, but we are just shifting it to somebody else to fix, and nobody's taking care of that." See Bring the details for them.

  5. Do your AI coding agents get your security rules before they write code?

    • No
    • Some repositories have a rules file
    • Every repository has a security context file the agents read

    "So with the right context, you can do marvelous things." See A big enough lever.

  6. How do you decide which findings you won't fix?

    • We don't, they stay in the backlog
    • Case by case, when someone asks
    • An accepted-risk register, re-checked when the context changes

    "There is always going to be a risk." See Is a million good or bad?

  7. How do new packages get into your builds?

    • Whatever a developer or an agent installs
    • Lockfiles, but no allowlist
    • An approved registry or allowlist, with pinned versions

    "And the combination of trusting this and trusting this is really a bad idea." See Two things you trust.

  8. When a critical flaw hits something you expose to the internet, how fast is it patched?

    • We'd find out when someone asks
    • Within days
    • Within hours, and we can show it

    "But then nobody's actually picking up the phone and fixing that." See Great detection, nobody fixing.

Noise

Your findings probably reach developers without the details they need to act. Start with two moves: tag your services with what they expose and what data they hold, and sample 20 open findings to see how many still matter.

Some signal

Part of the context is there. Close the gaps next: send real findings to the owner with a drafted fix, give your coding agents a security context file, and write down the risks you accept.

Signal

Your findings probably arrive with the context to act on them. Keep it that way as you grow, because the context changes faster than the code, and time your patch window on the next critical disclosure.

How long would your backlog take?

The order you work a backlog in decides how long the findings that matter wait. Put in your own numbers.

Calculator

How long would your backlog take?

Three estimates: how many findings are open, the share you'd still call a real risk once you know what's deployed, reachable and exposed, and how many fixes your team ships in a month.

–months to work the whole queue
–findings that matter
–months to fix those first
–for the accepted-risk register

Worked top to bottom, the queue takes 50.0 months. Sorted by context first, the 200 findings that matter are done in 5.0 months, and the other 1,800 go into an accepted-risk register to re-check when their context changes.

A rough model, not a measurement. It assumes every fix takes the same effort and nothing new arrives. In practice new findings keep coming, which makes the order matter more. The share that matters is yours to estimate, and sampling 20 findings by hand is a quick way to start.

From Scitex to PHP2Shell

Everything on this page sits on one timeline, from Neatsun’s first job to OX’s October counts. Filter it by thread.

Timeline · 1996 to 2026

From Scitex to PHP2Shell

Filter by thread. Dates are from the public record except where marked as part of this show.

  1. First jobs in software

    Software development at Scitex, then Motorola (LinkedIn).

  2. Israel Defense Forces

    A software developer, to 2003 (LinkedIn).

  3. Shift left gets a name

    Larry Smith writes about shift-left testing in Dr. Dobb's Journal (Wikipedia).

  4. Vanadium Security

    Neatsun's first company, as founder and chief executive officer, to September 2011 (LinkedIn).

  5. Check Point

    Director for secure cloud, where Neatsun and Lior Arzi start two weeks apart (LinkedIn, on this show).

  6. Vice president

    Threat prevention and intelligence at Check Point, to July 2021 (LinkedIn).

  7. OX Security

    Neatsun and Lior Arzi start the company, based in New York and Tel Aviv (TechCrunch).

  8. Log4Shell

    The Log4j flaw reported in November gets its CVE identifier (Wikipedia).

  9. Vibe coding

    Andrej Karpathy coins the term (Wikipedia).

  10. Series B

    $60 million led by DTCP, for $94 million raised in total (TechCrunch).

  11. Meet VibeSec

    OX introduces VibeSec, for insecure code in AI coding tools (YouTube).

  12. Episode 91 airs

    "With the right context, you solve everything." (Transcript).

  13. On YouTube

    Episode 91 goes up as a video (YouTube).

  14. A Leader in a new Magic Quadrant

    The inaugural Gartner Magic Quadrant for Software Supply Chain Security (OX Security).

  15. A worm in the MCP Registry

    OX reports a Shai-Hulud payload delivered through an official registry listing (our MCP post).

  16. Tomorrow's agents

    Neatsun on securing what agents will be able to do, not today's designs (LinkedIn).

  17. 15,465 MCP servers

    2.3 percent of their hostnames no longer resolve (our MCP post).

  18. Two MCP projects

    The first led to more than 30 disclosures and more than 10 CVEs, by Neatsun's account (LinkedIn).

  19. PHP2Shell

    Emergency fixes for two critical flaws in the PHP engine (OX Security).

  20. 99.3% unpatched

    OX's count of measurable affected PHP instances, 24 hours after the fixes (OX Security).

  21. 93.6% after five days

    About 1.33 million of the affected hosts run end-of-life PHP (OX Security).

  22. Agent Activity

    OX introduces a way to see what AI agents are actually doing (OX Security).

What to do this week

Five things, in the order Neatsun’s argument suggests.

  1. Sample your backlog. Pick 20 open findings at random and answer Neatsun’s questions for each one. Is it live, is it exposed, can anything reach it? Count how many still matter. The scorecard above is a quick first pass, and the calculator shows what the order of work is worth.
  2. Write the context down once. Tag every service with what it exposes to the internet and what data it holds, and check a security context file into each repository so your coding agents read your rules before they write code. Our vibe coding security post has a checklist, and our secure AI development team sets this up with startups.
  3. Send fixes, not tickets. When a finding is real, it should reach the person who owns the code with the context attached and, wherever possible, a drafted fix ready to review. That’s how our vulnerability remediation program runs, with a senior engineer reviewing every change.
  4. Write down the risks you accept. Keep a register of the findings you won’t fix, why, and what change would reopen each one. It turns a backlog that never shrinks into decisions you can show an auditor or a customer’s security team.
  5. Pin what you trust, and time your patch window. Use an approved registry or allowlist with pinned versions, and run coding agents in a sandbox with scoped credentials. On the next critical disclosure, time how long your internet-facing systems take to patch. If you’d like a second pair of eyes on any of it, book 15 minutes with us.

Key takeaways

  1. Shift left failed because of priorities, not tools

    Neatsun Ziv says OX Security was founded on the problem statement that shift left had failed for years. Developers have their own priorities, and it's very hard to fix security as you go when it arrives as one more item on a full list.

  2. Most findings aren't relevant

    Companies can turn up something like five million issues. Sample them one by one, Neatsun says, and most aren't relevant: an example password with a comment saying so, a critical Log4j copy in a test application that never reaches production, a container issue on an internal lab.

  3. Noise teaches developers to ignore you

    Push a lot of noise toward developers and ask them to fix it, and what comes back is that they ignore you. When Neatsun managed about 600 developers and gave them 20 prioritized defects, they agreed to fix two, and each answer about the rest was a detail somebody could have looked up first.

  4. Bring the details before you ask

    Is it live, is it exposing an API, is it exposed to the cloud, is it a live Kubernetes agent? The information is available, Neatsun says, but it gets shifted to someone else to collect, and nobody does. OX's starting idea was to bring those details with the finding.

  5. Give the context to the coding agent first

    Rather than collect context for the developer after the code exists, load it in front of the vibe coding agent: which API is externally exposed, which databases and microservices are involved, which security restrictions, rate limits and sanitization apply. Then why wait for the wrong code to be written?

  6. Context is the lever

    With the right context, Neatsun says, you can do marvelous things, and he reached for the line about a big enough lever moving a planet. The Archimedes version is about a place to stand. In his version, the weight that moves everything is context.

  7. A founder has to burn the bridge

    Neatsun left a vice president's job at a large security company because a big company can't do everything it's doing and still focus on new projects. A new company needs absolute focus, no regrets, no undo, and no easy way back.

  8. Every milestone is the best and the worst day

    The high is seeing that a goal is achievable. The low comes a second later, when the next goal lands and it's from 20 to 50 rather than 10 to 20, and the math doesn't make sense yet. You scrape yourself off the floor, keep going, and you need a lot of luck.

  9. "I don't want any risks" is a bad answer

    Neatsun starts with what a customer is trying to achieve. Wanting no risk isn't an answer. The real answer is a comfortable spot between investing nothing and paying for a lot, and the goal of an AppSec program is to reduce risk, not cancel it.

  10. Detection without a fix does nothing

    Great detection and great visibility don't count if nobody picks up the phone and fixes the issue. A developer has product managers, a Jira backlog and customers, so asking them to stop everything for a million issues won't happen. The better question is how to draw attention to what matters and get it to the right person.

  11. Three seats: buyer, evaluator, fixer

    In larger companies the economic buyer is usually the CISO, AppSec and DevSecOps evaluate, and engineering and DevOps solve the problem, a flow from strategic to operational. At a startup the three seats are often one person.

  12. Training alone can't keep up

    Developers who meet CSRF or SQL injection for the first time look it up themselves. Training everyone is mission impossible, Neatsun says, because within a year a third of them have moved on and there's somebody else to train.

  13. Everybody is becoming a manager

    In the vibe coding era, engineers have moved from giving commands to describing intent, and from intent to policies and structures that agents work inside. Security can add its own agent to that team, and a threat model can finally keep up with the code.

  14. The cloud is a context problem

    Mobile platform owners could clean their stores because they owned the decision, the store and the operating system. In code and cloud deployment a team owns the repo it's working on. With the right context, you solve everything. With the wrong context, you get hallucinations.

  15. Watch for two trusted things combined

    OX's researchers showed how a typosquatted name and a vibe coding environment that trusts whatever is on the machine combine into malware that uploads everything. Each piece passes on its own. Neatsun expects many more cases like it.

  16. Cheap attacks, expensive naive defense

    Scrambling code costs an attacker about $10 in tokens, while a defender who scans everything with AI pays far more for mostly harmless traffic. OX balances the cost with pattern-based scanning most of the time, periodic deep scans, and AI for edge cases.

  17. It's not security that slows the business

    What slows a business is a vague decision driven by past experience, regulation or fear. Neatsun has seen CISOs explain a better risk profile to regulators using compensating controls, and he notes that most teams don't have the luxury of one security person for every 50 people.

  18. Invest ahead, but not too far ahead

    Using identity as his example, Neatsun says to take a bigger solution than you need now, not the one a company ten times your size would run. Guess too small and the migration costs a quarter you wanted for something else. Gambling on three years is fine. Eighteen months, he doesn't know.

Chapters

Tap a chapter to play from there. The play icon beside it opens that moment on YouTube.

Pull quotes

“OX was formed with the problem statement that shift left as a concept failed us for years.”

Neatsun Ziv ·

“We've been trying to make it work, but it's just that everybody's got their priorities.”

Neatsun Ziv ·

“It is super hard to try and fix security as we go along.”

Neatsun Ziv ·

“There are so many things we could be solving every day, but we cannot spread too thin.”

Sasha Sinkevich ·

“And then you go one over one, just sample them, and you see that most of them are not relevant.”

Neatsun Ziv ·

“Just understand the context.”

Neatsun Ziv ·

“If you're going to push a lot of noise towards developers and ask them to fix things, what you're going to get back is actually they're going to ignore you.”

Neatsun Ziv ·

“And out of the 20 prioritized, they said, we are willing to fix two.”

Neatsun Ziv ·

“What we had in mind is, why are we expecting somebody else to bring these details? Why don't we just go in and bring these details for you?”

Neatsun Ziv ·

“Just all of this information is available, but we are just shifting it to somebody else to fix, and nobody's taking care of that.”

Neatsun Ziv ·

“First of all, yes. I think for years we know it's all about the context.”

Neatsun Ziv ·

“But the challenge is most of us are coming blind to those questions.”

Neatsun Ziv ·

“And as part of this journey, we started getting to play, saying, hey, if you've got the context in advance, why wait for the wrong code to be actually written?”

Neatsun Ziv ·

“Why don't we move that to a vibe coding agent with the right context?”

Neatsun Ziv ·

“So with the right context, you can do marvelous things.”

Neatsun Ziv ·

“Just looking at OX Security, it's like VibeSec, security that vibes the way that software is built.”

Jon McLachlan ·

“And now, as an engineer, we're a little bit more like almost managing these agents as they produce a lot of the code that ends up in production systems.”

Jon McLachlan ·

“But at a certain point, you do understand that large companies have this disadvantage, that you can't do everything that you're doing and still focus on new projects.”

Neatsun Ziv ·

“You actually need to burn the bridge behind you.”

Neatsun Ziv ·

“It's like you never know if you're going up next minute or down. You just know that it's going somewhere that you don't expect.”

Neatsun Ziv ·

“We actually joined the company with a two weeks difference from each other.”

Neatsun Ziv ·

“So, yeah, well, he's got this amazing trait not to get excited from anything. And I'm exactly the opposite. So it's like he balances me off.”

Neatsun Ziv ·

“Like, I've tested other products. I know why they failed miserably, and we have a shot at doing something better.”

Neatsun Ziv ·

“I'd probably say that every time that we're getting to a new milestone, it's like the best and the worst day.”

Neatsun Ziv ·

“It's like you need to scrape yourself from the floor and start from the beginning.”

Neatsun Ziv ·

“It's like you don't need a bit of luck, you need a lot of luck.”

Neatsun Ziv ·

“Usually it starts with a very basic question, which is, what are you trying to achieve?”

Neatsun Ziv ·

“So the basic answer is simply, I don't want any risks. And that is usually a bad answer.”

Neatsun Ziv ·

“It's like, you will need to accept risks, and you kind of need to understand where it is that you feel comfortable.”

Neatsun Ziv ·

“It's not canceling the risk. There is always going to be a risk.”

Neatsun Ziv ·

“But then nobody's actually picking up the phone and fixing that. You hadn't done anything, really.”

Neatsun Ziv ·

“It's about how do I drive execution on where I want to draw the attention?”

Neatsun Ziv ·

“So everybody has a different risk profile, and we're just helping them with this journey.”

Neatsun Ziv ·

“But at the end of the day, it needs to be aligned with business initiatives, and the question is, who is your economical buyer at that point in the company's journey?”

Sasha Sinkevich ·

“So I would say that the economic buyer in larger companies is usually the CISO of the organization.”

Neatsun Ziv ·

“So you've got this flow from strategic to operational, to actually hammering down issues one by one.”

Neatsun Ziv ·

“And if you think about it, when developers see issues, even engineering managers, they are not equipped to understand what is important versus what is not important.”

Neatsun Ziv ·

“You're training your developers, and within a year, a third of them moved away, and you've got somebody else to train.”

Neatsun Ziv ·

“I think that as we're entering the vibe coding era, what we are seeing is that everybody's becoming a manager.”

Neatsun Ziv ·

“And this is also an opportunity to take pieces of the AppSec, CloudSec, product security mentality and actually say, hey, maybe an agent on our behalf should be part of this game as well.”

Neatsun Ziv ·

“But that was always like a futile exercise.”

Neatsun Ziv ·

“I think this is going to be one of the fastest and most impressive transformations in an industry that I've ever seen.”

Neatsun Ziv ·

“You actually own the repo that you're working on right now. So this creates a context problem.”

Neatsun Ziv ·

“With the right context, you solve everything. With the wrong context, you're going to get hallucinations.”

Neatsun Ziv ·

“When you have a team, if you're just barking orders and giving commands about what to do, you're really like violating autonomy.”

Jon McLachlan ·

“And it really goes back to this idea of maybe like enhancing the things that we're already doing as humans instead of like replacing humans.”

Jon McLachlan ·

“How do I make sure that the trust given to the agent is actually enforced?”

Neatsun Ziv ·

“And the combination of trusting this and trusting this is really a bad idea.”

Neatsun Ziv ·

“We get to think through a new problem space as security professionals, as a security community.”

Jon McLachlan ·

“I haven't proven it yet, but it actually increases the asymmetry between the attackers and the defenders.”

Neatsun Ziv ·

“It's like $10, really, for a deep work.”

Neatsun Ziv ·

“Periodically, I'm going to do like a deep scan.”

Neatsun Ziv ·

“I'm not sure that the law of unintended consequences will actually be in my favor in this case.”

Neatsun Ziv ·

“And while keeping it safe makes a lot of sense, part of this journey is really about taking the risk and be able to go to sleep and actually sleep.”

Neatsun Ziv ·

“We don't need to take astronomical risks, but you need to be prepared for the inevitable.”

Jon McLachlan ·

“Occasionally. I was going to say, isn't that what security is all about? It's managing the risk.”

Sasha Sinkevich ·

“It shouldn't introduce friction, but rather it should add value while being very seamlessly integrated in the background.”

Sasha Sinkevich ·

“Usually it's not the security that is slowing the business.”

Neatsun Ziv ·

“But most of us don't have this luxury.”

Neatsun Ziv ·

“And it said, life is all about managing expectations.”

Neatsun Ziv ·

“I've heard a similar sentence, or your sentence reminds me of this one, is that everything is temporary.”

Jon McLachlan ·

“Just like we said, there are a lot of pain points that we have to solve in the security and compliance space, but it needs to be timely, just like a lot of things in life.”

Sasha Sinkevich ·

“So I'm going to waste a quarter in a year and a half from now, when I'm going to be too big for the current solution.”

Neatsun Ziv ·

“Gambling on eighteen months, I don't know. It's a very delicate balancing question.”

Neatsun Ziv ·

About the guest

Neatsun Ziv, Co-Founder and Chief Executive Officer, OX Security

Neatsun Ziv is the co-founder and chief executive officer of OX Security, the application security company he started in October 2021 with Lior Arzi, its chief product officer, whom he met at Check Point. He spent almost ten years at Check Point, as director for secure cloud from December 2011 and then as vice president of threat prevention and intelligence from June 2016 to July 2021. Before that he founded and ran Vanadium Security from 2003 to 2011, after starting out in software development at Scitex and Motorola and as a software developer in the Israel Defense Forces. He is based in the New York City area.

About the host

Jon McLachlan and Sasha Sinkevich are co-founders of YSecurity, the on-demand cybersecurity team for startups, and of Cyberbase.ai. The Security Podcast of Silicon Valley is hosted by Jon McLachlan and Sasha Sinkevich. Jon McLachlan on LinkedIn ↗Sasha Sinkevich on LinkedIn ↗

Context and sources

  • Neatsun Ziv on LinkedIn: co-founder and CEO of OX Security, ex-VP at Check Point, in the New York City Metropolitan Area, with Harvard Business School Executive Education. Source ↗
  • Neatsun Ziv's LinkedIn experience: co-founder and CEO of OX Security since October 2021, vice president of threat prevention and intelligence at Check Point from June 2016 to July 2021 and director for secure cloud there from December 2011, founder and CEO of Vanadium Security from 2003 to September 2011, a software developer in the Israel Defense Forces from 1998 to 2003, and earlier software development at Motorola and Scitex. Source ↗
  • OX Security, about: the mission of a world where software secures itself, a Prompt-to-Runtime platform, VibeSec to prevent insecure code and destructive scenarios in AI coding tools, and a leadership team including co-founder and chief product officer Lior Arzi. Source ↗
  • TechCrunch, May 7, 2025: OX Security raises a $60 million Series B led by DTCP, with IBM Ventures, Microsoft, Swisscom Ventures, Evolution Equity Partners and Team8, for $94 million in total. Founded in 2021 by Neatsun Ziv and Lior Arzi, who met at Check Point, the New York and Tel Aviv company had about 200 customers and 150 employees, analyzed more than 100 million lines of code a day, and generated around $10 million in annual recurring revenue that Ziv expected to double by the end of the year. Source ↗
  • OX Security, June 18, 2026: OX is a Leader in the inaugural Gartner Magic Quadrant for Software Supply Chain Security. The announcement calls the software supply chain the defining attack surface of the last five years and names SolarWinds, Log4Shell, XZ Utils and Shai-Hulud. Source ↗
  • OX Security, August 2026: a Shai-Hulud worm payload delivered through a listing in the official MCP Registry. Source ↗
  • OX Security, September 2026: an analysis of 15,465 MCP servers across three registries, in which 2.3 percent of hostnames no longer resolved. Source ↗
  • Neatsun Ziv on LinkedIn, September 16, 2026: the AI agents being secured today aren't the ones that will be secured tomorrow, so build security for the capabilities agents are likely to have. Source ↗
  • Neatsun Ziv on LinkedIn, October 8, 2026: OX's MCP research, including systemic vulnerabilities at the core of MCP that led to more than 30 disclosures and more than 10 CVEs, and an analysis of 15,465 published MCP servers. Source ↗
  • OX Security, October 22, 2026: PHP2Shell, CVE-2026-109618 and CVE-2026-109619, unauthenticated remote code execution in the PHP engine with emergency fixes on October 21. OX tracked more than 2.2 million publicly visible PHP instances through Shodan, and 24 hours later 14,151 of 1,974,890 measurable instances in the affected range showed a patched version, 0.7%. Source ↗
  • Neatsun Ziv on LinkedIn, October 22, 2026: OX's 24-hour PHP2Shell count, the gap between knowing about a critical vulnerability and fixing it, and his CNBC interview the day before. Source ↗
  • OX Security, October 26, 2026: five days after the PHP2Shell fixes, 127,430 of 1,990,772 measurable affected hosts were patched and 93.6% were still exposed, with about 1.33 million affected hosts on end-of-life PHP branches. Hosts that hide their PHP version are left out. Source ↗
  • OX Security on X, October 26, 2026: five days after PHP2Shell dropped, 93.6% of measurable PHP instances are still unpatched. Source ↗
  • OX Security, October 28, 2026: Introducing Agent Activity, a way to see what AI agents are actually doing. Source ↗
  • OX Security on YouTube, September 30, 2025: Meet VibeSec. Source ↗
  • OX Security on YouTube, April 23, 2025: The Science Behind Alert Fatigue in Security Teams, and How to Beat It, with Matt Johansen and Moshe Bar. Source ↗
  • Wikipedia, shift-left testing: the term was coined by Larry Smith in Dr. Dobb's Journal in September 2001. Source ↗
  • Wikipedia, Log4Shell: a remote code execution vulnerability in the Log4j logging framework, reported in November 2021, given its CVE identifier on December 10, 2021, and unnoticed in the code since 2013. Source ↗
  • Wikipedia, vibe coding: coined by Andrej Karpathy in February 2025 and named the Collins English Dictionary Word of the Year for 2025. Source ↗
  • Wikipedia, Archimedes: Pappus of Alexandria attributed to him the remark about a place to stand and moving the Earth, and Archimedes proved the law of the lever. Source ↗
  • Wikipedia, typosquatting: a form of cybersquatting that relies on mistakes such as typos. Source ↗
  • Wikipedia, cross-site request forgery: an exploit in which unauthorized commands are submitted from a user that the web application trusts. Source ↗
  • Wikipedia, SQL injection: a code injection technique used to attack data-driven applications. Source ↗
  • Wikipedia, threat model: identifying and enumerating potential threats to a system and what to do about them. Source ↗
  • Wikipedia, virtual machine escape: a program breaking out of the virtual machine it runs on and interacting with the host operating system. Source ↗
  • Wikipedia, unintended consequences: Robert K. Merton popularized the concept in the twentieth century, starting with The Unanticipated Consequences of Purposive Social Action in 1936. Source ↗

Transcript

Automatic transcription. Jon McLachlan and Sasha Sinkevich host this episode. There is no diarization on the tape, so speaker labels were assigned from the content and checked passage by passage against reference recordings of each voice from this episode, and a few short lines may sit with the wrong speaker. The sponsor reads at the start and end are summarized in brackets. Names and product names were normalized where the recognizer misheard them (Jon McLachlan, Sasha Sinkevich, Neatsun Ziv, OX Security, VibeSec, YSecurity, AppSec, CloudSec, typosquatting). Words in [brackets] are best guesses where the audio is unclear. Answers are transcribed as spoken, with repeated words and false starts trimmed. Short backchannels such as "yeah" are left out where they overlap the other speaker.

Read the full transcript 6,533 words

[Sponsor read: YSecurity, the sponsor of the show. Forty-plus security engineers who've done security at Apple, Uber, Microsoft, Robinhood and Brex, rented by the hour with a monthly cap, for SOC 2, ISO and HIPAA. Book a free strategy call, and the first eight hours are free at ysecurity.io/startups.]

Jon McLachlan

Hello, everyone, and welcome to another episode of The Security Podcast of Silicon Valley. I'm one of the hosts, Jon McLachlan. I'm joined with Sasha Sinkevich, the other host. And we have an amazing guest, Neatsun Ziv, co-founder and CEO of OX Security. Welcome to the show.

Neatsun Ziv

Sasha, thank you.

Sasha Sinkevich

Welcome to the show.

Neatsun Ziv

It's a pleasure.

Jon McLachlan

So, for all of our listeners, would you like to share a little bit about OX Security? What are you guys up to over there?

Neatsun Ziv

OX was formed with the problem statement that shift left as a concept failed us for years. We've been trying to make it work, but it's just that everybody's got their priorities. It is super hard to try and fix security as we go along. And as technologies emerged, we started saying, hey, let's prioritize, let's do this, let's do this, and constantly trying to push it towards the cutting edge of making sure that application security and product security actually work from the moment you start thinking about code up until it's running in the cloud. So that's a basic concept, but every year you see new technologies, especially now with AI coming into the equation. It just becomes mind-blowing.

Sasha Sinkevich

You mentioned there are a lot of different things. How do you focus? Because it's important to focus. There are so many things we could be solving every day, but we cannot spread too thin. How do you guys figure out the question, what is the biggest pain point that we need to focus as a team?

Neatsun Ziv

First of all, I think it's one of the interesting things. You get a situation where you get the companies and you actually see that they've got like five million issues, and you say, oh, well, this is really bad. And then you go one over one, just sample them, and you see that most of them are not relevant. And how does not relevant look like? I'll give an easy example. You see a password embedded in the code, but you see in front of it a comment saying, this is an example. Okay, yeah, it's not a real password. This is not a critical anymore. This is just fake. Or you see a lot of those cases where you're saying, hey, you've got this open source Log4j, super critical, it will crash your system, but it's in a test application that is not running in production. There is no way to get there. So what a professional would do is they would go through a process to start triaging it, saying, you know what, this is not connected to the internet, this is not exploitable, this is not real risk, this is just a test project. Just understand the context. If you're going to push a lot of noise towards developers and ask them to fix things, what you're going to get back is actually they're going to ignore you. I used to manage a team of about 600 developers, and we've done this exercise, and it sounded very simple. Just take the defects and fix them. And out of the 20 prioritized, they said, we are willing to fix two. So, why two? Say, yeah, that's a container issue, it's not exposed to the internet, it's internal, this is a lab, and you constantly get like more and more details. What we had in mind is, why are we expecting somebody else to bring these details? Why don't we just go in and bring these details for you? It's very easy for us to know. Is it live? Is it exposing API? Is this right now exposed to the cloud? Is this a live Kubernetes agent? Just all of this information is available, but we are just shifting it to somebody else to fix, and nobody's taking care of that.

Jon McLachlan

All right. So it's kind of taking advantage of context to make security problems a little bit more relevant, a little bit more focused. It sounds like we could be connected to AI to help us speed that along. Is that the right path there?

Neatsun Ziv

First of all, yes. I think for years we know it's all about the context. So if we're just saying, hey, all you have to do is guess a bank number and a password to get into the account, and I'll give it the right context, yeah, that would be easy to guess that one. But the challenge is most of us are coming blind to those questions. Saying, is it deployed to the cloud? I don't know. Is it right now exploitable, exposing any APIs? What does it mean? We're blind to that. So yes, it is context, but I think one of the advancements that we've seen recently is actually taking it to the developer and saying, maybe we could take it not to the developer itself, maybe we can take it to the context of the vibe coding agent. And as part of this journey, we started getting to play, saying, hey, if you've got the context in advance, why wait for the wrong code to be actually written? If we can load upfront the context, saying, hey, you are going to touch right now with this request an API that is externally exposed. These are the databases that this app is connected to. Those are the microservices that's going to be deployed in connection with. We want you to have those security restrictions and this rate limit and this sanitization. Here are examples. And I've already found a few passwords. Why don't I just move them to your vault, and just do the work, instead of shifting it to the developer that is already loaded? Why don't we move that to a vibe coding agent with the right context? So with the right context, you can do marvelous things. I'm not sure what's the equivalent of the sentence, give me a big enough lever and I'll move a planet, to AI context. But I'm sure that there is such a thing.

Jon McLachlan

No, I'm sure there is too. Just looking at OX Security, it's like VibeSec, security that vibes the way that software is built. Unless you've been living under a rock, the software engineering space is absolutely changing. It's moving at incredibly fast paces, and there's AI agents writing code. And now, as an engineer, we're a little bit more like almost managing these agents as they produce a lot of the code that ends up in production systems. And I guess the timing smells perfect to like revisit all of these hard security problems that we've been like manually slugging through, everything in our rearview mirror, all of our past histories. I'm super curious, though. Was there a moment that you woke up and you had this spark of inspiration? We have to be a little bit crazy to start a company, a little bit crazy to be a founder. You've clearly got a vision and you've got that spark. What was it like to experience that? What was that moment for you? The moment that you're saying, I'm going to do that.

Neatsun Ziv

Yep. Okay, so before starting OX, VP, large security company, big department, like huge budget, accountability from sales to product, like everything that I wanted. But at a certain point, you do understand that large companies have this disadvantage, that you can't do everything that you're doing and still focus on new projects. It's this or the other. And I think that there are a few books that describe it really well. But you basically need this absolute focus, and you need to be in a situation where there is no regrets, no undo. It's like you can't go back. You actually need to burn the bridge behind you. Option to go back to something that is easy, it's super tempting. After my partner and myself left the company [we] worked for and started OX, it's like you get to those moments in time that you're saying, oh my God, what have I done? Like, it doesn't make any sense. And I'm sure you heard it from a lot of founders, but a founder's life, it's like a roller coaster. It's like you never know if you're going up next minute or down. You just know that it's going somewhere that you don't expect.

Jon McLachlan

Yeah, yeah, absolutely. It's a roller coaster. And you also mentioned your partner, your co-founder. How did you guys meet?

Neatsun Ziv

So we work together at the same company. We actually joined the company with a two weeks difference from each other. So we actually worked together for almost fourteen years now.

Jon McLachlan

So you're kind of like work spouses or something like that.

Neatsun Ziv

Yeah, something like that. We're trying to do like activities outside of the home. I'm New York based, he's Israel based, so we are actually trying to do like at least twice a year, do like a hike together, usually in the US or Europe. And it gives us like a few good days to hash things out.

Jon McLachlan

Amazing. Well, you have to have like that trust built up and rapport, because in order to ride that roller coaster of being an entrepreneur together, it requires some foundation there.

Neatsun Ziv

So, yeah, well, he's got this amazing trait not to get excited from anything. And I'm exactly the opposite. So it's like he balances me off.

Jon McLachlan

Okay, so there's complementation. That's really good. Do you also have a complementation in sort of the focus and the skill sets that you're bringing to the table? Are you both security experts?

Neatsun Ziv

Yeah, so we work together at a security company, so we kind of have this very, very deeply ingrained inside of us. But one of the things, I think, is that actually the field that we're working in right now, it's a field that we always were in overlap with, but we never worked in this field. So this adventure of getting to a new field, learning everything, even though we kind of know it, getting to own it, it's a different thing. Just to own every detail, saying, you know what? I can do this better. Like, I've tested other products. I know why they failed miserably, and we have a shot at doing something better.

Jon McLachlan

It's almost like you feel that pain firsthand. And that's maybe part of your superpower in this space. You know exactly what you want to see, and now you're in a position where you really own it, as you put it.

Neatsun Ziv

Yeah. So that's a big thing for us.

Jon McLachlan

What's been the proudest day so far that you've had?

Neatsun Ziv

I'd probably say that every time that we're getting to a new milestone, it's like the best and the worst day. The moment that you see that the goal that you set is actually achievable, you haven't reached it yet, but you can feel it, and it might be a quarter away, but you can actually say, you know what, I'm in the right trajectory to get there. That's the high. The low is when you know you're getting to that point, because you know a second afterwards the next goal is going to hit you. And the next goal is not going to be like, okay, we moved from 10 million dollar to 20. It's going to be from 20 to 50. So the next one is like way higher. And then you're just like, I have no idea how to do that one. You start [planning] it, and the math doesn't make sense, and everything's like it's broken. It's like you need to scrape yourself from the floor and start from the beginning. And every founder that I had this conversation with goes through this journey and say, yes, it happens in a few interesting points. And once you do that, it's like you get rolling, and somehow it's working. Nobody understands this equation, but it's really about being out there, trying every day, putting your best effort into it, and hopefully some luck will help you.

Jon McLachlan

Maybe something about being at the right place at the right time.

Neatsun Ziv

Yes. I mean, a lucky... Maybe I underestimated it. It's like you don't need a bit of luck, you need a lot of luck.

Sasha Sinkevich

In the beginning of the show, we mentioned there is a lot of noise, there are a lot of different pain points that we could be solving in the industry. And Neatsun, you mentioned that it's important to have those conversations with your customers in order to distill away all of the noise and focus on what actually matters, the actual pain point that, if solved, will deliver huge benefit. What does this process look like for OX Security and your partners?

Neatsun Ziv

Usually it starts with a very basic question, which is, what are you trying to achieve? I know it's very mundane, but just getting to a very crystal answer on this one, it's usually a very hard exercise. So let's do this exercise right now, saying, let's imagine an imaginary company. They have, let's just throw numbers, a thousand employees. The company is 20 years old. They've got internet exposure, and this is how they're making a lot of money. And now you're saying, okay, what are you trying to achieve? So the basic answer is simply, I don't want any risks. And that is usually a bad answer. It's like, you will need to accept risks, and you kind of need to understand where it is that you feel comfortable. So if you imagine this is a line between, I'm going to invest zero and expect zero, and I'm going to expect a lot and pay for it a lot, usually most companies say, you know what, I feel comfortable in this zone. Like, I understand I need to do something. I don't want to pay too much for this. I kind of have like three people to put on the problem and this amount of budget. And now, what's the best you can do for me? It's like, great, but that's not a good answer. It's like, how are you measuring this? And then they would say, okay, it's backlog. Okay, how many items do you have right now in the backlog? Saying, a million. Saying, a million is good or bad? It's like, bad. What a good number, it looks like? Like, half a million is good. And you start actually with this process of saying, how does good and bad look like? And most understand really early into the process that the AppSec program is a way to reduce the risk. It's not canceling the risk. There is always going to be a risk. And the best thing you can do is just think smart about what's probable, what's going to hit you, how am I engaging with the developer to actually fix it. Because if I'm just saying to you, hey, you know what, this problem is here, it's going to be deployed into the cloud and expose those vulnerabilities, and I already see that the infrastructure in the cloud that you're running on top is really not secure, so all of this is going to create for you some kind of an exposure. You see this and you're saying, this is very good, I've got great detection. But then nobody's actually picking up the phone and fixing that. You hadn't done anything, really. It's like, you've got great visibility, amazing. Now you actually need to fix this. Now, fixing, I know it sounds very easy, but you need to go to a developer that has product managers, Jira backlog, performance issues, UI issues, customers, and you say, oh, I need you right now to stop everything and fix a million issues. Like, yeah, that's not going to happen. And I see a lot of the teams actually started thinking about it, saying, oh, how do we get them engaged? Why don't we create a program that we're doing the developer of the month and give him like a small prize? And they started thinking about it. And the program evolves to saying, okay, it's not just about a million issues anymore. It's about how do I drive execution on where I want to draw the attention? How do I focus my attention and understanding what is important, and then making sure the right person is actually associated with it? This becomes a very interesting task for most. And when I'm looking on where we are part of this journey, so in some customers, we're helping them even with understanding how this journey looks like. How did others create amazing achievements? For others, it's a different journey, saying, okay, I just need to pass SOC 2. This is everything that I need to do. It's like, I don't care more than that. Just get me through this. And great. If you just need to do that for now, all you have to do is like check the box on those five things. Easy. The year afterwards, they're saying, okay, I just need to add one more component. So great, let's do this, let's add that. So everybody has a different risk profile, and we're just helping them with this journey.

Sasha Sinkevich

But at the end of the day, it needs to be aligned with business initiatives, and the question is, who is your economical buyer at that point in the company's journey? So this hypothetical company, it has a thousand employees, and it sounds like what you're saying, it's important to understand what is the specific pain point that this company has at this point in time, and focus on solving that pain point with business-driven KPIs, or you need some type of metrics to evaluate how successful it is.

Neatsun Ziv

So I would say that the economic buyer in larger companies is usually the CISO of the organization. And the technical evaluator and the people that actually need to work on the system are more on the AppSec and DevSecOps guys. But the guys that need to solve the problem are actually from engineering and DevOps. So you've got this flow from strategic to operational, to actually hammering down issues one by one. And if you think about it, when developers see issues, even engineering managers, they are not equipped to understand what is important versus what is not important. Some of them are taking this and saying, this is a great opportunity to learn security. They would just type into ChatGPT and saying, what is this CSRF? What does it mean? It's like, this is the first time that they're encountering this concept, or SQLi. What does the I stand for? Oh, it's SQL injection. I heard this term before. So it's about getting to the place saying, we need to train people, we need to educate them. But this is mission impossible. You're training your developers, and within a year, a third of them moved away, and you've got somebody else to train. So it's mission impossible to constantly build in this loop. And I think that there's smarter and better ways to do that right now.

Jon McLachlan

So, what's the smarter and better way to do it?

Neatsun Ziv

I think that as we're entering the vibe coding era, what we are seeing is that everybody's becoming a manager. When you're doing right now vibe coding, unlike what we had a year ago, where it wasn't vibe coding, it was like you're giving commands, and now you're just describing intent. And some of the recent enhancement is like, do more than intent, create a policy or a structure, and we'll work within the boundaries. And I think that as we're evolving and saying, we're actually taking concepts from how development teams work and start using AI to think about them as multi-agent that builds the task, verifies the task, adds analysts to it. It's like the more we think about it, the more it becomes more interesting. And this is also an opportunity to take pieces of the AppSec, CloudSec, product security mentality and actually say, hey, maybe an agent on our behalf should be part of this game as well. Maybe part of the things that we really wanted to do always as part of security is to make sure that you've got a threat model for everything. But that was always like a futile exercise. Like, you're doing this, and the implementation was never similar to the original design, and maintaining this becomes harder. Maybe now we've got a different shot, saying, hey, why don't we just give guidelines, and somebody will go over the assumptions that we have, and we'll see how reality faces the design. And maybe we can actually guide the vibe coding agent to do something better, smarter, that takes into account many more things and ignores drift in code. There's so many different ways to think about this problem.

Jon McLachlan

Yeah, I love it. It's taking all of the advancement that we have at our disposal today through AI and applying it directly to these difficult problems that we face day in and day out as security professionals.

Neatsun Ziv

Exactly. I think we're getting to this age where a part of our mind is going to be on not just doing things, but articulating them as a context in a very clear and precise way, that somebody can take this context from us, or process from us, and actually implement it, and allowing us to move one layer higher in focusing on the design, on the concepts, on iterating and verifying. I think this is going to be one of the fastest and most impressive transformations in an industry that I've ever seen.

Jon McLachlan

As you look into that future, what do you think will be the most difficult new security challenge that we'll face as a community?

Neatsun Ziv

It's a very good question. I'll try to do it with an analogy. If you recall, when mobile started, then everybody was super afraid from mobile malware. And then basically the owners of the platform kind of said, you know what? We own this. We will make sure that the stores are cleaned from issues. And every time that there's a security issue, we will patch an update and own up to it. Unlike, let's say, Windows at the time, that were simply not in the game, not in the same way that the mobile operating system manufacturer were. As they evolved, they said, you know what, this is something that we own. Now, it really depends where the industry is going on that front. The challenge for the mobile application is they owned everything. They owned the decision, the store, the operating system. They knew everything. When you think about code and cloud deployment, well, first of all, you don't have the context. You don't own everything. You actually own the repo that you're working on right now. So this creates a context problem. Now, giving enough context, you can solve any problem. And the challenge we're going to have is, how do we augment more and more context into writing the right code? Because think about it. With the right context, you solve everything. With the wrong context, you're going to get hallucinations. So you kind of need to be in a very good spot for that one.

Jon McLachlan

Yeah. I mean, that reflects a leadership style that speaks very closely to myself. When you have a team, if you're just barking orders and giving commands about what to do, you're really like violating autonomy. But if you set up a situation where, through the context of what's going on, you share like the difficult problems that we're trying to solve with that context, you're respecting people's autonomy to allow them to go off and think about how to solve problems. And it sounds like a very similar analogy in the agentic space, where if you can provide and use the context appropriately and position that in a way where you can get value from it. You used a word too, augment, which is one of my favorite words these days. And it really goes back to this idea of maybe like enhancing the things that we're already doing as humans instead of like replacing humans.

Neatsun Ziv

I had this conversation a few days ago, saying, what's the difference between fraud and cyber? Is fraud cyber? And somebody told me a sentence that just placed everything in place. [He was] saying, so cyber, it's more about abuse of system, where fraud is more of an abuse of trust. Now, it's a very nice distinguishing. And I think that as we're taking this to the AI sense, I think we are going to face a lot of challenges. As we've seen, then it's like, okay, can I do like the equivalent of a VM escape to the basic instruction set that the agent gets? How do I hard code things? How do I make sure that the trust given to the agent is actually enforced? And we're going to face a lot of those issues. I'll give you something that our research team found. I think it was already published, but if not, I'm sure I'm not doing anything. But let's say that you just go to GitHub and you publish the equivalent of a typosquatting. And in this typosquatting, you're actually adding a command that one of the famous vibe coding environments just treats as, hey, if it's on the machine, then I'm fine with it. Then you can instruct it to actually say, you know what, write a malware locally that takes everything from the machine, just uploads it. So when you think about this concept, saying, I'm actually recycling things that you trust. It's a name that I think I've trusted, downloading this package. Yes, I've mistaken with the hyphen, but I got this by mistake. I've got this environment that I trust because it's really doing good for me. And the combination of trusting this and trusting this is really a bad idea. I think that we're going to find a lot of those edge cases that you think about, one solution, it's fine. You're combining two things that you trust. I'm sure that we're going to find a lot of quirks over there.

Jon McLachlan

I mean, stuff like that to me is exciting. We get to think through a new problem space as security professionals, as a security community.

Sasha Sinkevich

We talked a little bit about agents. We talked about application, the new threat model, the new surface attacks. And with AI, it's a pretty common concept and pretty common acceptance that AI allows attackers to be a lot more nimble. How do you see the defense side of the house? So you have red team, you have blue team. How does the blue team take advantage of all of the innovative advancements that happen on the application layer, or maybe infrastructure, and maybe outer layer?

Neatsun Ziv

It is my opinion. I haven't proven it yet, but it actually increases the asymmetry between the attackers and the defenders. Think about token economy for a second. So in token economy, every intent that you have costs you something, let's say tokens. Now, for a defender, you're always looking for a lot of data, and inside of it, you're looking for weak signals or anomalies. Attacker is using this to actually scramble everything with a very, very cheap effort. Meaning, what is a cheap effort? You can actually say, you know what, take my code and scramble it so it won't look the same. It would cost you a few tokens, a few millions of tokens, nothing big. It's like $10, really, for a deep work. Then think about a defender for a second. They need to do it for everything, but most of it is not malicious by intent. Like, I think that one of the research I've seen is mostly that [internet] traffic contains like 0.3% of malicious content, or unwanted content. I think that was the definition. And as part of it, it actually puts a very, very, very high cost on the defender if you're going to do it in a very naive way. Now, on the other hand, one of the things that we are doing is saying, look, if you want to find things in code, and I need to scan code with AI, that's going to cost me a lot of money. So I can use it just for edge cases and to prefabricate patterns. So instead of human analysts actually working on generating hundreds of what we call signatures, we can really automate this loop and just say, hey, what are the odd cases? And start balancing the equation, saying, okay, I've scanned something for the first time. I want to see there's nothing anomalous in this one. And I would just balance the cost, saying, most of the time I'm going to do pattern base. Periodically, I'm going to do like a deep scan. And you need to start thinking about things in a different way. I don't think that we've figured this one out. And in every field of security, this is going to look completely different. Some of the fields are taking it to response, for example. You're saying, we're doing the scrubbing using basic signatures. As we're moving up, we're investing more and more to get it from a possible to verified. So exciting world.

Jon McLachlan

It's changing so quickly, and changing in ways I'm sure, like, even we'll be surprised in six months. I'm convinced of that. But, you know, looking the other direction just for a moment, I'm really curious, if you had the opportunity to meet your younger self, would you take that opportunity? And what advice might you have for yourself?

Neatsun Ziv

Oh, that's a good question. For the second part, I kind of know, but the first question, it's a very good question. You meet yourself, then your younger self actually knows how your older self is going to be. So am I actually eliminating timelines that I don't know? That's a very tricky question.

Jon McLachlan

You're changing yourself, but in a way that would like maybe result in a different version of yourself, which also, there's a self-acceptance piece to this question that's like very, maybe uncomfortable for folks that are very comfortable in themselves.

Neatsun Ziv

Yeah, so it's a very good question. I think that, yes, it will definitely augment my previous self. I'm not sure that the law of unintended consequences will actually be in my favor in this case. So I don't know.

Jon McLachlan

That's really interesting. Yeah. Okay, so if you had an opportunity to meet someone very similar to your younger self, that's definitely not you, would you have any advice for them?

Neatsun Ziv

I think that the, I mean, beside the obvious cheating of saying, hey, tomorrow's [stock] is going to go up, and of course, this is not an advice to anybody. But I would probably say, at least in our space, I would probably say that it's really about taking risks. And while keeping it safe makes a lot of sense, part of this journey is really about taking the risk and be able to go to sleep and actually sleep. It's not as easy as it sounds. And yeah, self-acceptance is definitely something that I know that a lot are struggling with.

Jon McLachlan

I love the piece on risks. It resonates really well with a lot of my life experiences. And I'm a motorcycle rider. So every time you jump on one of those things, it's a ginormous risk. But I just couldn't imagine life without it. But that doesn't mean you need to be stupid, right? You can always put on armor. There's this saying, like, all the gear all the time, which kind of goes along with our discussion around like security. We don't need to take astronomical risks, but you need to be prepared for the inevitable.

Neatsun Ziv

There are advantages definitely for my motorcycle, for sure. Not necessarily in the wintertime.

Jon McLachlan

Sasha, you ride motorcycles too, right?

Sasha Sinkevich

Occasionally. I was going to say, isn't that what security is all about? It's managing the risk. It's a scale. In any product, security is usually there for a reason, and that reason is to protect the crown jewels and protect the business. But it's a scale, in a sense that we have to be very careful about how much of the overhead security can add. Because oftentimes, security can be seen as an overhead. It can be seen as the slowdown of innovation, or slowdown of the business, or where business wants to go. And I think, Neatsun, you touched on this. It's very important that security is an integral part that is very seamless. It shouldn't introduce friction, but rather it should add value while being very seamlessly integrated in the background.

Neatsun Ziv

I've got like similar, but a bit different perspective. Usually it's not the security that is slowing the business. It's a vague decision to do something or to block something because of a past experience or regulation or a fear that prevents you to do something from great. I had the opportunity to talk with a few CISOs that went into the regulator and say, hey, look, this is a really, really bad idea. I want to explain to you, this is not what I'm going to do. This is what I'm going to do. Instead, this is actually a better risk profile. Even though it sounds just on the surface as a bad idea, it's actually a very, very good idea, because. And if you've got the strategy taking you from, here's what I want to achieve, but I'm going to imply not the obvious interpretation, but something that is relevant to me, because I've got compensating control as part of, I do have several places that I can do things in a different way, and not just go through the naive way, you can get to great places. The amount of places that I've seen security just adding things by themselves that weren't required by the business. Nobody from security enjoys getting those feedback, saying you're slowing me down, you're doing this. Security has a role in the company, saying, yes, we are scaling. Yes, we're bringing a lot of people, and we really don't want to do dumb things. So we can't tailor security to every person in different. So we're trying to put like a generic security for everybody, saying, for most people, this should work. And this is the most cost-effective thing that we can do, placing security at 300 people to one ratio, let's say. Now, if you had security in a one to 50 ratio, hey, you can do way better than that one. But most of us don't have this luxury. I think somebody told me a sentence like twenty something years ago, and I'm still chewing on that sentence. And it said, life is all about managing expectations. And that's like the end of the sentence. And the more you think about the sentence, it's like it makes perfect sense. And that's it.

Sasha Sinkevich

Well said.

Jon McLachlan

This is definitely something to noodle on. Definitely. I've heard a similar sentence, or your sentence reminds me of this one, is that everything is temporary. It is. I feel so philosophical right now. I think it's important that we have these sorts of discussions, and we have them as a community, and we think about them individually, and we noodle on these, especially as we undergo such rapid change, right? So we can navigate that together.

Sasha Sinkevich

I think we touched on a very important subject multiple times during the show, and that is, security, cybersecurity, compliance initiatives have to be aligned with business and [meet] business needs where they are today, and not overthink them five years out. Just like we said, there are a lot of pain points that we have to solve in the security and compliance space, but it needs to be timely, just like a lot of things in life.

Neatsun Ziv

I've got the obvious answer and the more complicated answer. I'll go to identity as a field. I think there are a lot of identity tricks that you can do, but most of them, if you don't think about them long term, saying, what is the right investment for us long term, and you're putting this investment up front, you're going to pay dearly for this later on. It's migrations, and thinking about connecting systems. So some places you do need to invest ahead of time, even though you're gambling, you're taking a bigger solution than you need right now, with the understanding that, hey, this is not like the ultimate solution that a company 10x from us will do, but we're going to move to that space. And if I'm not doing the right investment right now, when I get to that place, I'm going to be above the size that the current solution can provide to me, and migration is going to be very painful. And painful not in the cost sense, in this needs to be prioritized over another project that I want. And you're basically saying, oh, I need to do this again. So I'm going to waste a quarter in a year and a half from now, when I'm going to be too big for the current solution. So it's a balancing equation, saying, yes, there is a need right now, but I do need to think right now a step, maybe two steps down the road, saying, I'm okay with gambling on three years from now, saying, who knows what technology is going to be in three years, who's going to be the right vendor for us within three years. So three years, yes, I'm fine with gambling on, solution is fine right now. Gambling on eighteen months, I don't know. It's a very delicate balancing question.

Jon McLachlan

I love that. There's a time and a place for everything, and understanding where that is and where those lines are, and what sort of investments are important. Neatsun, thank you so much for joining us on this episode. It's been an absolute pleasure. And thank you for all of those vulnerable and very deep moments that we get to share together.

Neatsun Ziv

Thank you very much. Much appreciated.

Sasha Sinkevich

Thank you, Neatsun.

Neatsun Ziv

Thank you, guys. Thank you.

Jon McLachlan

And a huge thank you to all of our listeners for tuning in to another episode of The Security Podcast of Silicon Valley. I'm one of the hosts, Jon McLachlan, is joined with Sasha Sinkevich, and this is a YSecurity production. Thank you, everyone. Oh, and like and subscribe and share with your friends and repost. And if you'd like to participate in the conversations, please do so. Comments and likes most appreciated if you feel they're warranted. So, huge thank you, everyone.

[Sponsor read: YSecurity. SOC 2 and ISO as keys to enterprise deals and regulated industries, done right the first time by 40-plus engineers from Apple, Uber, Microsoft, Robinhood and Brex, a referral program for founders who need it, and the first eight hours free at ysecurity.io/startups.]

FAQ

Questions this episode answers

Who is Neatsun Ziv?
Neatsun Ziv is the co-founder and chief executive officer of OX Security, which he started in October 2021 with Lior Arzi. Before OX he spent almost ten years at Check Point, most recently as vice president of threat prevention and intelligence, and earlier he founded and ran Vanadium Security.
What is OX Security?
OX Security is an application security company, based in New York and Tel Aviv, that sells a platform covering software from the prompt to the runtime. Neatsun says it was formed on the problem statement that shift left had failed. It raised a $60 million Series B in May 2025, for $94 million in total.
Why does Neatsun say shift left failed?
Because everybody's got their priorities. Security findings arrived on developers' lists without the context to judge them, so it was very hard to fix security as the code was written. Neatsun's answer is to bring the context, and increasingly to give it to the coding agent before the code exists.
How many security findings actually matter?
On the episode Neatsun says companies can show up with something like five million issues, and when you sample them one by one, most of them aren't relevant. His examples are an example password in the code, Log4j in a test application that isn't running in production, and container issues on internal systems.
What happened when Neatsun asked 600 developers to fix 20 issues?
He used to manage a team of about 600 developers. Given 20 prioritized defects, they said they were willing to fix two. The rest came back with details nobody had checked first, like a container issue that wasn't exposed to the internet.
What context should a coding agent get before it writes code?
Neatsun's list: which API the request will touch and whether it's externally exposed, the databases the app is connected to, the microservices it will be deployed with, and the security restrictions, rate limits and sanitization you want. An agent with that context can also do work like moving found passwords into a vault.
What is VibeSec?
VibeSec is OX Security's name for preventing insecure code and destructive scenarios in AI coding tools. Jon described it on the episode as security that vibes the way software is built. OX introduced it in a video on September 30, 2025.
Who is the economic buyer for application security?
In larger companies, Neatsun says, it's usually the CISO. AppSec and DevSecOps teams are the technical evaluators, and engineering and DevOps are the people who actually fix the problems.
How is vibe coding changing developers' jobs?
Neatsun says everybody is becoming a manager. A year earlier developers gave commands, now they describe intent, and the next step is a policy or structure that agents work within, with multi-agent teams that build, verify and analyze, and possibly a security agent among them.
What is the difference between fraud and cyber?
In the sentence someone gave Neatsun, cyber is more about abuse of systems and fraud is more of an abuse of trust. He expects AI agents to raise both, with questions like how to make sure the trust given to an agent is enforced.
How does typosquatting work against AI coding tools?
In the research Neatsun described, an attacker publishes a typosquatted repository on GitHub with a command that a popular vibe coding environment trusts because it's on the machine. The environment can then be told to write malware locally that uploads everything from the machine. The danger is the combination of two things you trust.
Does AI help attackers more than defenders?
Neatsun's opinion, which he says he hasn't proven, is that it increases the asymmetry. Scrambling code costs an attacker about $10 in tokens, while a defender has to look at everything. OX balances it with pattern-based scanning most of the time, periodic deep scans, and AI for edge cases.
How far ahead should a startup invest in security tools?
Using identity as his example, Neatsun says some investments have to be made ahead of time. Take a bigger solution than you need right now, though not the one a company ten times your size would run, because a forced migration costs a quarter you wanted for another project. He's fine gambling on three years, not eighteen months.
What happened after the episode?
The episode aired on March 24, 2026. In June OX announced it was a Leader in the inaugural Gartner Magic Quadrant for Software Supply Chain Security. In October, OX's research found that 24 hours after the PHP2Shell fixes, 99.3% of measurable affected PHP instances were unpatched, and 93.6% after five days.
Who hosts this episode?
Jon McLachlan and Sasha Sinkevich, the co-founders of YSecurity, host The Security Podcast of Silicon Valley together.
Keep reading on the YSecurity blog
New episodes every other Tuesday

Got a story like this one?

We're always looking for practitioners who've been in the room when it mattered.