Podcast Episode 71

Episode 071 33 min

How Startups Can Fight AI Deepfake Fraud

with Ben Colman

0:00 / 33:00

Also on Spotify, Apple Podcasts, YouTube, Podbean, Player FM

Episode 71 of The Security Podcast of Silicon Valley. Hosts Jon McLachlan and Sasha Sinkevich, co-founders of YSecurity, talk with Ben Colman, co-founder and chief executive of Reality Defender, the New York deepfake-detection company that went through Y Combinator's winter 2022 batch and won Most Innovative Startup at the RSAC 2024 Innovation Sandbox. Ben explains why the company could not raise money in its first years and was told to pivot to NFT authentication, how ChatGPT turned the market into a fire hose of inbound interest, what deepfake fraud looks like in practice, from impersonated executives executing wire transfers to AI-generated job interviews, why a convincing fake went from thousands of dollars to free in a year, why his Harvard PhD co-founder can no longer spot one, why detecting realness is a fixed target while detecting fakeness is not, what a watermark does and does not prove, why hackers are the best product managers, the future of a phone that flags a synthetic voice mid-call, and the move from cloud to edge to on-device detection through OEM partners, a prediction Samsung fulfilled in October 2026. Published June 17, 2025. About 33 minutes.

Episode notes

AI-generated fraud is now mainstream—and your team probably can’t tell the difference.
Ben Colman shares hard-earned insights on fighting deepfakes, building detection tech that actually works, and how to stay ahead in the AI arms race.

Hosted by Jon McLachlan and Sasha Sinkevich — co-founders of YSecurity.

The deep dive

Hackers are the best product managers

Ben Colman could not raise money for Reality Defender's first few years and was told to pivot into NFT authentication. Then ChatGPT shipped, and the problem became a fire hose. On tape in June 2025 he explained why a convincing fake had gone from thousands of dollars to free, why his Harvard PhD co-founder can no longer spot one, why a watermark only proves that "a thing was uploaded to a thing," and why detection would move on-device through OEM partners he would not name. Sixteen months later Samsung signed. Here is what he said, what the record shows since, the number behind every claim, and four tools to run against the approvals your company still grants to a voice.

Sasha asked Ben Colman the question we ask every founder, what pain point the company solves, and Ben answered with a history lesson about antivirus. Then Sasha asked whether he still has to educate the market, and the answer was the whole arc of the company in four sentences.

“You know, we started the company five years ago and we’re incredibly stubborn, so we stuck into it, we stuck with it. But what we saw was that once OpenAI launched ChatGPT, which went really mass market in winter of ‘22, suddenly then people started really thinking about what we’re doing. And so what it started off was trying to educate people, and now they educate themselves, because the problem is so prevalent. So it’s a fire hose of inbound interest.”

Ben Colman, co-founder and chief executive of Reality Defender, at 3:14

Listen · Ben on episode 71, from 3:58
About 37 seconds: the half of last year's clients who said it was not an issue, and what they are saying now. The clip stops on its own. Read the full transcript.

We published this on June 17, 2025, with Sasha Sinkevich co-hosting. A month earlier the FBI had warned that someone was impersonating senior United States officials with AI-generated voice messages, and a month before that its annual report had put 2024’s reported internet-crime losses at $16.6 billion. The show notes were 36 words. This page is the rest of it: the year the company could not raise money, what “an issue” looks like when a client finally has one, why Ben thinks detection is not a losing race even though the tells of 2024 are gone, what a watermark does and does not prove, the fifth-grader at COMDEX who became the founder, the phone that will one day tell you there is an 80 percent chance a voice is synthetic, the on-device prediction that Samsung fulfilled in October 2026, and the company’s run from a Goldman Sachs vendor test to Gartner’s first deepfake-detection quadrant. Along the way there are four things to try: a quiz on the episode, a scorecard for whether a voice is still an authorization at your company, a calculator for what one convincing call is worth to an attacker and to you, and a timeline you can filter.

Half the clients, a year apart

The part of the story founders should hear first is the part before the fire hose.

“That’s right. Yeah, it’s been quite a journey. For those listening, being a startup founder has its ups and downs, and Reality Defender certainly [is] having a lot of excitement in the news right now. For our first few years, it was much the opposite. We couldn’t raise any money. Nobody wants to talk to us. Folks wanted us to get into NFT authentication. If you guys remember, NFTs were kind of the thing for a bit.”

Ben Colman at 1:27

Reality Defender was founded in New York in September 2021 and went through Y Combinator’s winter 2022 batch (LinkedIn, Y Combinator). ChatGPT launched on November 30, 2022. Between those two dates the pitch was a company that detected a thing most buyers had never seen, and the advice from the room was to go detect something they had. Ben’s own account of what happened next is the cleanest description of a market turning that I have heard on this show, and I have put it in a figure because the halves matter.

Two columns of boxes. A year before the tape: half of clients said we don't know if this is an issue but we should get started, and half said not an issue, we'll come back with this problem. On tape, June 2025: for the first half, today there is the data, and the second half are running to us saying we've had an issue, we need this yesterday.
Half the clients, a year apart. The halves are Ben's description of his own customers, not a survey, and that is exactly why they are useful: this is what a security category looks like from inside the vendor the quarter it stops being optional.

“And so last year I’d say half our clients said, hey, we don’t know if this is an issue, but we believe we should get started doing it. Well, today there is the data, so they don’t have to do it anymore. But then half the clients said, not an issue, we’ll come back with this problem. Now all those half that said it was [not] an issue are running to us saying we’ve had an issue. We need this yesterday.”

Ben Colman at 3:14

His frame for the whole category is the one I would borrow for a board deck: “The way I think about our space is just another application of cybersecurity to a new venue, which is around AI. So I think of it very similar to the antivirus industry and then the history of antivirus.” Antivirus went through an education phase, an explosion phase, and a fraud phase, and he thinks deepfake detection is on the same curve. The data he says clients no longer have to collect themselves was arriving in bulk while we were recording. The FBI’s Internet Crime Complaint Center counted nearly 860,000 complaints and $16.6 billion in reported losses for 2024, the highest since the center opened in 2000 (The Record). Deloitte’s Center for Financial Services had projected that generative AI could push United States fraud losses from $12.3 billion in 2023 to $40 billion by 2027 (Deloitte). Accenture’s threat researchers had reported a 223 percent increase in deepfake-related tool trading on dark web forums in the first quarter of 2024 against the year before (FinTech Futures). Entrust, whose figures Reality Defender cites, put a deepfake attempt at roughly one every five minutes in 2024 (Reality Defender). None of those numbers is a measurement of your company. All of them are the reason the second half of the market stopped waiting.

What “an issue” looks like

I asked Ben to describe the issue for our listeners, and he did it in two sentences that cover most of what we see.

“Yeah. Put bluntly, it’s, you know, it’s impersonations on the phone, impersonating company leadership, impersonating clients, executing wire transfers, getting access to accounts. And then similarly on video, which is all the same use cases, but also AI generated interviews, whether it’s someone interviewing for someone else, or a hacker or a state-level actor trying to get a job at a company to steal information.”

Ben Colman at 4:44

The case I reached for on tape was the one everyone reaches for, and I got the number wrong by a few million. In January 2024 a finance employee in Arup’s Hong Kong office received what looked like a phishing email from the engineering firm’s United Kingdom office asking for a secret transaction, set his doubts aside after a video call with people he took to be the chief financial officer and other colleagues, all of them deepfakes, and made 15 transfers totaling HK$200 million, about US$25.6 million. Arup confirmed that “fake voices and images were used” and that none of its internal systems were compromised (CNN). Six months later, a Ferrari executive got WhatsApp messages from a number that was not the chief executive’s, then a call in a voice that matched Benedetto Vigna’s southern Italian accent, about a confidential acquisition and a currency hedge. The executive noticed slight mechanical intonations, said “Sorry, Benedetto, but I need to identify you,” and asked which book Vigna had recommended to him a few days earlier. The call ended (Fortune). Those two stories are the two columns of this whole page: a process that accepted a face as proof, and a person who did not.

Four statistics: hundreds to thousands of dollars to do a good job a year before the tape, free on tape in June 2025, 15 minutes to build a real-time voice clone at DEF CON 34 in August 2026, and 24 hours for Reality Defender's red team to pass Sora 2's identity safeguards in October 2025. Below, three bars for what one convincing fake has taken: $25.6 million at Arup in January 2024, $0 at Ferrari in July 2024 where one question stopped it, and the $20 million example Jon reaches for on tape.
The price of a convincing fake, and what one has taken. Sasha asked for the cost and Ben's answer was a year-over-year collapse: "hundreds, if not thousands of dollars" to "basically free."

The month before this episode went out, the FBI said the same thing about a different target. On May 15, 2025 it published a public service announcement about an ongoing campaign using text messages and AI-generated voice to impersonate senior federal and state officials, aimed at their contacts, with the advice to verify any new number through a channel you already trusted (FBI, IC3).

Thirty-three days before this episode aired. The bureau issued a second warning about the same campaign that December. View on X.

The second half of Ben’s answer, the interview, is the one startups underrate. Gartner’s July 2025 research projected that by 2028 roughly one in four candidate profiles worldwide could be fake, and in a survey of 3,000 candidates six percent admitted to interview fraud, either posing as someone else or having someone pose as them (HR Dive). CrowdStrike counted more than 320 remote-job fraud incidents tied to North Korean actors in a year, and Reality Defender’s own demonstration of the problem was a fabricated candidate named Gary who passed a human interviewer’s eyes and ears on Zoom and was flagged as manipulated within seconds of being scanned (Biometric Update). The state-level actor Ben mentioned is not hypothetical. A fake hire with a laptop is an insider with credentials, which is why question four of the scorecard is about your interview process and why our counter-espionage work starts with hiring diligence rather than with network monitoring.

The only thing that can detect AI is AI

I asked Ben to frame the technical problem: would this podcast be enough to train a convincing fake of him, or would it take a photo and a little voice? His answer skipped the question and went to the thing that had changed.

“If this was six months or a year ago, we would have gone through all the things to look for. You know, looking for issues around symmetry or hourglassing or pixelation or anti-aliasing or sound versus mouth correlation, or kind of where the head and the neck kind of touch. But you know, my, one of my co-founders, who leads R&D, is a Harvard PhD. And even he can’t tell the difference anymore.”

Ben Colman at 9:23

That co-founder is Gaurav Bharaj, Reality Defender’s head of research, whose doctorate is from Harvard (Reality Defender). If he cannot see it, the line goes, your parents cannot, and neither can your accounts payable team. “Very similar to how you don’t expect my parents to be able to scan code and detect a virus. We similarly shouldn’t exactly be able to detect a deepfake, because it’s just too advanced for everybody, including the experts. And so, in a world where the only thing that can detect AI is AI, it’s just a matter of us ensuring accessibility, but also educating users on how scary it is.”

Five horizontal bars. Hundreds of DEF CON 34 attendees scored under 50 percent on a 30-item deck in August 2026. A 2024 meta-analysis of 56 studies put human accuracy at about 55 percent. People warned about deepfakes who can reliably identify them, about a third, as Ben put it in June 2026. A coin flip, 50 percent. Reality Defender's own detector on the DEF CON face swaps flagged every clip, by the company's claim.
How people do when asked to spot the fake. The DEF CON number is Reality Defender's own count of its own game and the detector claim is the vendor's, so weigh them accordingly. The meta-analysis is independent and says roughly the same thing.

The record since has been unkind to the human eye. At DEF CON 34 in August 2026, Reality Defender ran a Guess the Deepfake challenge in the AI Village: a 30-item deck, half synthetic, and players who knew that going in and were actively hunting. Hundreds played. The average score was under 15 of 30, which is worse than a coin flip, and the company’s chief technology officer Alex Lisle noted that “The conditions were as favorable as they will ever be” (Reality Defender). A year earlier, in his interview with ITIJ, Ben had put it at about a third of people reliably spotting a fake even when warned (ITIJ). I wrote up the independent numbers in Deepfake attacks keep working because we keep detecting instead of proving: a 2024 meta-analysis of 56 studies at about 55 percent human accuracy, and CSIRO’s 2025 test of 16 detectors, many of which struggled with fakes outside their training data.

Which is the point where I should be honest about where this show has landed. Jasson Casey of Beyond Identity argued on episode 92 that detection is a classification problem whose error rate grows with the adversary, and that the durable fix is cryptographic proof of who is on the line. I agree with him about the approval. Ben’s counterargument, made a year earlier, is the best case for why detection is still worth running, and it is a physics argument.

Listen · fakeness and realness, from 7:48
About 42 seconds: what generators recreate and what they do not, and the werewolf test. The clip stops on its own. Read the full transcript.

“Most standard AI tools are focused on recreating what we observe, literally how we hear things or see things. They’re not trying to recreate how sound waves move. [They’re not trying to] recreate how photons interact in physics. So, you know, I think we have many years of exciting problems to solve. It’s obviously going to get harder, but we’re working on both sides of the equation, detecting both fakeness, which is getting better, but also realness, which is not changing. If we can detect whether you’re blinking or your heart’s beating or you’re breathing, and Jon, if you’re not, then you’d either, you’re a werewolf or a vampire or you’re an AI-generated bot.”

Ben Colman at 7:30

Two columns. Detecting fakeness, which is getting better: symmetry, hourglassing, pixelation, anti-aliasing, sound versus mouth correlation, where the head and the neck touch, the tells of a year ago that even a Harvard PhD co-founder can no longer spot. Detecting realness, which is not changing: blinking, a heartbeat, breathing, because generators recreate what we observe rather than the physics. Below, a box: the physics of a real person is a fixed target, the artifacts of a generator are not.
Both sides of the equation. The tells move every six months. The physics of a person on a call does not, which is the bet the whole company is built on.

Hold the two arguments side by side and they are not actually in conflict. Jasson is talking about the decision: never let a wire depend on whether a face looks real. Ben is talking about the signal: a detector that scores a call is useful the way a spam filter is useful, as long as nobody treats its silence as permission. He said as much himself, and it is the sentence I would want every vendor in this category to say out loud: “there is no silver bullet here. Reality Defender alone is not going to solve these issues.” And then the sentence that matters for anyone designing a verification flow: “it’s paramount that organizations don’t just check for your personal information matching. All that means is that I have your information.” Knowledge-based checks prove the caller has your data. In 2025 everyone’s data is available. Deepak Dutt made the behavioral version of the same point on episode 78, and Vijay Balasubramaniyan of Pindrop made the voice version on episode 57.

What a watermark proves

Sasha asked whether the partnerships with generators meant watermarks, and got the most quotable answer of the episode.

“So we avoid watermarks, we avoid any provenance-based tools, because we assume they either can be hacked or just ignored. You know, for the tech folks who are following this podcast, you know, anyone can upload anything to Photoshop and add a watermark, [and] my parents might say, oh, [it] must say it’s real. This explosion of the Pentagon led to a $100 billion flash crash in the market. All the watermark means is that at this day and time, a thing was uploaded to a thing, and [they can] confirm that.”

Ben Colman at 11:54

Four boxes in a row: the fake Pentagon explosion image of May 22, 2023, posted by verified-looking accounts on X, reposted on Telegram and WhatsApp and as screenshots, and the S&P 500 dipping about 0.3 percent. A watermark could live at the second box and is gone by the third. Below, two boxes: what a watermark proves, that at this day and time a thing was uploaded to a thing, and what the detector looks for, indicators of AI, whoever uploaded it, however many conversions.
What a watermark proves, and where it goes missing. The Pentagon image never had one. The point is that it would not have mattered by the third box.

The Pentagon image is the right example. On the morning of May 22, 2023 a fabricated picture of an explosion near the Pentagon spread across social media, including from accounts with verification badges, and the S&P 500 fell about 0.3 percent to a session low just after 10 a.m. before recovering once it was debunked (Bloomberg, NPR). Ben’s “$100 billion flash crash” is his figure for that dip and I have not found a source that prices it, so take the direction and not the number. His actual argument does not depend on it: a watermark is an assertion attached at upload, it can be stripped by a screenshot, and it is invisible in the places where an image does its damage. Reality Defender is a member of the C2PA coalition and supports the content-credential standards, “focused on supporting when those others fail,” which is to say on “detecting indicators of AI” in the pixels and the audio regardless of who uploaded them or how many conversions the file has survived. I wrote the provenance half of that argument in the deepfake post: sign the approval, not just the media.

The partnerships Sasha was asking about are real and they are not watermarks. On July 18, 2024 ElevenLabs, whose voice technology had been identified behind the fake Biden robocall that hit New Hampshire voters that January, announced a collaboration in which it contributes its own models and methods to strengthen Reality Defender’s audio detection, with Ben promising “highly advanced audio detection that stays several steps ahead of bad actors and fraudsters” (ElevenLabs). On tape, eleven months later, he said about a dozen more generative platforms were lined up to “partner on the data side.” Then in October 2025 the company demonstrated what happens when a generator does not partner: within 24 hours of Sora 2’s launch, its red team used public footage of executives and entertainers to build real-time deepfakes that passed the app’s Cameo enrollment, the liveness prompts and the verbal attestation included, and reported that “Every attempt succeeded. The Sora platform detected nothing” (Reality Defender).

Four months after the tape. The generator's own safeguard was a liveness check, and a liveness check confirms a live person, not a real face. View on X.

Hackers are the best product managers

I asked the question I ask everyone, whether something in particular pulled him into security, and got a story about fifth grade.

“And I’ll be honest, like, I grew up having a lot of fun with technology, and I was fortunate enough to have my best friend, when I was a child, his father had a computer store. So we were having a lot of fun working with computers. We were in fifth grade, and I don’t know how our parents let us do this, but we flew unaccompanied to Las Vegas to go to the big COMDEX tech conference. But we were just exposed to a lot of technology then. And we tried a lot of tools that were questionable in nature. And I, you know, it certainly is a lot more fun being on the good side than the bad side. So I’d say, you know, really just being exposed to technology is great, but also, if you’re going to be involved with things that might be a little, you know, or a lot ethically dubious, might as well be on the good side ‘cause it’s just as much fun.”

Ben Colman at 13:24

The line that followed is the title of this page, and it is the most useful thing on the tape for anyone who has to decide what to defend first.

Listen · the best product managers, from 14:32
About 50 seconds: which segments are mass marketable, from both sides, and why the attacker only has to be right once. The clip stops on its own. Read the full transcript.

“Hackers are the best product managers. Yeah, if they could use a new tool to do more hacking, they absolutely will. And that’s really where the initial genesis of this really interesting research we developed to this commercialized solution of Reality Defender, thinking about how bad actors and hackers and state-level groups will use these widgets to cause more harm at a greater level. No longer a Nigerian prince scam or trying to attack one person, like me attacking you, Jon. Something could do it to thousands, tens of thousands, [or] millions of people at the same time. And I only have to be right a few times, or even just once, for it to work.”

Ben Colman at 14:20

Read that as a product manager would. The attacker’s funnel has a top that used to be constrained by labor, one scammer per phone call, and generative AI removed the constraint. The conversion rate can be terrible and the campaign still pays, because the cost per attempt is close to zero and the payout per success is a wire. That is the arithmetic behind the calculator further down, and behind Ben’s advice to his own family: “I try and force my family members to use password managers. You know, my parents should not use my birthday as their password.” One breach on one site and the credential is tried everywhere else, and the attacker needs to be right “a few times, or even just once.” Fourteen months after we recorded, the same economics showed up on Wall Street. In August 2026 Point72, Millennium, Two Sigma and Citadel were targeted by AI voice-phishing calls aimed at their employees, with Point72 telling investors no client information appeared to have been taken and Two Sigma saying it blocked the attempt, and Vinod Paul of Align Managed Services, which runs security for hedge funds, gave Bloomberg the product-manager version of Ben’s point: “Before they could attack 50 entities in a targeted attack, now they can do 1,000” (InvestmentNews). Reality Defender’s own post on the attacks is the policy in two sentences: “a familiar voice on a call is no longer proof of who is on the line,” and “Detection is a layer, not authentication” (Reality Defender). We covered the defender’s side of the same scaling problem in AI cyberattacks are going autonomous.

”An 80% chance that Jon’s voice is AI generated”

I asked what success looks like for Reality Defender, and the answer was a feature of your phone.

“Similar to your phone saying, hey, this call might be spam, which maybe you’re okay with because it’s an AI agent, or it’s a United saying that I’ve been upgraded, which is, you know, it is, it’s nice. It’s a AI voice saying it. I want that call. You know, and similar to when you’re on a call, finding out that you have another call, someone also calling you, or maybe letting you know that you got an email, or your battery’s low. Getting [an] alert saying, you know what, at four minutes, 20 seconds [into] the call, there’s an 80% chance that Jon’s voice is AI generated. I think we’ll start becoming very common. Not all of them [will be] fraudulent. A lot of them will be fantastic.”

Ben Colman at 16:30

Notice what the vision is not. It is not a world without synthetic voices. It is a world where the synthetic voice calling to move your reservation is labeled, the way a spam call is labeled, and where “Jon’s voice calling to change a reservation, or calling Ben to say, hey, Ben, I’m gonna be late to the meeting” is a permissioned agent doing something useful. Sasha drew the engineering parallel, service accounts talking to services, and Ben agreed that the positive agent and the fraud are “the same exact technology and framework.” Which is why the sentence he dropped earlier, almost in passing, is the one I have quoted most since. Talking about the arrival of AI agents at 7:30: “companies do want to engage your AI agent for information sharing, but maybe not for authorization.” Information yes, authorization no. That is the permission ladder in six words, and it is the rule we wrote up in Your AI agent said no. Your API key said yes. and in Are you actually going to give the agent write access?. By the autumn of 2026 Ben was writing about tier-one telecoms seeing agentic voice traffic double every month and about contact centers that cannot tell a customer’s negotiating agent from an attacker’s, and the company’s RealCall product is the “80 percent chance” alert, delivered to the call center instead of to your lock screen (LinkedIn). Who signs for the agent is our version of the question his customers are now asking.

Cloud, edge, on device

Sasha asked the technical question, whether the company runs small models on the device, and Ben answered with the company’s credentials before the roadmap.

“Yeah. So we have over a dozen patents and white papers. We are selected for peer review at all the big conferences in computer vision and audio: CVPR, NeurIPS, ECCV, AAAI, which really differs us from most companies in our space, in that the majority of our company are PhD researchers and engineers. We see our product deployed everywhere, starting with cloud, moving to edge, moving ultimately on device as well.”

Ben Colman at 19:59

Two things in that answer are worth a founder’s attention. The first is the refusal to build on open source: “we develop our [own] models [and] data sets in-house. It’s expensive and hard to do. We think that’s important, versus a lot of other platforms [that] claim they are highly effective, but in reality you’re just using open source.” Whatever you think of the claim, note the proof he offers for it, which is not a benchmark table but the customers’ own benchmarks: “they will literally recreate all of our testing themselves and grade the results. They’ll upload 10,000 or [a hundred thousand] or more real-time or asynchronous audio or videos or images, and then grade the results.” A detection vendor who invites you to grade them on your own data is making the only claim that can be checked. Ask for that from anyone selling you a classifier. The second is the roadmap, which he described and then, when I asked whether I had heard a prediction, described again as a fact.

Listen · on device, with partners, from 23:21
About 26 seconds: commodity laptops, commodity phones, and the partners he would not name. The clip stops on its own. Read the full transcript.

“So we have successfully already deployed our solution on commodity laptops, commodity phones. We’re not going to market for that ourselves. That’s [done] with partners who are the OEMs, or for various enterprise or government use cases that require a different kind of environment. And so yes, we’ve already done what we’re discussing, and we’re excited to really scale up the rollout with our partners.”

Ben Colman at 22:55

Three boxes in a row, cloud, edge and on device, the last filled and labeled laptops, phones, OEM partners. Below, a timeline: April 3, 2025, Samsung Next invests with BNY and Fusion Fund. June 17, 2025, on tape: we're not going to market for that ourselves, that's done with partners who are the OEMs. October 14, 2026: Samsung Electronics Singapore signs a memorandum of understanding for on-device detection on Galaxy S26 and later, demonstrated on a Galaxy S26 Ultra at GovWare.
Cloud, edge, on device. Two months before the tape Samsung's venture arm had invested. Sixteen months after it, Samsung's Singapore business signed for the phones.

The OEM had already invested. On April 3, 2025, Reality Defender announced strategic investments from BNY, Samsung Next and Fusion Fund, and the same week won the 2025 U.S.-Japan Global Innovation Challenge, sponsored by the Defense Innovation Unit and Japan’s defense acquisition agency, with PeakMetrics (Reality Defender, Biometric Update). Then, on October 14, 2026, Samsung Electronics Singapore signed a memorandum of understanding with Reality Defender to develop and deploy on-device deepfake detection for enterprises in Singapore, identifying AI-generated voice, video and images on Galaxy S26 and later devices, with analysis staying on the phone and Samsung Knox providing the isolated storage. The release quoted a Regula survey in which 56 percent of Singapore businesses had faced audio deepfake fraud, and Ben’s line in it was the architecture in five words: “our detection is stateless by design: nothing enrolled, nothing stored” (Samsung). His own post from GovWare is below. It is a memorandum, not a shipping feature, and I will believe the billions of phones when I see the settings screen. But it is the prediction from the tape, fulfilled by the company he would not name.

AI can fake anyone's voice. Now your Samsung phone can fight back.

Deepfake voice fraud is becoming a threat to everyone. AI can clone your child's voice, impersonate your boss, or power autonomous voice agents that sound convincingly human.

Yet consumers have few practical ways to protect themselves. That's the challenge Reality Defender and Samsung are tackling: What if your phone could detect a deepfake in seconds, entirely on-device?

Until now, deepfake detection has largely relied on cloud infrastructure. That approach works well for enterprises, but protecting billions of consumer devices requires a different model. Detection can now happen locally, privately, and in real time.

This week at GovWare in Singapore, we took a major step toward making that possible. Reality Defender and Samsung Electronics Singapore announced our collaboration for on-device deepfake detection, working alongside Samsung Knox. We showcased the technology live on a Samsung Galaxy S26 Ultra, where our local AI models identified deepfake calls entirely on the device.

Ben Colman · October 2026
"We're not going to market for that ourselves. That's [done] with partners who are the OEMs." Sixteen months later, the partner. View on LinkedIn.

Why on device at all? I asked whether the pressure was security or performance, and the answer was all of it: “Compute is not infinite on the cloud. It’s incredibly expensive. But sometimes [it’s] also not available. Sometimes you just have no connectivity.” And for some clients the model itself has to be protected, “being able to not only protect our IP, but also protect what we’re scanning on behalf of our clients,” which the company handles by compressing and quantizing the models “without kind of reducing the accuracy of what they’re doing.” If you run inference on anything a customer holds, the same three pressures will find you, in that order.

Scanning the whole call

Sasha asked a question only an engineer asks: surely you do not have to process the entire audio stream, you could chunk it, run the chunks in parallel, and stop as soon as one chunk comes back fake. Ben’s answer is a product decision disguised as a technical one.

“We could do that. Some of our clients want us to do that, but we prefer to make it cheap enough and scalable enough [that] they don’t have to make a decision that way. We’re just scanning the whole thing. And so instead of traditional authentication, where you’re checking Sasha’s [ID] at the beginning, checking it again at minute two or minute 20, we’re not scanning just the first minute. We’re scanning the whole call in real time. And we don’t think that folks should compromise that to just scan the first minute.”

Ben Colman at 25:53

The reason is the attacker’s product management again. A fraudster who knows the check runs at minute one and minute twenty behaves at minute one and minute twenty. Continuous scanning is the same principle as the continuous behavioral authentication Deepak Dutt described on episode 78, applied to the media instead of the hands. Sasha’s follow-up, that security has a habit of making things complex and calling it a solution, drew the line I would print on the wall of every security startup: “I accuse innovation that’s not easy to use to actually not be innovation. I will go that far.” The product history bears it out. The real-time video plugin for Zoom shipped in October 2024, with a bot that joins the call and a side panel only the host sees (Reality Defender). The public API and software development kit arrived in August 2025, running on NVIDIA hardware, with a free tier of 50 scans a month (Biometric Update). By November 2025 the whole thing was packaged as Real Suite: RealScan, a drag-and-drop web tool, RealAPI for developers, RealCall for contact centers and RealMeeting for Zoom and Microsoft Teams (Biometric Update). Whether the models are as good as claimed is a question for your own benchmark set. Whether the product is adoptable is no longer in doubt.

The flip side of “scanning the whole call” is what the company’s red team has spent 2026 demonstrating: a check that runs once, at enrollment, can be passed once. In July 2026 Google introduced selfie video sign-in, an optional account-recovery method in which you record a short video while following head-movement prompts. Reality Defender’s researcher Dharva Khambholia had an operator follow the prompts in real time while commercially available face-swap software replaced the operator’s face with a synthetic one, on an Edge browser on a Windows laptop with an NVIDIA GPU. Both enrollment attempts succeeded, and the write-up was careful about what that does and does not show: repeatability under those conditions, not a general success rate and not an account takeover. The conclusion was two sentences: “Liveness remains valuable. But liveness alone is no longer enough” (Reality Defender, Biometric Update). It is the same lesson as the Sora cameo and the same lesson as the IDmission case the company published that autumn, in which a stolen but genuine national ID was used to generate a matching selfie, injected into the verification flow without a camera, that passed document authentication and face matching because both checks traced back to the same photo (LinkedIn). If your product has a know-your-customer or onboarding flow, that is the question five of the scorecard asks, and it is what our product security work checks when a flow accepts a face as evidence.

From a Goldman vendor test to a Gartner quadrant

Sasha read Ben’s resume at the top of the show: Google intern, co-founder of PlaceAVote, vice president at Goldman Sachs, chief executive of Covertix, angel investor and past New York lead of Xoogler.co. The one detail the resume leaves out is where the company came from, and Ben told it to Goldman’s own alumni magazine in 2024. In the Office of the Chief Information Officer from 2015 to 2017, he worked on technology commercialization and investments and, after battle-testing voice-authentication vendors, found that some “would mistakenly recognize a computer-generated voice as a real voice,” using test software from the gaming and entertainment industry years before anyone said deepfake. The chief information security officer at the time, Phil Venables, pushed the team to ask what would happen if that technology reached fraudsters, and taught him that “the best time to engage a vendor was early on.” Four years after leaving the firm, Ben founded a company to answer the question. The lesson he draws from the founding is about saying no: Reality Defender has turned down dozens of revenue opportunities outside its mandate, because “if you say yes to everything, you will excel at nothing” (Goldman Sachs). Covertix, the company in between, built persistent file protection and was acquired by Micro Focus in 2018 (LinkedIn).

A timeline of ten entries. September 2021: founded in New York, Y Combinator winter 2022. October 17, 2023: a $15 million Series A led by DCVC. May 6, 2024: RSAC Innovation Sandbox Most Innovative Startup. October 22, 2024: the Series A expands to $33 million led by Illuminate Financial. June 17, 2025: episode 71 airs. August 18, 2025: public API and SDK with a free tier. October 3, 2025: Sora 2's identity safeguards passed within 24 hours. June 25, 2026: Gartner names Reality Defender a Market Shaper. September 10, 2026: KPMG takes a minority stake. October 14, 2026: Samsung Electronics Singapore signs for on-device detection.
Reality Defender from the years nobody would fund it to the quarter it became a Gartner category. Everything below the episode line happened after we stopped recording.

The money arrived in the order the market turned. A $15 million Series A led by DCVC closed on October 17, 2023, with Comcast, ex/ante, the Partnership Fund for New York City, Rackhouse and Nat Friedman’s AI Grant, and the release said the two-year-old company had already detected millions of deepfakes (PR Newswire). On April 16, 2024, Ben testified before the Senate Judiciary subcommittee on privacy, technology and the law at a hearing titled “Oversight of AI: Election Deepfakes,” alongside the chief executives of Resemble AI and DeepMedia, and told the senators that “Determining truth will always be slower and more difficult than spreading a lie” (Reality Defender, NBC News). Three weeks later he pitched at the RSAC Innovation Sandbox against VulnCheck, RAD Security, P0 Security, Mitiga, Harmonic Security, Dropzone AI, Bedrock Security, Antimatter and Aembit, told the judges “All we do is say human or not human,” said the top enterprise use case was real-time voice fraud at banks, and won (Dark Reading, RSAC).

May 6, 2024, thirteen months before this episode: the three-minute pitch that won Most Innovative Startup. "While the outputs are fake, the threats are real." Watch on YouTube.

On October 22, 2024 the Series A was expanded to a total of $33 million, led by Illuminate Financial with Booz Allen Ventures, IBM Ventures, the Jefferies Family Office and Accenture, which had joined through Accenture Ventures’ Project Spotlight the same day (PR Newswire, FinTech Futures). Then the episode, then the developer launch. Y Combinator’s post on August 1, 2025 is the pitch in a sentence, and the Launch HN thread seventeen days later, posted by Ben as bpcrd, is the conversation every detection vendor should expect to have in public.

Six weeks after this episode. Ali Shahriyari is the third co-founder. View on X.

"Yeah but does it actually work, though?"

taneq, on Hacker News, August 18, 2025

Ben’s reply was the same answer he gave Sasha on tape, deployments at tier-one banks and large enterprises, and the thread’s best question was the one about the arms race: whether a public detector becomes the fitness function for the next generator (Hacker News). His answer on this show, a year earlier, is the realness argument above. Then the category arrived. On June 25, 2026, Gartner published its first Emerging Market Quadrant for deepfake detection, for startup vendors, and named Reality Defender a Market Shaper, with Ben’s release line the closest thing to a company motto: “Every enterprise system assumes the voice, face, and document in front of it are real” (PR Newswire). His post about it said the company was tracking toward three times its revenue for the year (LinkedIn). In May 2026 he had set up an ethics committee with Google’s former chief privacy officer Keith Enright, Yale’s Luciano Floridi and Yoel Roth, formerly of Twitter’s trust and safety, on the argument that a company that certifies what is real holds “a lot of power which needs oversight,” and that “Most ethics committees are theater. This is not one of those” (Biometric Update). In June the detection went into ZeroFox’s takedown workflow (Biometric Update). On September 10, 2026 KPMG US took a minority stake, terms undisclosed, to build the detection into its cyber and fraud practices, and the partner on KPMG’s side, Matthew Miller, had worked with Ben on cybersecurity at Goldman Sachs more than a decade earlier (Biometric Update, LinkedIn). Ben’s post on the day had the line I keep: “We don’t verify who somebody is. We verify that they’re real. Those are different problems.” Then, a month later, Samsung.

Three weeks after this episode, July 2025: Ben's eight-minute TEDxMidAtlantic talk, the consumer version of the argument he made to us. Watch on YouTube.

The founder notes

The best day was a bake-off. “We run up against these massive companies that have every single advantage to them. They’re legacy providers.” The company has matched and beaten them “in bake-offs with large, large client opportunities,” and the one he named without naming: “We recently bested one of them with a top five global bank.” The bank’s leadership, as he tells it, said point blank that they turned to Reality Defender “because it was better. It’s measurable.” Measurable is the word to hold onto when you buy any detection product.

The hardest day is hiring, every day. “Hiring is a huge challenge.” Few people have done this work, and “anyone touching AI” has options. His response is unusual for a chief executive: “I connect with as many cold emails as I can. If you ping me on LinkedIn, I’m always happy to find a few minutes.” He put the wider gap at “over a million jobs needing to be filled [in] the US alone, let alone the world,” and said the company has “met our best partners on our team literally from receiving their cold emails.” In 2024 the team was about 40 people, two-thirds of them PhD researchers and engineers (Goldman Sachs).

Pro-AI, pro-innovation, and in Washington. “we’re incredibly pro-AI, and we’re pro-innovation, and we’re really working hard in DC on a bipartisan basis to set up some AI-friendly regulations.” A month before the episode, the TAKE IT DOWN Act, which passed the House 409 to 2 and makes platforms remove non-consensual intimate imagery including AI-generated imagery on request, was signed into law on May 19, 2025 (Wikipedia). Sasha’s worry on tape was the usual one, that regulation slows the defenders and never the attackers, and Ben’s position is that the fix is regulation written by people who like the technology.

Fraud is equal opportunity. “whether it’s my seven-year-old son, my seven[ty]-year-old mother. We’re all great targets.” The tools are in the app store: “there’s face swap tools, there are synthetic voice generation tools. No requirements, no regulations.” He is careful to say the majority of uses are legitimate, entertainment and productivity, and that “in this edge case, the risks are infinite.”

Would he go back? He spent most of his twenties at huge companies and sometimes regretted it, “saying, what if I did startups early on? But I learned so much through these large companies.” The reason he would not change it: “I don’t think I would know what I know or question what I question without those experiences, and really being myself in the seat of our clients.” The Goldman vendor test is that sentence with a date on it.

The exit line. I told him it is a treat to stand on the shoulders of giants. “I wouldn’t go that far,” he said. Then: “We’re optimistic. We are very optimistic.”

Did you catch it? A six-question quiz

Interactive · six questions

Did you catch it?

Six questions on what Ben actually said, with the timestamp for each answer. The answers are under each question for anyone reading without JavaScript.

  1. What did people want Reality Defender to pivot into during the years it could not raise money?

    1. Crypto wallet security
    2. NFT authentication
    3. Content moderation for social networks

    b. "Folks wanted us to get into NFT authentication. If you guys remember, NFTs were kind of the thing for a bit." Transcript, 1:27.

  2. Which side of the detection equation does Ben say is not changing?

    1. Fakeness: the artifacts a generator leaves behind
    2. Provenance: the watermark attached at upload
    3. Realness: blinking, a heartbeat, breathing

    c. "detecting both fakeness, which is getting better, but also realness, which is not changing. If we can detect whether you're blinking or your heart's beating or you're breathing." Transcript, 7:30.

  3. Who, by Ben's account, can no longer tell a good deepfake from the real thing?

    1. His co-founder who leads R&D, a Harvard PhD
    2. A top five global bank's fraud team
    3. The judges at the RSAC Innovation Sandbox

    a. "one of my co-founders, who leads R&D, is a Harvard PhD. And even he can't tell the difference anymore." Transcript, 9:23.

  4. What does a watermark prove, in Ben's words?

    1. That the image is real
    2. That the image was generated by a specific model
    3. That at this day and time, a thing was uploaded to a thing

    c. "All the watermark means is that at this day and time, a thing was uploaded to a thing." Watermarks can be faked and they can be ignored. Transcript, 11:54.

  5. Who are the best product managers?

    1. PhD researchers
    2. Hackers
    3. Bank fraud teams

    b. "Hackers are the best product managers. Yeah, if they could use a new tool to do more hacking, they absolutely will." Transcript, 14:20.

  6. How does Ben say Reality Defender will reach consumers' phones?

    1. Through the OEMs, not by going to market itself
    2. Through a consumer app in the app store
    3. Through the mobile carriers' spam filters

    a. "We're not going to market for that ourselves. That's [done] with partners who are the OEMs." Samsung Electronics Singapore signed in October 2026. Transcript, 22:55.

Is a voice an authorization at your company?

Ben’s bank customers upload a hundred thousand files to grade his detector. You have a Slack channel, a finance person and a chief executive who travels. The question is not whether you can detect a deepfake. It is whether anything at your company moves because someone recognized a voice or a face. This scorecard asks eight questions about your approvals, your hiring and your product, each tied to a point on the tape, and tells you which one a convincing call would find first.

Scorecard · eight questions

Is a voice an authorization at your company?

Answer for how the last quarter actually went, not the policy document. Weighted toward the decisions that move money or grant access.

  1. For a wire, a change to a vendor's bank details or a payroll change, is a phone or video call from the right person ever enough on its own?

    • Yes, if it is the boss and it is urgent
    • Policy says no, practice varies
    • Never. A second channel or a signed approval is required, no exceptions for rank

    "impersonating company leadership, impersonating clients, executing wire transfers." Arup's finance employee had a video call with the chief financial officer and colleagues. All of them were fakes. The policy that would have saved $25.6 million fits on one line.

  2. When you verify a request out of band, do you call back on a number you already had, never the one that just called or messaged you?

    • We reply on the same thread or number
    • Usually, when someone remembers
    • Always, from the directory, and it is written down

    The FBI's May 2025 advice for impersonated officials was exactly this: verify a new contact through a channel you already trusted. The Ferrari call came from a number that was not the chief executive's.

  3. Do your executives and finance team have a challenge: a phrase or a question only the real person could answer?

    • No
    • Some people do, informally
    • Yes, agreed in person, rotated, and everyone knows to use it

    "Sorry, Benedetto, but I need to identify you." One question about a book ended a deepfake of Ferrari's chief executive. It is free, and it works until the attacker has read your email too, which is why it is question three and not question one.

  4. For remote hires with access to code, data or money, is there an identity check beyond the video interview?

    • No, the interview is the check
    • Reference calls we make ourselves
    • Verified identity, references we call on numbers we found, and a live camera check before access is granted

    "a hacker or a state-level actor trying to get a job at a company to steal information." Gartner projects one in four candidate profiles will be fake by 2028. Hiring diligence is where counter-espionage starts.

  5. If your product verifies customers with a selfie, a document or a voice, does it check whether the media is generated, not only whether it matches?

    • We match the face to the document and stop there
    • Liveness detection only
    • Liveness plus a check for synthetic or injected media, and a step-up for high-risk enrollments

    "Liveness remains valuable. But liveness alone is no longer enough." A stolen but genuine ID plus a selfie generated from its photo passed document authentication and face matching at an IDmission customer, because both checks traced back to one image. Not applicable? Score it 2.

  6. Does everyone who can move money or grant access know that a short clip is enough to clone a voice, and what the rule is when "the CEO" calls in a hurry?

    • No, we have not talked about it
    • It came up once
    • Yes, with a rehearsed script for saying no to the boss

    "a year ago, it was hundreds, if not thousands of dollars to do a good job. Now it's basically free." Train people, but do not make them the control. Ben's parents cannot spot a fake. Neither can his co-founder with the Harvard PhD.

  7. Do your AI agents follow Ben's line: information sharing yes, authorization no?

    • Our agents can act with whatever the API key allows
    • Some actions need a human, it depends on the agent
    • Agents read freely and every write that moves money or grants access needs a signed human approval

    "companies do want to engage your AI agent for information sharing, but maybe not for authorization." The read-before-write ladder is how to draw that line.

  8. When someone gets a suspicious call, message or interview, is there a place to report it within minutes and a person who looks the same day?

    • No
    • They would tell their manager, probably
    • A channel, an owner, and a note back to the team on what was tried

    "I only have to be right a few times, or even just once, for it to work." The first attempt that fails is your best warning that the campaign has started. Monitoring and response is the team that reads it.

A voice is an authorization

Somewhere at your company, money or access moves because someone recognized a voice or a face, and in 2026 that is the cheapest thing in the world to fake. Fix the first two questions this week: nothing that moves money or changes bank details on a call alone, and every callback on a number you already had. Then agree the challenge question in person.

Policy says no, practice says maybe

The rule exists and the busy Friday beats it. The ones that bite are the medium cases: the vendor's "new bank details," the contractor hired on a video call, the onboarding flow that matches a face to a document and stops. Rehearse the script for refusing the boss, add the identity check to remote hiring, and ask your product team question five.

Nothing moves on a voice

Approvals have a second channel, callbacks use the directory, the challenge question is agreed, remote hires are verified and your product checks whether the face is synthetic. What is left is the signal: a detector on the calls and meetings that matter, used the way Ben describes, as a score that triggers verification, never as a silence that grants it.

The economics of one convincing call

Ben’s point is that the attacker only has to be right once, and the attempt is now free. Put your own numbers in and see what one convincing call is worth to them and what verifying every approval costs you. Every default is an assumption, chosen to be easy to argue with.

Calculator

The economics of one convincing call

Approvals that happen on a call or a video, the share that get a second channel today, what an attempt against the rest is worth, and what closing the gap costs in staff time. Rough by design. Change the numbers to yours.

–approvals a year that rest on a voice or a face
–expected loss a year at those odds
–if every attempt landed
–cost to verify the rest, a year
–staff hours that takes

At these numbers, a share of your approvals go through on a voice or a face each year. The expected loss from a few convincing attempts is set against the staff time it takes to verify every approval out of band, and the attacker's cost per attempt is close to zero either way.

The 20 percent default for verified approvals, the four attempts, the 25 percent hit rate and the five minutes are placeholders, not research. A 2024 survey that Reality Defender cites put the share of finance professionals who had been victims of a deepfake scam at 43 percent, with 87 percent saying they would make a transaction without delay if their chief executive or chief financial officer asked (Reality Defender). Not counted: the attempt that steals access instead of money, the fake hire, and the customer onboarding flow your product runs.

Fourteen years on one line

Everything on this page sits on one timeline, from Ben’s Google internship to the week this page was written. Filter it by thread.

Timeline · 2012 to 2026

Fourteen years on one line

Filter by thread. Dates are from the public record except where marked as Ben's own account on the tape.

  1. Google, graduate intern

    Consumer privacy work in the Bay Area, the first line of the resume Sasha reads at the top of the show (LinkedIn).

  2. PlaceAVote

    Co-founds a blockchain-based voting platform that pitches in the TechCrunch Disrupt Startup Battlefield, and meets Goldman Sachs at a lunch for data-driven founders (Goldman Sachs).

  3. Goldman Sachs, Office of the Chief Information Officer

    Technology commercialization and investments through August 2017. The voice-authentication vendor test that mistook synthetic voices for real ones, and Phil Venables' "what if" (Goldman Sachs).

  4. Covertix and Xoogler.co

    Chief executive of the file-protection company Micro Focus acquires in 2018, and New York lead of the network of former Googlers backing each other's startups (LinkedIn).

  5. Reality Defender

    Founded in New York. "For our first few years, it was much the opposite. We couldn't raise any money. Nobody wants to talk to us."

  6. Y Combinator

    The W22 batch, and a first Hacker News post about detecting AI-generated audio, video and images (Y Combinator).

  7. ChatGPT

    "Went really mass market in winter of '22," and the education phase ended.

  8. The Pentagon image

    A fabricated explosion spreads from verified-looking accounts and the S&P 500 dips about 0.3 percent before the debunk (Bloomberg).

  9. $15 million Series A

    Led by DCVC with Comcast, ex/ante, the Partnership Fund for New York City, Rackhouse and Nat Friedman's AI Grant (PR Newswire).

  10. Arup

    A Hong Kong finance employee wires HK$200 million, about US$25.6 million, in 15 transfers after a video call full of deepfaked colleagues (CNN). The same month, a robocall in a cloned Biden voice hits New Hampshire voters.

  11. "Oversight of AI: Election Deepfakes"

    Ben testifies to the Senate Judiciary subcommittee on privacy, technology and the law: "Determining truth will always be slower and more difficult than spreading a lie" (Reality Defender).

  12. RSAC Innovation Sandbox, Most Innovative Startup

    "All we do is say human or not human." Against VulnCheck, RAD Security, P0, Mitiga, Harmonic, Dropzone, Bedrock, Antimatter and Aembit (Dark Reading).

  13. ElevenLabs partnership

    The voice generator contributes its models and methods to Reality Defender's audio detection (ElevenLabs). Nine days later, Fortune reports the Ferrari call stopped by a question about a book.

  14. Real-time video detection for Zoom

    A bot joins the call and a side panel scores every face for the host (Reality Defender).

  15. Series A expanded to $33 million

    Led by Illuminate Financial with Booz Allen Ventures, IBM Ventures, the Jefferies Family Office and Accenture (PR Newswire).

  16. BNY, Samsung Next and Fusion Fund invest

    And, with PeakMetrics, the U.S.-Japan Global Innovation Challenge win (Biometric Update).

  17. $16.6 billion

    The FBI's Internet Crime Complaint Center reports record losses for 2024 from nearly 860,000 complaints (The Record).

  18. The FBI's voice-impersonation warning

    AI-generated voice messages impersonating senior officials, aimed at their contacts (IC3). Four days later the TAKE IT DOWN Act is signed.

  19. Episode 71 airs

    This conversation, with Sasha co-hosting. "It's a fire hose of inbound interest."

  20. TEDxMidAtlantic

    Eight minutes on the truth about deepfakes and what to do about them (YouTube).

  21. One in four

    Gartner projects a quarter of candidate profiles worldwide could be fake by 2028 (HR Dive).

  22. Public API, Launch HN

    Two lines of code, 50 free scans a month, NVIDIA hardware, and "Yeah but does it actually work, though?" (Hacker News).

  23. Gary

    A fabricated candidate passes a human interviewer on Zoom and is flagged within seconds (Biometric Update).

  24. Sora 2, within 24 hours

    Real-time deepfakes of executives pass the Cameo enrollment, liveness prompts and verbal attestation included (Reality Defender).

  25. Real Suite

    RealScan, RealAPI, RealCall and RealMeeting, plus JPMorganChase's Hall of Innovation (Biometric Update).

  26. "The real problem isn't deepfakes. It's identity."

    Jasson Casey on episode 92, and our post on detecting versus proving.

  27. The ethics committee

    Keith Enright, Luciano Floridi and Yoel Roth. "Most ethics committees are theater. This is not one of those" (Biometric Update).

  28. Gartner's first deepfake-detection quadrant

    Reality Defender named a Market Shaper, and tracking toward three times its revenue for the year by Ben's post (PR Newswire).

  29. Google's selfie sign-in, red-teamed

    Two enrollments with a synthetic face succeed six days after the feature ships. "Liveness alone is no longer enough" (Reality Defender).

  30. DEF CON 34 and Wall Street

    Hundreds of attendees average under 15 of 30 at Guess the Deepfake (Reality Defender). Point72, Millennium, Two Sigma and Citadel are targeted by callers posing as colleagues.

  31. KPMG takes a minority stake

    Terms undisclosed, to build the detection into its cyber and fraud practices (Biometric Update).

  32. Samsung

    Samsung Electronics Singapore signs for on-device detection on Galaxy S26 and later, demonstrated live on a Galaxy S26 Ultra at GovWare (Samsung).

What to do this week

Four things, in the order a convincing call would test them.

  1. Write the one-line rule. Nothing that moves money, changes bank details or grants access happens on a call or a video alone, whoever is on it. Put the second channel in writing: a callback on a directory number, or a signed approval from a registered device. Then tell the boss the rule applies to the boss most of all, because the boss is who the attacker will be.
  2. Agree the challenge in person. A phrase or a question only the real person could answer, agreed face to face, rotated when it is used. It is the cheapest control on this page and it stopped a deepfake of Ferrari’s chief executive. It is a backstop for the rule, not a replacement for it.
  3. Add identity to remote hiring. Verified identity before an offer, references you reach on numbers you found yourself, and a live camera check before any credential is issued. The fake candidate is an insider with a laptop, and Gartner says one in four profiles will be fake by 2028.
  4. Ask your product the realness question. If a selfie, a document or a voice gets a customer through onboarding, find out whether anything checks that the media is real, not only that it matches. Then decide whether a detector’s score should trigger a step-up. Use it as a signal. Never treat its silence as permission.

Key takeaways

  1. The years nobody would fund it

    Reality Defender was founded in 2021 and spent its first years unable to raise money, with people suggesting it pivot to NFT authentication. Then ChatGPT went mass market in the winter of 2022 and the education phase ended. "So it's a fire hose of inbound interest." By the tape, the half of last year's clients who had said deepfakes were not an issue were "running to us saying we've had an issue. We need this yesterday."

  2. What an issue looks like

    Impersonations on the phone and on video: company leadership, clients, wire transfers, account access, and AI-generated job interviews, including "a hacker or a state-level actor trying to get a job at a company to steal information." Jon's example on tape was the Arup case, a finance employee who wired about US$25.6 million after a video call in which every colleague was a deepfake.

  3. Fakeness keeps moving. Realness does not.

    The tells of a year earlier, symmetry, pixelation, lip sync, the seam at the neck, are gone, and Ben's co-founder who leads research, a Harvard PhD, can no longer tell the difference. Generators recreate what we observe, not the physics, so Reality Defender detects both fakeness, which keeps improving, and realness, blinking, heartbeat and breathing, which does not change. "In a world where the only thing that can detect AI is AI."

  4. What a watermark proves

    Reality Defender avoids watermarks and provenance as the answer because they can be hacked or ignored. "All the watermark means is that at this day and time, a thing was uploaded to a thing." The company is a member of C2PA and supports content credentials, but focuses on detecting indicators of AI in media that has lost its provenance through conversions and reposts.

  5. Hackers are the best product managers

    If a new tool lets attackers do more, they will adopt it. Generative AI turned the one-to-one scam into a campaign against thousands or millions at once, and "I only have to be right a few times, or even just once, for it to work." A good fake cost hundreds or thousands of dollars a year before the tape and was "basically free" by June 2025.

  6. Cloud, edge, on device, through the OEMs

    Over a dozen patents, papers at CVPR, NeurIPS, ECCV and AAAI, models and data sets built in-house, and clients who grade the detector on a hundred thousand of their own files. The product was already running on commodity laptops and phones, to be taken to market by OEM partners Ben would not name. Samsung Next had invested two months earlier. Samsung Electronics Singapore signed for on-device detection on Galaxy phones in October 2026.

Chapters

Tap a chapter to play from there.

Pull quotes

“For our first few years, it was much the opposite. We couldn't raise any money. Nobody wants to talk to us. Folks wanted us to get into NFT authentication.”

Ben Colman ·

“And so what it started off was trying to educate people, and now they educate themselves, because the problem is so prevalent. So it's a fire hose of inbound interest.”

Ben Colman ·

“But also, realness, which is not changing. If we can detect whether you're blinking or your heart's beating or you're breathing, and Jon, if you're not, then you'd either, you're a werewolf or a vampire or you're an AI-generated bot.”

Ben Colman ·

“Given that companies do want to engage your AI agent for information sharing, but maybe not for authorization.”

Ben Colman ·

“In a world where the only thing that can detect AI is AI, it's just a matter of us ensuring accessibility, but also educating users on how scary it is.”

Ben Colman ·

“All the watermark means is that at this day and time, a thing was uploaded to a thing.”

Ben Colman ·

“Hackers are the best product managers.”

Ben Colman ·

“I accuse innovation that's not easy to use to actually not be innovation. I will go that far.”

Ben Colman ·

About the guest

Ben Colman, Co-founder and Chief Executive Officer, Reality Defender

Ben Colman is the co-founder and chief executive of Reality Defender, the New York company whose platform detects AI-generated and manipulated voice, video, images and text in real time for banks, contact centers, enterprises and governments. He founded it in 2021 with Ali Shahriyari and Gaurav Bharaj, took it through Y Combinator's winter 2022 batch, and won Most Innovative Startup at the RSAC 2024 Innovation Sandbox. Before Reality Defender he was a vice president in Goldman Sachs' Office of the Chief Information Officer, where testing voice-authentication vendors against synthetic voices planted the idea, chief executive of the file-protection company Covertix, acquired by Micro Focus in 2018, co-founder of the blockchain voting platform PlaceAVote, and a graduate intern at Google. He leads the New York chapter of Xoogler.co, testified before the Senate on election deepfakes in April 2024, and holds an MBA from NYU Stern and a bachelor's degree from Claremont McKenna College. Reality Defender raised a Series A led by DCVC in October 2023, expanded to $33 million under Illuminate Financial in October 2024, and was named a Market Shaper in Gartner's first deepfake-detection quadrant in June 2026.

About the host

Jon McLachlan and Sasha Sinkevich are co-founders of YSecurity, the on-demand cybersecurity team for startups, and of Cyberbase.ai. The Security Podcast of Silicon Valley is hosted by Jon McLachlan and Sasha Sinkevich. Jon McLachlan on LinkedIn ↗Sasha Sinkevich on LinkedIn ↗

Context and sources

  • PR Newswire, October 17, 2023: Reality Defender raises a $15 million Series A led by DCVC with Comcast, ex/ante, the Partnership Fund for New York City, Rackhouse Venture Capital and Nat Friedman's AI Grant, having detected millions of deepfakes since its 2021 founding. Source ↗
  • PR Newswire, October 22, 2024: the Series A is expanded to a total of $33 million, led by Illuminate Financial with Booz Allen Ventures, IBM Ventures, the Jefferies Family Office and Accenture. Source ↗
  • FinTech Futures, October 22, 2024: Accenture Ventures invests in Reality Defender through Project Spotlight, citing a 223% increase in deepfake-related tool trading on dark web forums in the first quarter of 2024. Source ↗
  • Dark Reading, May 2024: Reality Defender wins the RSAC 2024 Innovation Sandbox against VulnCheck, RAD Security, P0 Security, Mitiga, Harmonic Security, Dropzone AI, Bedrock Security, Antimatter and Aembit. Ben Colman: all we do is say human or not human. Source ↗
  • RSA Conference, May 2024: Reality Defender named Most Innovative Startup 2024 at the Innovation Sandbox, with Ben Colman calling deepfakes the number one financial threat to enterprises. Source ↗
  • Reality Defender, April 2024: Ben Colman's testimony to the Senate Judiciary subcommittee on privacy, technology and the law at the Oversight of AI: Election Deepfakes hearing on April 16, 2024. Source ↗
  • NBC News, April 2024: the Senate hearing with the chief executives of Resemble AI, Reality Defender and DeepMedia, and Senator Blumenthal on political deepfakes being real and happening now. Source ↗
  • Goldman Sachs alumni spotlight, 2024: Ben Colman on the Office of the CIO role from 2015 to 2017, voice-authentication vendors that mistook computer-generated voices for real ones, Phil Venables' push to anticipate spoofing, founding Reality Defender in 2021, a team of 40 that is two-thirds PhD researchers and engineers, and saying no to customers. Source ↗
  • ElevenLabs, July 18, 2024: the voice company contributes its models and methods to Reality Defender's audio detection as part of an AI safety collaboration. Source ↗
  • Reality Defender, October 15, 2024: real-time video deepfake detection for Zoom, with a 43% of finance professionals victimized and 87% would transact on a chief executive's request survey figures, Deloitte's $40 billion projection, and the Arup case. Source ↗
  • Reality Defender, April 3, 2025: strategic investments from BNY, Samsung Next and Fusion Fund, citing Entrust's finding of a deepfake attempt roughly every five minutes in 2024. Source ↗
  • Biometric Update, April 3, 2025: the BNY, Samsung Next and Fusion Fund investments and the 2025 U.S.-Japan Global Innovation Challenge win with PeakMetrics, sponsored by the Defense Innovation Unit and Japan's ATLA. Source ↗
  • Hacker News, August 18, 2025: Launch HN for Reality Defender's public API and SDK, two lines of code, a free tier of 50 scans a month, posted by Ben Colman as bpcrd, 92 points. Source ↗
  • Biometric Update, August 18, 2025: the developer SDK and API run on NVIDIA infrastructure, with audio and image analysis first and video to follow. Source ↗
  • Biometric Update, September 29, 2025: Gary, the fabricated Zoom candidate, CrowdStrike's 320 North Korean remote-job fraud incidents, and Gartner's one in four fake candidate projection for 2028. Source ↗
  • Reality Defender, October 3, 2025: the red team passes Sora 2's Cameo identity safeguards within 24 hours of launch with real-time deepfakes of executives, by the company's account. Source ↗
  • Biometric Update, November 20, 2025: Real Suite, with RealScan, RealAPI, RealCall and RealMeeting, and Reality Defender's inclusion in JPMorganChase's 2025 Hall of Innovation. Source ↗
  • Biometric Update, May 7, 2026: the Reality Defender ethics committee, with Keith Enright, Luciano Floridi and Yoel Roth, and Ben Colman on epistemic authority needing oversight. Source ↗
  • ITIJ, June 2026: Ben Colman on detection as a continuously evolving capability, about a third of warned people reliably spotting deepfakes, and Deloitte's $40 billion projection. Source ↗
  • Biometric Update, June 3, 2026: Reality Defender's detection built into ZeroFox's takedown workflow. Source ↗
  • PR Newswire, July 1, 2026: Reality Defender named a Market Shaper in Gartner's Emerging Market Quadrant for Deepfake Detection, Startup Vendors, dated June 25, 2026. Source ↗
  • Reality Defender, July 29, 2026: red-teaming Google's selfie video sign-in, two successful enrollments with a synthetic face, and the conclusion that liveness alone is no longer enough. Source ↗
  • Biometric Update, August 3, 2026: the Google selfie red team, Dharva Khambholia's role, and Google's description of its anti-deepfake protections. Source ↗
  • Reality Defender, August 19, 2026: the DEF CON 34 Guess the Deepfake challenge, hundreds of players averaging under 15 of 30, and a real-time voice clone built in about 15 minutes. Source ↗
  • Reality Defender, August 10, 2026: the Wall Street vishing attempts against Point72, Two Sigma and Citadel, and detection as a layer, not authentication. Source ↗
  • InvestmentNews, August 5, 2026: Point72, Millennium, Two Sigma and Citadel targeted by AI voice phishing, and Align Managed Services' Vinod Paul on attacks scaling from 50 firms to 1,000. Source ↗
  • Biometric Update, September 11, 2026: KPMG LLP takes a minority stake in Reality Defender, terms undisclosed, to build the detection into its cyber and fraud prevention practices. Source ↗
  • Samsung Newsroom Singapore, October 14, 2026: Samsung Electronics Singapore and Reality Defender sign a memorandum of understanding for on-device deepfake detection on Galaxy S26 and later, alongside Knox, with 56% of Singapore businesses having faced audio deepfake fraud per Regula. Source ↗
  • Ben Colman on LinkedIn, October 2026: the Samsung on-device announcement from GovWare, demonstrated on a Galaxy S26 Ultra. Source ↗
  • Ben Colman on LinkedIn, 2026: the Gartner Market Shaper post, revenue tracking toward three times for the year, and Entrust's one in five biometric fraud attempts being deepfakes. Source ↗
  • CNN, May 16, 2024: Arup confirms the Hong Kong deepfake video call, HK$200 million in 15 transfers, about US$25.6 million, with no internal systems compromised. Source ↗
  • Fortune, July 27, 2024: a Ferrari executive stops a deepfake of chief executive Benedetto Vigna's voice by asking which book Vigna had recommended days earlier. Source ↗
  • Bloomberg, May 22, 2023: a fake AI image of a Pentagon explosion spreads on social media and the S&P 500 falls about 0.3% before recovering. Source ↗
  • FBI Internet Crime Complaint Center, May 15, 2025: public service announcement on a text and AI-generated voice campaign impersonating senior United States officials. Source ↗
  • The Record, April 23, 2025: the FBI's 2024 Internet Crime Report, $16.6 billion in reported losses from nearly 860,000 complaints, the highest since 2000. Source ↗
  • Deloitte Center for Financial Services, May 29, 2024: generative AI could push United States fraud losses from $12.3 billion in 2023 to $40 billion by 2027. Source ↗
  • HR Dive, August 8, 2025: Gartner projects one in four candidate profiles worldwide could be fake by 2028, and 6% of surveyed candidates admit to interview fraud. Source ↗
  • Wikipedia: the TAKE IT DOWN Act, passed the House 409 to 2 on April 28, 2025 and signed on May 19, 2025. Source ↗
  • Ben Colman's LinkedIn profile: Reality Defender from September 2021, Xoogler.co NYC lead from 2017, Covertix chief executive 2017 to 2018 (acquired by Micro Focus), Goldman Sachs vice president 2015 to 2017, PlaceAVote co-founder 2014 to 2015, Google graduate intern 2012. Source ↗

Transcript

Automatic transcription; speaker labels were assigned by ear (no diarization on the tape), and the two hosts' questions are attributed by voice and by who usually asks what, so a few host lines may be swapped. Names and product names were normalized where the recognizer misheard them (Jon McLachlan, Sasha Sinkevich, Ben Colman, YSecurity, Reality Defender, PlaceAVote, Covertix, Xoogler.co, ChatGPT, ElevenLabs, C2PA, COMDEX, NVIDIA, CVPR, NeurIPS, ECCV, AAAI, deepfake). Bracketed words are best guesses where a syllable was lost. Timestamps are the start of each turn to within a couple of seconds.

Read the full transcript 5,399 words

Jon McLachlan

Hello everyone and welcome to another episode of The Security Podcast of Silicon Valley. This is a YSecurity production. I'm one of the hosts, Jon McLachlan. I'm joined with the other host, Sasha Sinkevich. And today we have an amazing guest, Ben Colman, the CEO and co-founder of Reality Defender. Welcome to the show, guys.

Ben Colman

Thank you.

Sasha Sinkevich

[Thank you, Jon.] Ben, you have an amazing, amazing technical background. It looks like you launched your career at Google as an intern. From there you jumped right into the entrepreneurial thing. You co-founded a company called PlaceAVote.

Ben Colman

Yeah.

Sasha Sinkevich

Sounds very conscious, very, like, socially aware company. From there you jumped into Goldman Sachs as vice president. And you were CEO of another startup called Covertix. From there, you jumped into angel investing. Xoogler.co, you're a member, past NYC lead there, which helps ex-Googlers launch successful startups. Awesome, awesome, you're definitely part of that crowd for sure. And today, you're leading the charge as co-founder and CEO of Reality Defender, which is actually a YC Winter of 2022 backed startup. Incredible.

Ben Colman

That's right. Yeah, it's been quite a journey. For those listening, being a startup founder has its ups and downs, and Reality Defender certainly [is] having a lot of excitement in the news right now. For our first few years, it was much the opposite. We couldn't raise any money. Nobody wants to talk to us. Folks wanted us to get into NFT authentication. If you guys remember, NFTs were kind of the thing for a bit.

Sasha Sinkevich

But this is an amazing point, which is time to market always matters. And there's usually a very short window when the timing is perfect. And if you [are] just [a] couple years too early or [a] couple of years too late, you never get to experience that [hockey stick] growth. Where do you see AI defense fits in the market needs today? And what pain point do you guys solve?

Ben Colman

Throughout my career, [it's] always been focused on cybersecurity in a defensive capacity, whether it's protecting companies or consumers or their data, or finding the data and removing it. The way I think about our space is just another application of cybersecurity to a new venue, which is around AI. So I think of it very similar to the antivirus industry and then the history of antivirus. We think that our space in detecting AI fraud and deepfakes is actually following the same, the same growth story in terms of education and explosion and fraud as such.

Sasha Sinkevich

How do you educate people, or do you have to educate people before you start a discussion and conversations around AI and the need to defend against deepfakes? Do you still see the need to educate, or do people reach out directly to you?

Ben Colman

You know, we started the company five years ago and we're incredibly stubborn, so we stuck into it, we stuck with it. But what we saw was that once OpenAI launched ChatGPT, which went really mass market in winter of '22, suddenly then people started really thinking about what we're doing. And so what it started off was trying to educate people, and now they educate themselves, because the problem is so prevalent. So it's a fire hose of inbound interest. Our challenge is trying to understand which industry leaders, which company leaders, understand the existential risk versus just another software they should think about. And so last year I'd say half our clients said, hey, we don't know if this is an issue, but we believe we should get started doing it. Well, today there is the data, so they don't have to do it anymore. But then half the clients said, not an issue, we'll come back with this problem. Now all those half that said it was [not] an issue are running to us saying we've had an issue. We need this yesterday. So it's accelerating very quickly, both in terms of industry research groups understanding the data to be able to present it, but also the clients, the targets of this fraud, are seeing the risks firsthand.

Jon McLachlan

Yeah, and maybe for our listeners, would you mind giving us an example of what that issue is, or an example of an issue?

Ben Colman

Yeah. Put bluntly, it's, you know, it's impersonations on the phone, impersonating company leadership, impersonating clients, executing wire transfers, getting access to accounts. And then similarly on video, which is all the same use cases, but also AI generated interviews, whether it's someone interviewing for someone else, or a hacker or a state-level actor trying to get a job at a company to steal information.

Jon McLachlan

Yeah, that's a huge problem. I remember in the news there was a case of someone had wire transferred, someone had gone through, like, the quote unquote processes to wire transfer 20 million, $20 million out of the, you know, outside of a company. And they had done it because they thought that they were actually talking to their colleagues inside the company, who were okaying the transfer. Okay, everything looks good. Okay, yep, everything is signed. All right. Transfer the money. And then it happened, and then boom, the money was gone. And it turned out that the whole thing was just deepfake, AI-enhanced fraud. [I] really believe that's the tip of the iceberg, too.

Ben Colman

Absolutely. I mean, I think what we're seeing now is that, [you] know, we're all equally at risk. You know, fraud is equal opportunity, whether it's my seven-year-old son, my seven[ty]-year-old mother. We're all great targets. And in a space when generative AI platforms which create deepfakes required zero technical ability, you know, those same seven-year-old son with his tablet, or my seven[ty]-year-old mother with her, you know, her iPhone or her Android. These tools are everywhere. You just go onto the app store and there's face swap tools, there are synthetic voice generation tools. No requirements, no regulations, and [it] makes the thing very entertaining. So I think the challenge is that, you know, [the] majority of use cases for generative AI are credible, whether it's entertainment or productivity, but in this edge case, the risks are infinite. And there's no regulation yet, and we're incredibly pro-AI, and we're pro-innovation, and we're really working hard in DC on a bipartisan basis to set up some AI-friendly regulations.

Sasha Sinkevich

And I think AI-friendly regulation is the key. Otherwise, often we fall into this state where we over-regulate. And usually what it means is it means that we slow down innovation. But on the attack side, the innovation will never be slowed down. And so there's always this cat and mouse game. How do you guys approach the cat and mouse game? How do you stay, if not ahead of the curve, but at least you follow the same techniques as the attackers do?

Ben Colman

Yeah, I mean, we're certainly, it's a cat and mouse game. That's also true in all of cybersecurity. And I think that it's much more a feature than a bug. The good news is that I don't think anytime soon AI is going to suddenly [be im]possible for us to detect. Most standard AI tools are focused on recreating what we observe, literally how we hear things or see things. They're not trying to recreate how sound waves move. [They're not trying to] recreate how photons interact in physics. So, you know, I think we have many years of exciting problems to solve. It's obviously going to get harder, but we're working on both sides of the equation, detecting both fakeness, which is getting better, but also realness, which is not changing. If we can detect whether you're blinking or your heart's beating or you're breathing, and Jon, if you're not, then you'd either, you're a werewolf or a vampire or you're an AI-generated bot. Now it gets really exciting with the advent of AI agents, which creates new opportunities for Reality Defender, given that companies do want to engage your AI agent for information sharing, but maybe not for authorization. So we're thinking long and hard not only about detecting which are deepfakes, but whether [permissioned] deepfakes suddenly add additional calls to action for enterprise users.

Jon McLachlan

Let's frame the problem for all of our listeners out there. In order to pull off a deepfake today, with today's technology, do you think, like, this podcast would be enough to go off and train someone that looks just like Ben Colman, for the purposes of a deepfake, like, Zoom call? Or would it just be a photo and a little bit of your voice, or? How good is that technology? You're on the cutting edge of all of this stuff, so help us frame it.

Ben Colman

If this was six months or a year ago, we would have gone through all the things to look for. You know, looking for issues around symmetry or hourglassing or pixelation or anti-aliasing or sound versus mouth correlation, or kind of where the head and the neck kind of touch. But you know, my, one of my co-founders, who leads R&D, is a Harvard PhD. And even he can't tell the difference anymore. And so that kind of demonstrates that for average people, you know, my parents, they don't [stand a chance]. Very similar to how you don't expect my parents to be able to scan code and detect a virus. We similarly shouldn't exactly be able to detect a deepfake, because it's just too advanced for everybody, including the experts. And so, in a world where the only thing that can detect AI is AI, it's just a matter of us ensuring accessibility, but also educating users on how scary it is. And I, you know, I want to be very careful to say that there is no silver bullet here. Reality Defender alone is not going to solve these issues. But in a world where all of your personal data is available on the dark web or online, and your name and your face and your voice are available on social media or on YouTube, it's paramount that organizations don't just check for your personal information matching. All that means is that I have your information. [They should be] both checking that whoever claims to be you and have your information isn't using AI to do it.

Sasha Sinkevich

Everyone can connect with numbers. What is the cost of deepfaking someone's audio? And what is the cost of deepfaking someone's video?

Ben Colman

[Even] a year ago, it was hundreds, if not thousands of dollars to do a good job. Now it's basically free. The tools are all over. Just Google it. Unfortunately, I'm [going to] avoid trying to share any of the names of my favorites. But the good news is not only [does] our solution detect them, but more importantly, a lot of the GenAI tools are actually partnering with us to make sure their tools don't fall in dangerous hands. Or if they do, that we're, they could say, hey, well, Reality Defender can for sure detect it. So we announced [a] partnership with ElevenLabs, and we have about a dozen other GenAI platforms that we're going to be announcing over the coming months, [to] partner on the data side.

Sasha Sinkevich

And so is there some type of watermarking in the partnership that you just mentioned? Is there an easy identifier that something was generated using AI?

Ben Colman

So we avoid watermarks, we avoid any provenance-based tools, because we assume they either can be hacked or just ignored. You know, for the tech folks who are following this podcast, you know, anyone can upload anything to Photoshop and add a watermark, [and] my parents might say, oh, [it] must say it's real. This explosion of the Pentagon led to a $100 billion flash crash in the market. All the watermark means is that at this day and time, a thing was uploaded to a thing, and [they can] confirm that. One, watermarks can be faked, but also they could be ignored. That same image was shared on Telegram and WhatsApp. They don't [show] watermarks, or on social media, people don't know how to grade watermarks. And so we are a proponent of these content authenticity platforms and standards like C2PA, we're a member of it. Our platform at Reality Defender is focused on supporting when those others fail, whether or not an image or a photo or a video [has] gone through so many different conversions with the watermarks missing, whether we have no idea who it is, our focus is on detecting indicators of AI.

Jon McLachlan

You've gotta be a little bit crazy to get into security. It's like a little bit of a cat and mouse game. There's so much at stake, you know. I've always been blessed to know that this stuff gets me irrationally excited. But maybe you have a story. Did something in particular connect back to security, really just grabbed your interest and pulled you in?

Ben Colman

And I'll be honest, like, I grew up having a lot of fun with technology, and I was fortunate enough to have my best friend, when I was a child, his father had a computer store. So we were having a lot of fun working with computers. We were in fifth grade, and I don't know how our parents let us do this, but we flew unaccompanied to Las Vegas to go to the big COMDEX tech conference. But we were just exposed to a lot of technology then. And we tried a lot of tools that were questionable in nature. And I, you know, it certainly is a lot more fun being on the good side than the bad side. So I'd say, you know, really just being exposed to technology is great, but also, if you're going to be involved with things that might be a little, you know, or a lot ethically dubious, might as well be on the good side 'cause it's just as much fun.

Jon McLachlan

Yeah, no, that's a great way of seeing it. Like, you know, it's a cat and mouse game, and it's your decision whether, you know, you feel like the cat or you feel like the mouse.

Ben Colman

And it's also an area where the kind of cat and mouse game means it's always exciting and ever changing. And every single day brings new excitement. And the challenge for us is to understand which one of those segments are mass marketable, both from the hacker side, but also from the detection side. Hackers are the best product managers. Yeah, if they could use a new tool to do more hacking, they absolutely will. And that's really where the initial genesis of this really interesting research we developed to this commercialized solution of Reality Defender, thinking about how bad actors and hackers and state-level groups will use these widgets to cause more harm at a greater level. No longer a Nigerian prince scam or trying to attack one person, like me attacking you, Jon. Something could do it to thousands, tens of thousands, [or] millions of people at the same time. And I only have to be right a few times, or even just once, for it to work. Which is why, you know, I try and force my family members to use password managers. You know, my parents should not use my birthday as their password. If I get one breach on one site, [they're] using it everywhere else. They only [have to] do it once. So anyway, I'm very optimistic on AI, I'm very optimistic on deepfake detection, but I think we've got to stay vigilant.

Jon McLachlan

Yeah, definitely. And you mentioned building a company. I think there's a certain type of responsibility that comes with that. It's very different than just getting irrationally excited about security or a topic, though I think that that's very helpful, because it's a lot of work [to] build a company, right? So congratulations on all of the success with Reality Defender so far. I'm sure that the grand reward is still out there in the future. And I'm super curious, speaking about the future, if you look into the future, I know entrepreneurs and founders in particular, they're always, there's always a vision that's driving things forward. Maybe you'd like to share with the audience, what is that vision that you see as success for Reality Defender?

Ben Colman

You know, I, based on the way we see the world and how that's evolving, we want to see solutions like Reality Defender everywhere, both companies but also consumers are engaging communications or media. A lot of that comes down to compute, which is still quite expensive, but also battery life on phones. You know, I can't get by on my phone for more than, I don't know, half [a] day without charging it. As compute gets cheaper and moves to the edge and on device, for GPUs, which NVIDIA is working on, and also as battery life continues to expand, we want to see Reality Defender scanning everything we're doing all the time. We're seeing each other on video now. We're speaking real time on audio as well. Similar to your phone saying, hey, this call might be spam, which maybe you're okay with because it's an AI agent, or it's a United saying that I've been upgraded, which is, you know, it is, it's nice. It's a AI voice saying it. I want that call. You know, and similar to when you're on a call, finding out that you have another call, someone also calling you, or maybe letting you know that you got an email, or your battery's low. Getting [an] alert saying, you know what, at four minutes, 20 seconds [into] the call, there's an 80% chance that Jon's voice is AI generated. I think we'll start becoming very common. Not all of them [will be] fraudulent. A lot of them will be fantastic. Permissioned agents, so Jon's voice calling to change a reservation, or calling Ben to say, hey, Ben, I'm gonna be late to the meeting. It'll all be done in our devices, in our phones. It'll be done securely. And that's incredibly exciting for Reality Defender [to] play a role in it. And a more secure, you know, maybe simpler future, where you can trust what you see and what you hear.

Sasha Sinkevich

So in other words, in the near future, there will be a parallel that we have currently in the engineering space, which is service-to-service or service accounts communications between systems. And to paraphrase, in the future there will be agents that will represent an entity or an individual, that will actually be positive agents. And, the both positive or negative.

Ben Colman

Yeah, yeah. I mean, it could be, could be positive, Jon letting me know he's gonna be late to dinner. It could also be someone committing fraud, just doing it on a massive scale. So there is a delta there, but it's the same exact technology and framework. But it'll be everywhere.

Sasha Sinkevich

It'll help us understand, like, oh, this was actually, like, human generated. This was machine generated.

Ben Colman

Yeah, or it's machine generated and I'm saying, hey, Jon, I want you, some of your credit card number to co-pay this, you know, there's the concert tickets, and then the AI agent says, hey, Jon, I'm your AI agent. I need you to come on the call, because we need you to confirm it with [them]. So there'll be a lot of that kind of handoff between AI and non-AI.

Sasha Sinkevich

Ben, you mentioned something very interesting, which is the edge compute, the reduction in resources required for SLMs to process the audio. [Are you] currently using any SLMs on the local device? And SLM stands for small language models. Are you fine-tuning your own models? How do you currently use the technology that is available on the market? If that is something that you can share.

Ben Colman

Yeah. So we have over a dozen patents and white papers. We are selected for peer review at all the big conferences in computer vision and audio: CVPR, NeurIPS, ECCV, AAAI, which really differs us from most companies in our space, in that the majority of our company are PhD researchers and engineers. We see our product deployed everywhere, starting with cloud, moving to edge, moving ultimately on device as well. I can't share too much now, but yes, to everything that you're saying. But as far as what we're doing, it's all, you know, we develop our [own] models [and] data sets in-house. It's expensive and hard to do. We think that's important, versus a lot of other platforms [that] claim they are highly effective, but in reality you're just using open source. We think that's a great way of, you know, getting in trouble as a corporate entity. But the good news is that it's really easy to grade. You do a benchmarking data set, [a] test, and you can grade like a multiple choice exam in high school. So for us, it's not only important for us to demonstrate what we're doing, which is unfortunately considered just marketing. We'll also have our clients prove it for themselves. So, you know, our large clients, you know, [tier one] banks, government organizations, Fortune 100s, they will literally recreate all of our testing themselves and grade the results. They'll upload 10,000 or [a hundred thousand] or more real-time or asynchronous audio or videos or images, and then grade the results.

Sasha Sinkevich

We definitely look forward to that announcement. Once it becomes available, we'll celebrate together on the partnership with the manufacturers. That highlights another important point, which is trust. Modern businesses, and just [the] modern business environment in general, is built on communications, and people have to be able to trust each other in order to make deals, in order to create new businesses, in order to create partnerships. Going beyond the fraud, if someone is not able to trust another party, then essentially you hold [up] business deals, preventing the time to market, business deals which are very important. And it seems, and it sounds, based on what you share, the manufacturers themselves see the problem. They see the problem will become even more [severe] in the near future, and there needs to be a solution.

Ben Colman

Absolutely.

Jon McLachlan

Did I hear correctly? Did you make a prediction that we're going to go from LLMs that are mostly up in the cloud, that eventually migrates them to the edge compute, but then ultimately on device? And I assume that's one hundred percent more, that's a little bit more of the small language model, the SLMs that Sasha mentioned.

Ben Colman

I think there's other things that can be done for multiple reasons, for security and scalability. We've done a lot of that work ourselves, anyways, in terms of quantizing our models to reduce and use less compute, or to be able to scale in more secure environments where, for a variety of reasons, the client or we want to ensure that the models are more protected or protective. So we have successfully already deployed our solution on commodity laptops, commodity phones. We're not going to market for that ourselves. That's [done] with partners who are the OEMs, or for various enterprise or government use cases that require a different kind of environment. And so yes, we've already done what we're discussing, and we're excited to really scale up the rollout with our partners.

Jon McLachlan

What was the pressure? Was the pressure security pressure to keep things off of the cloud? Was the pressure performance, maybe you get better performance from SLMs, or?

Ben Colman

[All three] directions. Compute is not infinite on the cloud. It's incredibly expensive. But sometimes [it's] also not available. Sometimes you just have no connectivity, so, you know, to the internet to access cloud compute. But also, depending on where we're [deploying] models, the models have to be even more secure, things encrypted, being able to not only protect our IP, but also protect what we're scanning on behalf of our clients. And so, you know, without regard to the size of language models or vision models or audio models and beyond, we've developed some novel approaches to, really without changing the model itself, compress them and quantize them without kind of reducing the accuracy of what they're doing. So, you know, it's, so a lot of fun work to do there. But certainly we, it's an observation and a prediction mixed into one.

Sasha Sinkevich

Since we dipped into a little bit of a technical layer of this discussion, I have one more question for you. It's an interesting space in general, where we have [a] new technology, LLMs and SLMs, but it's still right on the backbone of the existing good engineering approach and good engineering architecture and good engineering design. And I imagine that you don't really have to process the entire audio stream in order to determine that something is deepfake. You can probably chunk it up into smaller chunks, process them in parallel, and once you determine that something is deepfake, you can make a decision that the entire stream is deepfake, or there is a high likelihood that there is a deepfake. Hence, you reduce the costs that go into the detection.

Ben Colman

We could do that. Some of our clients want us to do that, but we prefer to make it cheap enough and scalable enough [that] they don't have to make a decision that way. We're just scanning the whole thing. And so instead of traditional authentication, where you're checking Sasha's [ID] at the beginning, checking it again at minute two or minute 20, we're not scanning just the first minute. We're scanning the whole call in real time. And we don't think that folks should compromise that to just scan the first minute. They ask if they can. And we say, guys, you know, we're making it as easy and [in]expensive enough that you don't have to make the compromise yourself.

Sasha Sinkevich

Awesome. And this goes back into the user experience, which is very important. UI and UX. In security in general, we've been in this space where we've made things very complex, often, as a solution. But it sounds like you guys are working from a different point of view, which is, whatever we put in our customers' hands, it needs to be seamless. [The] customer does not need to be involved in the decision-making process of how to set it up, how to configure it. They just should be able to easily consume it and be protected.

Ben Colman

Absolutely. We couldn't agree more. I accuse innovation that's not easy to use to actually not be innovation. I will go that far. Because anything that's, like, not easy to adopt is not, you just can't, it's, it's maybe an interesting side thing, but if it's not adoptable, if it's not easy to understand, if it's not available for consumption, it's not going to make the world a better place, 'cause it won't get adopted, right? So.

Sasha Sinkevich

Yeah. No, we [couldn't] agree more. Yeah.

Jon McLachlan

All of the gratitude in the world for thinking through these hard problems. Being an entrepreneur is really like being on a roller coaster. You can have really high highs and really low lows. And so I'm super curious, what's the best day that you've ever had as co-founder and CEO of Reality [Defender]?

Ben Colman

Best day? You know, we run up against these massive companies that have every single advantage to them. They're legacy providers. They have [tons] of money, a ton of reputation. We've been successfully able to not only match them, but more importantly beat them, in bake-offs with large, large client opportunities, ones that they're already working with or we're working with. We recently bested one of them with a top five global bank. We heard their CEO [called] up bank leadership and had some strong words. And they said point blank, we turned [to] Reality Defender because it was better. It's measurable.

Jon McLachlan

On the flip side of that, what's been the most challenging day at Reality Defender?

Ben Colman

Hiring is a huge challenge. Not only that there's not a lot of people in our space, but also the fact that anyone touching AI is just, [has] a lot of opportunities. I'd say what's really helpful for us is that we're really helping to kind of mold the public narrative in the space. You know, we're not only leaders in the market, but we're also kind of starting the market. And so it's a lot of responsibility. And we spend a lot of time with folks in grad school, folks kind of switching or considering switching between jobs, and new for me, I connect with as many cold emails as I can. If you ping me on LinkedIn, I'm always happy to find a few minutes. Beyond just deepfakes, but just all cybersecurity, over a million jobs needing to be filled [in] the US alone, let alone the world. And so it's a space that needs a lot of new folks, and it needs a lot of people, whether they're career switchers or early in their career, or before careers start, thinking about it. It's just a lot of fun. There's never a boring day.

Jon McLachlan

I, no, I love that. You know, sometimes I see there's, as organizations grow and you pull in a lot of research components, a lot of, like, you're on the very bleeding edge of new technology. You have to have that research component. And then you get a really healthy mix of engineering, where the rubber hits the road, but also the cutting edge in terms of the research itself. And it sounds like you're right there on that edge as well. And you need expertise in both sides of that.

Ben Colman

Absolutely. We're working hard, we're having a lot of fun, and we welcome anybody who's interested in us to either apply for roles we have on our site, or reach out and say, hey, I don't see a role that fits me, but here's what I do, and here's how I think it can be accretive toward your goals. We have met our best partners on our team literally from receiving their cold emails.

Sasha Sinkevich

And to reach out to Ben, please check out the description in the podcast. If you had an opportunity to go back in time and meet your younger self, would you? And what advice would you have?

Ben Colman

Absolutely. Quick, you know, I think about this a lot. And, you know, I spent most of my 20s, you know, working at huge companies, and sometimes regretting it, saying, what if I did startups early on? But I learned so much through these large companies. [I don't] think I [would] change anything. I do look at my friends and startups who started them early, and there's certainly a world where you could do things early in a much larger way, but I don't think I would know what I know or question what I question without those experiences, and really being myself in the seat of our clients. That's helped us a lot.

Jon McLachlan

Awesome. Awesome. Yeah. Check out the description for the LinkedIn. And Ben, you sound super active, super engaged. So that's perfect.

Sasha Sinkevich

Ben, thank you so much for your time. This has been an amazing show. And we look forward to the exciting news that will be coming out of the organization that you are leading very successfully. Thank you for being part of [the] great show.

Ben Colman

Thank you, Sasha. Thank you, Jon. Always a pleasure.

Jon McLachlan

Ben, it was an absolute pleasure. It's always a real treat to stand on the shoulders of giants.

Ben Colman

I wouldn't go that far.

Jon McLachlan

To see the world, I would. No. To see the world from their point of view and get a glimpse into a better future.

Ben Colman

We're optimistic. We are very optimistic. But thank you both.

Jon McLachlan

And thank you to all of our listeners for tuning in to another show of The Security Podcast of Silicon Valley. This has been a YSecurity production. I'm Jon McLachlan, one of your hosts, and was joined by the other host, Sasha Sinkevich. Ben Colman, everyone. Co-founder and CEO of Reality Defender.

Ben Colman

Thanks, guys.

FAQ

Questions this episode answers

What does Reality Defender do?
It detects AI-generated and manipulated audio, video, images and text in real time for enterprises and governments, with in-house models rather than open-source ones. On the tape Ben describes the product as the detection layer for a call center, a video meeting or an onboarding flow: it scores the whole call continuously rather than checking identity once at the start, and its largest clients, banks and government organizations, validate it by uploading tens of thousands of their own files and grading the results. By late 2025 the offering was packaged as RealScan, RealAPI, RealCall and RealMeeting.
How do deepfakes get used for fraud?
Ben's list on the tape: impersonating company leadership or clients on the phone to execute wire transfers or get access to accounts, the same on video, and AI-generated job interviews in which someone interviews for someone else or a hacker or state-level actor tries to get hired to steal information. The Arup case in January 2024, a video call full of deepfaked colleagues and about US$25.6 million in transfers, is the canonical example of the first. Gartner projected in 2025 that one in four candidate profiles could be fake by 2028.
Can people tell a deepfake from the real thing?
Not reliably. Ben says the visual tells of a year earlier are gone and that his co-founder who leads research, a Harvard PhD, can no longer tell the difference, so ordinary people stand no chance. At DEF CON 34 in August 2026, hundreds of attendees who knew half the items were fake averaged under 15 of 30 in Reality Defender's challenge, and a 2024 meta-analysis of 56 studies put human accuracy at about 55 percent.
Why does Ben Colman say detection is not a losing race?
Because generators are trained to reproduce what we see and hear, not the physics underneath, so a detector can look for realness, whether a person is blinking, breathing, has a heartbeat, as well as for the artifacts of fakeness. The artifacts keep improving. The physics of a real person does not change. He is careful to add that there is no silver bullet and that Reality Defender alone will not solve the problem.
Do watermarks and content credentials stop deepfakes?
Not on their own, in Ben's view. A watermark proves only that a file was uploaded somewhere at a given time. It can be faked, and it disappears when an image is screenshotted or reposted on Telegram or WhatsApp, where nobody checks it. Reality Defender is a member of C2PA and supports provenance standards, but its focus is detecting indicators of AI when provenance is missing.
What does Ben mean by hackers are the best product managers?
Attackers adopt any new tool that lets them do more damage faster. Generative AI removed the labor constraint on scams, so one operator can target thousands or millions of people at once and only has to succeed a few times, or once. That is why the cost of a convincing fake going from thousands of dollars to free matters more than any single tool, and why Ben pushes his own family to use password managers.
What is Reality Defender's vision for consumers?
A phone that flags a synthetic voice mid-call the way it flags spam today: an alert that at four minutes and twenty seconds there is an 80 percent chance the voice is AI generated. Many of those calls will be legitimate, permissioned agents booking reservations or saying someone is late, and the point is that users know which is which. Companies, he says, want to engage your AI agent for information sharing but maybe not for authorization.
What happened to Reality Defender after the episode?
It launched a public API and SDK in August 2025 with a free tier, reported passing Sora 2's identity safeguards within 24 hours in October 2025, shipped Real Suite in November 2025, formed an ethics committee in May 2026, was named a Market Shaper in Gartner's first deepfake-detection quadrant in June 2026, red-teamed Google's selfie video sign-in in July 2026, took a minority investment from KPMG US in September 2026, and signed a memorandum with Samsung Electronics Singapore for on-device detection on Galaxy phones in October 2026.
Keep reading on the YSecurity blog
Related episodes
New episodes every other Tuesday

Got a story like this one?

We're always looking for practitioners who've been in the room when it mattered.