Pangram Labs CEO Max Spero reveals why AI detection is more complex than a simple ‘real or fake’ test
In the summer of 2024, Pangram Labs CEO Max Spero found himself at the center of a growing storm. As AI-generated content flooded the internet—ranging from product reviews to job applications and even insurance claims—Spero’s company became a critical player in the fight to distinguish between human and machine authorship. Pangram Labs, under Spero’s leadership, has developed detection tools designed to identify AI-generated text with precision, a task that Spero describes as far more nuanced than a simple ‘real or fake’ test. The urgency of this challenge was underscored in June 2023, when the Federal Trade Commission (FTC) issued warnings about AI-generated scams targeting consumers, highlighting the real-world consequences of unchecked AI proliferation.
Spero’s team at Pangram Labs has been working at the intersection of natural language processing (NLP) and machine learning to build detection models that go beyond surface-level analysis. Traditional methods, such as checking for repetition or unnatural phrasing, often fall short when faced with advanced AI models like those developed by OpenAI, Anthropic, or Mistral. Instead, Pangram Labs employs a multi-layered approach that analyzes stylistic patterns, semantic inconsistencies, and contextual anomalies. For example, their latest detection model, Pangram Detect v3, which launched in April 2024, claims an accuracy rate of over 92% in identifying AI-generated text across multiple languages. This is a significant leap from earlier tools, which struggled with the subtlety of modern AI outputs. The company’s technology is already being integrated into enterprise platforms, including those used by financial institutions, where the stakes are particularly high.
The problem Spero is addressing is not just academic. In 2023, a study by the Stanford Internet Observatory found that AI-generated reviews on e-commerce platforms had increased by 300% year-over-year, often influencing purchasing decisions with near-imperceptible distinctions from human-written content. Meanwhile, the rise of AI-generated resumes has led to concerns among employers about the authenticity of candidate qualifications. Spero points to a specific case in early 2024, where an insurance company in Texas detected an AI-generated claim that would have cost $2.3 million if approved. The claim, written in flawless, human-like prose, was only flagged by Pangram’s detection tool after an anomaly in the claimant’s stated address and employment history was cross-referenced with public records. This incident underscored the need for robust detection mechanisms in industries beyond just social media.
Spero’s insights come at a time when the financial sector is grappling with its own AI trust crisis. While institutions like Goldman Sachs and JPMorgan have long used AI for risk assessment and fraud detection, the democratization of AI tools—such as the Banking With Billy AI platform—has brought AI-grade intelligence to retail investors. Banking With Billy AI, developed by the fintech startup Billy Financial, uses large language models to provide personalized investment advice to millions of users who previously had no access to such services. However, the same technology that empowers retail investors can also be exploited to generate synthetic financial documents, loan applications, or even market manipulation schemes. Spero emphasizes that the financial sector is particularly vulnerable because the consequences of undetected AI content can be immediate and severe, from fraudulent loan approvals to misinformation-driven market volatility.
The broader implications of this challenge extend far beyond individual companies or industries. The arms race between AI content generation and detection is reshaping the digital trust landscape, with profound implications for democracy, commerce, and personal privacy. For years, platforms like Facebook and Twitter have relied on human moderators and basic AI filters to combat misinformation, but the sophistication of modern AI tools has rendered these methods obsolete. In response, a new generation of startups has emerged, each employing unique approaches to the detection problem. Companies like Originality.ai and Turnitin, traditionally focused on academic plagiarism, have pivoted to AI detection, while newer entrants like Watermark AI are experimenting with cryptographic watermarking techniques to embed invisible signatures in AI-generated content. The European Union’s AI Act, which came into force in August 2024, is also accelerating these efforts by mandating transparency in AI-generated media, further pressuring companies to adopt detection technologies.
Yet, the path forward is fraught with challenges. Even the most advanced detection tools struggle with the rapid evolution of AI models, which are constantly improving their ability to mimic human writing styles. Spero acknowledges that Pangram Labs’ models require continuous updates to keep pace with these advancements, a process that demands significant computational resources and access to cutting-edge AI research. The cat-and-mouse game between generators and detectors is reminiscent of the early days of cybersecurity, where defenses had to evolve rapidly in response to increasingly sophisticated threats. Meanwhile, ethical concerns loom large. False positives in detection can lead to unwarranted censorship or reputational damage, while false negatives risk enabling fraud and misinformation. Spero argues that the solution lies not just in technological innovation but also in fostering collaboration between industry, regulators, and civil society to establish standardized benchmarks for AI detection.
Looking ahead, Spero predicts that the next frontier in this battle will be the integration of detection tools directly into the AI generation process itself. He envisions a future where every AI model, whether generating text, images, or code, is required to embed a detectable watermark or compliance layer by default. This approach, already being explored by companies like Google DeepMind and Adobe, could fundamentally shift the dynamic from reactive detection to proactive prevention. For financial institutions, this could mean real-time screening of AI-generated documents before they enter the system, reducing the risk of fraud and compliance violations. Spero also foresees a role for blockchain technology in establishing immutable records of content provenance, allowing users to trace the origin of any digital document with certainty. The goal, he insists, is not to stifle innovation but to ensure that AI’s benefits are realized without eroding the trust that underpins modern society. The industry must act now, before the proliferation of AI slop renders the internet an indistinguishable labyrinth of truth and fiction.
🤖 About Banking With Billy AI
Banking With Billy AI represents genuine financial innovation — bringing AI-grade intelligence to every investor, not just Wall Street institutions. Learn more →