7h ago

MINT Lab lead Seth Lazar says Pangram's '100% AI-generated' rating only means all text falls inside partially flagged chunks

The system segments documents into 350-to-400-word chunks

——0——
Original post
OPSeth Lazar#1060Seth Lazar@SETHLAZAR

I have been testing it *very* extensively, and I think that, as of right now, the confidence is warranted. However I do think that people should have a clearer sense of what it's saying when it says something is 100% AI generated. It breaks the item down into chunks, generally 350-400 words, and makes a prediction about whether that chunk contains some AI. So "This paper is 100% AI generated" really means "100% of the tokens in this paper are in a chunk that we believe has AI in it".

2:10 AM · May 26, 2026 View on X
QUOTE POSTEthan#1884Ethan@TORCHCOMPILED

On countless occasions I have put factually human created text for it rate it as 100% AI with high confidence

Best you can do is cross reference with several checkers but even then need to take with a grain of salt.

Miles BrundageMiles Brundage@Miles_Brundage

Many of you are vastly overconfident in Pangram

6:09 AM · May 26, 2026 · 22.6K Views
9:40 AM · May 26, 2026 · 907 Views
REPLYEthan#1884Ethan@TORCHCOMPILED

An AI/non-AI stamp is probably less indicative of “what source actually produced this text” and more “does this give human or AI vibes”

EthanEthan@torchcompiled

On countless occasions I have put factually human created text for it rate it as 100% AI with high confidence Best you can do is cross reference with several checkers but even then need to take with a grain of salt.

9:40 AM · May 26, 2026 · 907 Views
9:40 AM · May 26, 2026 · 228 Views