• Home
  • Technology
  • Gaming
  • Entertainment
  • World & Business
  • Science
  • Sports
  • AI
HomeTechnologyGamingEntertainmentWorld & BusinessScienceSportsAI
  • HomeTechnologyGamingEntertainmentWorld & BusinessScienceSportsAI
    • Home
    • Technology
    • Gaming
    • Entertainment
    • World & Business
    • Science
    • Sports
    • AI
    AI

    FlyOCR creator describes a PDF reader modeled on a fruit fly brain

    The project’s creator reports 87% accuracy on 1,700-plus sampled characters and digits, using a circuit with 166,000 neurons and 25 million connections.

    JL
    1 Source, 17d ago, first seen 17d ago

    TLDR

    FlyOCR’s creator says the project uses the full MaleCNS v1.0 fruit fly connectome—a map of neural connections—to read PDF images. It separates individual characters, maps their pixels to receptor activations, runs simplified neural dynamics through the circuit and decodes the resulting signals into text. The creator reports 87% accuracy on 1,700-plus sampled characters and digits. In a test on a Microsoft 10-K filing, they report about 86% on the balance-sheet heading and say the system was largely able to read the numeric values correctly.

    Combined views

    30.7K

    1 Source, first seen 17d ago

    Combined views

    30.7K

    1 Source, first seen 17d ago

    576 likes
    576 likes
    25 comments
    323 saves
    65 reposts

    Sentiment

    Positive——Negative

    Summary

    Not enough discussion yet.

    No sentiment analysis available yet.

    25 comments
    323 saves
    65 reposts

    Sentiment

    Positive——Negative

    Summary

    Not enough discussion yet.

    No sentiment analysis available yet.

    Today's Rank

    —

    Not ranked yet

    Today's Rank

    —

    Not ranked yet

    1 Source

    @jerryjliu0Introducing FlyOCR 🪰 - I trained a fly brain to read a PDF It uses the full MaleCNS v1.0 fruit fly connectcome. The architecture is inspired by doomfly by @nftechie_ The fly splits a pdf image into individual glyphs, maps pixels into receptor activations, runs simplified current-based dynamics across the 166k neurons and 25m edges in the circuit, applies a compact readout model on the downstream spikes, and concatenates everything into the parsed output. On reading an actual Microsoft 10-k, the fly gets ~86% over the balance sheet heading, but is largely able to read the numeric values correctly. Over 1.7k+ sampled glyphs (chars+digits) it gets 87% accuracy. With enough training it might match some of the latter-generation MNIST models! Maybe eventually we’ll replace our doc parsing VLMs with flies. Full video below. Repo with full code + report: https://github.com/jerryjliu/fly_ocr

    1 Source

    @jerryjliu0Introducing FlyOCR 🪰 - I trained a fly brain to read a PDF It uses the full MaleCNS v1.0 fruit fly connectcome. The architecture is inspired by doomfly by @nftechie_ The fly splits a pdf image into individual glyphs, maps pixels into receptor activations, runs simplified current-based dynamics across the 166k neurons and 25m edges in the circuit, applies a compact readout model on the downstream spikes, and concatenates everything into the parsed output. On reading an actual Microsoft 10-k, the fly gets ~86% over the balance sheet heading, but is largely able to read the numeric values correctly. Over 1.7k+ sampled glyphs (chars+digits) it gets 87% accuracy. With enough training it might match some of the latter-generation MNIST models! Maybe eventually we’ll replace our doc parsing VLMs with flies. Full video below. Repo with full code + report: https://github.com/jerryjliu/fly_ocr