• Home
  • Technology
  • Gaming
  • Entertainment
  • World & Business
  • Science
  • Sports
  • AI
HomeTechnologyGamingEntertainmentWorld & BusinessScienceSportsAI
    • Home
    • Technology
    • Gaming
    • Entertainment
    • World & Business
    • Science
    • Sports
    • AI
    AI
    Report

    An AI-translated proof may pass Lean checks despite an error in the original

    A post describes a chatbot silently fixing a flawed proof while translating it into a valid Lean proof.

    Rohan PaulRP
    Shital ShahSS
    2 Sources, 1h ago, first seen 1h ago

    TLDR

    A post says a new paper shows a chatbot silently correcting a wrong math proof to produce a valid Lean proof. According to the post, passing Lean’s check says nothing about whether the original proof was right. The post also says knowing when a statement can be translated faithfully is provably harder than the Halting problem, so no AI translator can always do it.

    Combined views

    5.5K

    2 Sources, first seen 1h ago

    Combined views

    5.5K

    2 Sources, first seen 1h ago

    74 likes
    Today's Rank

    —

    Not ranked yet

    Today's Rank

    —

    Not ranked yet

    74 likes
    17 comments
    29 saves
    19 reposts
    Featured Source
    17 comments
    29 saves
    19 reposts

    2 Sources

    Rohan Paul@rohanpaul_aiA new paper shows that when AI translates a math proof into Lean, passing the Lean check says nothing about whether the original proof is right. They show a chatbot turning a wrong proof into a valid Lean proof by silently fixing the error. Knowing when a statement can be translated faithfully is provably harder than the Halting problem, so no AI translator can always do it.1h
    Shital Shah@sytelusThe paper is not saying that Lean proof can be incorrect but rather the English version of the proof can be incorrect and hide the bugs. So, people should not blindly trust English proof if someone auto formalizes it into Lean proof because LLM might silently fix mistakes in English version.54m

    Sentiment

    Positive——Negative

    Summary

    Not enough discussion yet.

    No sentiment analysis available yet.

    Sentiment

    Positive——Negative

    Summary

    Not enough discussion yet.

    No sentiment analysis available yet.

    2 Sources

    Rohan Paul@rohanpaul_aiA new paper shows that when AI translates a math proof into Lean, passing the Lean check says nothing about whether the original proof is right. They show a chatbot turning a wrong proof into a valid Lean proof by silently fixing the error. Knowing when a statement can be translated faithfully is provably harder than the Halting problem, so no AI translator can always do it.1h
    Shital Shah@sytelusThe paper is not saying that Lean proof can be incorrect but rather the English version of the proof can be incorrect and hide the bugs. So, people should not blindly trust English proof if someone auto formalizes it into Lean proof because LLM might silently fix mistakes in English version.54m