• Home
  • Technology
  • Gaming
  • Entertainment
  • World & Business
  • Science
  • Sports
  • AI
HomeTechnologyGamingEntertainmentWorld & BusinessScienceSportsAI
    • Home
    • Technology
    • Gaming
    • Entertainment
    • World & Business
    • Science
    • Sports
    • AI
    AI

    Authors of seemingly low-quality TMLR submissions reportedly did not understand their own papers

    A post says Nihar Shah spent 20–25 hours over two weeks interviewing authors about their seemingly low-quality submissions to TMLR.

    Kyunghyun ChoKC
    Lucas Beyer (bl16)LB
    Nathan LambertNL
    31 Sources, ,

    TLDR

    A post describes Nihar Shah’s interviews with authors of seemingly low-quality TMLR submissions, saying he spent 20–25 hours over two weeks on the effort. It claims those authors had “no idea” what was going on in their own papers. A comment quoting that account argues that heavily AI-generated papers are less likely to have competent authors behind them. The commenter also says they have little patience for anything Pangram identifies as mostly AI-generated.

    Combined views

    292.2K

    31 Sources, first seen 21d ago

    Combined views

    292.2K

    31 Sources, first seen 21d ago

    2.1K likes
    21d ago
    first seen 21d ago
    2.1K likes
    160 comments
    349 saves
    174 reposts
    160 comments
    349 saves
    174 reposts

    Sentiment

    Positive52.1%47.9%Negative

    Summary

    Replies welcomed shared experiences with AI-generated NeurIPS submissions and verification ideas like greCAPTCHA, while others criticized the poor quality of AI-assisted papers and expressed frustration with proposed automatic checks.

    Based on 34 sentiment-bearing replies from 23 accounts across 12 conversations.

    Today's Rank

    —

    Not ranked yet

    Today's Rank

    —

    Not ranked yet

    31 Sources

    Jessica Hullman@JessicaHullmanSad but not surprising. It’s pretty obvious that at this point in time, heavily AI-generated papers are less likely to have had a competent author at the helm. This is why I have little patience for anything Pangram says is mostly AI generated.21d
    Danish Pruthi@danish037Sad but also unsurprising for people paying attention to deluge of AI slop in research submissions. I've heard people sharing that no one would stake their reputation on work they don't understand or can't verify, but for many people their reputations don't exist (just yet). Also, worth noting that disincentives/penalties for such actions are nowhere commensurate with the inappropriateness of the act.21d
    Lucas Beyer (bl16)@giffmanaAt this point, "researchers" are basically DDoSing classic academia. It's pretty sad to see. Either someone comes up with, and executes, a CloudFlare for academia, or it's toast. And the only thing i can think of that might have a chance to scale is more automation combined with a credit/point system like we've discussed a few times here on X over the years, but it needs simultaneous buy-in and coordination from all ~10 major AI conferences and journals, so it's a heavy lift. But if nothing big happens, i think it's game over soon.21d
    Fernando Borretti@zetalyraeWho uses AI to write papers? This type of people:21d
    Atoosa Kasirzadeh@Dr_AtoosaPeer-review venues, education institutes, and universities face a flood of AI-assisted/AI-generated submissions lacking sufficient human oversight, making author names an unreliable signal of expertise. 3/1121d
    Seth Lazar@sethlazarRT @zetalyrae: Who uses AI to write papers? This type of people:21d
    Hector Yee@eigenhectorIronically the ML paper "Attention is all you need" gave rose to AI that sucks up all available attention21d
    Tal Linzen@tallinzen@anmarasovic Yes, I did this once for a neurips submission that ruined my life for a day and decided never again. There’s a 10% chance AI will kill us by 2029, gotta allocate your effort judiciously!21d
    Pasquale Minervini@PMinervini@tetraduzione yeah but it was over zoom, you can just have an LLM transcribe the Qs and generate the answers based on the paper in real-time -- in-person it's trickier21d
    antonio vergari ⚔️@tetraduzione@PMinervini that would have made sense if the answers were good. the answers were poor right? even if they used LLMs with those answers clearly implies they don't know what they are talking about21d

    31 Sources

    Jessica Hullman@JessicaHullmanSad but not surprising. It’s pretty obvious that at this point in time, heavily AI-generated papers are less likely to have had a competent author at the helm. This is why I have little patience for anything Pangram says is mostly AI generated.21d
    Danish Pruthi@danish037Sad but also unsurprising for people paying attention to deluge of AI slop in research submissions. I've heard people sharing that no one would stake their reputation on work they don't understand or can't verify, but for many people their reputations don't exist (just yet). Also, worth noting that disincentives/penalties for such actions are nowhere commensurate with the inappropriateness of the act.21d
    Lucas Beyer (bl16)@giffmanaAt this point, "researchers" are basically DDoSing classic academia. It's pretty sad to see. Either someone comes up with, and executes, a CloudFlare for academia, or it's toast. And the only thing i can think of that might have a chance to scale is more automation combined with a credit/point system like we've discussed a few times here on X over the years, but it needs simultaneous buy-in and coordination from all ~10 major AI conferences and journals, so it's a heavy lift. But if nothing big happens, i think it's game over soon.21d
    Fernando Borretti@zetalyraeWho uses AI to write papers? This type of people:21d
    Atoosa Kasirzadeh@Dr_AtoosaPeer-review venues, education institutes, and universities face a flood of AI-assisted/AI-generated submissions lacking sufficient human oversight, making author names an unreliable signal of expertise. 3/1121d
    Seth Lazar@sethlazarRT @zetalyrae: Who uses AI to write papers? This type of people:21d
    Hector Yee@eigenhectorIronically the ML paper "Attention is all you need" gave rose to AI that sucks up all available attention21d
    Tal Linzen@tallinzen@anmarasovic Yes, I did this once for a neurips submission that ruined my life for a day and decided never again. There’s a 10% chance AI will kill us by 2029, gotta allocate your effort judiciously!21d
    Pasquale Minervini@PMinervini@tetraduzione yeah but it was over zoom, you can just have an LLM transcribe the Qs and generate the answers based on the paper in real-time -- in-person it's trickier21d
    antonio vergari ⚔️@tetraduzione@PMinervini that would have made sense if the answers were good. the answers were poor right? even if they used LLMs with those answers clearly implies they don't know what they are talking about21d

    Sentiment

    Positive52.1%47.9%Negative

    Summary

    Replies welcomed shared experiences with AI-generated NeurIPS submissions and verification ideas like greCAPTCHA, while others criticized the poor quality of AI-assisted papers and expressed frustration with proposed automatic checks.

    Based on 34 sentiment-bearing replies from 23 accounts across 12 conversations.