• Home
  • Technology
  • Gaming
  • Entertainment
  • World & Business
  • Science
  • Sports
  • AI
HomeTechnologyGamingEntertainmentWorld & BusinessScienceSportsAI
    • HomeTechnologyGamingEntertainmentWorld & BusinessScienceSportsAI
    • Home
    • Technology
    • Gaming
    • Entertainment
    • World & Business
    • Science
    • Sports
    • AI
    AI
    Announcement

    Gary Marcus urges generative AI pause during NYC safeguards hearing

    Marcus reports concerns about AI-written code review, while disputing the broader claim that no AI system can be controlled.

    GM
    T(
    AC
    8 Sources, ,

    TLDR

    Gary Marcus called for pausing generative AI while commenting on the Oct. 5 New York City Council hearing. He reported Jacob Coxon and Kokotajlo warning about inadequate checks on AI-written code, with one account qualified as a paraphrase from memory. Marcus disputed the broader claim that all AI is uncontrollable. The Council's notice describes proposed safeguards, not an enacted pause.

    Combined views

    28.3K

    8 Sources, first seen 1h ago

    Combined views

    28.3K

    8 Sources, first seen 1h ago

    315 likes

    Useful links

    garymarcus.substack.com

    Coming soon: New York City’s hearing on AI risks

    Bloomberg Television · YouTube

    Gary Marcus, Robust AI Inc. CEO&Founder
    1h ago
    first seen 1h ago
    315 likes
    49 comments
    38 saves
    36 reposts
    49 comments
    38 saves
    36 reposts

    Gary Marcus called for a pause on generative AI in Oct. 5 posts about the New York City Council's AI hearing. His commentary combined agreement with warnings about insufficient scrutiny of AI-written code with a disagreement over whether every kind of AI has a control problem.

    Featured Source

    Marcus reported Jacob Coxon criticizing the review of AI-generated code, while noting that his account might be slightly paraphrased from memory. Marcus agreed with the concern. In a subsequent post, he said Kokotajlo echoed Coxon's warning that AI-written code was not being vetted carefully enough.

    These posts establish Marcus's account of the discussion. They do not provide a verified transcript or measurements of how much code AI writes or how thoroughly developers check it.

    Sentiment

    Positive——Negative

    Summary

    Not enough discussion yet.

    No sentiment analysis available yet.

    Useful Links

    garymarcus.substack.com

    Coming soon: New York City’s hearing on AI risks

    Related Videos

    • Gary Marcus, Robust AI Inc. CEO&FounderBloomberg Television · YouTube
    Today's Rank

    #4

    Today's Rank

    #4

    Marcus draws a distinction between AI systems

    Marcus also reported Coxon arguing that no AI system could yet be controlled. He disputed that broad claim, pointing to AlphaGo and GPS routing as counterexamples in his post.

    His own position was narrower: he argued that control of generative AI remained unresolved and advocated pausing that technology until it could be controlled. That is Marcus's assessment and policy preference, rather than a finding established by the hearing.

    The Council's Sept. 28 announcement scheduled the Oct. 5 Committee of the Whole hearing to examine AI risks and potential safeguards. It named proposals for whistleblower incentives, a private right of action for people harmed by AI agents and independent third-party validation. The notice describes proposed measures; it does not announce their enactment or a generative AI pause.

    Gary Marcus

    Sentiment

    Positive——Negative

    Summary

    Not enough discussion yet.

    No sentiment analysis available yet.

    9 Sources

    PressNew York City Council Announces Anthropic, OpenAI, Google, and Meta to Publicly Testify Under Oath for First Time Since Recent Incident Reports7d
    @GaryMarcusJacob Coxon @hilbertspaess and @DKokotajlo next at the NYC City Council meeting, hosted by @SpeakerMenin. Coxon cpens with “We do not know how to control any AI system yet”, which, importantly, isn’t actually true: lots of AI systems (AlphaGo, GPS Routing, etc) have no control issues. What is true is that we don’t know how to control generative AI. So let’s pause that specific technology until we do.1h
    @AndrewCurran_Intelligencer has published an interview with Miles Brundage, Rosie Campbell, Jacob Coxon, Jacob Hilton, Pamela Mishkin, Daniel Kokotajlo, Alex Turner, and Jeff Wu. The New York City Council hearing on AI safeguards has just started, and is being streamed live.1h
    @teortaxesTexThree of my mutuals are on stage! Pretty reasonable crowd Strong move by EAs1h
    @rohanpaul_aiEx-Anthropic researcher Jacob Coxon told New York City lawmakers that humans will probably lose control of AI and is set to testify at NYC AI hearing on ‘kill switches,’ New York City is also prepareing a bill that would require every AI model sold locally to pass outside validation first and would fine AI vendors $25K per unvalidated sale or deployment. All 51 council members are weighing this lead bill that would outlaw marketing, selling or deploying any AI model in the city without outside validation. It also requires a shutdown capability, meaning a human operator can technically make the model stop working, temporarily or permanently. Validators would grade accuracy, calibration, determinism, latency, data provenance, bias, privacy and safety, then certify readiness to the city's Cyber Command.33m

    Useful Links

    garymarcus.substack.com

    Coming soon: New York City’s hearing on AI risks

    Related Videos

    Gary Marcus, Robust AI Inc. CEO&FounderBloomberg Television · YouTube

    9 Sources

    PressNew York City Council Announces Anthropic, OpenAI, Google, and Meta to Publicly Testify Under Oath for First Time Since Recent Incident Reports7d
    @GaryMarcusJacob Coxon @hilbertspaess and @DKokotajlo next at the NYC City Council meeting, hosted by @SpeakerMenin. Coxon cpens with “We do not know how to control any AI system yet”, which, importantly, isn’t actually true: lots of AI systems (AlphaGo, GPS Routing, etc) have no control issues. What is true is that we don’t know how to control generative AI. So let’s pause that specific technology until we do.1h
    @AndrewCurran_Intelligencer has published an interview with Miles Brundage, Rosie Campbell, Jacob Coxon, Jacob Hilton, Pamela Mishkin, Daniel Kokotajlo, Alex Turner, and Jeff Wu. The New York City Council hearing on AI safeguards has just started, and is being streamed live.1h
    @teortaxesTexThree of my mutuals are on stage! Pretty reasonable crowd Strong move by EAs1h
    @rohanpaul_aiEx-Anthropic researcher Jacob Coxon told New York City lawmakers that humans will probably lose control of AI and is set to testify at NYC AI hearing on ‘kill switches,’ New York City is also prepareing a bill that would require every AI model sold locally to pass outside validation first and would fine AI vendors $25K per unvalidated sale or deployment. All 51 council members are weighing this lead bill that would outlaw marketing, selling or deploying any AI model in the city without outside validation. It also requires a shutdown capability, meaning a human operator can technically make the model stop working, temporarily or permanently. Validators would grade accuracy, calibration, determinism, latency, data provenance, bias, privacy and safety, then certify readiness to the city's Cyber Command.33m