• Home
  • Technology
  • Gaming
  • Entertainment
  • World & Business
  • Science
  • Sports
  • AI
HomeTechnologyGamingEntertainmentWorld & BusinessScienceSportsAI
    • Home
    • Technology
    • Gaming
    • Entertainment
    • World & Business
    • Science
    • Sports
    • AI
    AI
    Announcement

    Karotte open-sourced as a framework for building reinforcement-learning environments

    Karotte’s developers say they’ve used it for the past year to build MLE RL environments for frontier labs.

    Michael ChangMC
    Marco MascorroMM
    Alex GajewskiAG
    5 Sources, ,

    TLDR

    Karotte’s developers announced they are open-sourcing the framework for building reinforcement-learning environments. They say they’ve used it for the past year to build MLE RL environments for frontier labs and hardened it through 1 million-plus evaluation runs and red-teaming.

    Combined views

    33.5K

    5 Sources, first seen 2h ago

    Combined views

    33.5K

    5 Sources, first seen 2h ago

    420 likes
    2h ago
    first seen 2h ago
    420 likes
    42 comments
    324 saves
    62 reposts
    Featured Source
    42 comments
    324 saves
    62 reposts

    Sentiment

    Positive——Negative

    Summary

    Not enough discussion yet.

    No sentiment analysis available yet.

    Sentiment

    Positive——Negative

    Summary

    Not enough discussion yet.

    No sentiment analysis available yet.

    Today's Rank

    #12

    Today's Rank

    #12

    5 Sources

    Jennifer Zhou@chem_safetyToday we are open-sourcing 🥕Karotte, our framework for building RL environments. We've used it for the past year to build MLE RL environments for frontier labs, and it's been hardened through 1M+ evaluation runs and red-teaming.2h
    Ning@Ning_CatsnailSo proud of our team. Every production environment we've shipped was built on Karotte, including the environments behind $15M in revenue over the last month. We've hardened it through more than a million evaluation runs and extensive red-teaming. Excited for everyone to finally get to use it 🥕2h
    Marco Mascorro@MascobotCongrats @chem_safety & @Ning_Catsnail on the launch of 🥕Karotte! Building robust and secure RL environments is more important than ever these days because the current bottleneck on AI progress is misalignment, and developing aligned models requires robust, correct reward functions. They have been using it to build MLE tasks, and it's been hardened through 1M+ evaluation runs and red-teaming:1h
    Michael Chang@mmmbchangRT @Ning_Catsnail: So proud of our team. Every production environment we've shipped was built on Karotte, including the environments behind…1h
    Alex Gajewski@apagajewskiIf we end up in a world where many more companies are training very strong models, it will be important to have open source / public training tools that result in aligned models1h

    5 Sources

    Jennifer Zhou@chem_safetyToday we are open-sourcing 🥕Karotte, our framework for building RL environments. We've used it for the past year to build MLE RL environments for frontier labs, and it's been hardened through 1M+ evaluation runs and red-teaming.2h
    Ning@Ning_CatsnailSo proud of our team. Every production environment we've shipped was built on Karotte, including the environments behind $15M in revenue over the last month. We've hardened it through more than a million evaluation runs and extensive red-teaming. Excited for everyone to finally get to use it 🥕2h
    Marco Mascorro@MascobotCongrats @chem_safety & @Ning_Catsnail on the launch of 🥕Karotte! Building robust and secure RL environments is more important than ever these days because the current bottleneck on AI progress is misalignment, and developing aligned models requires robust, correct reward functions. They have been using it to build MLE tasks, and it's been hardened through 1M+ evaluation runs and red-teaming:1h
    Michael Chang@mmmbchangRT @Ning_Catsnail: So proud of our team. Every production environment we've shipped was built on Karotte, including the environments behind…1h
    Alex Gajewski@apagajewskiIf we end up in a world where many more companies are training very strong models, it will be important to have open source / public training tools that result in aligned models1h