• Home
  • Technology
  • Gaming
  • Entertainment
  • World & Business
  • Science
  • Sports
  • AI
HomeTechnologyGamingEntertainmentWorld & BusinessScienceSportsAI
  • HomeTechnologyGamingEntertainmentWorld & BusinessScienceSportsAI
    • Home
    • Technology
    • Gaming
    • Entertainment
    • World & Business
    • Science
    • Sports
    • AI
    AI

    Scaling web-video pre-training helped one industrial task, a team reports

    The team says it scaled model size and pre-training compute, then tested on one complex manipulation task in real deployment.

    AG
    VS
    CP
    8 Sources, ,

    TLDR

    A team reports that better prediction of general web video went with a better post-trained policy—the model’s strategy for choosing actions. It says the finding came from scaling model size and pre-training compute, with testing focused on one industrial manipulation task in real deployment.

    Combined views

    45.2K

    8 Sources, first seen 21d ago

    Combined views

    45.2K

    8 Sources, first seen 21d ago

    260 likes
    Today's Rank

    —

    Not ranked yet

    Today's Rank

    —

    Not ranked yet

    21d ago
    first seen 21d ago
    260 likes
    15 comments
    152 saves
    72 reposts
    15 comments
    152 saves
    72 reposts

    Sentiment

    Positive100%0%Negative

    Summary

    Many accounts welcomed RhodaAI's rigorous study on scaling web-video pre-training for robotics because it delivered principled evidence that the approach improves real-world manipulation tasks.

    Based on 23 sentiment-bearing replies from 22 accounts across 2 conversations.

    8 Sources

    @tongzhou_muDoes scaling pre-training on general web video improve a complex manipulation task in real deployment? We scale model size and pre-training compute, and test on one industrial task. Yes. The better a pre-trained model predicts web video, the better its post-trained policy. 🧵
    @animesh_gargRT @tongzhou_mu: Does scaling pre-training on general web video improve a complex manipulation task in real deployment? We scale model siz…
    @RhodaAIAt Rhoda, we care deeply about the science of pre-training for robotics. In one of the most rigorous studies of its kind, over thousands of trials and hundreds of hours of robot evaluations, we show how scaling web-video pre-training leads to better real-world robot performance.
    @ericryanchanWe recently came out with our blog post, Does Scaling Web-Video Pre-training Help Real Robots Do Real Work? This is a pretty exciting moment for robotics, because as far as I am aware, it is the first evidence that robot foundation models can scale on internet video data; not merely on teleoperation, UMI data, or egocentric data, but on the data you can truly find anywhere. It’s the necessary requirement for reaching massively powerful models.
    @stepjamUKRhoda AI checked whether scaling web video pretraining actually helps real robots, using a real customer task. Unpacking 10kg boxes of bearings and sorting the packaging. Turns out yes. Bigger models do better, more pretraining compute does better, and the compute gap is widest when you don't have many robot demos. Refreshing to see a company display this amount of rigour. Rare these days.
    @vincesitzmannRT @ericryanchan: We recently came out with our blog post, Does Scaling Web-Video Pre-training Help Real Robots Do Real Work? This is a pr…
    @chris_j_paxtonRT @stepjamUK: Rhoda AI checked whether scaling web video pretraining actually helps real robots, using a real customer task. Unpacking 10k…

    8 Sources

    @tongzhou_muDoes scaling pre-training on general web video improve a complex manipulation task in real deployment? We scale model size and pre-training compute, and test on one industrial task. Yes. The better a pre-trained model predicts web video, the better its post-trained policy. 🧵
    @animesh_gargRT @tongzhou_mu: Does scaling pre-training on general web video improve a complex manipulation task in real deployment? We scale model siz…
    @RhodaAIAt Rhoda, we care deeply about the science of pre-training for robotics. In one of the most rigorous studies of its kind, over thousands of trials and hundreds of hours of robot evaluations, we show how scaling web-video pre-training leads to better real-world robot performance.
    @ericryanchanWe recently came out with our blog post, Does Scaling Web-Video Pre-training Help Real Robots Do Real Work? This is a pretty exciting moment for robotics, because as far as I am aware, it is the first evidence that robot foundation models can scale on internet video data; not merely on teleoperation, UMI data, or egocentric data, but on the data you can truly find anywhere. It’s the necessary requirement for reaching massively powerful models.
    @stepjamUKRhoda AI checked whether scaling web video pretraining actually helps real robots, using a real customer task. Unpacking 10kg boxes of bearings and sorting the packaging. Turns out yes. Bigger models do better, more pretraining compute does better, and the compute gap is widest when you don't have many robot demos. Refreshing to see a company display this amount of rigour. Rare these days.
    @vincesitzmannRT @ericryanchan: We recently came out with our blog post, Does Scaling Web-Video Pre-training Help Real Robots Do Real Work? This is a pr…
    @chris_j_paxtonRT @stepjamUK: Rhoda AI checked whether scaling web video pretraining actually helps real robots, using a real customer task. Unpacking 10k…

    Sentiment

    Positive100%0%Negative

    Summary

    Many accounts welcomed RhodaAI's rigorous study on scaling web-video pre-training for robotics because it delivered principled evidence that the approach improves real-world manipulation tasks.

    Based on 23 sentiment-bearing replies from 22 accounts across 2 conversations.