• Home
  • Technology
  • Gaming
  • Entertainment
  • World & Business
  • Science
  • Sports
  • AI
HomeTechnologyGamingEntertainmentWorld & BusinessScienceSportsAI
    • Home
    • Technology
    • Gaming
    • Entertainment
    • World & Business
    • Science
    • Sports
    • AI
    AI

    Skild AI Shows S1 Model Learning 10-Minute Tasks From One Video

    The foundation model performs unseen long-horizon tasks through in-context learning.

    Deepak PathakDP
    Robert ScobleRS
    Shaun MaguireSM
    36 Sources, ,

    TLDR

    Skild AI posted that its S1 model learns tasks over 10 minutes long from one video prompt. The tasks were never seen during pre-training and require no fine-tuning. Founder Deepak Pathak described the approach as building intelligence from the foundations up. Sequoia Capital investors called the work impressive and a potential game changer. Company researcher Roozbeh Mottaghi noted the absence of test-task leakage and the focus on extended sequences. Other observers labeled the release the GPT moment for robotics.

    Combined views

    633.2K

    36 Sources, first seen 44d ago

    Combined views

    633.2K

    36 Sources, first seen 44d ago

    3.7K likes
    Today's Rank

    —

    Not ranked yet

    Today's Rank

    —

    Not ranked yet

    44d ago
    first seen 44d ago
    3.7K likes
    117 comments
    1.1K saves
    411 reposts
    117 comments
    1.1K saves
    411 reposts

    36 Sources

    Deepak Pathak@deepakpathakIn-context learning for robotics is here. - Long-horizon tasks over 10 minutes long - Never seen during pre-training - Prompted with one video, no fine-tuning We are building intelligence from the foundations up, not from the top down.44d
    Pat Grady@gradypbincredible moment for robotics44d
    Julien Bek@JulienBekChatGPT moment for robotics44d
    Alfred Lin@Alfred_LinWhile robot olympics may get more media headlines, these types of advancements are really what change the game for robotics. Very impressive work on turning single prompts into long-horizon tasks that robots can then execute independently.44d
    Sequoia Capital@sequoiaRT @SkildAI: Introducing S1, our new foundation model that learns from one example. It can be taught 10-minute long tasks that it has neve…44d
    Brian Zhan@brianzhan1This is the first genuine ChatGPT moment in robotics. I head they are already in production?!44d
    Robert Scoble@ScobleizerThey wanted to pay me to write this post, and I turned them down. Why? Because I wanted to be able to say, without any prejudice: this is a step forward for robotics. Hopefully, I can get them to sponsor something else in the future.44d
    Chris Paxton@chris_j_paxtonThis is the mark of a general purpose robot foundation model -- that it can be taught tasks from examples without training. We saw an early version of this from rhoda and a solid one last week from generalist, and now a really impressive, ten minute long one from skild. This to me does feel like the true gpt moment for robotics -- because if it truly generalizes, that means that you can really start deploying robots for anything, as developing robot skills becomes like prompting44d
    Stefanie Gschwind@gschw1ndSo amazing to see such impressive signs of robotic in-context learning. For the first time it really feels like a truly intelligent policy! Getting to see the wide span of diverse tasks S1 is able to complete is truly gobsmacking. I hope everyone, even if you’re not in the field, gets a chance to read through the blogpost to get a sense of truly how difficult of a feat this is!!44d
    Jess Lee@jesskahWho knew the ChatGPT moment of robotics would involve pancakes. @SkildAI @gupta_abhinav_ @deepakpathak we should host a US robot olympics where the robots cook brunch and do household tasks.44d
    Featured Source

    Sentiment

    Positive84.1%15.9%Negative

    Based on 69 sentiment-bearing replies from 63 accounts across 7 conversations.

    Sentiment

    Positive84.1%15.9%Negative

    Based on 69 sentiment-bearing replies from 63 accounts across 7 conversations.

    36 Sources

    Deepak Pathak@deepakpathakIn-context learning for robotics is here. - Long-horizon tasks over 10 minutes long - Never seen during pre-training - Prompted with one video, no fine-tuning We are building intelligence from the foundations up, not from the top down.44d
    Pat Grady@gradypbincredible moment for robotics44d
    Julien Bek@JulienBekChatGPT moment for robotics44d
    Alfred Lin@Alfred_LinWhile robot olympics may get more media headlines, these types of advancements are really what change the game for robotics. Very impressive work on turning single prompts into long-horizon tasks that robots can then execute independently.44d
    Sequoia Capital@sequoiaRT @SkildAI: Introducing S1, our new foundation model that learns from one example. It can be taught 10-minute long tasks that it has neve…44d
    Brian Zhan@brianzhan1This is the first genuine ChatGPT moment in robotics. I head they are already in production?!44d
    Robert Scoble@ScobleizerThey wanted to pay me to write this post, and I turned them down. Why? Because I wanted to be able to say, without any prejudice: this is a step forward for robotics. Hopefully, I can get them to sponsor something else in the future.44d
    Chris Paxton@chris_j_paxtonThis is the mark of a general purpose robot foundation model -- that it can be taught tasks from examples without training. We saw an early version of this from rhoda and a solid one last week from generalist, and now a really impressive, ten minute long one from skild. This to me does feel like the true gpt moment for robotics -- because if it truly generalizes, that means that you can really start deploying robots for anything, as developing robot skills becomes like prompting44d
    Stefanie Gschwind@gschw1ndSo amazing to see such impressive signs of robotic in-context learning. For the first time it really feels like a truly intelligent policy! Getting to see the wide span of diverse tasks S1 is able to complete is truly gobsmacking. I hope everyone, even if you’re not in the field, gets a chance to read through the blogpost to get a sense of truly how difficult of a feat this is!!44d
    Jess Lee@jesskahWho knew the ChatGPT moment of robotics would involve pancakes. @SkildAI @gupta_abhinav_ @deepakpathak we should host a US robot olympics where the robots cook brunch and do household tasks.44d