• Home
  • Technology
  • Gaming
  • Entertainment
  • World & Business
  • Science
  • Sports
  • AI
HomeTechnologyGamingEntertainmentWorld & BusinessScienceSportsAI
  • HomeTechnologyGamingEntertainmentWorld & BusinessScienceSportsAI
    • Home
    • Technology
    • Gaming
    • Entertainment
    • World & Business
    • Science
    • Sports
    • AI
    AI

    Teortaxes Details 12,096 Expert Cells in AI Model

    Post shares model specs including 42 layers and 288 experts each.

    T(
    1 Source, 28d ago, first seen 28d ago

    TLDR

    @teortaxesTex posted model architecture figures showing 12,096 expert cells across 42 layers with 288 experts per layer. The post lists exact REAP importance scores drawn from 12.59M tokens per layer along with route share and output contribution metrics. It suggests slicing the data by 14 domains that include Russian and vision tasks. The message ends with the question of what can be built using these details and includes an attached image.

    Combined views

    5.3K

    1 Source, first seen 28d ago

    Combined views

    5.3K

    1 Source, first seen 28d ago

    34 likes
    34 likes
    19 saves

    Sentiment

    Positive——Negative

    Summary

    Not enough discussion yet.

    No sentiment analysis available yet.

    19 saves

    Sentiment

    Positive——Negative

    Summary

    Not enough discussion yet.

    No sentiment analysis available yet.

    Today's Rank

    —

    Not ranked yet

    Today's Rank

    —

    Not ranked yet

    1 Source

    @teortaxesTex> 12,096 expert cells, 42 layers x 288 experts, each with exact REAP importance from 12.59M tokens per layer, route share and output contribution. Slice it by 14 domains, russian and vision included What can be built with this?

    1 Source

    @teortaxesTex> 12,096 expert cells, 42 layers x 288 experts, each with exact REAP importance from 12.59M tokens per layer, route share and output contribution. Slice it by 14 domains, russian and vision included What can be built with this?