• Home
  • Technology
  • Gaming
  • Entertainment
  • World & Business
  • Science
  • Sports
  • AI
HomeTechnologyGamingEntertainmentWorld & BusinessScienceSportsAI
AI

Small AI-model overlays could support per-user fact updates

A user says LongCat experiments use a few-megabyte overlay to edit n-gram blocks and introduce simple facts.

Teortaxes▶️ (DeepSeek 推特🐋铁粉 2023 – ∞)T(
1 Source, 21m ago, first seen 21m ago

TLDR

A user says n-gram blocks in models like DeepSeek V4.1 Flash can be edited with a cheaply derived overlay a few megabytes in size, though the experiments are on LongCat. The user says this could enable per-user continual learning, limited to subject-relation-object facts. In a separate post, the same user describes Internalizer as a “meta-learned hypernetwork” for DeepSeek V4-Flash, with projections on every layer’s shared-expert MLP.

Combined views

512

1 Source, first seen 21m ago

2 likes1 comments2 saves

Combined views

512

1 Source, first seen 21m ago

2 likes1 comments2 saves

Sentiment

Positive——Negative

Summary

Not enough discussion yet.

No sentiment analysis available yet.

Featured Source

Sentiment

Positive——Negative

Summary

Not enough discussion yet.

No sentiment analysis available yet.

1 Source

Teortaxes▶️ (DeepSeek 推特🐋铁粉 2023 – ∞)@teortaxesTexInternalizer: Portable Context-to-Parameter Mapping for Very Large Language Models (specifically, DeepSeek V4-Flash). "meta-learned hypernetwork". Funny trick: projections (up&gate&down) are placed on the shared expert MLP of every layer in V41h
    • Home
    • Technology
    • Gaming
    • Entertainment
    • World & Business
    • Science
    • Sports
    • AI

    1 Source

    Teortaxes▶️ (DeepSeek 推特🐋铁粉 2023 – ∞)@teortaxesTexInternalizer: Portable Context-to-Parameter Mapping for Very Large Language Models (specifically, DeepSeek V4-Flash). "meta-learned hypernetwork". Funny trick: projections (up&gate&down) are placed on the shared expert MLP of every layer in V41h
    Today's Rank

    —

    Not ranked yet

    Today's Rank

    —

    Not ranked yet