Aleph Alpha

@aleph__alpha

Our Specialized Sovereign Large Language Model for Mission Critical Environments is here: https://aleph-alpha.com/en/kolibri/

following
followers

AI model design choices and their costs in parameters, FLOPs and KV cache

Aleph Alpha says two researchers compare open models and share some of the tooling used to design Kolibri.

2 Sources, 16d ago, first seen 16d ago

Science

Aleph Alpha releases Kolibri weights under Apache 2.0

Aleph Alpha says its Kolibri model has 78 billion parameters, 3.46 billion active parameters, support for up to 1 million tokens of context, and was built in Europe.

1 Source, 20d ago, first seen 20d ago

Aleph Alpha releases open-weight Kolibri model under Apache 2.0

Aleph Alpha says the bilingual mixture-of-experts model has 78.1 billion parameters and a context option up to 1 million tokens.

40 Sources, 18d ago, updated 18d ago

Featured in

AI model design choices and their costs in parameters, FLOPs and KV cache

Aleph Alpha releases Kolibri weights under Apache 2.0

Aleph Alpha releases open-weight Kolibri model under Apache 2.0

Featured in

AI model design choices and their costs in parameters, FLOPs and KV cache

Aleph Alpha releases Kolibri weights under Apache 2.0

Aleph Alpha releases open-weight Kolibri model under Apache 2.0