What is an open-source LLM by EPFL and ETH Zurich
ETH Zurich and EPFL’s open-weight LLM offers a transparent alternative to black-box AI built on green compute and set for public release.
Large language models (LLMs), which are neural networks that predict the next word in a sentence, are powering today’s generative AI. Most remain closed, usable by the public, yet inaccessible for inspection or improvement. This lack of transparency conflicts with Web3’s principles of openness and permissionless innovation.
So everyone took notice when ETH Zurich and Swiss Federal Institute of Technology in Lausanne (EPFL) announced a fully public model, trained on Switzerland’s carbon‑neutral “Alps” supercomputer and slated for release under Apache 2.0 later this year.
It is generally referred to as “Switzerland’s open LLM,” “a language model built for the public good,” or “the Swiss large language model,” but no specific brand or project name has been shared in public statements so far.
Open‑weight LLM is a model whose parameters can be downloaded, audited and fine‑tuned locally, unlike API‑only “black‑box” systems.
Anatomy of the Swiss public LLM
- Scale: Two configurations, 8 billion and 70 billion parameters, trained on 15 trillion tokens.
- Languages: Coverage in 1,500 languages thanks to a 60 / 40 English–non‑English data set.
- Infrastructure: 10,000 Nvidia Grace‑Hopper chips on “Alps,” powered entirely by renewable energy.
- Licence: Open code and weights, enabling fork‑and‑modify rights for researchers and startups alike.
What makes Switzerland’s LLM stand out
Switzerland’s LLM blends openness, multilingual scale and green infrastructure to offer a radically transparent LLM.
- Open-by-design architecture: Unlike GPT‑4, which offers only API access, this Swiss LLM will provide all its neural-network parameters (weights), training code and data set references under an Apache 2.0 license, empowering developers to fine‑tune, audit and deploy without restrictions.
- Dual model sizes: Will be released in 8 billion and 70 billion parameter versions. The initiative spans lightweight to large-scale usage with consistent openness, something GPT‑4, estimated at 1.7 trillion parameters, does not offer publicly.
- Massive multilingual reach: Trained on 15 trillion tokens across more than 1,500 languages (~60% English, 40% non-English), it challenges GPT‑4’s English-centric dominance with truly global inclusivity.
- Green, sovereign compute: Built on Swiss National Supercomputing Centre (CSCS)’s carbon-neutral Alps cluster, 10,000 Nvidia Grace‑Hopper superchips delivering over 40 exaflops in FP8 mode, it combines scale with sustainability absent in private cloud training.
- Transparent data practices: Complying with Swiss data protection, copyright norms and EU AI Act transparency, the model respects crawler opt‑outs without sacrificing performance, underscoring a new ethical standard.
What fully open AI model unlocks for Web3
Full model transparency enables onchain inference, tokenized data flows and oracle-safe DeFi integrations with no black boxes required.
- Onchain inference: Running trimmed versions of the Swiss model inside rollup sequencers could enable real‑time smart‑contract summarization and fraud proofs.
- Tokenized data marketplaces: Because the training corpus is transparent, data contributors can be rewarded with tokens and audited for bias.
- Composability with DeFi tooling: Open weights allow deterministic outputs that oracles can verify, reducing manipulation risk when LLMs feed price models or liquidation bots.
These design goals map cleanly onto high‑intent SEO phrases, including decentralized AI, blockchain AI integration and onchain inference, boosting the article’s discoverability without keyword stuffing.
Did you know? Open-weight LLMs can run inside rollups, helping smart contracts summarize legal docs or flag suspicious transactions in real time.
AI market tailwinds you can’t ignore
- The AI market is projected to surpass $500 billion, with more than 80% controlled by closed providers.
- Blockchain‑AI is projected to grow from $550 million in 2024 to $4.33 billion by 2034 (22.9% CAGR).
- 68% of enterprises already pilot AI agents, and 59% cite model flexibility and governance as top selection criteria, a vote of confidence for open weights.
Regulation: EU AI Act meets sovereign model
Public LLMs, like Switzerland’s upcoming model, are designed to comply with the EU AI Act, offering a clear advantage in transparency and regulatory alignment.
On July 18, 2025, the European Commission issued guidance for systemic‑risk…
cointelegraph.com
