marketing-shibata50/OpenMythos
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

installation

Browse source
This commit is contained in:
Kye Gomez 2026-04-18 20:48:34 -04:00
parent 7abd3e5d20
commit 14a806c2a1
2 changed files with 11 additions and 1 deletions
Download patch file Download diff file Expand all files Collapse all files

10
README.md
View file

@ -1,8 +1,16 @@
# OpenMythos
OpenMythos is an open-source, theoretical implementation of the Claude Mythos model. It implements a Recurrent-Depth Transformer (RDT) with three stages: **Prelude** (transformer blocks), a looped **Recurrent Block** (up to `max_loop_iters`), and a final **Coda**. Attention is switchable between MLA and GQA, and the feed-forward uses a sparse MoE with routed and shared experts—ideal for exploring compute-adaptive, depth-variable reasoning.
OpenMythos is an open-source, theoretical implementation of the Claude Mythos model. It implements a Recurrent-Depth Transformer (RDT) with three stages: **Prelude** (transformer blocks), a looped **Recurrent Block** (up to `max_loop_iters`), and a final **Coda**. Attention is switchable between MLA and GQA, and the feed-forward uses a sparse MoE with routed and shared experts ideal for exploring compute-adaptive, depth-variable reasoning.
## Installation
```bash
git clone https://github.com/The-Swarm-Corporation/OpenMythos.git
cd OpenMythos
pip install -r requirements.txt
```
## Usage
```python

2
requirements.txt Normal file
View file

@ -0,0 +1,2 @@
torch>=2.1.0
pytest>=7.0.0