diff --git a/README.md b/README.md index fdf0561..20b38b8 100644 --- a/README.md +++ b/README.md @@ -1,8 +1,16 @@ # OpenMythos -OpenMythos is an open-source, theoretical implementation of the Claude Mythos model. It implements a Recurrent-Depth Transformer (RDT) with three stages: **Prelude** (transformer blocks), a looped **Recurrent Block** (up to `max_loop_iters`), and a final **Coda**. Attention is switchable between MLA and GQA, and the feed-forward uses a sparse MoE with routed and shared experts—ideal for exploring compute-adaptive, depth-variable reasoning. +OpenMythos is an open-source, theoretical implementation of the Claude Mythos model. It implements a Recurrent-Depth Transformer (RDT) with three stages: **Prelude** (transformer blocks), a looped **Recurrent Block** (up to `max_loop_iters`), and a final **Coda**. Attention is switchable between MLA and GQA, and the feed-forward uses a sparse MoE with routed and shared experts ideal for exploring compute-adaptive, depth-variable reasoning. +## Installation + +```bash +git clone https://github.com/The-Swarm-Corporation/OpenMythos.git +cd OpenMythos +pip install -r requirements.txt +``` + ## Usage ```python diff --git a/requirements.txt b/requirements.txt new file mode 100644 index 0000000..d428db7 --- /dev/null +++ b/requirements.txt @@ -0,0 +1,2 @@ +torch>=2.1.0 +pytest>=7.0.0