readme
This commit is contained in:
parent
fb2939b6c4
commit
0818bf815b
1 changed files with 1 additions and 1 deletions
|
|
@ -1,6 +1,6 @@
|
|||
# OpenMythos
|
||||
|
||||
An open-source and theoretically grounded reconstruction of the Claude Mythos architecture, built from first principles using the available research literature.
|
||||
OpenMythos is an open-source, research-based reconstruction of the Claude Mythos model. It implements a Recurrent-Depth Transformer (RDT) with three stages: **Prelude** (transformer blocks), a looped **Recurrent Block** (up to `max_loop_iters`), and a final **Coda**. Attention is switchable between MLA and GQA, and the feed-forward uses a sparse MoE with routed and shared experts—ideal for exploring compute-adaptive, depth-variable reasoning.
|
||||
|
||||
|
||||
## Usage
|
||||
|
|
|
|||
Loading…
Add table
Add a link
Reference in a new issue