diff --git a/README.md b/README.md index 4b59772..49fbb08 100644 --- a/README.md +++ b/README.md @@ -1,2 +1,24 @@ # OpenMythos My very theoriticial interpretation of what claude mythos could be + + + +# References + +## Twitter / X + +- Why Claude Mythos is so good — looped transformer theory (Sigrid Jin): https://x.com/realsigridjin/status/2044620031410266276 +- LT implicit reasoning over parametric knowledge unlocks generalization (Yuekun Yao): https://x.com/yuekun_yao/status/2044229171627639004 +- Looped transformer cyclic trajectories and input injection (rosinality): https://x.com/rosinality/status/2043953033428541853 +- Parcae scaling laws for stable looped language models — thread (Hayden Prairie): https://x.com/hayden_prairie/status/2044453231913537927 +- RoPE-like loop index embedding idea to differentiate functions across iterations (davidad): https://x.com/davidad/status/2044453231913537927 + +## Papers + +- Loop, Think, & Generalize — Implicit Reasoning in Recurrent Depth Transformers: https://arxiv.org/pdf/2604.07822 +- Parcae — Scaling Laws for Stable Looped Language Models: https://arxiv.org/abs/2604.12946 +- Parcae blog: https://sandyresearch.github.io/parcae/ +- Universal Transformers: https://arxiv.org/pdf/1807.03819 +- Reasoning with Latent Thoughts — On the Power of Looped Transformers: https://arxiv.org/abs/2502.17416 +- Training Large Language Models to Reason in a Continuous Latent Space: https://arxiv.org/abs/2412.06769 +- Relaxed Recursive Transformers — Effective Parameter Sharing with Layer-wise LoRA: https://arxiv.org/pdf/2410.20672