Commit graph

2 commits

Author SHA1 Message Date
Kye Gomez
5ffb897dcf [feat][training-script][add 3b fineweb-edu training
script][feat][tokenizer][add MythosTokenizer class with encode
  decode][improvement][deps][add transformers and datasets
  dependencies][docs][readme-training][add training section with run
  commands][improvement][pyproject][pin torch and add new deps]
2026-04-19 22:48:30 -04:00
Kye Gomez
97bc414977 use gpt-oss tokenizer because it's a great tokenizer 2026-04-19 22:28:09 -04:00