5ffb897dcf
script][feat][tokenizer][add MythosTokenizer class with encode decode][improvement][deps][add transformers and datasets dependencies][docs][readme-training][add training section with run commands][improvement][pyproject][pin torch and add new deps]
4 lines
65 B
Text
4 lines
65 B
Text
torch>=2.1.0
|
|
transformers>=4.40.0
|
|
datasets>=2.18.0
|
|
pytest>=7.0.0
|