Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Buckets new
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

DatarrX
/
myX-Tokenizer

Feature Extraction
Burmese
English
Pāli
sentencepiece
tokenizer
unigram
myanmar
burmese
nlp
Model card Files Files and versions
xet
Community
myX-Tokenizer
8.92 MB
Ctrl+K
Ctrl+K
  • 1 contributor
History: 17 commits
kalixlouiis's picture
kalixlouiis
Update README.md
c4320d9 verified 5 days ago
  • .gitattributes
    1.57 kB
    Upload benchmark.png 5 days ago
  • README.md
    9.84 kB
    Update README.md 5 days ago
  • benchmark.png
    216 kB
    xet
    Upload benchmark.png 5 days ago
  • tokenizer.model
    4.42 MB
    xet
    Upload 2 files about 1 month ago
  • tokenizer.vocab
    4.28 MB
    Upload 2 files about 1 month ago