How to convert tokenizer in .model format
#4
by
arpit2601 - opened
Hi @loubnabnl ,
I am trying to run this model in executorch which accepts the tokenizer in .model format but in Files only tokenizer.json is provided. How would I go about converting the tokenizer from .json format into .model format.