when the model is saved, i think it actually saves the tokenizer alongside it,
so i would just want to make sure i am loading the tokenizer saved
with the model

Reply via email to