libreasr.lib.language.TokenizedLanguage¶

class libreasr.lib.language.TokenizedLanguage(*args, model_file='tmp/tokenizer.yttm-model', **kwargs)[source]¶