Innopolis University DevOps Playground
Skip to content

Fix warning about tokenizers

At setup,

You set `add_prefix_space`. The tokenizer needs to be converted from the slow tokenizers