Janus-Pro-1B/tokenizer_config.json at master - Janus-Pro-1B - Git: MartinFarm

AI/Janus-Pro-1B

mirror of https://www.modelscope.cn/deepseek-ai/Janus-Pro-1B.git synced 2025-04-18 15:49:31 +08:00

ai-modelscope 2fd836a168 Update README.md

2025-01-28 08:16:58 +08:00

11 lines

285 B

JSON

Raw Permalink Blame History

This file contains Unicode characters that might be confused with other characters. If you think that this is intentional, you can safely ignore this warning. Use the Escape button to reveal them.

 {
   "bos_token": "<｜begin▁of▁sentence｜>",
   "clean_up_tokenization_spaces": false,
   "eos_token": "<｜end▁of▁sentence｜>",
   "model_max_length": 16384,
   "pad_token": null,
   "tokenizer_class": "LlamaTokenizer",
   "unk_token": null,
   "use_default_system_prompt": true
 }