diff options
| author |   HsiangNianian <i@jyunko.cn> | 2025-12-30 20:24:05 +0800 |
|---|---|---|
| committer | HsiangNianian <i@jyunko.cn> | 2025-12-30 20:24:05 +0800 |
| commit | 92a647ffbb3452a0ed49601177f290e20a88413e (patch) | |
| tree | 717124f3171467e044fe22fccfc518b25df018ce /models/trpg-final/special_tokens_map.json | |
| parent | eeecb738fccf2f541f98414f51e28ecf0bd710a3 (diff) | |
| download | base-model-92a647ffbb3452a0ed49601177f290e20a88413e.tar.gz base-model-92a647ffbb3452a0ed49601177f290e20a88413e.zip | |
refactor: Refactor code structure for improved readability and maintainability
Diffstat (limited to 'models/trpg-final/special_tokens_map.json')
| -rw-r--r-- | models/trpg-final/special_tokens_map.json | 7 |
1 files changed, 7 insertions, 0 deletions
diff --git a/models/trpg-final/special_tokens_map.json b/models/trpg-final/special_tokens_map.json new file mode 100644 index 0000000..a8b3208 --- /dev/null +++ b/models/trpg-final/special_tokens_map.json @@ -0,0 +1,7 @@ +{ + "cls_token": "[CLS]", + "mask_token": "[MASK]", + "pad_token": "[PAD]", + "sep_token": "[SEP]", + "unk_token": "[UNK]" +} |