diff options
| author |   HsiangNianian <i@jyunko.cn> | 2025-12-30 21:37:20 +0800 |
|---|---|---|
| committer | HsiangNianian <i@jyunko.cn> | 2025-12-30 21:37:20 +0800 |
| commit | 200ae0b8131367a55572cbfca00fbcf19257b84d (patch) | |
| tree | 66410a8b100f1a4ff972384eae48577062380e15 /models/trpg-final/special_tokens_map.json | |
| parent | d35712d0f200b7862450b173a1bee95d1bd85dc8 (diff) | |
| download | base-model-200ae0b8131367a55572cbfca00fbcf19257b84d.tar.gz base-model-200ae0b8131367a55572cbfca00fbcf19257b84d.zip | |
refactor: Refactor code structure for improved readability and maintainability
Diffstat (limited to 'models/trpg-final/special_tokens_map.json')
| -rw-r--r-- | models/trpg-final/special_tokens_map.json | 7 |
1 files changed, 7 insertions, 0 deletions
diff --git a/models/trpg-final/special_tokens_map.json b/models/trpg-final/special_tokens_map.json new file mode 100644 index 0000000..a8b3208 --- /dev/null +++ b/models/trpg-final/special_tokens_map.json @@ -0,0 +1,7 @@ +{ + "cls_token": "[CLS]", + "mask_token": "[MASK]", + "pad_token": "[PAD]", + "sep_token": "[SEP]", + "unk_token": "[UNK]" +} |