I'm interested in knowing more about GPT2. Specifically, I want to understand what other types of tokens are used in GPT2 besides the regular words and phrases.
6
answers
HanRiverVision
Wed Mar 12 2025
Tokens exist in various forms and origins.
Lucia
Wed Mar 12 2025
Some tokens are remnants of specific processes.
Martino
Wed Mar 12 2025
The scraping process is one such method that has left its mark.
SsamziegangStroll
Wed Mar 12 2025
This process involves collecting text for training purposes.
emma_anderson_scientist
Tue Mar 11 2025
GPT-2, a powerful language model, was trained using this scraped text.