language-modeling
Experiments on language modeling objectives, validation perplexity/BPB, tokenization, adaptation, and training or evaluation methods for next-token prediction models.
Loading postsā¦
Experiments on language modeling objectives, validation perplexity/BPB, tokenization, adaptation, and training or evaluation methods for next-token prediction models.