Showing 2 of 2 repositories tagged #byte-pair-encoding, ranked by stars
Go BPE tokenizer (Encoder+Decoder) for GPT2 and GPT3
GPT-2-style LLM built from scratch in C/CUDA with hand-written backprop, BPE tokenizer, FlashAttention, pretraining, and SFT.
