scratch-llm
From-scratch Llama 2-inspired Transformer in PyTorch for exploring tokenization, pre-training, and inference.
What is scratch-llm?
From-scratch Llama 2-inspired Transformer in PyTorch for exploring tokenization, pre-training, and inference.