real run, real loss ↘
RomkaSLM
A GPT-style language model I wrote and trained from zero: my own tokenizer, transformer, training loop and chat app. No pretrained weights, no API calls.
- 11.2M parameters
- byte-level BPE tokenizer, from scratch
- trains & runs fully offline