#machine-learning
4 posts
2026 - October
1 postI Trained My Own AI Model (Spoiler: It's Just for Study)
One exercise was missing: training an LLM from scratch. I started from Karpathy's microgpt, 200 lines of pure Python, and expanded it into a lab with a tokenizer, pretraining, SFT, an OpenAI-compatible server and OpenCode integration. Under two weeks, one RTX 5090, 10 billion tokens, 137 hours of training, at most around R$ 80 of electricity. The final model has 337 million parameters, gets 58 out of 100 simple Python functions right and scores zero on anything that requires acting in a repository. I explain each step, the stumbles, the dimensions against GPT-2 and frontier models, and why I think the future is smaller, specialized models.
2025 - May
2 postsFinal Attempt to Train an LLM with LoRA. Cannon Shot, But Missing the Fly.
Renting an 80GB H100 on RunPod to fine-tune Qwen3-32B with a LoRA on Zig 0.14, and discovering that even cannon-class hardware can still miss the target.
Teaching the Latest Zig to Your LLM - Training LoRAs (Sort Of)
A hands-on walkthrough of training a LoRA adapter on Qwen3-8B to teach it about Zig 0.14, covering datasets, fine-tuning, vLLM serving, and the limits of the experiment.
2025 - April
1 postUnderstanding the Basics of ComfyUI to Generate AI Images
A hands-on, no-nonsense walkthrough of ComfyUI's core concepts (checkpoints, LoRAs, ControlNet, VAEs, samplers) and a real workflow for turning a photo into anime-style art.