Documenting my journey as an AI engineer through experiments, readings, interactive explanations, and systems built from scratch.
+ 5 more chapters
A local-first memory engine that stores source-aware evidence, retrieves relevant context, and helps agents answer with traceable citations.
AresSim is a 32×32 Mars survival grid I built from scratch to test RL algorithms and LLM agents: a rover explores terrain, extracts ice, and keeps a 5×5 colony pad alive under weather, battery drain, in seed-reproducible worlds.
A deep dive into Temporal Difference (TD) Learning for Reinforcement Learning, an idea that forms basis for modern deep reinforcement learning algorithms
A deep dive into Monte Carlo methods for Reinforcement Learning, focusing on learning optimal strategies from raw experience without a model.
DotLM is a 165M parameter reasoning-capable SLM trained for all four stages of language modeling: Pretraining, Instruction Tuning, Alignment, and Reasoning using synthetically generated STE dataset.
Introduction to Dynamic Programming: Policy Evaluation, Policy Iteration, Value Iteration and Generalized Policy Iteration
