The lab notebook

Long-form notes on the RL environments ecosystem — what changed, what to use, and how we check.

October 2026

The State of RL Environments in 2026

Stewardship consolidated under the Farama Foundation, GPU-native suites took over robotics, and half the famous names quietly died. A field guide to what's alive, what's archived, and what it means for your next project.

October 2026

Which RL Environment Should You Start With?

An honest ladder from CartPole to MuJoCo: the order to learn environments in, what each one teaches you, and what to avoid until you're ready.

October 2026

10 Benchmarks That Defined Reinforcement Learning

From balancing a pole to Grandmaster StarCraft: the scores and milestones every new RL method gets measured against — and what each one actually proved.

October 2026

How We Verified 51 RL Environments (and What We Learned)

Our methodology: live GitHub API checks, commit-history cutoffs, arXiv ID verification — including the 7 paper links we caught pointing at the wrong papers entirely.