Reinforcement Learning illustration (by [Google Gemini](https://gemini.google.com/))

Fully Annotated Guide to "A (Long) Peek into Reinforcement Learning"

This is a fully annotated guide to Lilian Weng’s post A (Long) Peek into Reinforcement Learning.

 · Updated:  · 44 min · 9371 words · Shichao Song
Multi-armed bandit (by [ChatGPT Images 2.0](https://openai.com/index/introducing-chatgpt-images-2-0/))

Fully Annotated Guide to "The Multi-Armed Bandit Problem and Its Solutions"

The multi-armed bandit problem is a classic exploration–exploitation dilemma in reinforcement learning. Lilian Weng’s post is an excellent introduction, but some mathematical details and motivations can be cryptic. This article annotates it with step-by-step explanations and supplementary notes.

 · Updated:  · 16 min · 3235 words · Shichao Song