👋 Hi, all!
I am Shichao Song, a third-year PhD student. My current research focuses on foundation models. I blog about my research and life.
Fully Annotated Guide to "The Multi-Armed Bandit Problem and Its Solutions"
The multi-armed bandit problem is a classic exploration–exploitation dilemma in reinforcement learning. Lilian Weng’s post is an excellent introduction, but some mathematical details and motivations can be cryptic. This article annotates it with step-by-step explanations and supplementary notes.
)](https://ki-seki.github.io/posts/260322-ouroboros/process.png)
Product Requirements Document of Ouroboros
An agentic DOM workspace where an LLM has full read/write/delete privileges over its own source code and visual interface.
)](https://ki-seki.github.io/posts/260314-ai-economics/decouple.png)
Everything is Fleeting: A Roadmap to the Post-Labor AI Economy
A speculative roadmap of how AI will dismantle the labor market and what comes after.
 生成）](https://ki-seki.github.io/posts/260211-what-i-know-so-far/human_and_ai.png)
我目前知道的
关于 AI 和人的一个简单技术人文讨论
How is the Speculative Decoding Algorithm Constructed?
A simple mathematical derivation of the algorithm construction process from the paper “Fast Inference from Transformers via Speculative Decoding”.