Collection of useful notes

DPO

Personal notes on the Direct Policy Optimization.

1 min read · December 6, 2025

2025
Transformers

Personal notes on the Transformer architecture.

1 min read · October 1, 2024

2024
Stochastic Gradient Estimation

Personal notes on stochastic gradient estimation.

1 min read · September 15, 2023

2023
The Stochastic Policy Gradient

Personal notes on the stochastic policy gradient.

1 min read · October 1, 2022

2022