Materials
Cheat sheets and references I put together along the way: formulas, derivatives, worked numeric examples and code. They are kept here in full and keep growing.
ML / AICross-entropy in Excel: BCE and CE step by stepA walk through an Excel workbook on binary and categorical cross-entropy: every sheet, every column, every number step by step. What breaks if you forget sigmoid or softmax. Download the workbook and recompute it yourself.
4 sheets · 3 tasks
ML / AIMAE and MSE by example20 simple MAE and MSE problems with every step explained, from the example on the board to outliers and model choice. Every example includes the derivatives of MAE and MSE for backpropagation. Plus a calculator that writes out the solution for your own numbers.
20 examples
ML / AINeural network formulas: a cheat sheetActivations, loss functions and optimizers: 18 formulas with meaning, derivatives, numeric examples and code. Each has a detailed breakdown with interactive 2D and 3D visualizations.
18 formulas