Research Note

Disclaimer: The notes are primarily intended for my personal learning and may not be all correct.

AI Safety

• Subliminal Learning

Deep Learning Theory

• Information Exponents and Neural Networks
  This note is made for the reading group of multi-index model[Section 5.1], including DLS22 and BES+22.

• Edge of Stability and Central Flow

Science of Deep Learning

• Observational Scaling Laws
  Slides on Ruan et al. (2024) for CIS 7000 (Machine Learning Ecosystems) at UPenn, with a mini-project on how safety relates to capability.

• Physics of LLM
  Based on Zeyuan Allen-Zhu’s Physics of LLM work.

Experience

• Tips on writing papers (Under Development)

• PhD Statement of Purpose