Hyunin Lee

Deep learning theory1

Effective Theory of Deep Learning: Beyond the Infinite-Width Limit

Summary

Introduction

Initialization

Function Approximation

Infinite-Width Limit

Sparsity Principle

Perturbation Theory in Deep Learning

Generalized Linear Models and Supervised Learning

Training Dynamics and Model Generalization


This summary captures key themes and concepts from the lecture slides. It is intended for educational purposes to provide a concise overview of the material.