Some experiments to help me understand Neural Nets better, post 4 of N

After the previous blog posts here, here, and here, a friend of mine pointed me to some literature to read, and I will do so now :-).

The papers on my reading list are:

1. proceedings.mlr.press/v80/balestriero18b.html - Randall Balestrieros paper on DNNs as splines.

2. arxiv.org/abs/1906.00904 - ReLU networks have surprisingly few activation patterns (2019)

3. arxiv.org/abs/2305.09145 - Deep ReLU networks have surprisingly simple polytopes (2023)

4. frontiersin.org/journals/big-data/articles/10.3389/fdata.2023.1274831/full

I’ll blog more once I get around to reading them all.