Does this result explicitly not hold for other activation functions, or have the... | Hacker News

Hacker News new | past | comments | ask | show | jobs | submit

login

spencerchubb on June 23, 2023 | parent | context | favorite | on: Any Deep ReLU Network Is Shallow

Does this result explicitly not hold for other activation functions, or have they just not explored it yet?

gqcwwjtg on June 23, 2023 [–]

It seems like it doesn’t hold since this relies on turning the whole thing into a piecewise linear function.

Join us for AI Startup School this June 16-17 in San Francisco!
Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact