And a simple PID controller built with op-amps looks an awful lot like a simple ... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		sitkack on Feb 28, 2023 \| parent \| context \| favorite \| on: Fourier analysis may help to quickly train more ac... And a simple PID controller built with op-amps looks an awful lot like a simple neural network. http://www.ecircuitcenter.com/Circuits/op_pid/op_pid.htm https://www.nutsvolts.com/magazine/article/the_perceptron_ci...

mordae on Feb 28, 2023 [–]

Isn't gradient descent basically PID over parameters? And tricks like momentum basically a low-pass filter integrated in the PID loop? It's quite weird how not that many concepts from analog electronics domain have gotten carried over to ML.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact