> One neuron is equivalent to one bit in a computer. One bit of information is insufficient to distinguish between faces.

"Seen <particular face>" is a binary state, so one output neuron that fires on recognizing a particular face is actually quite reasonable.

Obviously, the inputs that contribute to that recognition must be more complicated.