Pattern storage by a single neuron is revisited. Generalizing Parisi’s framework for spin glasses, we obtain a variational free energy functional for the neuron. The solution is demonstrated at high temperature and large relative number of examples, where several phases are identified by thermodynamical stability analysis, two of them exhibiting spontaneous full replica symmetry breaking. We give analytically the curved segments of the order parameter function and, in representative cases, compute the free energy, the storage error, and the entropy.
ASJC Scopus subject areas
- Physics and Astronomy(all)