We consider the ability of a very simple feed-forward ne-ural network to discriminate phonemes based on just relative power spectrum. The network consists of two neurons with symmetric nonlinear response over a spectral range. The out-put of the neurons is subsequently fed to a comparator. We show that often this is enough to achieve complete separation of data. We compare the performance of found discriminants with that of more general neurons. Our conclusion is that not much is gained in passing to real-valued weights. More li-kely higher number of neurons and preprocessing of input will yield better discrimination results. The networks consi-dered are directly amenable to hardware (neuromorphic) de-signs. Other advantages include interpretability, guarantees of performance on unseen data and low Kolmogoroff’s comple-xity. Index Terms — phoneme discrimination, feed-forward neural network, neuromorphic hardware, TIMIT, memristor 1.