Complex Valued Neural Networks

Image credit:

Current neural network models that deal with data on the spectral plane (magnitude and phase) only take as input the magnitude, and do not incorporate, in a meaningful way, the phase information. Research has shown that the output of biological neurons is affected by the phase of its inputs.

In order to bridge this separation between artificial neurons and biological neurons, I am experimenting with the effectiveness and implementation of complex valued neural networks, which would integrate the phase information meaningfully. In particular, in order to take advantage of the popular neural network software package and framework, PyTorch, I am working to simulate complex valued neural network operations through real valued neural networks. I hope that by implementing complex valued neural networks through this framework, it will be easy for other researchers to use and experiment on.