How to contribute to the knowledge about building and training neural networks? Maybe by knowing the foundations of that discipline well?
PyTorch is one of the most efficient examples of basic Machine Learning research software.
How to contribute to PyTorch? By knowing the PyTorch internals well, e.g. with this guide.