Networks of interconnected nodes are at the heart of every neural network concept. While neural networks have been implemented in various hardware systems, the efficient realization of such networks still represents a major challenge. We demonstrate the implementation of an all-optical network scheme based on holographic coupling and induce complex spatio-temporal transients with Gigahertz bandwidth. Our scheme illustrates the potential of such all-optical systems for future neural network implementations.