Toward Relative Positional Encoding in Spiking Transformers

TL;DR

Spiking neural networks (SNNs) are bio-inspired networks that mimic how neurons in the brain communicate through discrete spikes, which have great potential in various tasks due to their energy effici…

Opening excerpt from the authors’ abstract. source