Robuta

https://research.google/pubs/consmax-hardware-friendly-alternative-softmax-with-learnable-parameters/ ConSmax: Hardware-Friendly Alternative Softmax with Learnable Parameters hardware friendly alternative softmax parameters