Towards Being Parameter-Efficient: A Stratified Sparsely Activated Transformer with Dynamic Capacity

Haoran Xu, Maha Elbayad, Kenton Murray, Jean Maillard, Vedanuj Goswami
May 2023
PDF Code
Type
Conference paper
Publication
Findings of EMNLP 2023