https://www.amazon.science/publications/segtree-transformer-iterative-refinement-of-hierarchical-features
SegTree Transformer: Iterative refinement of hierarchical features - Amazon Science
The building block of Transformer can be seen as inducing message passing over a complete graph whose nodes correspond to input tokens. Such dense connections...
iterative refinementsegtreetransformerhierarchicalfeatures
https://drive.google.com/file/d/1Ric52Jy7lFT-oeB6yoqWtCZWlDlLY8BN/view?usp=drive_link
segtree.cpp - Google Drive
segtreecppgoogledrive