https://openreview.net/forum?id=R0h3NUMao_U
Learnable Fourier Features for Multi-dimensional Spatial Positional Encoding | OpenReview
The work presents a method for encoding multi-dimensional positions using learnable Fourier features for Transformer models.
multi dimensionalpositional encodingfourierfeaturesspatial
https://deepai.org/publication/pet-neus-positional-encoding-tri-planes-for-neural-surfaces
PET-NeuS: Positional Encoding Tri-Planes for Neural Surfaces | DeepAI
May 9, 2023 - 05/09/23 - A signed distance function (SDF) parametrized by an MLP is a common ingredient of neural surface reconstruction. We build on the s...
positional encodingpetneustriplanes
https://aclanthology.org/R19-1099/
Dependency-Based Relative Positional Encoding for Transformer NMT - ACL Anthology
Yutaro Omote, Akihiro Tamura, Takashi Ninomiya. Proceedings of the International Conference on Recent Advances in Natural Language Processing (RANLP 2019)....
positional encodingdependencybasedrelativetransformer
https://openreview.net/forum?id=e95i1IHcWj
Equivariant and Stable Positional Encoding for More Powerful Graph Neural Networks | OpenReview
Graph neural networks (GNN) have shown great advantages in many graph-based learning tasks but often fail to predict accurately for a task-based on sets of...
graph neural networkspositional encodingfor more
https://openreview.net/forum?id=09-528y2Fgf
Rethinking Positional Encoding in Language Pre-training | OpenReview
In this work, we investigate the positional encoding methods used in language pre-training (e.g., BERT) and identify several problems in the existing...
positional encodingpre trainingrethinkinglanguageopenreview
https://huggingface.co/papers/2106.02795
Paper page - Learnable Fourier Features for Multi-Dimensional Spatial Positional Encoding
Join the discussion on this paper page
multi dimensionalpaperfourierfeatures
https://openreview.net/forum?id=6oQDDcW2gY&referrer=%5Bthe%20profile%20of%20Jason%20D.%20Lee%5D(%2Fprofile%3Fid%3D~Jason_D._Lee1)
Rethinking Addressing in Language Models via Contextualized Equivariant Positional Encoding |...
Transformers rely on both content-based and position-based addressing mechanisms to make predictions, but existing positional encoding techniques often...
in languagerethinkingaddressingmodelsvia
https://arxiv.org/abs/2509.14640
[2509.14640] DyWPE: Signal-Aware Dynamic Wavelet Positional Encoding for Time Series Transformers
Abstract page for arXiv paper 2509.14640: DyWPE: Signal-Aware Dynamic Wavelet Positional Encoding for Time Series Transformers
https://aclanthology.org/2022.emnlp-main.713/
A Generative Model for End-to-End Argument Mining with Reconstructed Positional Encoding and...
Jianzhu Bao, Yuhang He, Yang Sun, Bin Liang, Jiachen Du, Bing Qin, Min Yang, Ruifeng Xu. Proceedings of the 2022 Conference on Empirical Methods in Natural...
https://openreview.net/forum?id=wgGC1N4rKy&referrer=%5Bthe%20profile%20of%20Jason%20D.%20Lee%5D(%2Fprofile%3Fid%3D~Jason_D._Lee1)
Rethinking Addressing in Language Models via Contextualized Equivariant Positional Encoding |...
Transformers rely on both content-based and position-based addressing mechanisms to make predictions, but existing positional encoding techniques often...
in languagerethinkingaddressingmodelsvia