Robuta

https://openreview.net/forum?id=R0h3NUMao_U Learnable Fourier Features for Multi-dimensional Spatial Positional Encoding | OpenReview The work presents a method for encoding multi-dimensional positions using learnable Fourier features for Transformer models. multi dimensionalpositional encodingfourierfeaturesspatial https://deepai.org/publication/pet-neus-positional-encoding-tri-planes-for-neural-surfaces PET-NeuS: Positional Encoding Tri-Planes for Neural Surfaces | DeepAI May 9, 2023 - 05/09/23 - A signed distance function (SDF) parametrized by an MLP is a common ingredient of neural surface reconstruction. We build on the s... positional encodingpetneustriplanes https://aclanthology.org/R19-1099/ Dependency-Based Relative Positional Encoding for Transformer NMT - ACL Anthology Yutaro Omote, Akihiro Tamura, Takashi Ninomiya. Proceedings of the International Conference on Recent Advances in Natural Language Processing (RANLP 2019).... positional encodingdependencybasedrelativetransformer https://openreview.net/forum?id=e95i1IHcWj Equivariant and Stable Positional Encoding for More Powerful Graph Neural Networks | OpenReview Graph neural networks (GNN) have shown great advantages in many graph-based learning tasks but often fail to predict accurately for a task-based on sets of... graph neural networkspositional encodingfor more https://openreview.net/forum?id=09-528y2Fgf Rethinking Positional Encoding in Language Pre-training | OpenReview In this work, we investigate the positional encoding methods used in language pre-training (e.g., BERT) and identify several problems in the existing... positional encodingpre trainingrethinkinglanguageopenreview https://huggingface.co/papers/2106.02795 Paper page - Learnable Fourier Features for Multi-Dimensional Spatial Positional Encoding Join the discussion on this paper page multi dimensionalpaperfourierfeatures https://openreview.net/forum?id=6oQDDcW2gY&referrer=%5Bthe%20profile%20of%20Jason%20D.%20Lee%5D(%2Fprofile%3Fid%3D~Jason_D._Lee1) Rethinking Addressing in Language Models via Contextualized Equivariant Positional Encoding |... Transformers rely on both content-based and position-based addressing mechanisms to make predictions, but existing positional encoding techniques often... in languagerethinkingaddressingmodelsvia https://arxiv.org/abs/2509.14640 [2509.14640] DyWPE: Signal-Aware Dynamic Wavelet Positional Encoding for Time Series Transformers Abstract page for arXiv paper 2509.14640: DyWPE: Signal-Aware Dynamic Wavelet Positional Encoding for Time Series Transformers https://aclanthology.org/2022.emnlp-main.713/ A Generative Model for End-to-End Argument Mining with Reconstructed Positional Encoding and... Jianzhu Bao, Yuhang He, Yang Sun, Bin Liang, Jiachen Du, Bing Qin, Min Yang, Ruifeng Xu. Proceedings of the 2022 Conference on Empirical Methods in Natural... https://openreview.net/forum?id=wgGC1N4rKy&referrer=%5Bthe%20profile%20of%20Jason%20D.%20Lee%5D(%2Fprofile%3Fid%3D~Jason_D._Lee1) Rethinking Addressing in Language Models via Contextualized Equivariant Positional Encoding |... Transformers rely on both content-based and position-based addressing mechanisms to make predictions, but existing positional encoding techniques often... in languagerethinkingaddressingmodelsvia