Robuta

https://www.amazon.science/publications/question-aware-vision-transformer-for-multimodal-reasoning Question aware vision transformer for multimodal reasoning - Amazon Science Vision-Language (VL) models have gained significant research focus, enabling remarkable advances in multimodal reasoning. These architectures typically... vision transformerquestionawaremultimodalreasoning https://arxiv.org/abs/2602.06883 [2602.06883] Vision Transformer Finetuning Benefits from Non-Smooth Components Abstract page for arXiv paper 2602.06883: Vision Transformer Finetuning Benefits from Non-Smooth Components vision transformer260206883finetuningbenefits https://arxiv.org/abs/2405.13998?context=cs.LG [2405.13998] CViT: Continuous Vision Transformer for Operator Learning Abstract page for arXiv paper 2405.13998: CViT: Continuous Vision Transformer for Operator Learning vision transformer2405cvitcontinuousoperator https://openreview.net/forum?id=2Aoi0VKPOWT ViT-AE++: Improving Vision Transformer Autoencoder for Self-supervised Medical Image... ViT-AE++: a strong baseline for learning self-supervised 2D and 3D medical image representations. vision transformerself supervisedvitaeimproving https://openreview.net/forum?id=cRnCcuLvyr CViT: Continuous Vision Transformer for Operator Learning | OpenReview Operator learning, which aims to approximate maps between infinite-dimensional function spaces, is an important area in scientific machine learning with... vision transformercvitcontinuousoperatorlearning https://openreview.net/forum?id=LzBBxCg-xpa NViT: Vision Transformer Compression and Parameter Redistribution | OpenReview Transformers yield state-of-the-art results across many tasks. However, they still impose huge computational costs during inference. We apply global,... vision transformernvitcompressionparameterredistribution https://deepai.org/publication/lgvit-dynamic-early-exiting-for-accelerating-vision-transformer LGViT: Dynamic Early Exiting for Accelerating Vision Transformer | DeepAI Aug 1, 2023 - 08/01/23 - Recently, the efficient deployment and acceleration of powerful vision transformers (ViTs) on resource-limited edge devices for pr... vision transformerdynamicearlyexitingaccelerating https://www.amazon.science/publications/blending-anti-aliasing-into-vision-transformer Blending anti-aliasing into vision transformer - Amazon Science The transformer architectures, based on self-attention mechanism and convolution-free design, recently found superior performance and booming applications in... anti aliasingvision transformerblendingamazonscience https://www.frontiersin.org/journals/computer-science/articles/10.3389/fcomp.2025.1463006/full Frontiers | Integrating pyramid vision transformer and topological data analysis for brain tumor IntroductionBrain tumor (BT) classification is crucial yet challenging due to the complex and varied nature of these tumors. We present a novel approach comb... topological data analysisvision transformer https://openreview.net/forum?id=5Ld5bRB9jzY Adder Attention for Vision Transformer | OpenReview Implementing transformers using cheap addition operation vision transformeradderattentionopenreview https://deepai.org/publication/vision-transformer-visualization-what-neurons-tell-and-how-neurons-behave Vision Transformer Visualization: What Neurons Tell and How Neurons Behave? | DeepAI Oct 14, 2022 - 10/14/22 - Recently vision transformers (ViT) have been applied successfully for various tasks in computer vision. However, important questio... vision transformerand howvisualizationneuronstell https://openreview.net/forum?id=afoV8W3-IYp&referrer=%5BAuthor%20Console%5D(%2Fgroup%3Fid%3D%0A%20%20%20%20%20%20%20%20%20%20%20%20%20%20ICLR.cc%2F2022%2FConference%2FAuthors%23your-submissions) RelViT: Concept-guided Vision Transformer for Visual Relational Reasoning | OpenReview Reasoning about visual relationships is central to how humans interpret the visual world. This task remains challenging for current deep learning algorithms... vision transformerconceptguidedvisualrelational https://www.southampton.ac.uk/research/projects/vision-transformer-models-for-solar-irradiance-forecasting Vision transformer models for solar irradiance forecasting | University of Southampton Vision transformer models for solar irradiance forecasting. vision transformersolar irradianceuniversity ofmodelsforecasting https://keras.io/examples/vision/vit_small_ds/ Train a Vision Transformer on small datasets Keras documentation: Train a Vision Transformer on small datasets a visiontraintransformersmalldatasets https://deepai.org/publication/vicinity-vision-transformer Vicinity Vision Transformer | DeepAI Jun 21, 2022 - 06/21/22 - Vision transformers have shown great success on numerous computer vision tasks. However, its central component, softmax attention,... vision transformervicinitydeepai https://openreview.net/forum?id=8hWs60AZcWk Discrete Representations Strengthen Vision Transformer Robustness | OpenReview Vision Transformer (ViT) is emerging as the state-of-the-art architecture for image recognition. While recent studies suggest that ViTs are more robust than... vision transformerdiscreterepresentationsstrengthenrobustness https://www.coursera.org/courses?query=vision%20transformer%20(vit) Top Vision Transformer (vit) Courses - Learn Vision Transformer (vit) Online Vision Transformer (vit) courses from top universities and industry leaders. Learn Vision Transformer (vit) online with courses like Computer Vision and... vision transformertopvitcourseslearn https://openreview.net/forum?id=KvEjv5klWi Locality-Attending Vision Transformer | OpenReview Vision transformers have demonstrated remarkable success in classification by leveraging global self-attention to capture long-range dependencies. However,... vision transformerlocalityattendingopenreview https://deepai.org/publication/robust-face-anti-spoofing-framework-with-convolutional-vision-transformer Robust face anti-spoofing framework with Convolutional Vision Transformer | DeepAI Jul 24, 2023 - 07/24/23 - Owing to the advances in image processing technology and large-scale datasets, companies have implemented facial authentication pr... vision transformerrobustfaceantispoofing https://arxiv.org/abs/2411.14953 [2411.14953] Evaluating Vision Transformer Models for Visual Quality Control in Industrial... Abstract page for arXiv paper 2411.14953: Evaluating Vision Transformer Models for Visual Quality Control in Industrial Manufacturing vision transformer https://openreview.net/forum?id=DF8LCjR03tX HRFormer: High-Resolution Vision Transformer for Dense Predict | OpenReview We present a High-Resolution Transformer (HRFormer) that learns high-resolution representations for dense prediction tasks, in contrast to the original Vision... high resolutionvision transformerdensepredictopenreview https://deepai.org/publication/eye-gaze-guided-vision-transformer-for-rectifying-shortcut-learning Eye-gaze-guided Vision Transformer for Rectifying Shortcut Learning | DeepAI May 25, 2022 - 05/25/22 - Learning harmful shortcuts such as spurious correlations and biases prevents deep neural networks from learning the meaningful and... eye gazevision transformerguidedrectifyingshortcut https://the-decoder.com/google-trains-largest-vision-transformer-to-date/ Google trains largest Vision Transformer to date Feb 26, 2023 - Google's ViT-22B is the largest Vision Transformer to date, with 22 billion parameters. Google says it is better aligned to humans than other models. vision transformergoogletrainslargestdate https://www.mdpi.com/2072-4292/15/21/5208 Vision Transformer-Based Ensemble Learning for Hyperspectral Image Classification Hyperspectral image (HSI) classification, due to its characteristic combination of images and spectra, has important applications in various fields through... vision transformerensemble learninghyperspectral imagebasedclassification https://openreview.net/forum?id=_PHymLIxuI CrossFormer: A Versatile Vision Transformer Hinging on Cross-scale Attention | OpenReview Transformers have made great progress in dealing with computer vision tasks. However, existing vision transformers have not yet possessed the ability of... vision transformerversatile https://arxiv.org/abs/2207.07039 [2207.07039] Convolutional Bypasses Are Better Vision Transformer Adapters Abstract page for arXiv paper 2207.07039: Convolutional Bypasses Are Better Vision Transformer Adapters better vision220707039bypassestransformer https://deepai.org/publication/differentially-private-cutmix-for-split-learning-with-vision-transformer Differentially Private CutMix for Split Learning with Vision Transformer | DeepAI Oct 28, 2022 - 10/28/22 - Recently, vision transformer (ViT) has started to outpace the conventional CNN in computer vision tasks. Considering privacy-prese... with visionprivatesplitlearningtransformer https://wandb.ai/vincenttu/blog_posts/reports/Hiera-Hierarchical-Vision-Transformer--Vmlldzo0NTY3NjU3 Hiera: Hierarchical Vision Transformer hieravisiontransformer https://zenn.dev/cartellya/articles/cartellya_20250720230726_e-memo-00043 Vision Transformer visiontransformer https://github.com/MKVarun/ViT-Transformers-with-learnable-resizers GitHub - MKVarun/ViT-Transformers-with-learnable-resizers: We implement a Vision Transformer model... We implement a Vision Transformer model and understand the effect of adding a learnable resizer network to the ViT Model. -... https://arxiv.org/abs/2405.19315 [2405.19315] Matryoshka Query Transformer for Large Vision-Language Models Abstract page for arXiv paper 2405.19315: Matryoshka Query Transformer for Large Vision-Language Models large vision2405matryoshkaquerytransformer https://openreview.net/forum?id=wkbeqr5XhC LUM-ViT: Learnable Under-sampling Mask Vision Transformer for Bandwidth Limited Optical Signal... Bandwidth constraints during signal acquisition frequently impede real-time detection applications. Hyperspectral data is a notable example, whose vast volume... https://deepai.org/publication/tvlt-textless-vision-language-transformer TVLT: Textless Vision-Language Transformer | DeepAI Sep 28, 2022 - 09/28/22 - In this work, we present the Textless Vision-Language Transformer (TVLT), where homogeneous transformer blocks take raw visual and... textlessvisionlanguagetransformerdeepai https://arxiv.org/abs/2405.08342 [2405.08342] Abnormal Respiratory Sound Identification Using Audio-Spectrogram Vision Transformer Abstract page for arXiv paper 2405.08342: Abnormal Respiratory Sound Identification Using Audio-Spectrogram Vision Transformer sound identification240508342abnormalrespiratory https://openreview.net/forum?id=qHZs2p4ZD4 V1T: large-scale mouse V1 response prediction using a Vision Transformer | OpenReview Accurate predictive models of the visual cortex neural response to natural visual stimuli remain a challenge in computational neuroscience. In this work, we... large scale