https://openreview.net/forum?id=rke4HiAcY7
Caveats for information bottleneck in deterministic scenarios | OpenReview
Information bottleneck behaves in surprising ways whenever the output is a deterministic function of the input.
for informationcaveatsbottleneckdeterministicscenarios
https://deepai.org/publication/invariant-information-bottleneck-for-domain-generalization
Invariant Information Bottleneck for Domain Generalization | DeepAI
Jun 11, 2021 - 06/11/21 - The main challenge for domain generalization (DG) is to overcome the potential distributional shift between multiple training doma...
information bottleneckdomain generalizationinvariantdeepai
https://openreview.net/forum?id=wsFCbuDwxY
Clinical Time Series Imputation using Conditional Information Bottleneck | OpenReview
Clinical time series imputation presents a significant challenge because it requires capturing the underlying temporal dynamics from partially observed time...
time seriesconditional informationclinicalimputationusing
https://openreview.net/forum?id=vU0KbvQ91x
Learning to Abstract with Nonparametric Variational Information Bottleneck | OpenReview
Learned representations at the level of characters, sub-words, words, and sentences, have each contributed to advances in understanding different NLP tasks and...
information bottlenecklearningabstractnonparametricvariational
https://openreview.net/forum?id=ry_WPG-A-¬eId=ry_WPG-A-
On the Information Bottleneck Theory of Deep Learning | OpenReview
We show that several claims of the information bottleneck theory of deep learning are not true in the general case.
theory of deep learninginformation bottleneckopenreview
https://openreview.net/forum?id=lhl_rYNdiH6
Contrastive Graph Structure Learning via Information Bottleneck for Recommendation | OpenReview
Graph convolution networks (GCNs) for recommendations have emerged as an important research topic due to their ability to exploit higher-order neighbors....
structure learninginformation bottleneckcontrastivegraphvia
https://openreview.net/forum?id=HJloElBYvB
Phase Transitions for the Information Bottleneck in Representation Learning | OpenReview
We give a theoretical analysis of the Information Bottleneck objective to understand and predict observed phase transitions in the prediction vs. compression...
for the informationphase transitionsrepresentation learningbottleneckopenreview
https://deepai.org/publication/multi-agent-communication-with-graph-information-bottleneck-under-limited-bandwidth
Multi-agent Communication with Graph Information Bottleneck under Limited Bandwidth | DeepAI
Dec 20, 2021 - 12/20/21 - Recent studies have shown that introducing communication between agents can significantly improve overall performance in cooperati...
multi agentinformation bottleneckcommunicationgraph
https://openreview.net/forum?id=Bq4XOaU4sV
Bridging the Sim-to-Real Gap from the Information Bottleneck Perspective | OpenReview
Reinforcement Learning (RL) has recently achieved remarkable success in robotic control. However, most works in RL operate in simulated environments where...
the siminformation bottleneckbridgingreal
https://en.wikipedia.org/wiki/Information_bottleneck_method
Information bottleneck method - Wikipedia
information bottleneck methodwikipedia
https://openreview.net/forum?id=rJg8yhAqKm
InfoBot: Transfer and Exploration via the Information Bottleneck | OpenReview
Training agents with goal-policy information bottlenecks promotes transfer and yields a powerful exploration bonus
the informationinfobottransferexplorationvia
https://deepai.org/publication/explanation-regeneration-via-information-bottleneck
Explanation Regeneration via Information Bottleneck | DeepAI
Dec 19, 2022 - 12/19/22 - Explaining the black-box predictions of NLP models naturally and accurately is an important open problem in natural language gener...
information bottleneckexplanationregenerationviadeepai
https://openreview.net/forum?id=INqLJwqUmc
Narrowing Information Bottleneck Theory for Multimodal Image-Text Representations Interpretability...
The task of identifying multimodal image-text representations has garnered increasing attention, particularly with models such as CLIP (Contrastive...
information bottleneckimage textnarrowingtheorymultimodal
https://openreview.net/forum?id=kvhzKz-_DMF
Variational Information Bottleneck for Effective Low-Resource Fine-Tuning | OpenReview
While large-scale pretrained language models have obtained impressive results when fine-tuned on a wide variety of tasks, they still often suffer from...
information bottleneckfine tuningvariationaleffectivelow