https://openreview.net/forum?id=jvjRNm6tb3
Getting free Bits Back from Rotational Symmetries in LLMs | OpenReview
Current methods for compressing neural network weights, such as decomposition, pruning, quantization, and channel simulation, often overlook the inherent...
getting freerotational symmetriesbitsbackllms