Sponsor of the Day:
Jerkmate
https://blog.eleuther.ai/mutransfer/
The Practitioner's Guide to the Maximal Update Parameterization | EleutherAI Blog
Jul 31, 2025 - Exploring the implementation details of muTransfer
eleutherai blogpractitionerguidemaximalupdate
https://blog.eleuther.ai/attention-probes/
Attention Probes | EleutherAI Blog
Aug 3, 2025 - Adding attention to linear probes
eleutherai blogattentionprobes
https://blog.eleuther.ai/
EleutherAI Blog
Discussing and disseminating open-source AI research.
eleutherai blog
https://blog.eleuther.ai/pile-t5/
Pile-T5 | EleutherAI Blog
Apr 20, 2024 - Trained T5 on the Pile
eleutherai blogpilet5
https://blog.eleuther.ai/prompts-gpt-fewshot/
Evaluating Different Fewshot Description Prompts on GPT-3 | EleutherAI Blog
Oct 7, 2021 - We evaluate different fewshot prompts on GPT-3 to see how it changes performance.
evaluating differentgpt 3eleutherai blogdescriptionprompts
https://blog.eleuther.ai/tuning-on-eval-harness/
Finetuning Models on Downstream Tasks | EleutherAI Blog
Oct 7, 2021 - We tuned GPT-Neo on eval harness tasks to see how it would change its performance.
eleutherai blogfinetuningmodelsdownstreamtasks
https://blog.eleuther.ai/alignment-eleuther/
Alignment Research @ EleutherAI | EleutherAI Blog
May 3, 2023 - A breif overview of EAIs approach to alignment
alignment researcheleutherai blog