https://github.com/stanford-crfm/helm
GitHub - stanford-crfm/helm: Holistic Evaluation of Language Models (HELM) is an open source Python...
Holistic Evaluation of Language Models (HELM) is an open source Python framework created by the Center for Research on Foundation Models (CRFM) at Stanford for...
evaluation of language models
https://openreview.net/forum?id=iO4LZibEqW
Holistic Evaluation of Language Models | OpenReview
Language models (LMs) are becoming the foundation for almost all major language technologies, but their capabilities, limitations, and risks are not well...
evaluation of language modelsholisticopenreview
https://openreview.net/forum?id=CfKbLzyDKU&referrer=%5Bthe%20profile%20of%20Julen%20Etxaniz%5D(%2Fprofile%3Fid%3D~Julen_Etxaniz1)
Lessons from the Trenches on Reproducible Evaluation of Language Models | OpenReview
Effective evaluation of language models remains an open challenge in NLP. Researchers and engineers face methodological issues such as the sensitivity of...
evaluation of language modelsfrom the trencheslessons