A framework for few-shot evaluation of language models.
PythonMIT Licenseactive
5 projectsLLM Evaluation:
A framework for few-shot evaluation of language models.
PythonMIT Licenseactive
Eval tools by OpenAI.
PythonMIT Licensesteady
Holistic Evaluation of Language Models (HELM), a framework to increase the transparency of language models.
PythonApache License 2.0active
a lightweight LLM evaluation suite that Hugging Face has been using internally.
PythonMIT Licenseactive
This repository contains code to quantitatively evaluate instruction-tuned models such as Alpaca and Flan-T5 on held-out tasks.
PythonApache License 2.0slowing