openai/evals

This is stars and forks stats for /openai/evals repository. As of 27 Apr, 2024 this repository has 12088 stars and 2278 forks.

OpenAI Evals Evals is a framework for evaluating LLMs (large language models) or systems built using LLMs as components. It also includes an open-source registry of challenging evals. We now support evaluating the behavior of any system including prompt chains or tool-using agents, via the Completion Function Protocol. With Evals, we aim to make it as simple as possible to build an eval while writing as little code as possible. An "eval" is a task used to evaluate the quality of a system's behavior. To...