tatsu-lab/alpaca_eval

This is stars and forks stats for /tatsu-lab/alpaca_eval repository. As of 05 May, 2024 this repository has 658 stars and 90 forks.

AlpacaEval : An Automatic Evaluator for Instruction-following Language Models Evaluation of instruction-following models (e.g., ChatGPT) typically requires human interactions. This is time-consuming, expensive, and hard to replicate. AlpacaEval in an LLM-based automatic evaluation that is fast, cheap, replicable, and validated against 20K human annotations. It is particularly useful for model development. Although we improved over prior automatic evaluation pipelines, there are still fundamental...