google/BIG-bench

This is stars and forks stats for /google/BIG-bench repository. As of 09 May, 2024 this repository has 2287 stars and 533 forks.

BIG-bench 🪑 The Beyond the Imitation Game Benchmark (BIG-bench) is a collaborative benchmark intended to probe large language models and extrapolate their future capabilities. The more than 200 tasks included in BIG-bench are summarized by keyword here, and by task name here. A paper introducing the benchmark, including evaluation results on large language models, is currently under review, and is available as a preprint. New task submissions are encouraged. Tasks will be reviewed and merged into...