a16z-infra/cog-llama-template

This is stars and forks stats for /a16z-infra/cog-llama-template repository. As of 11 May, 2024 this repository has 261 stars and 38 forks.

LLaMA Cog template 🦙 NOTE: This is an experimental branch that depends on exllama For now, you should: git clone https://github.com/turboderp/exllama cd exllama git checkout e8a544f95b3fd64dfa5549eeeafb85b1ac71a793 We're working on a proper integration. This Cog template works with LLaMA 1 & 2 versions. LLaMA is a new open-source language model from Meta Research that performs as well as closed-source models. This is a guide to running LLaMA using in the cloud using Replicate. You'll use the...