latitudegames/GPT-3-Encoder

This is stars and forks stats for /latitudegames/GPT-3-Encoder repository. As of 29 Apr, 2024 this repository has 678 stars and 193 forks.

GPT-3-Encoder Javascript BPE Encoder Decoder for GPT-2 / GPT-3 About GPT-2 and GPT-3 use byte pair encoding to turn text into a series of integers to feed into the model. This is a javascript implementation of OpenAI's original python encoder/decoder which can be found here Install with npm npm install gpt-3-encoder Usage Compatible with Node >= 12 const {encode, decode} = require('gpt-3-encoder') const str = 'This is an example sentence to try encoding out on!' const encoded = encode(str) console.log('Encoded...