This is stars and forks stats for /abacusai/Long-Context repository. As of 13 May, 2024 this repository has 494 stars and 32 forks.
Extending LLM Context Length The choice of how to encode positional information for transformers has been one of the key components of LLM architectures. An area that has been interesting to us and others in the community recently is whether LLMs can be extended to longer contexts. We have conducted a range of experiments with different schemes for extending context length capabilities of Llama, which has been pretrained on 2048 context length with the RoPE (Rotary Position Embedding) encoding. Here...
Extending LLM Context Length The choice of how to encode positional information for transformers has been one of the key components of LLM architectures. An area that has been interesting to us and others in the community recently is whether LLMs can be extended to longer contexts. We have conducted a range of experiments with different schemes for extending context length capabilities of Llama, which has been pretrained on 2048 context length with the RoPE (Rotary Position Embedding) encoding. Here...
| repo | techs | stars | weekly | forks | weekly |
|---|---|---|---|---|---|
| Dicklesworthstone/fast_vector_similarity | RustPython | 258 | 0 | 8 | 0 |
| VirtusLab/pekko-serialization-helper | ScalaShellsed | 7 | 0 | 1 | 0 |
| GFDRR/rdls-cove | SCSSHTMLSass | 0 | 0 | 0 | 0 |
| ublue-os/bazzite | ShellMakefileDockerfile | 567 | 0 | 30 | 0 |
| DeepSourceCorp/helm-charts | SmartyShell | 1 | 0 | 2 | 0 |
| stacksimplify/helm-masterclass | SmartyShell | 35 | +2 | 139 | +12 |
| stacksimplify/helm-charts | SmartyShell | 8 | 0 | 43 | 0 |
| rh-telco-tigers/rhacm-gitops-workshop | SmartyShellMakefile | 0 | 0 | 2 | 0 |
| microsoft/cheriot-safe | SystemVerilogC++C | 1 | 0 | 1 | 0 |
| Thinkgamer/Machine-Learning-With-Python | TSQLPython | 688 | 0 | 420 | +2 |