This is stars and forks stats for /lucidrains/lion-pytorch repository. As of 03 May, 2024 this repository has 1695 stars and 45 forks.
🦁 Lion - Pytorch 🦁 Lion, EvoLved Sign Momentum, new optimizer discovered by Google Brain that is purportedly better than Adam(w), in Pytorch. This is nearly a straight copy from here, with few minor modifications. It is so simple, we may as well get it accessible and used asap by everyone to train some great models, if it really works 🤞 Instructions Learning rate and weight decay: the authors write in Section 5 - Based on our experience, a suitable learning rate for Lion is typically 3-10x smaller...
🦁 Lion - Pytorch 🦁 Lion, EvoLved Sign Momentum, new optimizer discovered by Google Brain that is purportedly better than Adam(w), in Pytorch. This is nearly a straight copy from here, with few minor modifications. It is so simple, we may as well get it accessible and used asap by everyone to train some great models, if it really works 🤞 Instructions Learning rate and weight decay: the authors write in Section 5 - Based on our experience, a suitable learning rate for Lion is typically 3-10x smaller...
| repo | techs | stars | weekly | forks | weekly |
|---|---|---|---|---|---|
| rerun-io/rerun | RustPythonC++ | 3.3k | +333 | 146 | +11 |
| swarmlet/swarmlet | ShellDockerfilePython | 809 | 0 | 50 | 0 |
| flashohq/flasho | HTMLTypeScriptPython | 334 | 0 | 16 | 0 |
| victorchall/EveryDream2trainer | PythonJupyter NotebookOther | 622 | -1 | 86 | 0 |
| riscv-android-src/platform-build | MakefilePythonJava | 0 | 0 | 2 | 0 |
| hotosm/raw-data-api | PythonHCLLua | 10 | 0 | 3 | 0 |
| yihong0618/xiaogpt | PythonOther | 3.9k | 0 | 563 | 0 |
| Guiflayrom/yolnp | PythonVueJavaScript | 207 | -1 | 32 | 0 |
| mukulpatnaik/researchgpt | PythonJavaScriptHTML | 3.4k | 0 | 321 | 0 |
| 13exp/SpringBoot-Scan-GUI | PythonOther | 373 | +5 | 44 | 0 |