OFA-Sys/ONE-PEACE

A general representation model across vision, audio, language modalities. Paper: ONE-PEACE: Exploring One General Representation Model Toward Unlimited Modalities

PythonShellCudaC++CythonLuarepresentation-learningmultimodalvision-and-languagecontrastive-lossvision-languagevision-transformerfoundation-modelsaudio-language
This is stars and forks stats for /OFA-Sys/ONE-PEACE repository. As of 06 May, 2024 this repository has 639 stars and 37 forks.

📖 Paper   |  🤗 Demo   |   🤖 ModelScope   |   Checkpoints  |  Datasets ONE-PEACE is a general representation model across vision, audio, and language modalities, Without using any vision or language pretrained model for initialization, ONE-PEACE achieves leading results in vision, audio, audio-language, and vision-language tasks. Furthermore, ONE-PEACE possesses a strong emergent zero-shot retrieval capability, enabling it to align modalities that are not paired in the training data. Below shows the...
Read on GithubGithub Stats Page
repotechsstarsweeklyforksweekly
microsoft/PodcastCopilotPython60201260
TransformerOptimus/SuperAGIPythonJavaScriptCSS12.6k01.5k0
LmeSzinc/StarRailCopilotPythonTypeScriptVue1.1k0560
cran/sgsRC++1000
UMich-CURLY/Lie-MPC-AMVsRoffSWIGC++20010
guix-mirror/guixSchemeC++Shell2540630
patte/fly-tailscale-exitShellDockerfile1.4k+877+1
bl4ck44/NextcloudShell20050
edoliberty/vector-search-class-notesTeXPythonShell2630300
being24/latex-template-jaTeXShellMakefile310320