keyu-tian/SparK

[ICLR'23 Spotlight] The first successful BERT/MAE-style pretraining on any convolutional network; Pytorch impl. of "Designing BERT for Convolutional Networks: Sparse and Hierarchical Masked Modeling"

PythonJupyter Notebookssldeep-learningconvnetcnnpytorchconvolutional-neural-networksobject-detectionberticlrmaeinstance-segmentationmask-rcnnsparse-convolutionself-supervised-learningpre-trained-modelpretrainpretrainingmasked-autoencodermasked-image-modelingiclr2023
This is stars and forks stats for /keyu-tian/SparK repository. As of 02 May, 2024 this repository has 1282 stars and 63 forks.

SparK: the first successful BERT/MAE-style pretraining on any convolutional networks   This is the official implementation of ICLR paper Designing BERT for Convolutional Networks: Sparse and Hierarchical Masked Modeling, which can pretrain any CNN (e.g., ResNet) in a BERT-style self-supervised manner. We've tried our best to make the codebase clean, short, easy to read, state-of-the-art, and only rely on minimal dependencies. SparK_demo_22s_4k_wo_bages.1.mp4     🔥...
Read on GithubGithub Stats Page
repotechsstarsweeklyforksweekly
wger-project/wgerPythonHTMLJavaScript2.5k04890
njsmith/posyRustPythonC2460180
TheAppleTucker/backend-GPTJavaScriptHTMLPython2.9k02520
MuhammadMoinFaisal/YOLOv8-DeepSORT-Object-TrackingJupyter NotebookPython39601200
drshahizan/python-webJupyter NotebookOther640450
VikParuchuri/zero_to_gptJupyter NotebookPython29501080
udlbook/udlbookJupyter NotebookHTML1.7k+48249+4
edatfreecodecamp/python-mathJupyter NotebookPython19501340
keerthanpg/TalkToCodeJupyter NotebookHTMLPython1620140
JDA-DM/mojxml2geojsonPythonDockerfileShell1980690