zhuyingda/webster

a reliable high-level web crawling & scraping framework for Node.js.

JavaScriptHTMLnodejsjavascriptcrawlerspiderjavascript-frameworkcrawlingchromiumautomation-uinodejs-frameworkautomation-testheadless-chromescraping-frameworkpuppeteer
This is stars and forks stats for /zhuyingda/webster repository. As of 28 Apr, 2024 this repository has 464 stars and 59 forks.

Webster Overview Webster is a reliable web crawling and scraping framework written with Node.js, used to crawl websites and extract structured data from their pages. Which is different from other crawling framework is that Webster can scrape the content which rendered by browser client side javascript and ajax request Requirements Node.js 10.x+ Works on Linux, Mac OSX Or you can deploy on Docker. Install npm install webster Single spider example const { spider } = require('webster'); class MySpider...
Read on GithubGithub Stats Page
repotechsstarsweeklyforksweekly
remy/nodemonJavaScriptHTMLjq25.6k+281.7k+4
souravkl11/raganork-mdJavaScriptDockerfile47305.7k0
rjsf-team/react-jsonschema-formTypeScriptJavaScriptMDX13.1k02.1k0
piratekevin1129/ips-sitioCSSHTMLJavaScript0000
ARF-SS13/coyote-bayouDMJavaScriptHTML90117+3
joinum/parzivalElixirHTMLShell10040
greycodee/wechat-backupGoDockerfilePython2.6k+90262+9
Akshay-Arjun/69phisherHackHTMLCSS1670320
digital-asset/ex-bond-issuanceHaskellTypeScriptJavaScript20070
digital-asset/ex-mortgage-repackagingHaskellJavaScript10030