maxcountryman/warc-parquet

This is stars and forks stats for /maxcountryman/warc-parquet repository. As of 11 May, 2024 this repository has 95 stars and 0 forks.

warc-parquet 🗄️ A utility for converting WARC to Parquet. 📦 Install The binary may be installed via cargo: $ cargo install warc-parquet To use the crate in your project, add the following to your Cargo.toml file: [dependencies] warc-parquet = "0.6.1" 🤸 Usage The Binary Once installed, the warc-parquet utility can be used to transform WARC into Parquet: $ wget --warc-file example 'https://example.com' $ cat example.warc.gz | warc-parquet --gzipped...