website-scraper/

node-website-scraper

Download website to local directory (including all css, images, js, etc.)

Owners:

$0.00

USD raised

Recent activities

aivus added the repository

about 3 years ago

aivus added the repository

about 3 years ago

Issues

Funded Unfunded Rewarded Closed

Issue with // URLs

Unfunded#440created byap1969

$0.00

Ignore data:image URLs

Unfunded#429created bynikolay-borzov

$0.00

Cookies are not working

Unfunded#446created byabd-falyoun

$0.00

`request` is deprecated

Unfunded#401created byRichienb

$0.00

where to find puppeteer

Unfunded#452created byCodeStudent09

$0.00

High NPM Vulnerability

Unfunded#453created byearlvhin

$0.00

Non-English characters are not converted correctly

Unfunded#454created bytverona1

$0.00

Saving Popup content

Unfunded#455created byGermminate

$0.00

How to get request.uri from each download file

Unfunded#456created bythe-prodigy

$0.00

urlFilter terminates recursive scraping

Unfunded#460created byjkanel

$0.00

Scrape files with exact same names when they include french characters

Unfunded#466created byLucasDemea

$0.00

single vs double quotes: keep original

Unfunded#355created byfancydev18

$0.00

Error thrown by the request module stop the process, even if ignoreErrors was set to true

Unfunded#415created bymax-hk

$0.00

Add retries for failed requests

Unfunded#412created bytverona1

$0.00

Pass options to Cheerio?

Unfunded#484created bygmhenderson

$0.00

Crawling rate limit or requeue?

Unfunded#485created byabale

$0.00

[not serious] Unsure of how to use urlFilter

Unfunded#487created byxsCalamity

$0.00

Unfunded#489created byChristian-Martinez1

$0.00

Default non-downloaded paths to alternate url

Unfunded#490created byChristopherJohnson25

$0.00

TypeError: text.replace is not a function

Unfunded#493created byChristopherJohnson25

$0.00

Replace remote image assets with downloaded one

Unfunded#494created byjeepers3327

$0.00

Website-scraper on Windows 11 throws error while scraping an academic archive site.

Unfunded#498created byrrgerber

$0.00

French characters "à" are not converted correctly

Unfunded#500created byJeremytijal

$0.00

Unfunded#505created byrainb3rry

$0.00

How do I change the style file name?

Unfunded#507created byenotmen

$0.00

Remove plugins export

Unfunded#510created bys0ph1e

$0.00

Running `website-scraper` Without a `package.json` in the Working Directory Triggers Error

Unfunded#512created bymanuth

$0.00

lazy load images are not downloading

Unfunded#518created bychaybcr

$0.00

Incorrect source code for dynamic javascript src

Unfunded#530created bydiegomachado1

$0.00

Adding Plugin stops recursion

Unfunded#533created bynigel-daniels

$0.00

throw new Error(`Directory ${absoluteDirectoryPath} exists`);

Unfunded#537created byobsidianart

$0.00

Recent activities

aivus added the repository

about 3 years ago

aivus added the repository

about 3 years ago

Company

Community

Support

FAQ Terms of use Privacy policy Code of conduct Credits

Connect

Facebook Twitter

© 2019 BoostIO, Inc.