leopardslab/
CrawlerX - Develop Extensible, Distributed, Scalable Crawler System
USD raised
Recent activities
Cannot build docker - Failed to build Twisted
[GSoC 2021] Integrate Django Celery Beat to manage and schedule Crawler jobs
[Epic for GSoC 2021] Complete Improvements of CrawlerX web application
[GSoC 2021] Documentation the progress of the project
[GSoC 2021] Integrate user based data management module
[GSoC 2021] Data export module for CrawlerX projects
[GSoC 2021] Integrate Apache Airflow to manage Crawler jobs
[GSoC 2021] Enable tor web URL support for CrawlerX
[Epic for GSoC 2021] Complete CrawlerX Kubernetes Deployment with Helm
[GSoC 2021] Update Readme.md file with the progress
[GSoC 2021] K8s artifacts for apache Airflow server
[GSoC 2021] K8s artifacts for ElasticSearch server and dashboard
[GSoC 2021] K8s artifacts for MongoDB server
Feature: Add Kubernetes artifacts for the CrawlerX project
Feature: Add some new crawlers for popular web pages
Feature: Improve Schedule new Job popup view
© 2019 BoostIO, Inc.