📄 skillActivePromisingmedium
apify/crawlee
by apify
Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
Supported Platforms
🤖 Claude Code
Quality Breakdown
90/ 200
Content Signals
Repo Health
Multi-platform bonus: +5 pts if tool supports 2+ platforms. Score derived from 12 structural signals — not stars or popularity.
Trust & Verification
medium
Requires extended permissions (shell access, subagents). Review before use.
Active
Updated within the last 90 days. Actively maintained.
Risk Assessment
- Repository contains `.claude/CLAUDE.md` file which suggests persistent Claude configuration that could be modified to alter AI behavior
- GitHub workflows include CI/CD pipelines (publish-to-npm.yml, release.yml) that execute automated deployment scripts
- Web scraping and browser automation library could potentially be misused for malicious purposes (unauthorized data collection, bot attacks)
- Contains Docker-related deployment guidance which involves container execution
- Husky pre-commit hooks are configured which can execute scripts on developer machines