Skip to content
@apify

Apify

Let's put the web to work.
README.md

Apify Banner

Apify is the largest ecosystem where developers build, deploy, and publish data extraction and web automation tools. We call them Actors.

discord X/Twitter youtube linkedin

Learn About Apify 🧑‍🎓

  • Find hundreds of ready-made Actors for your web scraping or automation project on Apify Store.
  • Learn everything about web scraping and automation with our free courses that will turn you into an expert scraping developer.
  • Publish your web scrapers as paid Actors on the Apify platform, attract people who need these solutions, and get regular passive income.
  • View our livestreams and video content at the Apify YouTube channel.
  • Learn more through tutorials and thought leadership content about web scraping on Apify Blog and Crawlee Blog.

We are hiring! 🕸️

Check out the open positions at Apify and help us make the web more programmable.

Pinned Loading

  1. crawlee crawlee Public

    Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, an…

    TypeScript 22.4k 1.3k

  2. impit impit Public

    impit | rust library for browser impersonation

    Rust 403 32

  3. crawlee-python crawlee-python Public

    Crawlee—A web scraping and browser automation library for Python to build reliable crawlers. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Wo…

    Python 8.6k 697

  4. apify-mcp-server apify-mcp-server Public

    The Apify MCP server enables your AI agents to extract data from social media, search engines, maps, e-commerce sites, or any other website using thousands of ready-made scrapers, crawlers, and aut…

    TypeScript 925 125

  5. mcp-cli mcp-cli Public

    mcpc is a CLI client for MCP. It supports persistent sessions, stdio/HTTP, OAuth 2.1, JSON output for code mode, proxy for AI sandboxes, and much more.

    TypeScript 394 29

  6. proxy-chain proxy-chain Public

    Node.js implementation of a proxy server (think Squid) with support for SSL, HTTP/HTTPS, SOCKS5, authentication, and upstream proxy chaining.

    JavaScript 984 165

Repositories

Showing 10 of 211 repositories
  • apify-client-python Public

    Apify API client for Python

    apify/apify-client-python’s past year of commit activity
    Python 89 Apache-2.0 16 11 7 Updated Mar 20, 2026
  • apify-sdk-python Public

    The Apify SDK for Python is the official library for creating Apify Actors in Python. It provides useful features like actor lifecycle management, local storage emulation, and actor event handling.

    apify/apify-sdk-python’s past year of commit activity
    Python 163 Apache-2.0 22 18 3 Updated Mar 20, 2026
  • apify-cli Public

    Apify command-line interface helps you create, develop, build and run Apify Actors, and manage the Apify cloud platform.

    apify/apify-cli’s past year of commit activity
    TypeScript 182 Apache-2.0 42 48 (1 issue needs help) 2 Updated Mar 20, 2026
  • crawlee-python Public

    Crawlee—A web scraping and browser automation library for Python to build reliable crawlers. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Parsel, BeautifulSoup, Playwright, and raw HTTP. Both headful and headless mode. With proxy rotation.

    apify/crawlee-python’s past year of commit activity
    Python 8,646 Apache-2.0 697 79 8 Updated Mar 20, 2026
  • crawlee Public

    Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.

    apify/crawlee’s past year of commit activity
    TypeScript 22,428 Apache-2.0 1,274 140 (1 issue needs help) 37 Updated Mar 20, 2026
  • apify-actor-docker Public

    Base Docker images for Apify actors.

    apify/apify-actor-docker’s past year of commit activity
    Dockerfile 91 Apache-2.0 31 6 2 Updated Mar 19, 2026
  • agent-skills Public

    Collection of Apify Agent Skills

    apify/agent-skills’s past year of commit activity
    JavaScript 1,691 179 1 6 Updated Mar 19, 2026
  • mcp-cli Public

    mcpc is a CLI client for MCP. It supports persistent sessions, stdio/HTTP, OAuth 2.1, JSON output for code mode, proxy for AI sandboxes, and much more.

    apify/mcp-cli’s past year of commit activity
    TypeScript 394 Apache-2.0 29 2 8 Updated Mar 19, 2026
  • actor-vector-database-integrations Public

    Transfer data from Apify Actors to vector databases (Chroma, Milvus, Pinecone, PostgreSQL (PG-Vector), Qdrant, and Weaviate)

    apify/actor-vector-database-integrations’s past year of commit activity
    Python 9 Apache-2.0 7 1 0 Updated Mar 19, 2026
  • actor-templates Public

    This project is the 🏠 home of Apify Actor templates to help users quickly get started. Contributions welcome!

    apify/actor-templates’s past year of commit activity
    Python 48 32 17 8 Updated Mar 19, 2026
View all repositories