Skip to content
@crwlrsoft

crwlr.software

PHP Packages for Rapid Crawler and Scraper Development
README.md

crwlr.software logo

crwlr.software - PHP Packages for Rapid Crawler and Scraper Development

crwlr.software is a collection of open source PHP composer packages that provide the necessary tools for web crawling and scraping tasks. The crawler package contains everything and helps you build crawlers as fast as possible. And there are also parts of it that you can use standalone.

Popular repositories Loading

  1. crawler crawler Public

    Library for Rapid (Web) Crawler and Scraper Development

    PHP 371 14

  2. url url Public

    Swiss Army knife for urls.

    PHP 109 5

  3. query-string query-string Public

    A library for convenient handling of query strings used in HTTP requests.

    PHP 20 3

  4. schema-org schema-org Public

    Extract schema.org objects from HTML documents

    PHP 15 2

  5. robots-txt robots-txt Public

    Robots Exclusion Standard/Protocol Parser for Web Crawling/Scraping

    PHP 10 2

  6. laravel-crawler laravel-crawler Public

    Laravel adapter for the crwlr/crawler package.

    PHP 4

Repositories

Showing 10 of 14 repositories
  • crawler Public

    Library for Rapid (Web) Crawler and Scraper Development

    crwlrsoft/crawler's past year of commit activity
    PHP 371 MIT 14 1 2 Updated May 3, 2026
  • schema-org Public

    Extract schema.org objects from HTML documents

    crwlrsoft/schema-org's past year of commit activity
    PHP 15 MIT 2 0 0 Updated May 2, 2026
  • utils Public

    Utilities that are needed in multiple crwler packages.

    crwlrsoft/utils's past year of commit activity
    PHP 2 MIT 1 0 0 Updated Jan 6, 2026
  • crwl-extension-utils Public

    Utils for extension packages for the crwl.io app.

    crwlrsoft/crwl-extension-utils's past year of commit activity
    PHP 0 0 0 0 Updated Jan 6, 2026
  • html-2-text Public

    Convert HTML to formatted plain text.

    crwlrsoft/html-2-text's past year of commit activity
    PHP 3 MIT 0 0 0 Updated Jan 6, 2026
  • crawler-ext-browser Public

    Extension for the crwlr/crawler package containing steps utilizing a headless browser.

    crwlrsoft/crawler-ext-browser's past year of commit activity
    PHP 0 MIT 0 0 0 Updated Jan 6, 2026
  • robots-txt Public

    Robots Exclusion Standard/Protocol Parser for Web Crawling/Scraping

    crwlrsoft/robots-txt's past year of commit activity
    PHP 10 MIT 2 0 0 Updated Jan 6, 2026
  • query-string Public

    A library for convenient handling of query strings used in HTTP requests.

    crwlrsoft/query-string's past year of commit activity
    PHP 20 MIT 3 0 0 Updated Jan 6, 2026
  • url Public

    Swiss Army knife for urls.

    crwlrsoft/url's past year of commit activity
    PHP 109 MIT 5 1 0 Updated Jan 6, 2026
  • package-template Public template

    Template repository for new crwlr packages

    crwlrsoft/package-template's past year of commit activity
    PHP 1 MIT 0 0 0 Updated Nov 21, 2025
View all repositories

Top languages

Loading…

Most used topics

Loading…