Home

robots PHP packages

129 PHP Packages found for robots | Latest robots packages | RSS

webignition/robots-txt-file

Models a robots.txt file

  • 3637
  • 8
  • 42
  • 13
  • 3

webignition/robots-txt-parser

Parser for robots.txt files

  • 4542
  • 1
  • 6
  • 8
  • 1

vinicius73/seotools

A package containing SEO helpers.

  • 4658
  • 0
  • 1
  • 25
  • 8

tractorcow/silverstripe-robots

Simple robots generation module for Silverstripe

  • 4964
  • 2
  • 7
  • 9
  • 4

calotype/seo

A package containing SEO helpers.

  • 4975
  • 0
  • 1
  • 65
  • 30

cuab/phpcrawl

PHPCrawl is a webcrawler/webspider-library written in PHP. It supports filters, limiters, cookie-handling, robots.txt-handling, multiprocessing and much more.

  • 6667
  • 2
  • 8
  • 20
  • 9

tomverran/robots-txt-checker

Given a robots.txt file, user agent and URL path will tell you whether you're allowed to access a page

  • 6721
  • 3
  • 4
  • 10
  • 2

healey/robots

Robots.txt Generator for Laravel 4 and 5

  • 9058
  • 1
  • 34
  • 38
  • 12

t1gor/robots-txt-parser

PHP class to parse robots.txt rules according to Google, Yandex, W3C and The Web Robots Pages specifications.

  • 9694
  • 9
  • 52
  • 77
  • 29

mmerian/phpcrawl

PHPCrawl is a webcrawler/webspider-library written in PHP. It supports filters, limiters, cookie-handling, robots.txt-handling, multiprocessing and much more.

  • 9930
  • 0
  • 3
  • 55
  • 28

spatie/laravel-robots-middleware

Add an `all` or `none` robots header to your requests via a middleware in Laravel

  • 12351
  • 3
  • 123
  • 227
  • 24

mgargano/non-production-robots-ignore

Non Production Robots Ignore is a simple WordPress plugin that is used with vlucas/phpdotenv (or similar) that sets environment variables to set robots.txt to ignore all on all environments except production.

  • 12378
  • 1
  • 1
  • 2
  • 0

novactive/ezseobundle

Novactive eZ SEO Bundle is an eZ Platform bundle for SEO simplications. metas, sitemaps, robots.txt, etc.

  • 13253
  • 7
  • 36
  • 24
  • 49

league/stack-robots

StackRobots Middleware for StackPHP

  • 13880
  • 1
  • 2
  • 67
  • 6

phantazm/robotdetector

Detect robots and crawlers.

  • 16911
  • 0
  • 1
  • 5
  • 5

ricbra/robots-txt-bundle

Simple Symfony2 which generates robots.txt based on config setting

  • 18132
  • 0
  • 3
  • 3
  • 0

bee4/robots.txt

Robots.txt parser and matcher

  • 19160
  • 1
  • 2
  • 12
  • 1

evheniy/robots-txt-bundle

The RobotsTxtBundle adds the ability to generate robots.txt file to your application.

  • 20305
  • 0
  • 6
  • 5
  • 0

execut/yii2-robots-txt

Module for generate robots.txt file by url rules

  • 20679
  • 1
  • 3
  • 5
  • 4

php-middleware/block-robots

PSR-15 middleware to avoid search engine indexing with PSR-7

  • 20692
  • 0
  • 16
  • 4
  • 0

fourlabs/robots-bundle

Symfony2 bundle to control X-Robots-Tag HTTP header via annotations

  • 20966
  • 0
  • 3
  • 1
  • 0

vipnytt/sitemapparser

XML Sitemap parser class compliant with the Sitemaps.org protocol.

  • 22312
  • 4
  • 50
  • 35
  • 13

anomaly/robots-extension

A simple robots.txt generator.

  • 23491
  • 3
  • 22
  • 0
  • 3

vipnytt/robotstxtparser

Robots.txt parsing library, with full support for every directive and specification.

  • 23603
  • 3
  • 50
  • 15
  • 4

glicer/link-checker

Check broken links in html files, sitemap.xml and robots.txt

  • 24069
  • 0
  • 2
  • 23
  • 8

Built with Laravel by psampaz, powered by DigitalOcean