Package

Scrape-LE

Analyse robots.txt content and report whether a path may be crawled.

io.github.nolindnaidoo/scrape-leSource repository
Version2.6.0latest catalog version
ConnectionPackagenpm
PublishedOct 27, 2026catalog
UpdatedOct 27, 2026catalog
Overview

What this server provides

Analyse robots.txt content and report whether a path may be crawled.

Install

Packages

1
Package 1npm
scrape-le-mcp2.6.0
View server metadata