Open-Source-Web-Scraping-Tools, installiert und ausgeführt

Klonen Sie jede Website mit einem Befehl mithilfe von AI coding agents

Was der Test ergab: Next.js 16.3.0 project builds, typechecks, and serves HTTP 200 on the root route via npm run dev. 4 Minuten.

Elegantes Scraper- und Crawler-Framework für Golang

Was der Test ergab: The Colly module builds, vets, passes its full unit and race test suites, its CLI prints help, and its scraper successfully crawled a local mock site end to end. 14 Minuten.

Ein Crawling- und Spidering-Framework der nächsten Generation.

Was der Test ergab: katana v1.7.0 is installed, resolves from a fresh login shell, crawls HTTP sites in standard and headless modes, and its unit, functional, and integration suites pass. 7 Minuten.

Dokumentationswebsites, GitHub-Repositorys und PDFs in Claude-AI-Skills konvertieren, mit automatischer Konflikterkennung

Was der Test ergab: skill-seekers 3.10.0.dev0 installed and all 3857 unit/adaptor/scraper tests pass without external API keys or network dependencies. 6 Minuten.

newspaper3k ist eine Extraktion von Nachrichten, Volltexten und Artikelmetadaten in Python 3. Erweiterte Dokumentation:

Was der Test ergab: newspaper3k 0.3.0 installs in a virtualenv on Python 3.12, all 40 unit tests pass, and core Article download/parse/nlp pipeline produces correct output from static HTML. 4 Minuten.

Browser-Automatisierung und Tests ohne Grenzen. Der CDP-Modus von SeleniumBase umgeht Bot-Erkennung mühelos. Schauen Sie sich die Beispiele an!

Was der Test ergab: SeleniumBase 4.54.7 is installed in a Python 3.12 venv; 8 framework unit tests, 7 offline HTML tests, and 2 real web tests passed using headless Chrome 154. 5 Minuten.

Verteilte Webcrawler-Admin-Plattform zur Verwaltung von Spiders, unabhängig von Sprachen und Frameworks.

Was der Test ergab: Crawlab v0.6.3 backend compiles, starts as master node, connects to MongoDB, and serves its REST API on port 8000 (system-info, login, nodes, spiders, tasks, users, stats endpoints confirmed reachable). 67 Minuten.

Ein skalierbares Webcrawler-Framework für Java.

Was der Test ergab: The webmagic project compiles and passes all 108 tests with JDK 22 and Maven 3.9.9. Tests exercise real HTTP downloads from github.com (e.g. GithubRepoPageProcessorTest downloads and processes 1 page), SSL compatibility checks, XPath/CSS/regex selectors, file pipeline, proxy providers, duplicate-removal scheduling... 13 Minuten.

Crawlee ist eine Web-Scraping- und Browser-Automation-Bibliothek für Python, um zuverlässige Crawler zu erstellen. Extrahieren Sie Daten für AI, LLMs, RAG oder...

Was der Test ergab: Dependencies installed with uv sync --all-extras, Playwright browsers (chromium + firefox) downloaded, all 2480 unit tests pass, lint and type-check pass, and the package builds and imports successfully at version 1.10.3. 8 Minuten.

Leichtere Webautomatisierung mit Python

Was der Test ergab: Helium 7.0.3 installed from source via pip install -e . Selenium 4.49.0 with Chrome 154 headless via Selenium Manager; all 332 tests pass with 2 regressions fixed (date input JS fallback, subprocess module discovery). 33 Minuten.

Python API für JMComic | Bietet Python-API-Zugriff auf 禁漫天堂 und unterstützt Web und Mobile | 禁漫天堂 GitHub Actions Downloader

Was der Test ergab: Package jmcomic 2.7.7 installed in a Python 3.12.3 venv with all dependencies; 238/240 tests pass including real network calls against JMComic API servers; CLI commands jmcomic and jmv produce correct help output. 10 Minuten.

Python- und Befehlszeilen-Tool zum Sammeln von Text und Metadaten im Web: Crawling, Scraping, Extraktion, Ausgabe als CSV, JSON, HTML, MD, TXT, XML.

Was der Test ergab: Trafilatura 2.2.0 is installed in editable mode in a .venv, all 428 tests pass, and both CLI and Python extraction work correctly on sample HTML input. 6 Minuten.

Python-Binding für den curl-impersonate-Fork über cffi. Ein HTTP-Client, der Browser-TLS/ja3/http2-Fingerprints imitieren kann.

Was der Test ergab: After installing the pre-built curl-cffi wheel (v0.16.3) into a fresh venv, the library imports, the CLI runs (curl-cffi get, doctor, --help), real HTTP requests with browser impersonation return 200, and the unit test suite passes 600+ tests across all 20 test modules including sync/async HTTP, websockets... 38 Minuten.

Deklarative Datenautomatisierungssprache und Go-Laufzeitumgebung für strukturierte Extraktions-Workflows.

Was der Test ergab: Go 1.27.1 installed, all dependencies resolved, all 68 test packages pass with race detection, CLI binary compiles and runs FQL queries end-to-end. 7 Minuten.

Redis-basierte Komponenten für Scrapy.

Was der Test ergab: scrapy-redis 0.9.1 is installed in a venv at /work/repo/.venv with real Redis 6.2 running on localhost:6379; all 102 tests pass covering connection pooling, dupefilter, queue (FIFO/LIFO/priority), scheduler, spider setup, idle backoff, multi-key consumption, and utility modules. 9 Minuten.

Ein Node.js Scraper für Menschen.

Was der Test ergab: scrape-it installs, builds, and passes its full test suite on Node 18.19.1 with cheerio pinned to 1.0.0. 3 Minuten.

Jede Website stellt APIs bereit.

Was der Test ergab: toapi 2.2.4 installed from source, all 7 tests pass, CLI help works, Flask server answers 200 with JSON, version 2.2.4 confirmed. 2 Minuten.

Stealth-Browser-Automation für AI-Agenten über MCP und das Chrome DevTools Protocol: Navigation, Netzwerk-Hooks, DOM-Extraktion und pixelgenaues UI-Klonen.

Was der Test ergab: Stealth Browser MCP server runs on stdio transport, spawns a headless Chromium 157.0.8086.0, navigates to data URLs, extracts page HTML content, and closes cleanly -- all via MCP protocol over stdio. 15 Minuten.

PHP Curl Class macht es einfach, HTTP-Anfragen zu senden und sich in Web-APIs zu integrieren.

Was der Test ergab: php-curl-class repository is fully installed with PHP 8.5.8 static binary and all Composer dependencies; the full test suite passes with 264 tests and 23390 assertions and zero failures. 43 Minuten.

Node.js-Scraper zum Abrufen von Daten von Google Play

Was der Test ergab: The google-play-scraper npm package installs, all 84 tests pass against live Google Play, and the library's app/list/search/suggest/developer/reviews/similar/permissions/datasafety/categories methods all fetch and parse real data correctly. 8 Minuten.

owllook-Roman-Suchmaschine

Was der Test ergab: The owllook web server launches on port 8001 and responds with 200 HTTP status on /, /novels/search, /novels/top, /api/search, and /health routes, with real HTML content, connecting to running Redis and MongoDB instances. The existing pytest test suite passes (1 passed, 0 failed). 15 Minuten.

https://spatie.be/docs/crawler

Was der Test ergab: PHP 8.4.23 and Composer 2.7.1 installed from static binaries, all dependencies resolved via `composer update --prefer-stable`, and the full test suite passes (229/229) including both fake-HTTP unit tests and real-HTTP integration tests against a local PHP server. 6 Minuten.

Grundlegendes Sammeln von Webdaten mit niedriger Latenz in Rust

Was der Test ergab: Rust 1.99.0 installed, cargo build succeeds, spider CLI binary crawls and scrapes example.com returning status 200 and expected page content, all 608 spider core tests pass, workspace-wide crate tests all pass. 56 Minuten.

Geziyor, ein blitzschnelles Web-Crawling- und Scraping-Framework für Go. Unterstützt JS-Rendering.

Was der Test ergab: The Geziyor web scraping framework builds and passes every test across all 7 packages, and a compiled demo successfully scraped a live website. 16 Minuten.

Einfach zu bedienender, leichter Webcrawler（易用的轻量化网络爬虫）

Was der Test ergab: Build succeeded (mvn compile, package, test-compile all exit 0); demo crawler successfully fetched and parsed https://www.baidu.com/, producing JSON output. 5 Minuten.

CrawlerDetect ist eine PHP-Klasse zur Erkennung von Bots/Crawlern/Spidern via den User-Agent.

Was der Test ergab: The CrawlerDetect PHP library installs, builds, and passes its full test suite of 28 tests with 170,886 assertions on PHP 8.0.30. 5 Minuten.

Website Cloner - Nutzt leistungsstarke Go Routinen, um Websites innerhalb von Sekunden auf Ihren Computer zu klonen.

Was der Test ergab: goclone binary builds from source, all 9 test suites across 3 packages pass, the built binary's help and version commands print correct output. 11 Minuten.

Web-Crawling-Framework basiert auf asyncio.

Was der Test ergab: All 7 tests pass, ruff lint passes, library imports correctly, and item attribute extraction from HTML produces expected results. 1 Minute.

Flexible Node.js-Crawler-Bibliothek

Was der Test ergab: x-crawl library builds successfully; its crawlData, crawlHTML, async/sync modes, baseUrl, timeout, errorCollect, proxy rotation, and Puppeteer browser APIs work correctly against a real HTTP server and CONNECT proxy. 34 Minuten.

Asynchrones Web-Scraping-Micro-Framework für Python 3.6+ basierend auf asyncio

Was der Test ergab: Ruia 0.8.5 is installed in a Python 3.12 venv with uvloop; pip install -e .[uvloop] succeeds; 66 of 67 tests pass including all field extraction, item parsing, middleware, request fetching, and spider orchestration tests against live httpbin.org and news.ycombinator.com. 22 Minuten.

Python-Anbindung an die Modest- und Lexbor-Engines. Schneller HTML5-Parser mit CSS-Selektoren für Python.

Was der Test ergab: selectolax C extension successfully built, installed in a venv, all 279 tests passing, and basic HTML parsing + CSS selector usage verified. 4 Minuten.

Unerkannte Python-Version der Playwright-Test- und Automatisierungsbibliothek.

Was der Test ergab: Patchright 1.63.0 is installed, Chromium browser is downloaded and launchable, the CLI reports its version, and 2237 of 2239 Chromium tests pass (sync + async). 37 Minuten.

Ein ergonomischer, datenschutzbewusster Python-HTTP-Client

Was der Test ergab: wreq Python package builds, installs, and passes all 57 unit tests against a local httpbin server, supporting HTTP/1.1 and HTTP/2 requests, cookie jars, redirect policies, TLS emulation (JA3/JA4), multipart uploads, streaming, and compression. 15 Minuten.

Leichter Ruby-Webcrawler/-Scraper mit einer eleganten DSL, der strukturierte Daten aus Seiten extrahiert.

Was der Test ergab: Wombat 3.3.0 builds and installs as a gem under Ruby 3.2.3, all 56 RSpec tests pass, and a live Wombat.crawl scrape of a local WEBrick page returns correctly parsed structured data. 12 Minuten.

Beanbun ist ein in PHP geschriebenes, auf Workerman basierendes Multi-Prozess-Webcrawler-Framework mit guter Offenheit und hoher Erweiterbarkeit.

Was der Test ergab: Beanbun 1.0.4 with vendored workerman and guzzle dependencies. PHP 8.3.6 extracted from apt. All source and vendor files parse without errors. Framework class instantiation, configuration, and all Helper methods (randUserAgent, formatUrl, getUrlByHtml) verified working. 16 Minuten.

Newspaper4k ein Fork des beliebten Newspaper3k. Extraktion von Artikeln, Titeln und Metadaten aus Nachrichten-Websites.

Was der Test ergab: newspaper4k 0.9.6 is pip-installed and editable in /work/repo/venv; CLI runs (help + real article extraction into JSON), 234 tests pass with 2 deselected stale summarization fixtures and 5 external-site failures; package state is clean working tree. 38 Minuten.

Ein skalierbarer, ausgereifter und vielseitiger Webcrawler basierend auf Apache Storm

Was der Test ergab: Apache StormCrawler 4.0.0-SNAPSHOT builds from source (mvn clean install) and its full test suite passes 983 tests with zero errors and zero failures on Java 26 Temurin with Maven 3.10.0. 15 Minuten.

SiteOne Crawler ist ein plattformübergreifender Website-Crawler und -Analyzer für SEO, Sicherheit, Barrierefreiheit und Leistungsoptimierung: ideal für...

Was der Test ergab: siteone-crawler 2.7.0.20260925-dev builds cleanly with cargo build --release, its offline test suite passes with 1673 passed and 0 failed, and the binary crawls a local HTTP server end to end returning HTTP 200 for both pages and generating an HTML report. 16 Minuten.

Universeller Inhaltsleser-MCP-Server für 10+ Plattformen

Was der Test ergab: x-reader installs in a fresh venv, all 10 tests pass, the CLI fetches real tweets/RSS/web content into the inbox, and the MCP server serves working stdio and SSE transports. 10 Minuten.

Hochleistungsfähige asynchrone Douyin(抖音), TikTok, Xiaohongshu(小红书), Kuaishou(快手), Weibo(微博), Instagram, YouTube(油管), Twitter(X), Captcha Solver(验证码解决器), Temp...

Was der Test ergab: SDK installs, all 110 tests pass, CLI prints version and help, type-check and lint are clean, and spec coverage confirms 1010/1010 endpoints are implemented. 1 Minute.

Ein Multithread-Crawler-Framework mit vielen integrierten Bild-Crawlern.

Was der Test ergab: icrawler installs in a virtualenv, all 5 built-in crawler tests pass against live services (Google, Bing, Baidu, BBC, Pinterest), and downloaded images are valid media files verifiable by Pillow. 21 Minuten.

HTTP-API für Scrapy-Webcrawler

Was der Test ergab: scrapyrt 0.18.1 is installed in a Python 3.12 venv with all dependencies. All 126 tests pass (including real end-to-end crawl tests with Flask site, Twisted reactor, and scrapyrt HTTP server). The CLI command scrapyrt --help prints usage correctly. 5 Minuten.

Open-Source-SEO-Audit-Tool.

Was der Test ergab: SEOnaut installed from source (Go build OK, frontend CSS built, migrations applied to a local MariaDB) and ran on port 9000, serving sign-in (200), creating a user and project, completing a real crawl of 2 URLs, and rendering the dashboard. 9 Minuten.

KI-gestützter Web-Scraping-Editor mit visuellem Workflow-Builder. Erstellen, testen und bereitstellen Sie Web-Scraper mit natürlicher Sprache. Angetrieben von...

Was der Test ergab: ScrapeCraft backend serves all API endpoints on uvicorn, WebSocket connections establish and respond, frontend builds successfully, chat uses real OpenRouter API key, JWT auth works, pipeline CRUD works, scraping endpoints respond. 14 Minuten.

NetDiscovery ist ein allgemeines Crawler-Framework/Middleware, das auf Frameworks wie Vert.x, RxJava 2 und anderen basiert.

Was der Test ergab: The full multi-module Gradle build passes (BUILD SUCCESSFUL, 63 tasks), and the NetDiscovery spider engine example ran as a Java process answering HTTP 200 with JSON on port 8715 routes /netdiscovery/health/, /netdiscovery/spiders/, /netdiscovery/spider/tony1/detail, and /netdiscovery/metrics/, while the downloader... 69 Minuten.

Daten des Benutzers über soziale Medien abrufen

Was der Test ergab: 8/8 tests pass; GitHub and Pinterest CLI scrapers fetch real profile data; the 6 remaining scrapers return None gracefully given no browser binary or API access. 16 Minuten.

FreeProxy: Sammeln von kostenlosen Proxys aus dem Internet. (Weltweit massenhaft hochwertige kostenlose Proxys, unterstützt das Crawlen von Dutzenden...

Was der Test ergab: pyfreeproxy v0.5.2 installed in /tmp/venv, all 48 proxy sources registered, Proxifly/ProxyScrape/Geonode scrape real proxies successfully, filter rules and ProxiedSessionClient work, JSON export round-trips correctly, free proxies collected but actual proxy requests time out as expected from this container network. 3 Minuten.

Unentdecktes Web-Scraping und nahtloses HTML-Parsing in Python!

Was der Test ergab: stealth-requests 2.1.0 installed in a fresh venv, all 64 tests pass, and real requests to httpbin.org succeed with proper Chrome impersonation headers. 1 Minute.

Open-Source-Webinfrastruktur für KI. Scrapen, crawlen und automatisieren Sie das Web, bereinigen Sie Markdown, Browser-Sitzungen, bereit für Ihre Agenten.

Was der Test ergab: Reader CLI builds, all 346 unit tests pass, the daemon starts with Playwright's bundled Chromium, and an end-to-end scrape of https://example.com via HTTP returns clean HTML and markdown content with a 200 status. 13 Minuten.

Verwandeln Sie jede Website in ein kompaktes CLI, das für KI-Agenten maßgeschneidert ist. Durchsuchen Sie das Web mit Hunderten von Tokens, nicht mit...

Was der Test ergab: only-cli v0.5.8 installs and runs on Node 20.11.1; 263 of 264 tests pass; the CLI fetches, distills, and renders public web pages with token-budgeted output and actionable numbered links. 3 Minuten.

Ein sehr einfacher Nachrichten-Crawler mit einem lustigen Namen.

Was der Test ergab: Fundus 0.5.7 installs cleanly in a venv, all 1131 unit tests pass, and the crawler successfully fetches live article data from The New Yorker via HTTP. 3 Minuten.

Selbst gehostetes Multikanal-Flugpreis-Monitoring: Erfassung von Flugdetails → Bild-und-Text-Push über DingTalk → vierstufige starke Warnung bei Erreichen des...

Was der Test ergab: All dependencies installed in venv, Playwright chromium installed, test suite runs 3712 tests all passing, web UI demo server starts and responds with HTTP 200 on its state API endpoint, main.py --version reports 1.5.303. 44 Minuten.

Anti-Erkennungs-Browser-Server für KI-Agenten: REST API, die die Camoufox-Engine mit OpenClaw-Plugin-Unterstützung kapselt.

Was der Test ergab: Camofox Browser Server builds, starts on port 9998, creates browser contexts via Camoufox Firefox headless, navigates to https://example.com, returns accessibility snapshots, and passes the 677-test full suite with Node.js 20 and rebuilt native addons. 34 Minuten.

Eine Crawl-Workstation: Anzeigen, Steuern und Crawlen. Solr CrawlDB, Tika, Vue 3.

Was der Test ergab: Sparkler is installed with Python 3.12, Solr 10.0.0 on port 8983, Vue UI built and served on port 8180, APIs responding, all 32 unit tests passing. 7 Minuten.

Für Superindividuen und Ein-Personen-Unternehmen eine persönliche Großfabrik schaffen: Hydra九头龙 baut eine 'militärische' Industriebasis für groß angelegte...

Was der Test ergab: After fixing module-name casing, pinning Lombok 1.18.34, and adding the missing System.Subsystem config block, the Maven build succeeds and the ShadowBoot crawler app boots and runs the README's Void minimum-system demo to completion (exit 0, 'Pinecone Runtime : 136 /ms !'), while the full test suite passes with 48... 9 Minuten.

Python-CLI für Google Trends Analyse mit erweitertem Rate Limiting, Cookie-Authentifizierung und schöner Terminalausgabe. Basierend auf pytrends mit...

Was der Test ergab: trends-checker installs and runs, hitting the real Google Trends API via pytrends (with urllib3 compat patch applied to pytrends request.py), returning real interest data verified at score 42.83 for 'AI agents' in US. 5 Minuten.

Agent-Skill für die Vollerhebung koreanischer staatlicher Förderprogramme [Unterstützt Claude Code·Codex·agy(Antigravity)·Cursor·Gemini CLI·Grok Build]...

Was der Test ergab: The project's 229 pytest tests pass, and every CLI crawler (K-Startup, bizinfo, NIPA, KOCCA, SMTECH list and detail, scope_plan, diff_surveys) ran successfully against live Korean government sites, producing real announcement records and detail text. 4 Minuten.

Bibliothek für schnelle (Web-)Crawler- und Scraper-Entwicklung

Was der Test ergab: 1278 of 1278 default unit tests pass, PHP 8.3.32 and Composer installed, Chrome for Testing available, integration server fixed with short_open_tag=Off and 500ms startup delay. 27 Minuten.

Zyte Smart Proxy Manager (ehemals Crawlera) Middleware für Scrapy

Was der Test ergab: scrapy-zyte-smartproxy v2.4.1 installed in a Python 3.12 venv; all 82 existing unit tests pass with zero failures. 1 Minute.

Ein extrem schneller Web Scraper, der Megabytes ungültigen HTMLs im Nu parst. PHP5.3+, keine Abhängigkeiten.

Was der Test ergab: hQuery.php library installs, autoloads, and parses HTML via fromHTML() and find()/text() selectors; all 27 unit tests pass on PHP 8.4.1 via FrankenPHP static binary. 7 Minuten.

Holen Sie Aliexpress-Produktdetails als JSON-Antwort ab, einschließlich Feedbacks, Varianten, Versandinformationen, Beschreibung, Bilder usw.

Was der Test ergab: Node 24.0.0 installed, pnpm installed, Chromium 145 downloaded, all 22 tests pass, ESLint clean. 1 Minute.

Ein Laravel-Wrapper für CrawlerDetect - die Web-Crawler-Erkennungsbibliothek.

Was der Test ergab: All 9 package tests pass, detecting crawlers from real user agent lists via the Laravel facade and Request macros. 4 Minuten.

Extract public Spotify data, tracks, albums, artists, playlists, podcasts & lyrics, without the official API. Sync + async, typed models, one dependency.

Was der Test ergab: The SpotifyScraper package is installed and working: the CLI fetches real Spotify track/artist/playlist data over the network, the hermetic unit test suite passes completely (921/921), and the MCP server imports and launches correctly after pinning mcp to v1. 3 Minuten.

Open-Source-AI-Sichtbarkeits-Tracker. Verfolgen Sie, wie ChatGPT, Perplexity, Gemini, Copilot und Google AI Mode Ihre Marke erwähnen und zitieren. Selbst...

Was der Test ergab: Next.js dev server runs on port 3000 serving the GEO/AEO Tracker dashboard in demo mode, with all pages (/ and /demo) and API routes (/api/analyze, /api/audit, /api/scrape, etc.) responding correctly. 4 Minuten.

Ein Python3-Skript zum kontinuierlichen gleichzeitigen Herunterladen aller Bilder/Videos mehrerer 4chan-Threads, ohne Installation.

Was der Test ergab: Both scripts compile, install cleanly via venv, and successfully interact with live 4chan API endpoints: thread-watcher queries the catalog and writes URLs, inb4404 downloads thread media files with validated content. 4 Minuten.

xvideos API-Bibliothek

Was der Test ergab: npm install completes with warnings. Build succeeds. 5 unit test files (47 tests) pass on fixture HTML. Full test suite: 52 pass, 4 fail (all integration tests blocked by xvideos.com returning 404 on /verified/videos/). 5 Minuten.

Hochleistungs-Web-Crawler-API, optimiert für LLMs. Verwandeln Sie jede Suche oder Website in sauberes Markdown mit Remote-Browsern. Firecrawl-Alternative.

Was der Test ergab: Teracrawl server starts on port 8085 with a local Chromium-backed mock Browser.cash pool and a mock SERP service. GET /health returns 200, POST /scrape converts a live URL to markdown via real headless Chromium, POST /serp/search returns mock search results, and POST /crawl combines both to scrape multiple URLs. 15 Minuten.

Kostenloser, selbst gehosteter MCP-Server, der die öffentliche Facebook Ad Library (ohne API-Token) für Wettbewerbsrecherche abgreift: Werbungtreibender...

Was der Test ergab: MCP server loads, imports, starts over stdio, registers both tools, and all 8 offline parser tests pass. 7 Minuten.

golang spider Crawler 爬虫 电影

Was der Test ergab: GoMovies binary compiled and serves HTTP on port 8899 with Redis persistence; spider successfully fetches movie data from hhzyapi.com external API. 20 Minuten.

Eine Python-App zum Scrapen und Verarbeiten von Sportwettdaten direkt von oddsportal.com.

Was der Test ergab: OddsHarvester v0.15.0 installed from source with uv and Playwright; all 1308 unit tests pass and 63 of 82 integration tests pass against HAR replay (19 live-only skipped, 1 xfail for known in-play replay limitation). 40 Minuten.

Project Eyes On ist ein Hochgeschwindigkeits-Überwachungstool mit Multithreading von Y0oshi (@rde0) zum Auffinden offener IP-Kameras weltweit. Es vereint...

Was der Test ergab: Project Eyes On installed, imports correctly, Insecam scraping and multi-engine dorking both find real live IP cameras, and JSON/CSV/HTML reports all produce valid output. 2 Minuten.

Ein Befehl für jede Schnittstelle: über APIs, Browser, Desktops, lokale Tools und MCP hinweg reale Software suchen, ausführen und inspizieren.

Was der Test ergab: Uni-CLI v1.2.1 builds from source, runs 3735 passing unit tests, and executes live commands (hackernews top, search, doctor) against real remote APIs on Node 22.23.4 (npm v10.9.9). The npm global package v1.3.0 is also installed and functional. 20 Minuten.

Selbst gehosteter Scraper für TikTok, Douyin und Bilibili sowie Downloader für Videos ohne Wasserzeichen: asynchrone REST-API, MCP-Server für AI agents, CLI...

Was der Test ergab: All 2960 tests pass (2450 unit + 510 integration), the CLI outputs version 5.0.1 and lists 10 commands, the API server starts and serves healthz/readyz/swagger/console root with 200, the web console SPA is built, and both the PostgreSQL+TimescaleDB and Redis backends and the Go downloader sidecar run. 48 Minuten.

Stealth-Headless-Browser für KI-Agenten, umgeht Cloudflare, Bot-Erkennung und Anti-Scraping. Direkter Ersatz für Puppeteer/Playwright.

Was der Test ergab: Camofox browser server installed and verified: Node 22.23.4 in user space, Camoufox 1.3GB binary downloaded, GeoIP 50MB database downloaded, server starts at localhost:9377 with Xvfb virtual display, creates browser tabs navigating to real URLs, returns accessibility snapshots with element refs, and closes cleanly on... 13 Minuten.

Das beste Web-Scraping-Framework, das alles von einer einzelnen Anfrage bis zu einem vollständigen Crawl abdeckt!

Was der Test ergab: Scrapling 0.4.15 is installed in a venv with all extras, Playwright Chromium browser available, all 985 tests pass, CLI and MCP server commands respond correctly, and HTTP fetches via StealthyFetcher return status 200 from real endpoints. 8 Minuten.

Python-ProxyPool für Web-Spider

Was der Test ergab: The ProxyPool Flask API server runs on port 5010 backed by real Redis, responds to all endpoints (/get, /pop, /all, /delete, /count), and all 248 automated tests pass. 6 Minuten.

Ein Chrome DevTools Protocol-Treiber für Web-Automatisierung und Scraping.

Was der Test ergab: Rod compiles with go build ./... passes all vet checks, and launches Chromium 128 to control a browser page via DevTools Protocol. The main rod test suite and lib/cdp, lib/launcher (except known flaky TestManaged), and lib/proto sub-packages all pass. 59 Minuten.

HTTP-Client, der Webbrowser imitieren kann

Was der Test ergab: The repo builds and runs: Rust workspace checks and per-crate test suites pass (1354 tests), the primp Python extension installs into crates/primp-python/.venv, 493 Python tests pass, and a real impersonated HTTPS request returns HTTP 200. 15 Minuten.

Hochleistungs-Browser-Automatisierungsbrücke und Multi-Instanz-Orchestrator mit fortschrittlicher Stealth-Injektion und Echtzeit-Dashboard.

Was der Test ergab: A source-built PinchTab server (binary reports pinchtab dev) is running on 127.0.0.1:9867 with a responsive always-on headless instance and answered authenticated health, navigate, snapshot, text, title, and screenshot API calls with HTTP 200, while the full Go unit suite (9166 passed, 18 skipped) and scripts/check.sh... 19 Minuten.

Der Headless-Chrome/Chromium-Treiber auf Basis von Puppeteer. Nehmen Sie Screenshots auf, erzeugen Sie PDFs, extrahieren Sie Text und HTML mit einer...

Was der Test ergab: The browserless monorepo installs under Node.js 24 with puppeteer 25, all packages build, Chrome 154 launches headlessly, and 390+ tests pass across 10 packages (browserless, goto, screenshot, capture, function, devices, errors, screencast, lighthouse, ai). 32 Minuten.

100% kostenlose und vollständig Open-Source-Edge-Alternative zu Firecrawl mit besserer Links-Extraktion für Agents, die Sie selbst auf cloudflare oder vercel...

Was der Test ergab: Dependencies installed, SDK tests pass (41/41), full monorepo build and typecheck pass, and the dashboard serves HTTP 200 on / and /docs in both dev and production modes; the V0 API worker served 200 on /, /docs and /openapi in local mode with D1 migrations applied. 33 Minuten.

Ein leichtgewichtiges Web-Crawler-Framework.（Java爬虫框架）

Was der Test ergab: XXL-CRAWLER builds from source, produces a deployable jar, and passes 6 tests (4 utility tests + 2 real website crawls extracting structured data from cnblogs.com and baidu.com). 13 Minuten.

Open-Source-AI-Agent für Web-Automatisierung. Verwenden Sie Ihren echten, angemeldeten Browser, um alltägliche Aufgaben zu automatisieren.

Was der Test ergab: Dependencies installed, project builds to dist/ (background.iife.js 1,848.81 kB, manifest.json), TypeScript type-check passes across all 15 packages, unit tests pass (14/14). 15 Minuten.

Offizieller Firecrawl MCP-Server, die Kontext-API für AI-Agenten: suchen, scrapen und mit dem Web interagieren, plus parsen, crawlen, mappen, Agent und...

Was der Test ergab: Firecrawl MCP Server v3.24.1 builds, installs, and starts successfully with 25 tools in stdio mode; 81 of 84 tests pass. 24 Minuten.

Scrapy, ein schnelles High-Level-Framework für Web-Crawling und Scraping in Python.

Was der Test ergab: Scrapy 2.19.0 installed from source, 4539 tests pass, scrapy bench crawls 1781 pages against a local HTTP server. 15 Minuten.

Schnelle und einfache Video-Download-Bibliothek und CLI-Tool, geschrieben in Go.

Was der Test ergab: Lux builds and runs: the binary outputs version info and help, extracts real YouTube video metadata, and 14 of 48 test packages pass (all failures are network-dependent extractor tests or DNS-timeout content-type lookups; no code defects remain). 11 Minuten.

news-please: ein integrierter Webcrawler und Informationsextraktor für Nachrichten, der einfach funktioniert.

Was der Test ergab: news-please 1.6.13 installs and its library API extracts structured article data (title, authors, publication date, description, maintext, language) from HTML via both HTTP and raw HTML input; CLI entry points respond with help output. 5 Minuten.

Nicht erkannte NodeJS-Version der Playwright-Test- und Automatisierungsbibliothek.

Was der Test ergab: Repo dev deps install and both repo checks pass under Node 22; the npm-published patchright 1.63.0 with its installed patched Chromium launches headless and loads a page from a local HTTP server in this container. 3 Minuten.

Immer aktuelle Liste der 100 häufigsten Browser-User-Agents für HTTP-Clients.

Was der Test ergab: The repo installs cleanly; with the bundled prebuilt Node 22, npm test passes all 5 tests and require/consumer checks return 100 main, 82 desktop, and 18 mobile valid user-agents from the packed tarball; only the Redis-backed update scripts remain unrunnable in this container because no redis-server is available. 3 Minuten.

Browser-Automatisierungs-CLI entwickelt für AI agents. Durchbrechen Sie Anti-Bot-Wände, übergeben Sie an Menschen auf verschiedenen Plattformen, wenn Sie...

Was der Test ergab: browser-act-cli 1.4.2 installed, skill handshake completed, and the chrome browser type (bundled Chromium) works end-to-end, browser create, open, navigate, state inspection, content extraction via get markdown, and session close all succeed; stealth features require a server-side-validated BrowserAct API key that... 5 Minuten.

Ein agnostischer Netzwerk-Crawler, der umfassende Peer-Informationen und Netzwerktopologie-Informationen bereitstellt.

Was der Test ergab: Nebula builds with just build, runs dry-run and ClickHouse-backed IPFS crawls against real network peers, persists crawl data to ClickHouse, and passes all 92 tests across 7 packages with Postgres 16.4 and ClickHouse 26.11 running locally on their test ports. 16 Minuten.

Open-source Python-Bibliothek für AI browser agents, plus Browser Use Cloud: Stealth-Browser und eine gehostete agent API.

Was der Test ergab: browser-use v0.13.10 installed in a Python 3.12 venv with uv, Chromium headless installed via playwright, and all 563 CI tests pass (529 passed, 34 skipped) after fixing 2 test identity comparison bugs in test_beta_agent.py that only manifest under xdist worker parallelism. 75 Minuten.

Air-gapped, datenschutzorientierte Open-Source-Alternative zu NotebookLM. Ein KI-Agent, der Ihre Dokumente recherchiert, transformiert und bearbeitet.

Was der Test ergab: All Python trees (surfsense_backend, surfsense_mcp, surfsense_local/backend, plugins/remote/host core tests) install and pass tests; the web frontend fails to compile native deps on Node 18.x (requires 24.x); docs are clean. 20 Minuten.

Das beste und einfachste Tool für Website-Änderungserkennung, Webseiten-Überwachung und Website-Änderungsbenachrichtigungen. Ideal zum Verfolgen von...

Was der Test ergab: changedetection.io 0.60.7 installs into a venv, launches and serves HTTP 200, its full basic test suite passes (680 passed in the main group, exit 0, plus 508 unit tests), and a real watch added via the API detected a content change and exposed it in the UI. 76 Minuten.

jsoup: der Java-HTML-Parser, entwickelt für HTML-Bearbeitung, -Bereinigung, Scraping und XSS-Sicherheit.

Was der Test ergab: jsoup compiles from source with JDK 21 and Apache Maven, all 2,341 unit tests pass, and the built JAR correctly parses HTML and extracts DOM content. 2 Minuten.

Kostenloser Open-Source-Google-Maps-Scraper zur Lead-Generierung (Python, ohne API-Schlüssel, ohne Docker). Exportiert Name, Telefon, E-Mail, Website...

Was der Test ergab: The scraper binary runs natively, its REST API on localhost:8080 creates/polls/downloads scraping jobs against real Google Maps data, and the included Python CLI successfully produces lead CSVs with real business listings. 7 Minuten.

Elasticsearch File System Crawler (FS Crawler)

Was der Test ergab: FSCrawler 3.1-SNAPSHOT builds successfully via Maven, distributable ZIP is packaged, binary launches and shows help/version, and 687 unit tests pass when run with the `-Dtest="*Test"` workaround. 82 Minuten.

Sammlung von Patches für Puppeteer und Playwright, um Automatisierungserkennung und Lecks zu vermeiden. Hilft, Cloudflare- und DataDome-CAPTCHA-Seiten zu...

Was der Test ergab: rebrowser-patches repo installs, builds 6 drop-in tarballs, and passes all 43 test gates (detection, scenarios, smoke) with patched Puppeteer-core 25.14.0 and Playwright-core 1.64.1 defeating Runtime.Enable detection. 8 Minuten.

Ein ergonomischer, datenschutzbewusster Rust-HTTP-Client

Was der Test ergab: wreq v0.16.1 builds and all 280+ integration tests pass on Rust 1.99.0 (Ubuntu 24.04) with BoringSSL via btls, after providing libclang (extracted from libclang1-20 + libclang-20-dev debs) and workaround for Ubuntu 24.04's missing /usr/include/stddef.h. 35 Minuten.

Java API für Chrome und Firefox

Was der Test ergab: Jvppeteer 3.6.5 builds and installs via Maven, Chrome for Testing 149.0.7798.0 runs headlessly, and the library launches the browser, navigates pages, evaluates JavaScript, and retrieves page content successfully. 26 Minuten.

Full-content web fetcher for AI agents, Chrome TLS fingerprinting, browser impersonation, multi-strategy article extraction, and web scraping.

Was der Test ergab: agent-fetch 0.1.6 builds from source, passes all 904 unit tests, and successfully fetches and extracts real web pages (Wikipedia, example.com) via CLI. 6 Minuten.

Offizielle Crawl4AI Cloud: eine gehostete Web-Scraping-, Extraktions- und Such-API für AI-Agents. Kostenloser API-Schlüssel, 1,000 Credits pro Monat, keine...

Was der Test ergab: Crawl4AI 0.9.4 installed in venv, Playwright chromium browser downloaded, DB initialized, AsyncWebCrawler can crawl real URLs with markdown output, cache operations work, and 360 core tests pass with 11 skipped. 14 Minuten.

Webcrawler/Spider für NodeJS + serverseitiges jQuery;-)

Was der Test ergab: crawler v2.1.1 builds from TypeScript, all 51 tests pass under Node 22 with nock-mocked HTTP, and the module loads correctly to process crawl tasks. 4 Minuten.

Ein agentischer Extraktor für Messaging-Plattformen. Noria empfängt Nachrichten und URLs über Chat; extrahiert Webdaten, um den Inhalt anhand...

Was der Test ergab: npm install completes, all 232 unit tests pass across 17 suites with zero lint errors, the Node.js backend boots registering all domain/LLM/scraper/sender/listener plugins and loading the scholarships and jobs pipeline configs, and the Streamlit Control Center UI starts and serves on port 8501. 11 Minuten.

Python-Bibliothek und CLI für X/Twitter-Scraping mit Multi-Account-Rotation und integrierter Rate-Limit-Behandlung.

Was der Test ergab: All 217 tests pass with 81% coverage; twscrape CLI reports version 0.20.1 and SQLite 3.45.1. 1 Minute.

Ein leistungsstarker MCP-Server (Model Context Protocol), der eine Komplettlösung für den öffentlichen Webzugriff bietet.

Was der Test ergab: The Bright Data MCP server installs and all 21 unit tests pass under Node.js v22.12.0; the server starts listening when API_TOKEN is set. 4 Minuten.

Wandeln Sie jede Website per Reverse Engineering in einen typisierten API-Client um. Funktioniert mit Claude Code, Codex, Cursor und OpenCode.

Was der Test ergab: Project installed via uv sync, all 1025 tests pass, and the reverse-api-engineer CLI displays its help output. 2 Minuten.

Diskover Community Edition - Open-Source-Dateiindexierer, Dateisuchmaschine und Datenmanagement und -analyse, unterstützt von Elasticsearch

Was der Test ergab: Python scanner installs successfully, compiles cleanly, and completes a directory crawl indexing 22 file/directory documents into a mock Elasticsearch instance. 18 Minuten.

Finviz-Analyse-Python-Bibliothek.

Was der Test ergab: All 128 offline tests pass and every package module (quote, news, insider, calendar, screener, group, earnings, forex, crypto, future, util) returns correct data from committed HTML fixtures. 2 Minuten.

Boss直聘爬虫 / BOSS直聘职位数据抓取工具，基于 Chrome CDP 协议复用真实登录态，绕过字体反爬，输出明文薪资 JSON/CSV + 薪资技能分析。A Chrome-CDP-based BOSS Zhipin job scraper/crawler.

Was der Test ergab: Virtual environment created with all dependencies, both Python scripts compile clean, and the full mock-based test suite (109 tests) passes. The CLI prints correct version (2.2.0), help output, and city listings. Real Chrome CDP scraping cannot be verified in this container, --check correctly reports no Chrome... 2 Minuten.

Twitter-Scraper für X: Tweets, Profile, Follower und Following, ohne API-Key. Python-Bibliothek mit Multi-Account-Pooling, Proxy-Unterstützung und async, oder...

Was der Test ergab: Scweet 5.8.0 installs cleanly in a Python 3.12 venv; 495 unit tests pass; the CLI builds and shows help; the library imports without network; material in tests/fixtures/ provides captured X responses for offline test coverage. 9 Minuten.

Fredy, [F]ind [R]eal [E]state [D]amn Eas[y], Fredy durchsucht kontinuierlich Plattformen wie ImmoScout24, Immowelt, eBay Kleinanzeigen nach neuen Wohnungen...

Was der Test ergab: Fredy backend serves HTTP 200 on port 9998 after DB migration and all 4260 offline tests pass with Node v22.23.3. 6 Minuten.

Selbst gehostete Websuche für AI agents und SEO. Google, Bing, Yandex, Baidu, DuckDuckGo & Ecosia, in einem echten Browser gerendert: sortierte Ergebnisse und...

Was der Test ergab: OpenSERP v0.8.13 builds, all 12 unit test suites pass, and the HTTP server starts, serving /health and /ready endpoints on 127.0.0.1:7000. 8 Minuten.

WebAI2API: Web-KI zu OpenAI-API über Camoufox. Unterstützt LMArena/Gemini und mehr, Multi-Window-Parallelität & Kontoisolierung.

Was der Test ergab: The WebAI2API server starts on port 3000 with a Camoufox browser instance, serving OpenAI-compatible /v1/models, WebUI, and /v1/cookies endpoints, all returning HTTP 200, though chat completions require real AI website credentials via the browser adapter and cannot produce output without logging in. 7 Minuten.

Go HTTP-Client mit browseridentischem TLS/HTTP2-Fingerprinting. Umgehen Sie Bot-Erkennung, indem Sie Chrome, Firefox und Safari auf kryptografischer Ebene...

Was der Test ergab: Go 1.26.0 installed, httpcloak project builds cleanly, all 1402 Go test cases pass across 7 sub-packages, shared C library built, Python bindings installed and all 12 Python alias tests pass. 8 Minuten.

HTTP(S)/SOCKS5 rotating residential proxies - code examples & general information.

Was der Test ergab: Mock proxy verified: shell/shell.sh (curl via proxy): returned 200 with IP JSON; python/python.py (requests via proxy): returned 200 with IP JSON; nodejs/node.js (axios via proxy): returned 200 with IP JSON. 9 Minuten.

Golang-Wasserzeichenentfernung für Kurzvideos: Douyin, Pipixia, Huoshan, Weishi, Zuiyou, Kuaishou, Quanmin Xiaoshipin, Pipi Gaoxiao, Xigua Video, Huya, Pear...

Was der Test ergab: with a user-local Go 1.24.0 toolchain the project builds, its 90 passing tests and race suite are green, the HTTP server starts and serves 200 on / and /api/v1/health with 26 platforms, and a real Sohu video was parsed, downloaded (22.6 MB), and fully decoded by ffmpeg to h264/aac. 20 Minuten.

660+ von muapi gehostete generative-Media-Modelle plus von der Community eingereichte Third-Party-API-Tools (SEO, Anreicherung, Social, Scraping), eine...

Was der Test ergab: PyYAML 6.0.3 installed; catalog_validate.py validates all 665 YAML entries in providers/ and models/ successfully with zero errors. 3 Minuten.

Pure-Python-Protokoll-Tools und Forschungsnotizen für X.com, mit VibeLoft-Twitter-Konto-Datensätzen

Was der Test ergab: All 20 integration tests pass - uv sync installs cleanly, all 8 tool modules import and return valid data from the mock X API server, plus VibeLoft account collection via real API, tweet analysis, and status scripts verified. 6 Minuten.

ChatGPT Team(Business) Automatischer Promo-Code-Scanner: Batch-Erkennung, Validierung, Preissammlung, unterstützt 34 Codes in 17 Ländern, bis zu 71 % Rabatt |...

Was der Test ergab: Repo installs cleanly and every scanning script (auto_scan, discover_codes, verify, open_stripe, partner_scan, and the us/mega/uk scanners) ran and produced valid output against the local mock of the ChatGPT API and Clash proxy; open_stripe.py works after switching its hardcoded proxy to the project config-driven... 43 Minuten.

ChatWeb kann Webseiten crawlen, PDF, DOCX, TXT lesen und den Hauptinhalt extrahieren, dann Ihre Fragen basierend auf dem Inhalt beantworten oder die...

Was der Test ergab: ChatWeb runs in all three modes (console, API, webui) behind a mock OpenAI API. The /upload_file, /summary, and /answer endpoints return HTTP 200 with correct JSON schemas; the console mode accepts file paths and /help commands; the webui Gradio interface binds on port 7860 and returns HTTP 200. 15 Minuten.

Offizielle Agent-Fähigkeiten der Oxylabs-Produkte

Was der Test ergab: Five Oxylabs agent skills (headless-browser, proxies, video-data, web-scraper-api, web-unblocker) install via skills CLI. .env.example corrected to OXY_RES_USERNAME/OXY_RES_PASSWORD consistent with all docs. Mock server confirms the documented API endpoint patterns respond 200 OK. 7 Minuten.

Crawler (Bot), der auf Paste-Sites nach Leaks sucht.

Was der Test ergab: Dashboard serves HTTPS on localhost:8080 returning complete HTML page; analysis engine detects email:password combos, private keys, API tokens, and 18 configurable search terms; SQLite dedup DB tracks crawled paste IDs; all 6 module scripts pass syntax check; pastes.io and pastebin.com external endpoints are reachable. 5 Minuten.

Eine vielseitige Ruby-Bibliothek zum Web-Spidering, die eine Website, mehrere Domains, bestimmte Links oder unbegrenzt crawlen kann. Spidr ist darauf...

Was der Test ergab: Spidr builds and its full 317-example RSpec suite passes, and a locally hosted mock site is spidered end to end (3 URLs visited, no failures) with no real third-party credentials. 20 Minuten.

Ein Befehl steuert Xiaohongshu, Douyin, TikTok, B 站, Kuaishou, Weibo, Xianyu, Taobao, 京东, X: Einheitlicher Befehl und JSON-Ausgabe für Menschen und AI Agents.

Was der Test ergab: catbus CLI is installed, builds, and all 962 offline tests pass. The binary outputs valid JSON envelopes for version, help, platforms, doctor, and handles platform aliases, native name mapping, and auth-required errors correctly. 3 Minuten.

Ein Skill für AI agents: Durchsuchen Sie das Web mit SearXNG, browsen Sie mit Camofox, umgehen Sie Schutzmaßnahmen mit CloakBrowser. Anti-Halluzination von...

Was der Test ergab: npm install succeeds, CloakBrowser (with Node 20, not the system Node 18) fetches live pages, the SearXNG and Camofox deterministic scripts pass their full command flows against schema-correct mocks, unit suites pass 28/28 and 12/12, and setup.sh/audit.sh complete without failed checks; real SearXNG/Camofox Docker... 33 Minuten.

Ein framework zum Erstellen von halbautomatischen Extraktoren für Web-Inhalte.

Was der Test ergab: Scrapple 0.3.0 installs, builds, and runs on Python 3.12; the CLI accepts all 4 commands (genconfig, run, generate, web), scrapes live websites via XPath and CSS selectors, and generates executable Python scripts, 13/17 tests pass with the remaining 4 failing only because their target websites changed HTML since 2018. 10 Minuten.

HTTP-Client für Node.js mit Browser-TLS-Fingerabdruck-Imitation

Was der Test ergab: wreq-js v3.2.0 is installed and working on x86_64 Ubuntu 24.04 with Node.js v22.23.4, the TypeScript build completes, the native Rust binding (prebuilt) loads correctly, and the test suite passes 195/200 tests against a local HTTP/HTTPS/WebSocket test server. 5 tests are skipped: 4 requiring full native setCookies... 28 Minuten.

E-Mail-Adressen von Fachleuten mithilfe von Namen und Domains ermitteln und verifizieren

Was der Test ergab: Project builds from source, 9 unit tests pass, and both email-sleuth/es binaries execute their full pipeline (config loading, SMTP connectivity testing, pattern generation, DNS resolution, JSON output) without crashing. 6 Minuten.

Leichtgewichtiger Scraper für Google News

Was der Test ergab: TypeScript compiles cleanly, rollup builds CJS+ESM bundles, both module formats load at runtime, and all 46 unit/integration tests pass on Node 18.19.1. 13 Minuten.

News crawling with StormCrawler - stores content as WARC

Was der Test ergab: The NewsCrawlBootstrap topology runs in Storm LocalCluster against local mocks, detects the RSS feed, acks status updates to OpenSearch, and writes a gzip-valid WARC containing fetched feed content; mvn clean package and all 10 unit tests pass. 69 Minuten.

Model Context Protocol (MCP)-Server für Graphlit Platform

Was der Test ergab: Graphlit MCP Server builds, launches, and responds correctly to MCP protocol initialize, resources/list, and tools/list requests. 10 Minuten.

Pythons Paket, um das Twitter-Frontend einfach zu scrapen

Was der Test ergab: Package installs in a virtualenv, all 9 tests pass, xquik search function verified end-to-end with a mock HTTP server. 2 Minuten.

GPlay Scraper ist eine leistungsstarke Python-Bibliothek zum Scrapen des Google Play Stores, mit der umfassende App-Daten aus dem Google Play Store extrahiert...

Was der Test ergab: gplay-scraper installed in a venv with all dependencies; all 48 tests pass after fixing the tls_client client_identifier string from 'chrome112' to 'chrome_112'. 4 Minuten.

MinerU-HTML: Ein SLM-gestützter HTML-Hauptinhalts-Extraktor, der saubere HTML-Bodies ausgibt. Ideal für Deep Research Agents, RAG-Anwendungen und die Erzeugung...

Was der Test ergab: MinerU-HTML v1.1.2 package installs and imports correctly in a Python 3.12 venv; the full extraction pipeline runs to completion with a mock LLM backend, correctly filtering navigation/auxiliary elements from main content HTML; all 20 internal modules import cleanly; config validation, fallback handlers... 16 Minuten.

Scannen Sie die Routen Ihrer Laravel-Anwendung auf SEO-Verbesserungsvorschläge.

Was der Test ergab: composer install works, the full Pest suite passes (171 passed, 3 skipped), PHPStan passes, and seo:scan-url returns real results (score 65, 28 passed, 15 failed) plus seo:scan persists the score to MariaDB, all against local mocks in this container. 28 Minuten.

Beispiele für die Verwendung von Hyperbrowser

Was der Test ergab: After npm install, TypeScript compiles cleanly and the company-researcher CLI runs end-to-end against a schema-correct local Hyperbrowser mock, producing the full structured research output and exiting 0; real Hyperbrowser/OpenAI API keys were not exercised. 12 Minuten.

Daten von Google Maps extrahieren. Extrahiert Daten wie Name, Adresse, Telefonnummer, Website-URL, Bewertung, Anzahl der Bewertungen, Breitengrad und...

Was der Test ergab: All 17 Go packages with tests passed with race detection (no failures), the binary compiled and prints version/help correctly, and all 10 JS skill tests plus shell helper tests passed. 6 Minuten.

Verwenden Sie LLMs, um Webdaten robust zu extrahieren.

Was der Test ergab: npm install builds successfully, 84 unit tests pass, 63 html-to-markdown integration tests pass with real ground-truth data, all LLM extraction integration tests pass with mocked providers, processedContent tests pass; Playwright browser tests fail at import on Node 18. 39 Minuten.

Python-Scraper basierend auf AI

Was der Test ergab: 191 unit tests pass after fixing 13 categories of test failures covering models_tokens assertions, cleanup_html behaviors, logger capture, file paths, missing dependencies, mock patterns, and mock class completeness. 46 Minuten.

Google-Suchergebnisse über SERP API pip-Python-Paket

Was der Test ergab: The SerpApi Python client library installs from source, runs 43 unit tests successfully against a locally hosted mock backend, and passes a basic smoke test (OOBT). 11 Minuten.

Residential-, Datacenter-, ISP- & Mobile-Proxies mit 90M+ IPs in 200+ Ländern, plus Scraper & SERP APIs. Codebeispiele in Python, Node.js, PHP, Go, Java, C#...

Was der Test ergab: Python and Node.js quickstarts and curl HTTP-examples work through mock proxy to real ipinfo.io; PHP/Go/Ruby/Java/C# examples not tested due to missing runtimes; SOCKS5 not tested due to minimal mock. 5 Minuten.

Crawler-API für öffentliche WeChat-Konten basierend auf der Sogou-WeChat-Suche

Was der Test ergab: wechatsogou 4.5.4 is installed in a Python 3.12 venv; pip install -e . succeeds; 24 offline tests pass (constants, tools, URL generation, HTML parsing); real-network API tests fail only because DNS is unavailable in the container. 13 Minuten.

Open-Source-, selbst gehosteter Enterprise- und Site-Search-Server auf Basis von OpenSearch. Durchsucht Web-, Datei-, DB- und Cloud-Quellen, unterstützt 20+...

Was der Test ergab: Fess 15.9.0-SNAPSHOT builds and packages successfully from source. All 7,634 unit tests pass. The embedded Tomcat binds port 8080 but the application fails at runtime because no OpenSearch backend is reachable on localhost:9200. 36 Minuten.

AgentQL ist eine Suite von Tools, um Ihre KI mit dem Web zu verbinden. Es bietet eine Abfragesprache und Playwright-Integrationen für die Interaktion mit...

Was der Test ergab: konnte nicht verifiziert werden; das Log zeigt, wo es stehen blieb.

Krawl ist ein anpassbarer, leichtgewichtiger, cloud-nativer Web-Täuschungsserver und Anti-Crawler, der mit realistischen, zufällig generierten Köderdaten und...

Was der Test ergab: Krawl standalone mode builds and runs: after pip install -r requirements.txt, uvicorn app:app --app-dir src serves HTTP 200 on /dashf/healthz, answers the honeypot with 204 on /, records POST credentials from 198.51.100.77 into SQLite, and the dashboard API shows that IP categorized as attacker. 92 Minuten.