Open source CI/CD tools, installed and run
CI/CD tools you can run yourself. The list is ordered by whether each project came up when Argusic installed it fresh, with the recording of that attempt one click away.
Tested between and . Each row shows its own test date; a project can change after that day.
101 of 109 tested projects run. 4 more waiting for a test.
In short: 78 of the 109 tested projects started as-is on a fresh machine: harness, jenkins, volkswagen, gocd, jx, tox, create-pull-request, and database-lab-engine, and 70 more. 23 more started once a stand-in replaced a service they expect, such as a database: cds, test-reporter, jenkinsapi, ue4-docker, run-on-arch-action, chart-releaser-action, Odevio-CLI, and powerplatform-build-tools, and 15 more. 8 could not be verified: devops-basics, magic-nix-cache-action, dagger, xcov, docker-ci-automation, maestro-runner, levelrail, and argo-cd; the log shows where each one stopped.
Measured by Argusic on a fresh machine every time. Every number links to its evidence.
| # | project | verdict | Argusic Score | language | stars | tested on |
|---|---|---|---|---|---|---|
| 1 | harness | Runs | 100 / 100 | Go | 38,954 | |
Harness Open Source is an end-to-end developer platform with Source Control Management, CI/CD Pipelines, Hosted Developer Environments, and Artifact Registries. What the test found: Harness (Gitness) Go server binary builds and runs, listening on port 3000 with SQLite, answering HTTP 200 on / and /health; all 116 Go test packages pass; web UI frontend stubs exist but full webpack build requires >8GB RAM. 21 minutes. | ||||||
| 2 | jenkins | Runs | 100 / 100 | Java | 26,801 | |
Jenkins automation server What the test found: Jenkins WAR built at war/target/jenkins.war (56 MB), frontend yarn build completes with 9 JS/CSS bundles, vitest frontend tests pass (9/9), 53 core Java unit tests pass, Jenkins server launches and serves on port 8080 showing setup wizard. 17 minutes. | ||||||
| 3 | volkswagen | Runs | 100 / 100 | JavaScript | 15,466 | |
:see_no_evil: Volkswagen detects when your tests are being run in a CI server, and makes them pass. What the test found: npm install completes successfully, npm test executes six fixtures and exits 0 with 36 TAP ok assertions, and the packed package installs and suppresses failing assert and Chai checks in CI mode while leaving those failures active outside CI. 2 minutes. | ||||||
| 4 | gocd | Runs | 100 / 100 | Java | 7,439 | |
GoCD - Continuous Delivery server main repository What the test found: GoCD server compiles against JDK 25 with Gradle 9.7.1; all 3373 server tests pass including the CI/CD pipeline modeling, material expansion, security, web controllers, and persistence layers. The fatJAR distribution cannot be assembled due to a pre-existing Rails gem cache corruption in the source tree's WEB-INF/rails... 74 minutes. | ||||||
| 5 | jx | Runs | 100 / 100 | Go | 4,692 | |
Jenkins X provides automated CI+CD for Kubernetes with Preview Environments on Pull Requests using Cloud Native pipelines from Tekton What the test found: Binary builds, runs 'jx version' printing 3.2.238, all 17 unit tests pass. 5 minutes. | ||||||
| 6 | tox | Runs | 100 / 100 | Python | 3,983 | |
Command line driven CI frontend and development task automation tool. What the test found: tox 4.64.3 installed in /tmp/tox-venv, 8069 tests pass across config, execute, session, plugin, journal, util, pytest_, tox_env, and docs modules; CLI launches and prints version 4.64.3. 25 minutes. | ||||||
| 7 | create-pull-request | Runs | 100 / 100 | TypeScript | 2,877 | |
A GitHub action to create a pull request for changes to your repository in the actions workspace What the test found: All 68 tests pass (18 unit + 50 integration): Node 24 via nvm, git daemon populated with test repos on port 9418, test paths relocated to /tmp/git-test/, build produces dist/index.js via ncc. 36 minutes. | ||||||
| 8 | database-lab-engine | Runs | 100 / 100 | Go | 2,809 | |
DBLab enables 🖖 database branching and ⚡️ thin cloning for any Postgres database and empowers DB testing in CI/CD. This optimizes database-related costs while... What the test found: The DBLab Engine repository builds successfully with go1.26.8, producing all 4 binaries (dblab, dblab-server, run-ci, rds-refresh) with zero compilation errors, and all 56 Go test packages pass with zero failures. The CLI tool responds to help commands correctly. The server binary requires Docker and a config file to... 6 minutes. | ||||||
| 9 | changed-files | Runs | 100 / 100 | TypeScript | 2,736 | |
:octocat: Github action to retrieve all (added, copied, modified, deleted, renamed, type changed, unmerged, unknown) files and directories. What the test found: TypeScript compilation succeeds with zero errors and all 65 jest tests pass after creating required git tags and updating a hardcoded test SHA. 3 minutes. | ||||||
| 10 | openchoreo | Runs | 100 / 100 | Go | 1,925 | |
OpenChoreo is an internal developer platform for Kubernetes What the test found: OpenChoreo v1.3.0 Go project builds 4 binaries, all 229 non-e2e Go unit test packages pass, and the occ CLI reports version 1.3.0 correctly. 69 minutes. | ||||||
| 11 | kumo | Runs | 100 / 100 | Go | 1,510 | |
A lightweight AWS service emulator written in Go What the test found: kumo v0.30.0 builds, its server answers HTTP 200 on port 4566, the S3 CLI successfully creates buckets, and the full test suite passes (31 packages, 443 tests, 0 failures). 9 minutes. | ||||||
| 12 | churn-php | Runs | 100 / 100 | PHP | 1,384 | |
Discover files in need of refactoring. What the test found: Dependencies installed via composer, static PHP 8.3.0 and Composer 2.7.1 configured in PATH, all 172 unit/integration tests pass, churn-php binary runs and analyzes PHP source files producing JSON/text/csv/markdown output. 3 minutes. | ||||||
| 13 | linkinator | Runs | 100 / 100 | TypeScript | 1,291 | |
Broken link checker that crawls websites and validates links. Find broken links, dead links, and invalid URLs in websites, documentation, and local files... What the test found: All 363 tests pass, the CLI prints version 8.1.0 and help output, and the npm package includes build/package.json and build/src files needed for install. 2 minutes. | ||||||
| 14 | platform-espressif32 | Runs | 100 / 100 | Python | 1,214 | |
Espressif 32: development platform for PlatformIO What the test found: PlatformIO 6.2.0 is installed with the espressif32 platform v7.1.3 loaded from the local repo symlink. 5 example projects compile successfully to valid ESP32 firmware images across 13 different board environments, using both the Arduino and ESP-IDF frameworks. 14 minutes. | ||||||
| 15 | agent | Runs | 100 / 100 | Go | 1,109 | |
The Buildkite Agent is an open-source toolkit written in Go for securely running build jobs on any device or network What the test found: Buildkite Agent builds and runs with go1.26.11, all 38 test packages pass (0 failures), and the bootstrap pipeline runs end-to-end. 12 minutes. | ||||||
| 16 | webhookd | Runs | 100 / 100 | Go | 1,106 | |
A minimalist, powerful webhook server designed to easily trigger shell scripts and run external processes via HTTP requests. What the test found: webhookd v1.22.1 binary downloaded and runs; server listens on port 9999, executes shell scripts via HTTP GET, returns 200 OK with script output. 2 minutes. | ||||||
| 17 | puppetry | Runs | 100 / 100 | JavaScript | 888 | |
Web testing solution for non-developers on top of Puppeteer and Jest What the test found: npm install succeeds, webpack build succeeds, all 21 unit test suites pass (261 tests), and the Electron app launches on the virtual display logging renderer initialization. 21 minutes. | ||||||
| 18 | Tracely-ai | Runs | 100 / 100 | Python | 848 | |
Trace-native CI/CD for AI agents: grade production traces, cluster failures, freeze them into replayable regression tests, and block PRs that regress... What the test found: Python project installs with uv sync; 1330/1330 backend+SDK tests pass; ruff lint clean; CLI binaries (gate/replay/simulate/export) respond to --help; FastAPI app instantiates; SDK modules import correctly. 11 minutes. | ||||||
| 19 | php-censor | Runs | 100 / 100 | PHP | 686 | |
PHP Censor is an open source self-hosted continuous integration server for PHP projects. What the test found: PHP Censor v2.2.0-alpha is installed with static PHP 8.3.0 CLI, all 352 runnable PHPUnit tests pass (20 DB/reported skipped), the console application boots and lists all commands, and the web application serves HTTP requests. 12 minutes. | ||||||
| 20 | ai-development-patterns | Runs | 100 / 100 | Python | 682 | |
A comprehensive collection of AI development patterns for building software with AI assistance, organized by implementation maturity and development lifecycle... What the test found: All 556 non-slow tests pass on Python 3.12.3 with 22 pinned dependencies. 3 pre-existing slow tests fail due to external content drift (not fixable here). verification/STATUS.md regenerated. Cannot push to remote (no auth). 7 minutes. | ||||||
| 21 | devopness | Runs | 100 / 100 | TypeScript | 581 | |
Devopness: AI DevOps on your cloud. Deploy apps, infra and CI/CD. Any cloud and any stack, one MCP. Deterministic API, opinionated and fully configurable. No... What the test found: All three SDK packages install, build, and pass their test suites: Python SDK 86/86 tests, JavaScript SDK 29/29 tests plus clean TypeScript compilation, UI React 403/403 tests. 4 minutes. | ||||||
| 22 | lychee-action | Runs | 100 / 100 | Shell | 531 | |
Github action to check for broken links in Markdown, HTML, and text files using lychee, a fast link checker written in Rust. What the test found: The action installs lychee 0.24.2 and entrypoint.sh runs it to completion against the repo's fixtures with FAIL/FAILIFEMPTY conflict checks, markdown/json/junit reporting, and exit_code propagation all behaving as the repository's own CI expects. 2 minutes. | ||||||
| 23 | platform-ststm32 | Runs | 100 / 100 | Python | 474 | |
ST STM32: development platform for PlatformIO What the test found: The repo's PlatformIO platform builds real firmware for the arduino, libopencm3, and stm32cube-hal frameworks after initializing its git submodules. 2 minutes. | ||||||
| 24 | circleci-cli | Runs | 100 / 100 | Go | 462 | |
Use CircleCI from the command line What the test found: circleci-cli builds from source with Go 1.27.1, the binary reports version and help, and all 7 clikit packages, all ~30 internal packages, and the full acceptance test suite (261s) pass. 27 minutes. | ||||||
| 25 | action | Runs | 100 / 100 | TypeScript | 449 | |
Show a helpful summary of test results in GitHub Actions CI/CD workflow runs What the test found: npm install, npm run build, npm run package, and npm test all succeed; node dist/index.js parses JUnit, TAP, and TRX fixtures and prints proper markdown summaries and step outputs (e.g. 37 passed, 20 failed, 4 skipped), and writes the summary to the requested output file. 2 minutes. | ||||||
| 26 | bundlewatch | Runs | 100 / 100 | TypeScript | 445 | |
Keep watch of your bundle size What the test found: Dependencies installed, Babel compiles, all 22 Jest tests pass, and the bundlewatch CLI runs end-to-end checking file sizes against configured thresholds. 2 minutes. | ||||||
| 27 | elastic-ci-stack-for-aws | Runs | 100 / 100 | Shell | 441 | |
An auto-scaling cluster of build agents running in your own AWS VPC What the test found: 6 Go tests pass after patching test fixture paths; fix-perms-linux-amd64 builds and prints usage; CloudFormation template builds and passes cfn-lint validation. 24 minutes. | ||||||
| 28 | jenkins-rest | Runs | 100 / 100 | Java | 414 | |
Java client, built on top of jclouds, for working with Jenkins REST API What the test found: jenkins-rest client library builds and passes all 100 mock tests with Adoptium JDK 11.0.26 on Ubuntu 24.04. 4 minutes. | ||||||
| 29 | kelos | Runs | 100 / 100 | Go | 360 | |
Kelos - The Kubernetes-native framework for orchestrating autonomous AI coding agents. What the test found: All unit tests (45 packages) and integration tests (173 specs) pass, the CLI binary builds and answers commands, and the controller, webhook, and install CRDs work correctly against a real Kubernetes API server. 11 minutes. | ||||||
| 30 | lasso | Runs | 100 / 100 | PHP | 355 | |
🐎 Lasso is a Laravel package created to make your deployments blazing fast. What the test found: All 11 Lasso PHP package tests pass (44 assertions), including end-to-end publish/pull with webpack compilation, zip bundling, cloud storage upload/download, and file content verification. 12 minutes. | ||||||
| 31 | gitstream | Runs | 100 / 100 | JavaScript | 345 | |
/:\ gitStream - Workflow automation for your git repo. Use YAML to auto-assign reviewers, auto-merge PRs, automatic PR labeler, and more. What the test found: MkDocs documentation site builds with --strict, serves HTTP 200 on port 8000, and all 15 JavaScript filter plugins load and run their inline tests without error. 3 minutes. | ||||||
| 32 | actions-template-sync | Runs | 100 / 100 | Shell | 327 | |
:octocat: Github action for syncing other repositories (templates) with current repository. Any git provider like GitHub (enterprise), GitLab, Gittea,.. are... What the test found: All 23 BDD tests pass across both test suites, bash scripts pass syntax validation, and the action.yml correctly wires all inputs to environment variables. 1 minute. | ||||||
| 33 | test-with-actions | Runs | 100 / 100 | Python | 319 | |
Create workflows that enable you to use Continuous Integration (CI) for your projects. What the test found: Python venv created with matplotlib 3.11.2, pytest, and pytest-cov; all 4 unit tests pass covering area_of_circle and get_nth_fibonacci functions; commented-out test_get_nth_fibonacci_ten remains as shipped in the exercise template. 1 minute. | ||||||
| 34 | k8s | Runs | 100 / 100 | Shell | 315 | |
Platform In a Box! What the test found: All 13 Helm charts render and pass lint; 47 container images were scanned for CRITICAL vulnerabilities with no failures; Checkov policy scanning passes on all first-party chart templates with only expected warnings from Kyverno's upstream dependency. 44 minutes. | ||||||
| 35 | patchscope | Runs | 100 / 100 | JavaScript | 308 | |
GitHub Action for Git diff review: flag risky changes, removed tests and CI permissions. Export Markdown, JSON and SARIF checklists. Free, local-first, no AI... What the test found: All 33 tests pass on Node 18.19.1, the CLI produces correct Markdown/JSON/SARIF review output from a unified diff, and the dev server serves the web app on port 4173 returning HTTP 200. 1 minute. | ||||||
| 36 | enola | Runs | 100 / 100 | C | 305 | |
Understand, analyze, and govern software systems across repositories, languages, and technologies. What the test found: enola v0.4.35 installed and operational: analyzes Go/TypeScript/Python/Ruby/C/C++ repositories, generates architectural snapshots with 10000+ facts, produces 23 categories of insights including cycles, layers, hotspots, god-class, dead-code, and dependency-depth; baseline pinning and MCP server both confirmed working. 3 minutes. | ||||||
| 37 | rok8s-scripts | Runs | 100 / 100 | Shell | 303 | |
Opinionated scripts for managing application deployment lifecycle in Kubernetes What the test found: rok8s-scripts test suite runs successfully from source: shellcheck validates 50+ scripts, k8s-lint checks 5 config files across both staging and production, and Helm template rendering produces output byte-identical to the reference gold file. 4 minutes. | ||||||
| 38 | aws-codebuild-run-build | Runs | 100 / 100 | JavaScript | 300 | |
Run an AWS CodeBuild project as a step in a GitHub Actions workflow job. What the test found: Dependencies install, all 23 mocha tests pass, and ncc build produces a working dist/index.js bundle with no runtime errors. 1 minute. | ||||||
| 39 | chart-testing-action | Runs | 100 / 100 | Shell | 295 | |
A GitHub Action to lint and test Helm charts What the test found: ct.sh installs chart-testing 3.14.0 with cosign signature verification, creates a venv with yamllint 1.33.0 and yamale 6.0.0, and ct lint validates Helm charts successfully. 3 minutes. | ||||||
| 40 | qa-skills | Runs | 100 / 100 | JavaScript | 293 | |
50 QA and test-automation skills for Claude Code, Codex, Cursor, and any Agent Skills Standard runtime. What the test found: After installing Node 24, npm ci, Playwright chromium, and PyYAML, all 3 npm test suites (252 tests total), 157 Python unit tests, 50 skill validations, and 516 static eval cases pass with zero failures, and the QA CLI produces valid plan output. 3 minutes. | ||||||
| 41 | reframe | Runs | 100 / 100 | Python | 286 | |
A powerful Python framework for writing and running portable regression tests and benchmarks for HPC systems. What the test found: ReFrame installed into a venv and passes its full unit suite (1448 passed, 280 skipped), unittests exit 0, and ran real tests end-to-end: 4/4 dummy echo cases PASSED and 2/2 gcc-compiled STREAM cases PASSED with sanity and performance output. 5 minutes. | ||||||
| 42 | lockenv | Runs | 100 / 100 | Go | 284 | |
Simple, password-based encrypted vault for .env and infrastructure secrets. Like git-crypt or sops, but dramatically simpler. Ideal for small teams and IaC... What the test found: lockenv CLI binary builds and runs on Linux x86_64; all 3 test packages pass; full init/lock/unlock/status/diff/compact workflow works with LOCKENV_PASSWORD env var. 6 minutes. | ||||||
| 43 | jenkins-cli | Runs | 100 / 100 | Rust | 269 | |
Cross-platform CLI tool for triggering Jenkins builds. Written in Rust for high performance. What the test found: Repository builds and tests pass with Rust 1.96.0 on Linux x86_64. The jenkins CLI binary runs, displays help, and reports version 0.1.32. 2 minutes. | ||||||
| 44 | release-downloader | Runs | 100 / 100 | TypeScript | 256 | |
Github action to download release assets from private or public repositories What the test found: The release-downloader GitHub Action installs, builds, and passes all 48 tests across 6 test suites on Node.js v18.19.1, with code bundled into dist/index.js via rollup. 3 minutes. | ||||||
| 45 | env-ci | Runs | 100 / 100 | JavaScript | 243 | |
Get environment variables exposed by CI services What the test found: All 113 tests pass under Node 24. Lint passes. Coverage 99.6% statements. The library correctly detects CI services from environment variables. 2 minutes. | ||||||
| 46 | tagref | Runs | 100 / 100 | Rust | 242 | |
Manage cross-references in your code. What the test found: Tagref 1.14.0 installed and verified: prebuilt binary and source build both run, its 29-test suite passes, and it validates real tag/group/reference fixtures with correct exit codes on both passing and failing cases. 2 minutes. | ||||||
| 47 | lazy-bird | Runs | 100 / 100 | Python | 239 | |
Universal development automation for ANY project. Claude Code implements features, runs tests, creates PRs autonomously. 15+ framework presets or custom... What the test found: A clean venv install of lazy-bird builds and imports all modules, the full pytest suite passes 803 tests with 17 skips, and the web backend serves HTTP 200 on its root, system status, and projects endpoints on port 5137. 10 minutes. | ||||||
| 48 | glim | Runs | 100 / 100 | Rust | 232 | |
A TUI for monitoring GitLab CI/CD pipelines and projects What the test found: glim-tui 0.2.1 compiles and runs on Ubuntu 24.04 x86_64 with OpenSSL 3. All 26 unit tests in client/api, client/config, client/error, client/poller, client/service, and client/tests pass. 3 minutes. | ||||||
| 49 | konflux-ci | Runs | 100 / 100 | Go | 226 | |
Trusted builds made easy! A cloud-native software factory for building, testing, and releasing trusted software artifacts What the test found: Operator builds and lints clean; full unit/envtest suite passes; the built manager ran against a live kube-apiserver, answered /healthz 200, created all sub-CRs and namespaces from a Konflux CR, and reported component conditions; operand pods cannot schedule because this container has no container runtime. 18 minutes. | ||||||
| 50 | ci-detector | Runs | 100 / 100 | PHP | 222 | |
Detect continuous integration environment and get information of current build What the test found: The PHP library is installed, all 44 PHPUnit tests pass, lint and static analysis pass, and the CI detection works end-to-end on simulated GitHub Actions environments (detects CI name, branch, commit, PR status, target branch, repo name/url). 4 minutes. | ||||||
| 51 | cifuse | Runs | 100 / 100 | JavaScript | 215 | |
Turn noisy CI logs into grouped failures, exact evidence and investigation steps. Offline CLI, reusable GitHub Action and bilingual browser workbench. No API... What the test found: All 42 tests pass, CLI produces valid analysis reports in markdown and JSON format, and the static site builds to dist/ with no errors. 1 minute. | ||||||
| 52 | Clausura | Runs | 100 / 100 | Rust | 205 | |
CI-native agent CLI tool for deterministic pipeline gating. What the test found: The Clausura project builds from source, all 416 tests pass, and the CLI binary runs correctly responding to --version and all subcommand help flags. 3 minutes. | ||||||
| 53 | CumulusCI | Runs | 97.1 / 100 | Python | 404 | |
Python framework for building portable automation for Salesforce projects What the test found: CLI installed and responds correctly; 3231 unit tests pass; 2 VCR-based Salesforce upsert tests fail due to cassette format incompatibility with vcrpy 8.x that requires re-recording against a live Salesforce org. 38 minutes. | ||||||
| 54 | opensre | Runs | 96 / 100 | Python | 14,304 | |
The open-source agent for CI/CD reliability. What the test found: OpenSRE v0.1 is installed from source and builds successfully; the CLI starts and responds to all commands (help, health, doctor, version); all 274 tests and all quality gates (lint, format, typecheck, import checks) pass. 5 minutes. | ||||||
| 55 | earthly | Runs | 96 / 100 | Go | 12,050 | |
Super simple build framework with fast, repeatable builds and an instantly familiar syntax, like Dockerfile and Makefile had a baby. What the test found: The earthly CLI builds from source and its real Go unit-test suite runs green (128 passed, 0 failed, 31 packages ok); --version, --help, ls, doc, config, and bootstrap all execute successfully, while actual builds cannot run because this sandbox forbids user namespaces, mount(2), and setuid, so no real buildkit... 84 minutes. | ||||||
| 56 | concourse | Runs | 96 / 100 | Go | 7,943 | |
Concourse is a container-based automation system written in Go. It's mostly used for CI/CD. What the test found: Concourse binary compiles and runs (--help, --version, generate-key all work). 27 Go unit test suites pass (flag, tracing, vars, fly commands/subsystems, worker runtime/spec/integration/network, atc engine/resource/vault/transport, worker baggageclaim volume). Elm frontend dependencies installed; subset of Elm unit... 23 minutes. | ||||||
| 57 | werf | Runs | 96 / 100 | Go | 4,738 | |
A solution for implementing efficient and consistent software delivery to Kubernetes facilitating best practices. What the test found: werf builds and all 53 unit test suites pass on Ubuntu 24.04 amd64 (no root, no Docker). CGO tests need CGO_CPPFLAGS=-I/tmp/btrfs-extract/usr/include to find libbtrfs headers. Git global user identity must be set for git_repo tests. 28 minutes. | ||||||
| 58 | tbls | Runs | 96 / 100 | Go | 4,401 | |
tbls is a CI-Friendly tool to document a database, written in Go. What the test found: tbls 1.96.0 builds from source, passes all 20 test packages (unreachable DB servers skipped), and documents an SQLite database end-to-end producing correct Markdown, SVG, and JSON output. 12 minutes. | ||||||
| 59 | erda | Runs | 96 / 100 | Go | 2,756 | |
An enterprise-grade Cloud-Native application platform for Kubernetes. What the test found: Go 1.24.13 installed, proto generated code built, kms binary runs and prints usage, erda-cli binary runs and prints version, 111 test packages pass with 0 failures. 23 minutes. | ||||||
| 60 | kuberhealthy | Runs | 96 / 100 | Go | 2,279 | |
A Kubernetes operator for running synthetic checks as pods. Works great with Prometheus! What the test found: The Kuberhealthy v3 controller builds, its full Go test suite passes, it runs as leader against a real kube-apiserver/etcd control plane, serves all documented HTTP endpoints with 200, and completes a HealthCheck run from schedule to checker-pod creation to report to updated /json status and Prometheus metrics. 11 minutes. | ||||||
| 61 | keycloak-config-cli | Runs | 96 / 100 | Java | 1,223 | |
Import YAML/JSON-formatted configuration files into Keycloak - Configuration as Code for Keycloak. What the test found: Project compiles, packages into a valid Spring Boot executable JAR, and all 338 unit tests pass with 0 failures. 4 minutes. | ||||||
| 62 | expo-github-action | Runs | 96 / 100 | TypeScript | 1,037 | |
Expo GitHub Action makes it easy to automate EAS builds or updates What the test found: npm install succeeds, all 115 Jest tests pass across 12 suites with 8 matching inline snapshots, and all 9 ncc-compiled action bundles (setup, preview, preview-comment, command, fingerprint, fingerprint-post, continuous-deploy-fingerprint, continuous-deploy-fingerprint-info, preview-build) are present and loadable. 5 minutes. | ||||||
| 63 | jenkins-library | Runs | 95 / 100 | Go | 823 | |
Jenkins shared library for Continuous Delivery pipelines. What the test found: Go 1.27.4 installed from tarball at /tmp/go; piper binary built at /tmp/piper (189 MB); all 2394 unit tests pass with 0 failures across 16 test packages; the binary runs and displays help with ~160 available commands. 8 minutes. | ||||||
| 64 | jumpstarter | Runs | 95 / 100 | Python | 236 | |
Hardware testing for the software world. Real or virtual, local or remote, human, automated or agentic. What the test found: Jumpstarter monorepo installs and builds (uv sync, uv build, controller make build with Go 1.26.3, cargo build with Rust 1.99.1), and the full test suite passes: Python packages all green except the qemu-img/qemu-system-dependent driver tests which skip or fail only due to missing system QEMU binaries, Go controller... 74 minutes. | ||||||
| 65 | backend | Runs | 93.3 / 100 | TypeScript | 486 | |
Prod Forge is an open-source reference that shows how to build and operate a production-ready system: AI-assisted development, quality gates, CI/CD... What the test found: The NestJS Todo API builds, launches, and serves all API endpoints (auth, todos, version, health, metrics, swagger) backed by PostgreSQL and Redis, with all 483 unit tests passing. 22 minutes. | ||||||
| 66 | miniblue | Runs | 93.3 / 100 | Go | 451 | |
Local Azure development. One binary. No account needed. 25+ emulated services for testing, CI and local dev. What the test found: miniblue builds, starts on port 4566, responds to /health with HTTP 200, serves 30 Azure service emulations, and passes 211 tests across all unit/e2e test suites. The azlocal CLI correctly creates resource groups and manages keyvault secrets against the running server. 10 minutes. | ||||||
| 67 | github-pages-deploy-action | Runs | 91 / 100 | TypeScript | 4,611 | |
🚀 Automatically deploy your project to GitHub Pages using GitHub Actions. This action can be configured to push your production-ready code into any branch... What the test found: Node v24.13.0 installed via n, rsync 3.2.7 extracted from Ubuntu noble debs, npm install clean, tsc build compiles to lib/, all 75 jest tests pass, eslint reports 0 issues, prettier reports all files formatted correctly. 10 minutes. | ||||||
| 68 | setup-php | Runs | 91 / 100 | TypeScript | 3,279 | |
GitHub action to set up PHP with extensions, php.ini configuration, coverage drivers, and various tools. What the test found: Dependencies installed and the project builds under Node v24.22.2; the full jest suite (605 tests, 9 suites) passes with exit 0 and 100% coverage; the compiled action bundles and starts correctly but the PHP system install is blocked by the container lacking root/sudo. 14 minutes. | ||||||
| 69 | paths-filter | Runs | 90 / 100 | TypeScript | 3,408 | |
Conditionally run actions based on files modified by PR, feature branch or pushed commits What the test found: npm ci completed with one engine warning, tsc build succeeded, jest suite passed 78/78, and the action run against a real scratch git repo detected a modified a.js and set src=true output. 30 minutes. | ||||||
| 70 | Tracely-ai | Runs | 90 / 100 | Python | 1,122 | |
Trace-native CI/CD for AI agents, production failures become regression tests that block the PR. Auto-detect, cluster, freeze into hermetic cases, replay in CI... What the test found: All Python dependencies and frontend node_modules install, the backend API server starts on port 8000, the frontend builds with Next.js, the hermetic test suites (back-end, SDK, and frontend) pass 1478 tests total, and the Python codebase passes ruff lint. 12 minutes. | ||||||
| 71 | ex_check | Runs | 80 / 100 | Elixir | 331 | |
One task to efficiently run all code analysis & testing tools in an Elixir project. Born out of 💜 to Elixir and pragmatism. What the test found: Elixir 1.20.4 and Erlang/OTP 29.1.1 installed via asdf without apt; deps fetched and project compiles; all 82 unit tests pass; mix check runs all 11 tools, 10 pass, hex_audit fails on CVE advisories in mint and decimal (transitive deps, not project bugs). 15 minutes. | ||||||
| 72 | onedev | Runs | 73.3 / 100 | Java | 15,372 | |
The Unified and Autonomous Development Platform What the test found: OneDev builds and compiles from source with all 86 tests passing, and the server starts on localhost:6610 returning HTTP 200 with the setup initialization page. 38 minutes. | ||||||
| 73 | FTP-Deploy-Action | Runs | 60 / 100 | TypeScript | 5,317 | |
Deploys a GitHub project to a FTP server using GitHub actions What the test found: The FTP-Deploy-Action repository installed cleanly, its 23 Jest tests all passed, and the ncc build bundled src/main.ts into dist/index.js without errors. 2 minutes. | ||||||
| 74 | vps-audit | Runs | 60 / 100 | Shell | 3,321 | |
lightweight, dependency-free bash script for security, performance auditing and infrastructure monitoring of Linux servers. What the test found: vps-audit.sh runs to completion with exit code 0, prints color-coded PASS/WARN/FAIL on 20 security checks, and writes a timestamped report file to disk with no shell errors. 2 minutes. | ||||||
| 75 | jreleaser | Runs | 60 / 100 | Java | 1,250 | |
:rocket: Release projects quickly and easily with JReleaser What the test found: The JReleaser CLI builds with Gradle 8.14.3 on the bundled OpenJDK 21.0.2, its test suite passes 472/472, and the installed binary answers --version, creates a jreleaser.yml via init, and generates brew packager templates. 28 minutes. | ||||||
| 76 | abstruse | Runs | 60 / 100 | Go | 963 | |
Abstruse is a free and open-source CI/CD platform that tests your models and code. What the test found: Both abstruse-server and abstruse-worker binaries compile and run; the server serves HTTP 200 with the Abstruse CI web UI on port 8765 using SQLite without external dependencies. 10 minutes. | ||||||
| 77 | github-slug-action | Runs | 60 / 100 | Shell | 359 | |
GitHub Action to expose slug value of GitHub environment variables inside your GitHub workflow What the test found: All 14 environment variables (SLUG, SLUG_URL, SLUG_CS, SLUG_URL_CS, SHORT, owner/name parts, with prefix support) generated correctly; maxlength truncation, custom short-length, and input validation all work as specified. 4 minutes. | ||||||
| 78 | temps | Runs | 50 / 100 | Rust | 941 | |
AI-native open-source alternative to Vercel + Sentry + PostHog + Pingdom + Resend + E2B. 440+ CLI operations with drop-in skills for Claude Code, Codex &... What the test found: Temps built from source runs a control-plane server on 127.0.0.1:8081 against a Postgres 17.4 + TimescaleDB/pgvector/pg_tsparser mock database, serves /health 200 and an authenticated API that created and listed a real project; all 276 database migrations and the web console build complete successfully. 85 minutes. | ||||||
| 79 | cds | Runs with mocks | 92 / 100 | Go | 4,847 | |
Enterprise-Grade Continuous Delivery & DevOps Automation Open Source Platform What the test found: All three Go binaries (cds-engine, cds-worker, cdsctl) build and print correct version metadata. All 33 standalone Go test packages pass. The Angular UI builds to production. The kubernetes contrib plugin build failure is fixed. 36 minutes. | ||||||
| 80 | test-reporter | Runs with mocks | 92 / 100 | TypeScript | 1,187 | |
Displays test results from popular testing frameworks directly in GitHub What the test found: With Node 24 in PATH, npm ci installed 643 packages, tsc build exited 0, eslint/prettier checks exited 0, npm test passed 177/177, and running the action dist/index.js on the jest-junit fixture exited 0 and produced a summary plus outputs showing 1 passed, 4 failed, 1 skipped. 6 minutes. | ||||||
| 81 | jenkinsapi | Runs with mocks | 92 / 100 | Python | 884 | |
A Python API for accessing resources and configuring Hudson & Jenkins continuous-integration servers What the test found: The jenkinsapi Python package (0.3.20) installs, imports, and passes all 261 unit tests via pytest with mock-based verification; CLI entry points jenkinsapi_version and jenkins_invoke respond correctly. 2 minutes. | ||||||
| 82 | ue4-docker | Runs with mocks | 92 / 100 | Python | 840 | |
Windows and Linux containers for Unreal Engine 4 What the test found: ue4-docker 0.0.124 is installed in a Python venv at /work/repo/venv; all package imports succeed; CLI 'version', 'info', 'diagnostics all' (4/4 passed), 'setup', 'clean' and 'build --dry-run' (generates 27 docker build commands for UE 5.4) all work against a mock Docker API; real Docker image builds require a Docker... 16 minutes. | ||||||
| 83 | run-on-arch-action | Runs with mocks | 92 / 100 | Shell | 752 | |
A Github Action that executes jobs/commands on non-x86 cpu architectures (ARMv6, ARMv7, aarch64, s390x, ppc64le, riscv64) via QEMU What the test found: The repository is syntactically valid with all npm dependencies installed. One real bug in the shell script (incorrect array declaration collapsing docker arguments) was found and fixed. The full action pipeline runs to completion under mock conditions, exercising all code branches including custom base images, GitHub... 9 minutes. | ||||||
| 84 | chart-releaser-action | Runs with mocks | 92 / 100 | Shell | 668 | |
A GitHub Action to turn a GitHub project into a self-hosted Helm chart repo, using helm/chart-releaser CLI tool What the test found: The chart-releaser action installs cr v1.7.0 successfully, packages Helm charts, creates GitHub releases, and generates Helm repository index files; the upstream cr binary has a panic in GetPushURL for non-HTTPS git remotes that does not affect real GitHub usage. 17 minutes. | ||||||
| 85 | Odevio-CLI | Runs with mocks | 92 / 100 | Python | 425 | |
Build, sign and publish iOS apps from any OS - no Mac, no Xcode. Driven by your AI agent What the test found: Odevio CLI 1.3.0 installs in a venv, prints its version and copyright, and the bundled test suite runs user account, team, and Apple developer account CRUD flows against a Flask mock server built to replace the production API. 43 minutes. | ||||||
| 86 | powerplatform-build-tools | Runs with mocks | 92 / 100 | TypeScript | 313 | |
Power Platform Build Tools automate common build and deployment tasks related to Power Platform. This includes synchronization of solution metadata (a.k.a... What the test found: The project compiles successfully via webpack and all 126 unit tests pass. Component and functional tests are gated behind real Power Platform credentials (PA_BT_ORG_PASSWORD) which are not available in this container. 7 minutes. | ||||||
| 87 | bitbucket-cli | Runs with mocks | 92 / 100 | Go | 266 | |
Bitbucket CLI with gh-like ergonomics What the test found: The bkt CLI built from source in this container; its version/help commands exit 0, all 2148 unit tests pass, and repo/project list and repo view commands return correct text and JSON output against a local Bitbucket DC mock server. 3 minutes. | ||||||
| 88 | terraform-module-releaser | Runs with mocks | 92 / 100 | TypeScript | 236 | |
GitHub Action to automate versioning, releases, and documentation for Terraform modules in monorepos. What the test found: npm install succeeds, TypeScript compiles clean, and 814 of 821 tests pass on Node 24 with terraform-docs v0.21.0 installed to ~/.local/bin/. The 4 skipped/failed suites are GitHub API integration tests requiring a real GITHUB_TOKEN. 4 minutes. | ||||||
| 89 | compose-action | Runs with mocks | 92 / 100 | TypeScript | 211 | |
This action runs your docker-compose file and clean up before action finished What the test found: Full source compiles, packages, and passes all 72 unit tests with 100% branch/line/function coverage. The GitHub Action is ready for use in a CI runner with Docker available. 2 minutes. | ||||||
| 90 | build-monitor-plugin | Runs with mocks | 88 / 100 | Java | 728 | |
Jenkins Build Monitor Plugin What the test found: The plugin builds (HPI contains the Vite bundle), its full Maven+Vitest suite passes in this container, and a standalone Jenkins 2.516.3 with the plugin installed serves a live Build Monitor view at /view/Monitor/ (HTTP 200) with the frontend bundle at /plugin/build-monitor-plugin/js/bundles/app.js (HTTP 200). 38 minutes. | ||||||
| 91 | gojenkins | Runs with mocks | 86 / 100 | Go | 906 | |
Jenkins API Client in Go. Looking for maintainers to move this project forward. What the test found: Go 1.21.9 compiler installed; gojenkins library builds and all 278 unit tests pass; CLI binary compiles and responds to help and version commands. 5 minutes. | ||||||
| 92 | drone-cli | Runs with mocks | 82 / 100 | Go | 436 | |
Command Line Tools for Drone CI What the test found: The drone CLI builds and installs with Go 1.23.8, its test suite passes (2 tests PASS, no failures), and the binary successfully runs version, lint, starlark/jsonnet code generation, and info, repo ls, build ls and sign commands against a local mock Drone server. 5 minutes. | ||||||
| 93 | github-act-runner | Runs with mocks | 77 / 100 | Go | 399 | |
act as self-hosted runner What the test found: Project builds with go build, binary answers version and help commands, go test suite passes (10 tests across 4 packages), and the runner successfully executed format-substitution.yml and loglevel.yml workflows end-to-end against the runner.server v3.11.16 mock with failing workflows correctly reported as failed. 8 minutes. | ||||||
| 94 | kind-action | Runs with mocks | 76 / 100 | Shell | 384 | |
A GitHub Action for Kubernetes IN Docker - local clusters for testing Kubernetes What the test found: kind v0.33.0 and kubectl v1.37.0 binaries are downloaded, SHA256-verified, cached under RUNNER_TOOL_CACHE, and execute successfully in install-only mode; the Node.js wrapper and shell entrypoints all work with exit code 0. 1 minute. | ||||||
| 95 | industrial_ci | Runs with mocks | 76 / 100 | Shell | 301 | |
Easy continuous integration repository for ROS repositories What the test found: The industrial_ci Python package installs, all shell scripts pass syntax check, the travis config parser module lists jobs from .travis.yml correctly, and ROS distribution configuration maps to correct OS/builder settings. 10 minutes. | ||||||
| 96 | toast | Runs with mocks | 56 / 100 | Rust | 1,636 | |
Containerize your development and continuous integration environments. 🥂 What the test found: Toast binary builds from source, all 79 unit tests pass, --version/--help/--list CLI commands work, but Docker-dependent container execution is untestable without Docker daemon. 3 minutes. | ||||||
| 97 | pipecd | Runs with mocks | 56 / 100 | Go | 1,371 | |
The One CD for All {applications, platforms, operations} What the test found: PipeCD Go binaries build and run, 126 Go packages plus all 192 web tests pass, and the controlplane serves HTTP/admin/health endpoints backed by locally stood-up Redis, MinIO, and MariaDB mocks; only the pkg/oci test remains unfixable without a Docker daemon. 50 minutes. | ||||||
| 98 | cirrus-cli | Runs with mocks | 56 / 100 | Go | 294 | |
CLI for executing Cirrus tasks locally and in any CI What the test found: Cirrus CLI builds successfully with Go 1.27.3, all 55 test packages pass, and the binary produces its version and help output. 43 minutes. | ||||||
| 99 | tecli | Runs with mocks | 56 / 100 | Go | 219 | |
In a world where everything is Terraform, teams use Terraform Cloud API to manage their workloads. TECLI increases teams productivity by facilitating such... What the test found: TECLI builds from source, version and help commands display correctly, and 24 Go tests pass without real TFC credentials using a mocked API token. 14 minutes. | ||||||
| 100 | continuous-integration | Runs with mocks | 48 / 100 | Python | 303 | |
Bazel's Continuous Integration Setup What the test found: Python core CI orchestrator (bazelci.py) and its 55 unit tests pass, bcr-pr-reviewer Node.js action passes 9 tests, and the CLI prints usage; the aggregate_incompatible_flags_test_result_test has a pre-existing stale test data mismatch, and other components require Go, Rust, or Java not available in this container. 7 minutes. | ||||||
| 101 | flagsmith | Runs with mocks | 46 / 100 | Python | 8,627 | |
Flagsmith is an open-source feature flag platform with remote config and experimentation. Choose from self-hosted or cloud deployment options. What the test found: Python API dependencies installed via uv, Django checks pass with custom SQLite backend, 41 API unit tests pass, 719 frontend unit tests pass, npm postinstall env config resolves correctly; full PostgreSQL/ClickHouse dependent test suite cannot run without Docker database services. 40 minutes. | ||||||
| 102 | devops-basics | Could not verify | 80 / 100 | Shell | 1,872 | |
🚀 Practical and document place for DevOps toolchain What the test found: MkDocs site builds and generates all 40+ topic pages with full Material for MkDocs theme, search, and navigation. 3 minutes. | ||||||
| 103 | magic-nix-cache-action | Could not verify | 80 / 100 | TypeScript | 573 | |
Save 30-50%+ of CI time without any effort or cost. Use Magic Nix Cache, a totally free and zero-configuration binary cache for Nix on GitHub Actions. What the test found: npm install, npm run build (tsup), npm run package (ncc), npm run lint all pass; executing the action emits the expected Nix-not-installed warning and exits 0. 6 minutes. | ||||||
| 104 | dagger | Could not verify | 50 / 100 | Go | 16,640 | |
Automation engine to build, test and ship any codebase. Runs locally, in CI, or directly in the cloud What the test found: Dagger CLI v0.21.9 is installed and responds to help/version commands; 15 Go unit test packages and 13 Python SDK tests pass; the Dagger engine cannot start because no container runtime is available in this environment and user namespaces are blocked. 22 minutes. | ||||||
| 105 | xcov | Could not verify | 50 / 100 | Ruby | 573 | |
Nice code coverage reporting without hassle What the test found: could not be verified; the log shows where it stopped. 1 minute. | ||||||
| 106 | docker-ci-automation | Could not verify | 50 / 100 | Shell | 357 | |
GitHub Actions automation examples with Docker's official actions What the test found: All repository files are syntactically valid and pass their respective linters; Docker runtime is not available to execute container builds or workflows. 2 minutes. | ||||||
| 107 | maestro-runner | Could not verify | 20 / 100 | Go | 535 | |
Fast mobile UI test automation for Android, iOS, React Native, Flutter & Expo. Open-source Maestro alternative, 100% free, no features behind a paywall... What the test found: could not be verified; the log shows where it stopped. | ||||||
| 108 | levelrail | Could not verify | 10 / 100 | Go | 235 | |
Git push to production on your own servers. One Go binary, about 200 MB idle, with rollbacks, previews, HTTPS, databases and 570+ one-click apps built in... What the test found: could not be verified; the log shows where it stopped. 2 minutes. | ||||||
| 109 | argo-cd | Could not verify | 0 / 100 | Go | 24,678 | |
Declarative Continuous Deployment for Kubernetes What the test found: could not be verified; the log shows where it stopped. 87 minutes. | ||||||
| - | moon | Not yet tested | - | Rust | 4,195 | - |
| - | magic-nix-cache | Not yet tested | - | Rust | 385 | - |
| - | build | Not yet tested | - | JavaScript | 265 | - |
| - | autotag | Not yet tested | - | Go | 207 | - |
runs installed and started with its real dependencies. runs with mocks started after stand-ins replaced external services such as a database or a third-party API. could not verify neither the standard agent nor the stronger one got it running within the time limit; the log shows where it stopped.
How we tested
On this list as of the latest test: 78 projects ran as-is, 23 with mocks, 8 could not be verified, 4 still waiting. Languages tested: C, Elixir, Go, Java, JavaScript, PHP, Python, Ruby, Rust, Shell, TypeScript. Every attempt used a clean single-use machine, the subject at a pinned version, and a 90-minute limit for standard projects; the complete procedure is on the methodology page.
Frequently asked questions (FAQs)
How is this list ranked?
By measurement, not opinion: projects Argusic installed and launched on a fresh machine come first, then those that ran with mocks in place of external services, then those it could not verify. Ties go to the Argusic Score, then how popular it is on its own source.
Why are some projects unranked?
4 projects are still waiting for a test or for a finished attempt. They are listed without a rank until Argusic has measured them.
Where is the evidence?
Every row links to the project's Argusic page, where each run has a full log and a terminal recording stored with a sha256 fingerprint. The same pages exist for every one of the tested projects, on this list or not.
More lists in this category
- self-hosted AI apps (shares Tracely-ai, ai-development-patterns, levelrail with this list)
- observability tools (shares Tracely-ai, openchoreo, opensre with this list)
- developer CLI tools (shares circleci-cli, xcov with this list)
- wikis (shares onedev, terraform-module-releaser with this list)
- LLM gateways (shares temps with this list)
- browser automation tools (shares puppetry with this list)
- open source coding agents (shares kelos with this list)
- low-code platforms (shares puppetry with this list)
- project management tools (shares onedev with this list)
- self-hosted git servers (shares onedev with this list)
- AI agent frameworks
- API clients
- API gateways
- CMS platforms
- MCP servers
- VPN tools
- backup tools
- code editors
- Open source databases, installed and queried
- e-commerce platforms
- ebook readers
- game engines
- open source games
- home automation tools
- map tools
- message queues
- Open source music servers, installed and played
- Open source office suites, installed and launched
- self-hosted password managers
- screen recorders
- search engines
- self-hosted analytics
- speech tools
- static site generators
- uptime monitors
- vector databases
- open source video editors
- video players
- web scraping tools
- whiteboard tools
- workflow automation tools
- self-hosted Notion alternatives
- self-hosted dashboards