inference-gateway
An open-source, cloud-native, high-performance gateway unifying multiple LLM providers, from local solutions like Ollama to major cloud providers such as OpenAI, Groq, Cohere, Anthropic, Cloudflare and DeepSeek.
Not yet testedsource: GitHubhomepageGoApache-2.0commit 97fe89fbe7c5
Go, Apache-2.0 licensed. The project labels itself: agnostic, anthropic, api, deepseek v4 pro, gateway, gateway api, golang and inference api.
inference-gateway has not been verified yet.
Measured by Argusic on a fresh machine every time. Every number links to its evidence.
At a glance
Subject data from GitHub, linked at the top of this page, refreshed . Test data by Argusic (CC BY 4.0); every number links to a run page with the full log, the recording, and their sha256 hashes.
Also tested, in the same area
Every one of these was installed and run by Argusic on a clean machine. Nothing appears here that was not tested.
Run history
No recorded runs.
Topics (from GitHub)
agnosticanthropicapideepseek-v4-progatewaygateway-apigolanginference-apikubernetesllmmcpopenaiopensourceopensource-projectsopentelemetryperformanceproxyproxy-serverself-hostedtracing
Embed the badge
Markdown for the project README. It links back here; terms on the terms page.
[](https://argusic.com/subject/inference-gateway)Questions
- Does inference-gateway run?
- inference-gateway has not been fully verified yet. No recorded run has produced a verdict yet.
- How did Argusic test inference-gateway?
- On a fresh, disposable machine, with every command recorded. 0 attempts are recorded, and the full method is on the methodology page.
- Where is the evidence for inference-gateway?
- All 0 recorded runs are on this page, each linking to its full log and terminal recording, stored with a sha256 fingerprint so it cannot be quietly altered.