Roadmap
The Hub is actively growing. Here's what's live now, what's coming next, and our long-term vision.
A native SDK, real-time security alerts, agentic cost protection, intelligent caching, and compliance-ready audit logging.
Official SDK ✅
pip install aisg — live on PyPI. Native Python client with typed metadata, structured errors, and model discovery.
Recursive Loop Protection ✅
Shipped. Detects and kills runaway agent loops before they drain your credits. 60s window, 30s cooldown.
Semantic Caching ✅
Shipped. Cache identical DLP-cleaned prompts. Cache hits eliminate the LLM call entirely — zero cost, zero latency. Backed by a low-latency distributed cache.
Webhook Notifications ✅
Shipped. HMAC-signed webhooks for PII blocks, prompt injection, redaction, budget alerts, and loop detection. Up to 5 per project.
EU AI Act Logging ✅
Shipped. Hash-chained, tamper-evident audit records with input/output fingerprints, JSONL export, and chain verification API. Ready for August 2026 enforcement.
Deploy the AISG proxy inside your own infrastructure. Prompts never leave your network — DLP, PII redaction, and budget enforcement run on-prem. Cloud dashboard manages policies, analytics, and multi-project governance.
SaaS convenience meets on-prem data sovereignty. Hybrid VPC, SSO, RBAC, and SIEM connectors — all shipped.
Hybrid VPC Deploy ✅
Shipped. Run the compiled Go proxy in your VPC. Cloud dashboard manages policies; prompts never leave your infrastructure. Docker Compose or Kubernetes, 3 containers, 4GB RAM minimum.
SAML SSO ✅
Shipped. Self-hosted BoxyHQ Jackson — Okta, Azure AD, Google Workspace, any SAML 2.0 IdP. Auto-provisioning with configurable default roles.
SIEM Connectors ✅
Shipped. Stream security events to Splunk HEC, Datadog Logs, or Microsoft Sentinel. Tokens stored in Secrets Manager, outbound HTTPS only.
RBAC & Team Management ✅
Shipped. 4-tier roles (owner, admin, member, viewer), org model, invitations, and per-team policy assignment.
Our top priority — now in public beta. As teams move from chatbots to autonomous agents, governance shifts from static prompt filtering to real-time control of the tool plane. The MCP Gateway extends AISG’s inline trust-boundary model to the tool↔LLM flow — the same DLP and injection defense, applied where agents call tools.
When AI agents call tools, execute code, and make decisions autonomously — who’s watching the tool plane?
MCP Gateway ✅ (Beta)
Live in beta. An aggregating proxy between agents and MCP servers — enforce policy on every tool call and result, across any LLM, in cloud or in-VPC.
Tool-Result DLP ✅ (Beta)
Live in beta. Scan tool and database outputs for PII before they enter the model’s context. Redact or block — fail closed.
Schema Pinning / Rug-Pull Guard
Building. Pin approved tool schemas and block silent redefinition — a known MCP attack vector.
Human-in-the-Loop
Building. Approve or deny high-risk agent actions in real time, with full audit + SIEM streaming.
Granular budget controls and next-generation prompt injection defense.
Multi-Provider Quotas
Set one budget across all providers. Get alerted at 50%, 80%, and 100% via Webhook or Slack.
ML Jailbreak Detection
Deep learning classifiers that catch attacks regex can’t — semantic similarity, encoding exploits, and novel patterns.
Policy-Based Routing
Automatically restrict to low-cost models when a project crosses a spending threshold.
Stop guessing which model is best for your specific prompts. The world's first Financial & Quality Optimizer for production AI is here.
Smart Model Selection
Automatically pick the best model for each prompt based on quality, latency, and cost.
Cost Optimization
Reduce redundant AI spend through semantic caching and smart routing on production workloads.
Quality Benchmarking
Continuous evaluation of model responses against your quality criteria in real time.
Get notified when new features launch:
No credit card required · Start in 60 seconds