Search for a command to run...
IBM is solving real-time data for agents. AWS is solving inference speed. Both are foundational. Here's how Rynko Flow adds an output validation layer to complement what they're building.
No comments yet. Be the first to comment.
How we built Rynko — a validation gateway and document generation platform for AI agents. Architecture decisions, MCP integrations, performance benchmarks, and lessons from shipping infrastructure that agents use autonomously.
Microsoft open-sourced a runtime governance platform for AI agents. It's the most comprehensive behavioral governance framework I've seen. Here's how Flow complements it by adding output validation to the pipeline.
Madrigal Pharmaceuticals turned production failures into their evaluation pipeline. They built this custom on LangSmith. Flow gives you the same feedback loop as infrastructure.
Your ESLint config catches 200 rule violations. Your tests pass. Coverage is above 80%. And the PR still has a function that does four things, catches generic errors, and string-concatenates a SQL query. Rules caught the mechanics. Nobody caught the architecture.
An AI agent receives a trade document. It needs to extract the HS codes, verify them against the Harmonized Tariff Schedule, check the vendor against an approved list, and flag anything that doesn't match. Before today, that was three systems and a lot of glue code. Now it's one pipeline with one API call.
Microsoft open-sourced a runtime governance platform for AI agents. It's the most comprehensive behavioral governance framework I've seen. Here's how Flow complements it by adding output validation to the pipeline.
Two announcements in the same week paint a clear picture of where enterprise AI infrastructure is headed, and both of them are exciting.
IBM closed its $11 billion acquisition of Confluent, the Kafka-based streaming platform used by 40% of Fortune 500 companies. The thesis is sound: enterprises moving from AI experimentation to production need live, continuously flowing data — not batch exports that arrive hours late. As Rob Thomas (IBM SVP) put it, "AI decisions need to happen just as fast" as the transactions generating the data. That's exactly right, and Confluent is the best platform in the world for making it happen.
Meanwhile, AWS announced a collaboration with Cerebras to bring wafer-scale inference to Amazon Bedrock. The CS-3 delivers thousands of times more memory bandwidth than the fastest GPU, targeting the decode bottleneck that slows agentic workloads. Andrew Feldman (Cerebras CEO) called it "blisteringly fast inference." Their disaggregated architecture pairs Trainium for compute-heavy prefill with Cerebras WSE for bandwidth-heavy token generation — an order of magnitude faster inference than what's available today. For anyone building real-time agentic workflows, this is a big deal.
These are the kind of infrastructure investments that make agentic systems practical at enterprise scale. They also got me thinking about where Rynko Flow fits into this picture.
The enterprise AI pipeline looks roughly like this:
IBM + Confluent handle the input: getting live, governed, trustworthy data to the agent. AWS + Cerebras handle the processing: making the agent produce output fast enough for real-time operations. Both are necessary — an agent making decisions on stale data is worse than no agent at all, and an agent that takes 30 seconds to respond isn't useful for time-sensitive workflows.
What we've been focused on at Rynko is the next step in that pipeline: once the agent processes that real-time data at speed and produces a result — an invoice, a purchase order, a compliance report — how do you validate that the result is correct before it reaches the downstream system?
This is a genuinely different problem from data freshness or inference speed, and it's the problem we built Flow to solve. Even with perfect input data, agents can submit "usd" instead of "USD", produce a total that's off by a rounding error, or silently drop a required field. The data flowing in was pristine. The processing was fast. The output still needs a checkpoint.
Flow is a validation gateway that sits between the agent's output and your downstream systems. You define a gate with a schema and business rules, the agent submits its output, and Flow validates it before the data moves forward. Failed submissions return structured errors the agent can use to self-correct. Passed submissions return a tamper-proof validation_id that the downstream system can verify to confirm nothing was modified in transit.
Say you have an order processing agent. Confluent is streaming real-time order events from your POS systems, inventory databases, and payment providers. The agent processes these events and produces a purchase order to send downstream. Here's the Flow gate that checks the agent's output:
Schema:
- order_id: string, required
- vendor: string, required
- amount: number, required, min 10
- currency: string, required, enum [USD, EUR, GBP]
- line_items: array of objects, required
Business Rules:
- amount > 0 ("Order amount must be positive")
- amount <= 100000 ("Single order cannot exceed $100,000")
- line_items.length > 0 ("Must have at least one line item")
The agent submits its payload. Flow validates it against the schema and evaluates every business rule. If the agent submitted amount: -500, it gets back:
{
"success": false,
"status": "validation_failed",
"errors": [
{ "rule": "amount > 0", "message": "Order amount must be positive" }
]
}
The agent self-corrects and resubmits. When validation passes, the response includes a validation_id:
{
"success": true,
"status": "validated",
"validation_id": "val_4f546e9bcb76f120c4984d72"
}
That validation_id is an HMAC-SHA256 hash of the validated payload, computed using canonical JSON serialization with recursively sorted keys. This means even if the payload passes through multiple systems that reorder the JSON keys or reformat the whitespace, the verification still works. The downstream system receives the payload and the validation_id from the agent, then calls Flow to verify:
curl -X POST https://api.rynko.dev/api/flow/verify \
-H "Authorization: Bearer $API_KEY" \
-H "Content-Type: application/json" \
-d '{
"validation_id": "val_4f546e9bcb76f120c4984d72",
"payload": { "order_id": "ORD-001", "vendor": "Acme", "amount": 500, ... }
}'
{
"verified": true,
"runId": "550e8400-e29b-41d4-a716-446655440000",
"gateName": "Order Validation",
"gateSlug": "order-validation"
}
If the agent tampered with the payload after validation — changed the amount, added a field, removed a required value — verification returns verified: false. The downstream system knows not to trust the data.
One concern I hear is whether validation adds meaningful latency to a real-time pipeline. We benchmarked Flow against enterprise-scale payloads — the kind of data you'd see flowing through Kafka in a large manufacturing or logistics operation.
We tested with a Sterling Commerce OMS-style order payload: 21 schema variables, 10 business rules, 900 order line items. The payloads were around 9MB for XML and 7.3MB for JSON.
| Metric | XML (9.1 MB) | JSON (7.3 MB) |
|---|---|---|
| Total round-trip | 4,989 ms | 4,401 ms |
| Server-side validation | ~50 ms | ~50 ms |
| Network upload (at ~800 KB/s) | ~3,800 ms | ~3,100 ms |
The validation itself — schema checks plus 10 business rule evaluations — takes about 50 milliseconds. The rest is network transfer. At typical payload sizes (a few KB for a single order or invoice), the validation adds single-digit milliseconds. For a 30-line order at 0.3MB, the total round-trip was 1,960ms with most of that being upload time over a standard connection.
Server-side processing is fast because Flow runs validation in-memory: schema validation against a pre-compiled variable array, then expression evaluation through a recursive descent parser for each business rule. No database queries during validation. Persistence runs asynchronously after the response is sent — payloads go to S3, run metadata goes to Postgres, both fire-and-forget so the agent gets its response immediately.
For Kafka-speed pipelines where even 50ms matters, Flow also supports webhook delivery — validation happens, and the validated payload is pushed directly to your endpoint without the agent needing to relay it. That eliminates the agent-as-middleman entirely.
Here's how I'd architect an agentic pipeline with all three layers working together:
Confluent handles data-in-motion: live events, governed, streaming at scale. Cerebras on Bedrock processes those events fast — the disaggregated Trainium+WSE architecture means agents produce structured output at speeds that make real-time workflows practical. Flow validates that output against your schema and business rules, returns errors for self-correction or a tamper-proof validation_id on success. The downstream system verifies the validation_id before accepting the data.
Three separate problems, three separate layers. Each one does its part well. Confluent ensures the agent gets good data. Cerebras ensures the agent processes it fast. Flow ensures the output is correct before it reaches production systems.
I want to be clear: Flow doesn't replace anything IBM, Confluent, AWS, or Cerebras are building. They're solving data infrastructure and inference speed — foundational problems that every enterprise needs addressed. These are massive, hard engineering challenges, and both acquisitions and partnerships reflect the kind of investment this space deserves.
What Flow adds is a complementary output validation layer. As agents move from experimental to production, and as the data flowing through them gets faster and the inference gets cheaper, the volume of agent-generated outputs hitting downstream systems is going to increase significantly. Having a validation checkpoint in that pipeline — one that catches domain-specific errors, enforces business rules, and provides tamper-proof verification — becomes more valuable as the rest of the stack gets faster.
AWS's Agentic AI Security Scoping Matrix (published November 2025) calls out many of the capabilities Flow provides: approval gateway enforcement, agent controls, audit trails, agency perimeters. We've mapped Flow against every scope in that framework — it covers Scopes 2 and 3 well, with partial coverage at Scope 4 where fully autonomous agents need capabilities beyond what a validation gateway provides alone.
If you're building agentic workflows on Kafka, Bedrock, or both, try dropping a Flow gate between your agent and your downstream system. The free tier gives you 500 validation runs per month and three gates — enough to see how output validation fits into your pipeline.
Rynko Flow is a validation gateway for AI agent outputs. Try it free or read the docs.