Demo mode shows realistic sample traffic. Live mode connects to the real gateway and reflects requests sent from this page.

Type your own question in the box, or pick one of the examples below.

Try asking:
Ask a question to see how Conduit routes it
Try: What is Python?
Switch to Live to chat

Dashboard

Original cost↘18.7%
$
All-frontier baselineavg $0.0068 per request
Modeled cost↘41.2%
$
Routed to cheaper tiersavg $0.0002 per request • 31.2% cache hit rate
Total savings↗46.3%
$
Savings compounding97.6% cost reduction vs. baseline
% saved↗97.6%
%
Strong cost efficiencycost cut vs. baseline
Total requests↗35.3%
Traffic steady this period31.2% cache hit rate • 2,839 provider requests
Input tokens3.7M$0.45 spend
Output tokens1.9M$0.22 spend
Cached tokens1.2M$8.69 • included in input
Top modelgroq 8bvia groq
Requests over time

Rolling last 24 hours, requests per hour · hour of day in your local time

Cache hit rate↗12.4%
0%
Semantic cache active1,288 hits · 4,127 scanned
Failover events↘8.1%
Chain survived3 providers up · last event —
Latency (P50)↘5.3%
ms
Typical response timeP95 1,290ms · P99 2,740ms
Routing mix

Share of requests each model tier handled, from cheapest and fastest to full escalation when a request needs it. T1/T2 are the cheap, fast backbone; T3 runs locally at zero cost; T4/T5 are rare escalations for requests the cheaper tiers couldn't handle.

%
T1groq 8b
%
T2groq 70b
%
T3ollama
%
T4openrouter
%
T5gemini
Cost per tier

Modeled spend by routing tier, in USD. The local tier (T3) runs free, escalating to bigger models costs more. Shown to 6 decimal places, Groq's per-token pricing runs in fractions of a cent, so real spend here is intentionally tiny, not a display bug.

Router decisions
Last 50
TimeDifficultyConfidenceTierReason
02:20:00Easy
88%
groq 8bconfidence 0.94 ≥ floor → cheapest tier
02:19:15Easy
88%
groq 8bconfidence 0.94 ≥ floor → cheapest tier
02:18:30Easy
88%
groq 8bconfidence 0.94 ≥ floor → cheapest tier
02:17:45Easy
88%
groq 8bconfidence 0.94 ≥ floor → cheapest tier
02:17:00Easy
88%
groq 8bconfidence 0.94 ≥ floor → cheapest tier
02:16:15Easy
88%
groq 8bconfidence 0.94 ≥ floor → cheapest tier
02:15:30Easy
88%
groq 8bconfidence 0.94 ≥ floor → cheapest tier
02:14:45Hard
55%
groq 70bdifficulty 0.81 → hard escalation to T2
02:14:00Hard
55%
groq 70bdifficulty 0.81 → hard escalation to T2
02:13:15Easy
88%
ollamaconfidence 0.94 ≥ floor → cheapest tier
02:12:30Easy
88%
ollamaconfidence 0.94 ≥ floor → cheapest tier
02:11:45Hard
55%
openrouterdifficulty 0.81 → hard escalation to T2