31
14
0
0
7
- Overview
- Monitor (31)
- Audit (14)
- Automate
What you can achieve
Capabilities are grouped around merchant outcomes, not API terminology.Protect revenue
Run operations
Control risk and change
Customer experience
Grow revenue
From connection to verified outcome
The controlled sequence every capability follows. Nothing changes a connected system without the approval step.Connect
Monitor
Detect
Recommend
Approve
Execute
Verify
Monitor performance
31 performance signals. Open an outcome to see its signals and how each one alerts. Read-only operations do not modify the connected system.Run operations (16 signals)
Run operations (16 signals)
| Signal | Alert behaviour | What it tracks |
|---|---|---|
| Active Datasets | Watch only | Count from datasets.list. |
| BigQuery Health Score | Merchant rule | Description pending editorial review; the signal is live. |
| Bytes Scanned (24h) | Merchant rule | SUM(total_bytes_processed) from INFORMATION_SCHEMA.JOBS. BigQuery-defining - on-demand billing is per byte scanned (~$6.25/TiB). This IS the spend sig |
| Bytes-Scanned Cost +50% Week-over-Week | Merchant rule | BigQuery-distinctive - un-pruned / runaway query scanning a giant un-partitioned table is the #1 cost surprise. |
| Concurrent Query Jobs | Merchant rule | RUNNING jobs from jobs.list - interactive concurrency quota defaults ~100/project. Approaching cap = queries queue or fail. |
| Estimated On-Demand Query Cost (24h) | Merchant rule | total_bytes_billed × on-demand rate ($6.25/TiB default; first 1 TiB/month free). Capacity-priced projects show slot cost instead. |
| Largest Table (GB) | Watch only | From INFORMATION_SCHEMA.TABLE_STORAGE active_logical_bytes. Top tables drive storage cost. |
| Last Table Snapshot Age (hours) | Alert band 24 / 72 | BigQuery time-travel retains 7 days by default; table snapshots / scheduled exports are the explicit backup. Reflects newest snapshot age. |
| Long-Term Storage % | Watch only | long_term_bytes ÷ (active + long_term). Higher = more tables untouched 90d, billed at ~half rate - informational cost lever. |
| Pending Jobs (waiting for slots) | Merchant rule | Jobs in PENDING state from jobs.list - sustained pending = reservation under-provisioned or concurrency cap hit. |
| Query Jobs per Hour (live) | Watch only | Count of QUERY jobs from INFORMATION_SCHEMA.JOBS in the last hour. Baseline-relative, no absolute band. |
| Reservation Slot Saturation (>90% sustained) | Alert band 70 / 90 | Alerts for Reservation Slot Saturation (>90% sustained). |
| Slot Utilisation % | Alert band 70 / 90 | slots/allocated ÷ reservation capacity (Cloud Monitoring). Sustained 100% on a reservation = queueing; on-demand has no slot cap to hit. BigQuery-dist |
| Slot-ms Consumed (24h) | Watch only | SUM(total_slot_ms) from INFORMATION_SCHEMA.JOBS - the capacity-pricing cost anchor (vs bytes for on-demand). |
| Streaming Buffer Lag (s) | Alert band 1 / 10 | Streaming-insert buffer flush lag - high lag means freshly streamed rows aren’t queryable yet (ingest pipeline backpressure). |
| Top 10 Most Expensive Queries | Watch only | Ordered by total_bytes_processed from INFORMATION_SCHEMA.JOBS. The optimisation hit-list - add partitioning / clustering / pruning here. |
Customer experience (6 signals)
Customer experience (6 signals)
| Signal | Alert behaviour | What it tracks |
|---|---|---|
| Query Cache Hit Rate % | Alert band 95 / 80 | Share of jobs where cache_hit = true in INFORMATION_SCHEMA.JOBS - cached results are free, so a rising cache rate cuts cost. BigQuery-distinctive. |
| Query Latency p50 (ms) | Watch only | Median (end_time - start_time) from INFORMATION_SCHEMA.JOBS. |
| Query Latency p95 (ms) | Alert band 50 / 200 | BigQuery analytics queries measured in seconds - threshold reflects warehouse use case, not OLTP. |
| Query Latency p99 (ms) | Alert band 100 / 500 | Description pending editorial review; the signal is live. |
| Slow-Query Rate % | Alert band 1 / 5 | Share of query jobs with duration > 5s in INFORMATION_SCHEMA.JOBS. |
| Top 10 Slowest Queries | Watch only | Top 10 Slowest Queries, broken down by row. |
Protect revenue (4 signals)
Protect revenue (4 signals)
| Signal | Alert behaviour | What it tracks |
|---|---|---|
| BigQuery Event Ingest vs Ecom Orders | Merchant rule | Fivetran / Dataflow ingest stall while orders flow = analytics blind spot; dashboards silently go stale. |
| BigQuery Query Spike vs Ecom Order Rate | Merchant rule | Description pending editorial review; the signal is live. |
| Bytes-Scanned Cost vs Ecom Order Volume | Merchant rule | BigQuery-distinctive XC - on-demand spend should track ecom volume (more data to analyse = more bytes). Divergence = wasted scan cost. |
| Expensive Queries During Checkout Window | Merchant rule | Expensive Queries During Checkout Window, broken down by row. |
Control risk and change (3 signals)
Control risk and change (3 signals)
| Signal | Alert behaviour | What it tracks |
|---|---|---|
| Job Error Rate % | Alert band 0.1 / 1 | Share of jobs with error_result set in INFORMATION_SCHEMA.JOBS (quota exceeded, permission, syntax, resources). |
| Job Error Rate Spike (>1% in 1h) | Alert band 0.1 / 1 | Alerts for Job Error Rate Spike (>1% in 1h). |
| Quota-Exceeded Errors (24h) | Merchant rule | Jobs failing with quotaExceeded reason - concurrency / bytes-billed / API quota hit. BigQuery-distinctive failure mode. |
Grow revenue (2 signals)
Grow revenue (2 signals)
| Signal | Alert behaviour | What it tracks |
|---|---|---|
| Bytes Scanned by User (7d) | Watch only | GROUP BY user_email (hashed) from INFORMATION_SCHEMA.JOBS. Surfaces the top spenders for cost attribution. |
| Total Storage (TB) | Alert band 70 / 90 | Sum of active + long-term logical bytes across datasets (tables.get / TABLE_STORAGE). Storage is cost-anchored - growth = bill growth. |
Audit risks and opportunities
A fix status appears only where the action, inputs, approval, verification and recovery controls are mapped. Candidate remediations are never executable. Open a check for the detail.Connection pool saturation above 90%
Connection pool saturation above 90%
DB-CAP-001Disk usage above 90%
Disk usage above 90%
DB-CAP-002Query error rate above 1% in last 5 minutes
Query error rate above 1% in last 5 minutes
DB-ERR-001Bytes Scanned +50% Week-over-Week
Bytes Scanned +50% Week-over-Week
BQ-COST-001Job Error Rate Spike >1% in 1h
Job Error Rate Spike >1% in 1h
BQ-PERF-004Last successful backup older than 72 hours
Last successful backup older than 72 hours
DB-BAK-001Replication lag above 10 seconds
Replication lag above 10 seconds
DB-REP-001Reservation Slot Utilisation >90% Sustained with Jobs Pending
Reservation Slot Utilisation >90% Sustained with Jobs Pending
BQ-CAP-003Slow-query rate above 5% of total
Slow-query rate above 5% of total
DB-PERF-002p95 query latency above 200ms sustained 15m
p95 query latency above 200ms sustained 15m
DB-PERF-001Buffer / cache hit rate below 80%
Buffer / cache hit rate below 80%
DB-CACHE-001Quota-Exceeded Errors Detected (>0 in 24h)
Quota-Exceeded Errors Detected (>0 in 24h)
BQ-PERF-005Single Query Scanning >1 TiB (un-partitioned / un-pruned)
Single Query Scanning >1 TiB (un-partitioned / un-pruned)
BQ-COST-002Query Cache Hit Rate Below 50% (cost lever unused)
Query Cache Hit Rate Below 50% (cost lever unused)
BQ-COST-003Build your own automated fixes
Turn any finding into an automated fix with a Vortex IQ workflow: over 13,000 read and write operations across more than 200 connectors are available as building blocks, with approval, verification and rollback on every change.Automate approved work
Vortex IQ is integrated with 6 read and 1 write operations across projectdatasettables, projectjobs, projectdatasets, projectquerys, projecttimeserys on Google BigQuery. Combine them with anything from the over 13,000 operations across more than 200 connectors to automate the work in your own words.Changes follow your configured approval policy: the target, proposed change, affected records, risk, reversibility and verification plan are shown before execution.Create a workflowReady to build your first Google BigQuery workflow
Pick a trigger, add the operations above as steps, and every step that changes data pauses for your approval. Monitoring and audits are live now and can start any workflow you build.Browse the operations you can build with
Browse the operations you can build with
| Resource | Read operations | Write operations |
|---|---|---|
| projectdatasettables | 2 | 0 |
| projectjobs | 2 | 0 |
| projectdatasets | 1 | 0 |
| projectquerys | 0 | 1 |
| projecttimeserys | 1 | 0 |