better/compute

Metrics

The 47 Prometheus metric families better-compute exposes on /metrics, with their labels.

Every family carries the better_compute_ prefix and none has a tenant label (series stay bounded by maxSeries). Histograms also expose _bucket, _sum and _count series. Families are grouped by the function that registers them: standardMetrics on every process, the others where a host wires them.

standardMetrics

MetricTypeLabelsDescription
better_compute_gateway_sessionsgaugeroleOpen daemon sessions on this gateway
better_compute_gateway_handshakes_totalcounteroutcomeSession handshakes
better_compute_command_latency_secondshistogramkind, laneCommand enqueue to terminal result. Buckets (s): 0.05, 0.1, 0.25, 0.5, 1, 1.5, 2.5, 5, 10, 30, 60
better_compute_commands_swept_totalcountertoCommands the CommandSweeper moved
better_compute_work_queue_depthgaugekindDue work_queue rows
better_compute_reconcile_duration_secondshistogramreconcilerOne reconciler run. Buckets (s): 0.005, 0.01, 0.025, 0.05, 0.1, 0.25, 0.5, 1, 2.5, 5, 10, 30
better_compute_generation_lag_nodesgaugeNodes whose observed generation is behind
better_compute_placements_totalcounteroutcomePlacement attempts
better_compute_booking_conflicts_totalcounterBooking conflicts that forced a replan
better_compute_pool_gpusgaugestateGPUs by state across pools
better_compute_node_connectivitygaugestateNodes by connectivity
better_compute_backloggaugequeueRows waiting in a queue table
better_compute_usage_dead_letters_totalcounterUsage events dead-lettered
better_compute_iam_inbox_spill_totalcounterIAM events spilled because the inbox was down
better_compute_iam_calls_totalcounterop, outcomeIamPort calls
better_compute_iam_call_duration_secondshistogramopIamPort call latency (each op takes ≥1 IAM lock acquisition). Buckets (s): 0.005, 0.01, 0.025, 0.05, 0.1, 0.25, 0.5, 1, 2.5, 5, 10, 30
better_compute_resolver_lookups_totalcounterresultAuthz resolver lookups
better_compute_tenant_statesgaugestateIAM tenants compute refuses (§12.8), by state: suspended, deleted
better_compute_tenant_teardowns_pendinggaugeDeleted tenants whose teardown has not finished (a module still releasing)
better_compute_sandbox_ready_secondshistogramsourceSandbox create to its instance first running (§3.7), by source: a warm claim or a cold create; the counts give the warm-pool hit ratio. Buckets (s): 0.5, 1, 2, 5, 10, 20, 30, 60, 120, 300
better_compute_sandbox_expiry_lag_secondshistogramHow late a sandbox was expired after its expiresAt. Buckets (s): 1, 5, 15, 30, 60, 120, 300, 900
better_compute_sandbox_warm_instancesgaugestateUnclaimed warm-pool instances, by instance state
better_compute_sandbox_warm_deficitgaugeWarm instances missing below the templates’ warm.min, summed over live templates
better_compute_sandbox_warm_refills_totalcounterWarm-pool instances created to refill templates
better_compute_cert_expiry_secondsgaugekindSeconds until the soonest expiry
better_compute_clock_offset_secondsgaugeProcess clock minus compute_now()
better_compute_security_events_totalcountertypeSecurity events recorded

createObserver

MetricTypeLabelsDescription
better_compute_spans_totalcounterkind, name, outcome, codeUnits of work by kind, name, outcome and code
better_compute_span_duration_secondshistogramkindLatency of units of work by kind. Buckets (s): 0.005, 0.01, 0.025, 0.05, 0.1, 0.25, 0.5, 1, 2.5, 5, 10, 30

meteredAttestor

MetricTypeLabelsDescription
better_compute_attestor_verifications_totalcounterattestor, outcomeAttestor verifications by outcome
better_compute_attestor_verification_secondshistogramattestorAttestor verification time. Buckets (s): 0.005, 0.01, 0.025, 0.05, 0.1, 0.25, 0.5, 1, 2.5, 5, 10, 30

meteredGatewayServices

MetricTypeLabelsDescription
better_compute_gateway_service_calls_totalcountermethod, outcomeJoin, Renew and Secret calls by outcome
better_compute_gateway_service_secondshistogrammethodJoin, Renew and Secret time. Buckets (s): 0.005, 0.01, 0.025, 0.05, 0.1, 0.25, 0.5, 1, 2.5, 5, 10, 30

meteredProvider

MetricTypeLabelsDescription
better_compute_provider_calls_totalcounterprovider, method, outcomeProvider API calls by outcome
better_compute_provider_call_secondshistogramprovider, methodProvider API call time. Buckets (s): 0.05, 0.1, 0.25, 0.5, 1, 2.5, 5, 10, 30, 60

placementObserver

MetricTypeLabelsDescription
better_compute_placement_secondshistogramplacerOne placement attempt, by placer. Buckets (s): 0.005, 0.01, 0.025, 0.05, 0.1, 0.25, 0.5, 1, 2.5, 5, 10, 30

gatewayCollector

MetricTypeLabelsDescription
better_compute_gateway_open_sessionsgaugegateway, roleOpen agent sessions by role
better_compute_gateway_stream_headroomgaugegatewayStreams this gateway can still admit
better_compute_gateway_draininggaugegatewayWhether the gateway is draining (1) or not (0)
better_compute_gateway_lease_heldgaugegatewayWhether the gateway holds its lease (1) or is fenced (0)
better_compute_gateway_commands_in_flightgaugegatewayCommands dispatched and not yet settled
better_compute_gateway_sessions_upgrade_requiredgaugegatewaySessions told to upgrade
better_compute_gateway_loop_consecutive_failuresgaugegateway, loopFailed runs of a gateway loop since its last clean one (alert on a stuck loop)
better_compute_gateway_loop_failuresgaugegateway, loopFailed runs of a gateway loop since start
better_compute_gateway_loop_last_ok_age_secondsgaugegateway, loopSeconds since a gateway loop last ran cleanly (-1 before its first clean run)

revocationFeedCollector

MetricTypeLabelsDescription
better_compute_revocation_feed_consecutive_failuresgaugefeedRevocation feed polls failed in a row: revoked certificates keep their sessions while it fails

eventCounter

MetricTypeLabelsDescription
better_compute_events_totalcounterfamily, moduleOutbox events by catalog family

Was this page helpful?

Better Compute is created by Sean Filimon

Last updated

On this page