Skip to content

Interface: PoolCandidateRuntimeMetrics ​

Defined in: runtime/pools/pool-runtime-state.ts:7

Mutable per-candidate runtime telemetry and rate-limit state inside a PoolRuntimeState.

Tracks HTTP 429 cooldown windows, invocation counts, last-used timestamps, and empirical completion counts for escalate-on-retry model selection.

Properties ​

PropertyModifierTypeDescriptionDefined in
idreadonlystringCandidate identifier (seat.id, model.modelId, or model.alias).runtime/pools/pool-runtime-state.ts:9
lastUsedAtMspublicnumber | undefinedOptional epoch timestamp in milliseconds of the most recent selection.runtime/pools/pool-runtime-state.ts:15
rateLimitedUntilMspublicnumber | undefinedOptional epoch timestamp in milliseconds until which this candidate is rate-limited (429).runtime/pools/pool-runtime-state.ts:11
sampleCountpublicnumberTotal number of completed or failed execution samples recorded for this candidate.runtime/pools/pool-runtime-state.ts:19
successCountpublicnumberNumber of completed executions that succeeded on this candidate.runtime/pools/pool-runtime-state.ts:17
usageCountpublicnumberTotal number of times this candidate has been selected.runtime/pools/pool-runtime-state.ts:13

Released under the MIT License.