batchwatch

https://github.com/batchwatch/client

Crowdsourced measurement of queue time on LLM batch APIs. Fails open (a batchwatch outage never touches your job) and never sends content - only a fixed allowlist of provider, model, mode, endpoint, request count, token counts and timestamps. Standard library only, no dependencies.