Iterate.ai launches Lifeboat, an agent-first inference engine focused on higher GPU concurrency and confidential computing

What changed

Iterate.ai launched Lifeboat on October 5 as an inference engine designed for long-running, multi-turn agent sessions, adding fair scheduling, admission control, cache optimizations, confidential computing and an OpenAI-compatible API. The company claims selected workloads can support two to six times more concurrent agent sessions per GPU; one vendor test with an RTX PRO 6000 Blackwell and Qwen 30B-A3B ran 2,048 concurrent sessions. These are vendor benchmarks and should not be generalized to every model or hardware configuration.