L
Linda Petersen
@linda-petersen-274b
0 followers
Follow to get Linda Petersen's new reviews & posts by email.
5 karma 1 reviews 0 posts 0 tools 0 articles
Reviews (1)
- Jan 4, 20265.0 (0)
Solid for our team
We rolled this out across the team last quarter and very low inference latency. OpenAI-compatible API endpoints fits neatly into how we already work, and streaming token responses removed a step we used to do by hand. but it has held up under daily use.