Together Inference Reviews

Run leading open-source models like Llama-2 on the fastest inference stack available, up to 3x faster1 than TGI, vLLM, or other inference APIs like Perplexity, Anyscale, or Mosaic ML.
Together Inference is 6x lower cost2 than GPT 3.5 Turbo when using Llama2-13B. Our optimizations bring you the best performance at the lowest cost.
We obsess over system optimization and scaling so you don’t have to. As your application grows, capacity is automatically added to meet your API request volume.