Triton Inference Server Alternatives

A fast inference library for running LLMs locally on modern consumer-class GPUs - turboderp-org/exllamav2

Recall.ai provides an API to get recordings, transcripts and metadata from video conferencing platforms like Zoom, Google Meet, Microsoft Teams, and m

Inference performance drives profitability.

Train, deploy, observe, and evaluate LLMs from a single platform. Lower cost, faster latency, and dedicated support from Inference.net.

Welcome to Cloudflare - Powering the next generation of applications

Bring your own code, and run CPU, GPU, and data-intensive compute at scale. The serverless platform for AI and data teams.

High-throughput and memory-efficient inference and serving engine for Large Language Models. Deploy AI faster with state-of-the-art performance.

Daily is the team behind Pipecat. Ultra low latency, open source SDKs, and enterprise reliability since 2016.

DeepSpeed is a deep learning optimization library that makes distributed training easy, efficient, and effective.

Create with AI or code, deploy instantly on production infrastructure. One platform to build and ship.

Cloud GPUs, on-demand clusters, private cloud, and hardware for AI training and inference. Run B200 and H100, deploy fast, and scale cost effectively.