Skip to content

Cache-DiT Serving

Cache-DiT is already fully integrates with SGLang Diffusion and vLLM-Omni. Thus, we highly recommend using Cache-DiT through the serving capabilities of SGLang Diffusion and vLLM-Omni. Cache-DiT's own serving module will no longer be maintained and already deprecated after Cache-DiT v1.3.5. Let's go beyond Cache-DiT!

Simple HTTP Server

Deprecated: The simple HTTP server provided by Cache-DiT is deprecated and will be removed in future releases. We recommend using the serving capabilities of SGLang Diffusion and vLLM-Omni for production use.