
Innovative caching design for near-storage accelerators, combining host and device capabilities to enhance I/O and data processing performance through collaborative caching and dynamic offloading.

Explore LoRAX, an innovative LLM inference system enabling efficient serving of multiple fine-tuned models on a single GPU. Learn about dynamic adapter loading, heterogeneous batching, and scheduling techniques.