Skip to main content
Megha Agarwal

Megha Agarwal

Megha Agarwal's posts

Abstract representation of LLM Inference token generation pipeline

Mosaic Research

March 20, 2024/14 min read

Fast, Secure and Reliable: Enterprise-grade LLM Inference

Integrating NVIDIA TensorRT-LLM with the Databricks Inference Stack

Mosaic Research

December 21, 2023/3 min read

Integrating NVIDIA TensorRT-LLM with the Databricks Inference Stack

LLM Inference Performance Engineering: Best Practices

Mosaic Research

October 12, 2023/15 min read

LLM Inference Performance Engineering: Best Practices