Vitaliy Chiley

Vitaliy Chiley's posts

Llama Finetuning Blog Post Graphic

September 19, 2024/4 min read

Fine-tuning Llama 3.1 with Long Sequences

Mix Attention Blog Banner Image

September 18, 2024/14 min read

Inference-Friendly Models with MixAttention

Hero image with abstract drawing representing a sparse matrix on a dark background

July 1, 2024/Less than a minute

Training MoEs at Scale with PyTorch and Databricks

Abstract image of a stream of data

April 9, 2024/4 min read

Bringing MegaBlocks to Databricks

Benchmarking Large Language Models on NVIDIA H100 GPUs with CoreWeave (Part 1)

April 27, 2023/7 min read

Benchmarking Large Language Models on NVIDIA H100 GPUs with CoreWeave (Part 1)