Jacob Portes

Jacob Portes's posts

Improving Retrieval and RAG with Embedding Model Finetuning

February 20, 2025/9 min read

Improving Retrieval and RAG with Embedding Model Finetuning

Header graphic for long context RAG part 2

October 8, 2024/10 min read

The Long Context RAG Capabilities of OpenAI o1 and Google Gemini

Header graphic with circles, triangles, and squares

August 12, 2024/19 min read

Long Context RAG Performance of LLMs

Header image for model training blog post

July 19, 2024/8 min read

How Long Should You Train Your Language Model?

February 9, 2024/11 min read

LIMIT: Less Is More for Instruction Tuning

March 9, 2023/17 min read

MosaicBERT: Pretraining BERT from Scratch for $20

Mosaic LLMs: GPT-3 quality for <$500k

April 7, 2022/17 min read

Efficiently Estimating Pareto Frontiers with Cyclic Learning Rate Schedules