Polyglot Workshop – Developing LLMs for Low-Resource Languages

Session

LLM Pretraining 101

12 Mar 2026, 08:00

2. OG (IMPULSE-Haus)

Conveners

LLM Pretraining 101

• Nicholas Kluge
• Aniket Sen

Description

Participants are introduced to the fundamentals of pretraining LLMs (e.g., model architecture, parallel training, optimization, monitoring, evaluation).