App Development

Structured Text Generation with Incremental Parsers in Rust

Speakers
Date / Time
2024-10-18
15:50
Presentation Slides
Presentation Video

LLMs are a powerful tool for understanding unstructured data. We will explore how Kalosm uses Rust for high-performance structured generation to extract structured data from model outputs. Along the way, we will dive into LLM internals and high-performance incremental parsers