App Development
Structured Text Generation with Incremental Parsers in Rust
Speakers
Presentation Slides
Presentation Video
LLMs are a powerful tool for understanding unstructured data. We will explore how Kalosm uses Rust for high-performance structured generation to extract structured data from model outputs. Along the way, we will dive into LLM internals and high-performance incremental parsers