Get early access
Back to episodes
#25about 1 year ago

Dynamic Schemas

In this episode, Dex and Vaibhav explore the concept of dynamic UIs and how to build systems that can adapt to unknown data structures. They discuss the importance of dynamic schema generation, meta programming with LLMs, and the potential for creating dynamic React components. The conversation also delves into the execution and rendering of these dynamic schemas, highlighting the challenges and opportunities in this evolving field. They conclude with thoughts on future directions and the importance of building robust workflows around schema management.

Project details

Open in GitHub

In this episode, Dex and Vaibhav explore the concept of dynamic UIs and how to build systems that can adapt to unknown data structures. They discuss the importance of dynamic schema generation, meta programming with LLMs, and the potential for creating dynamic React components.

Video (1h27m)

Dynamic Schemas

Episode Overview

BAML can be leveraged to build a pipeline that can extract anything without knowing the schema in advance.

This is done via 2 steps:

  1. Ask an LLM to describe a schema that could represent the content of the document.

  2. Use the schema to extract the content by leveraging dynamic types.

Whiteboards

image

Architecture

Backend is python + FASTAPI + BAML

Frontend is React

We try and stream whatever possible!

# Start the backend
cd backend
uv run fastapi run server.py --reload

# Start the frontend
cd frontend
pnpm dev

Key Takeaways

  • Dynamic schema generation enables systems to adapt to unknown data structures
  • Meta programming with LLMs opens new possibilities for creating flexible components
  • Building robust workflows around schema management is critical for production systems
  • The execution and rendering of dynamic schemas presents both challenges and opportunities

Resources

All episodes