LLMs & GenAI

12 pages in this section.

Why tokens, context windows, the prompt-as-interface idea, and structured output/tool schemas are one underlying model rather than unrelated API details - the mental model behind every other page in this section.

Explainer Python Llms Genai Tokens

LLMs Basics

How to think about prompts, tokens, and models.

Python Llms Genai Basics Llm

Anthropic Claude SDK

Messages API, streaming, and tool use in Python.

Python Llms Genai Anthropic Claude

OpenAI & Other SDKs

Chat completions and provider abstraction.

Python Llms Genai Openai Sdk

Hugging Face transformers

Loading, running, and generating with open models.

Python Llms Genai Transformers Huggingface

Prompt Engineering

System prompts, few-shot, and prompt patterns.

Python Llms Genai Prompts Engineering

Structured Output

Python Llms Genai Structured Output Pydantic

Embeddings & Similarity

Generating and using text embeddings.

Python Llms Genai Embeddings Similarity

Streaming & Async LLM Calls

Python Llms Genai Streaming Async

Tokens, Cost & Rate Limits

Python Llms Genai Tokens Cost

Local & Open Models

Python Llms Genai Ollama Vllm

LLMs Best Practices

Reliability, evaluation, and safety.

Python Llms Genai Best Practices List

LLMs & GenAI

Search Documentation

LLMs & GenAI