LLM App Production Checklist: Cost, Caching, Retries, and Safety
Eleven practices that keep an LLM feature alive in production, ranked by impact, each with a wrong example, a right example, and a way to verify…
Category
Python
Practical Python for engineering work. Language fundamentals, tooling, testing, concurrency, data, web APIs, and AI features.
34 articles
-
-
How to Test and Evaluate LLM Applications in Python
Separate deterministic tests from evals, build a golden dataset, score with code before judges, and read pass rates…
-
How to Build an MCP Server in Python
Expose your own tools and data to AI assistants through the Model Context Protocol: a complete Python server,…
-
Structured Output from LLMs in Python with Pydantic
Turn model replies into validated Python objects: one Pydantic schema, schema-constrained generation where available, and a repair loop…
-
Python 3.13 Free-Threading and JIT: What Changed and Should You Care
Python 3.13 ships an optional build without the GIL and an experimental JIT. Learn what each one does…
-
uv Python Tutorial: Fast Package and Project Management
uv replaces pip, venv, pip-tools, pipx, and pyenv with one fast tool. Learn the project workflow, the lockfile,…
-
How to Build an AI Agent in Python: Tool Calling from Scratch
An agent is a loop around a model that can ask for tools. Build one in plain Python…
-
How to Run LLMs Locally with Ollama and Python
Install Ollama, pull an open model, and call it from Python with streaming, error handling, and a speed…
-
How to Build a RAG App in Python Without a Framework
Retrieval-augmented generation in about 150 lines of plain Python: chunking, retrieval, a grounded prompt with citations, a refusal…
-
Python Embeddings and Semantic Search: Build It from Scratch
Turn text into vectors, store them in a NumPy matrix, and rank by cosine similarity. A complete semantic…
-
How to Call the OpenAI API in Python: Streaming, Retries, and Errors
Use the v1 OpenAI Python client properly: explicit timeouts, bounded retries, specific error handling, streaming output, and tests…
-
What’s New in Python 3.12: Features and Upgrade Guide
Python 3.12 brings cleaner generic syntax, unrestricted f-strings, smarter error messages, and the removal of distutils. Here is…
-
FastAPI Tutorial: Build a REST API in Python Step by Step
Build a complete task API with FastAPI: typed request and response models, a database session per request, proper…
-
Pydantic v2 Tutorial: Data Validation and Settings in Python
Validate untrusted data with typed models, write field and model validators, serialize with model_dump, and load typed settings…
