Programming articles from Sudo engineers: Java design patterns, Python, AI and data, and web development, with runnable code examples.
A typical order-processing service is written in the "one thread per request" style: the handler receives a request, calls the database, calls the payment gateway, and returns a result. The code is si...
ONNX (Open Neural Network Exchange) is an open format for storing a machine learning model as a computation graph plus weights, separate from the framework that trained it. An ONNX model runs on ONNX...
FastAPI is a Python web framework built on Starlette and Pydantic, and a popular way to turn an AI model into an HTTP service. Getting it to run in a notebook is only half the journey. The other half...
The Visitor pattern is the most awkward design in the GoF catalog. To total the price of two kinds of products, you write a Visitor interface, add an accept method to every class, and then turn each n...
A multimodal model accepts more than one kind of input. In this article that means an image plus a text question, answered in text. Examples include an invoice photographed with a phone, a scanned pri...
Call three warehouses to compare prices, calculate shipping, then merge the results into one invoice. Written sequentially, each call waits for the previous one and the response time equals the sum of...
LLM evaluation means measuring, with numbers, whether an application built on a language model does its job and whether it can be tricked into doing the wrong thing. Without LLM evaluation, every prom...
LoRA (Low-Rank Adaptation) is a technique for fine-tuning large language models without updating the original weights: you freeze the matrix W, learn only two low-rank matrices B and A, and the layer...
When an order system is split into microservices, a request that sounds simple, like "place an order", suddenly touches three databases: inventory reservation, payment, and shipping. There is no singl...
Model Context Protocol is an open protocol that lets AI applications (clients) connect to external tools and data (servers) through one common standard, instead of every application writing its own ad...
The hand-written tool calling loop from the previous article is enough for a simple agent, but it has one weakness: all state lives in local variables of a running Python function. The more branches t...
An order is paid through a third-party gateway. One evening the gateway does not go down completely, it just gets slow: every call takes 30 seconds instead of 300 milliseconds. Tomcat threads are held...
All articles are displayed
