The Python, AI & Data series goes from collecting and cleaning data to machine learning, deep learning, Vietnamese language processing, LLMs, RAG, agents and running models in production, with runnable Python code ...
For more than two decades, the standard answer to "why doesn't adding threads make Python faster?" has been the GIL, the global interpreter lock that lets only one thread run bytecode at a time. Since...
A customer support RAG chatbot that runs on a personal laptop takes one afternoon. The hard part is turning it into something you can hand to customers: it has to know when to stay silent, never inven...
A good data pipeline is not one long script that happens to run once. It is a chain of small steps, each with its own input, output and check, that gives the same result no matter how many times you r...
Polars is a DataFrame library written in Rust with a Python API, built around one idea: you describe the whole query first, the library optimizes the plan, and only then does it read any data. On an o...
Responsible AI is not an ethics slogan on the last slide of a deck. It is a concrete set of engineering tasks: knowing which personal data you use, whether you have the right to use it, whether the mo...
Data drift is what happens when the distribution of the inputs to a live model slowly moves away from the distribution of the data it was trained on. The model raises no error, the API still returns H...
MLflow is an open-source platform for managing the machine learning lifecycle: it records every training run, stores the model together with its input signature, names and versions it in a registry, a...
vLLM is an open-source engine for serving large language models (LLMs) at high throughput. It came out of a research group at UC Berkeley and was published through the PagedAttention paper at SOSP 202...
ONNX (Open Neural Network Exchange) is an open format for storing a machine learning model as a computation graph plus weights, separate from the framework that trained it. An ONNX model runs on ONNX...
FastAPI is a Python web framework built on Starlette and Pydantic, and a popular way to turn an AI model into an HTTP service. Getting it to run in a notebook is only half the journey. The other half...
A multimodal model accepts more than one kind of input. In this article that means an image plus a text question, answered in text. Examples include an invoice photographed with a phone, a scanned pri...
LLM evaluation means measuring, with numbers, whether an application built on a language model does its job and whether it can be tricked into doing the wrong thing. Without LLM evaluation, every prom...
LoRA (Low-Rank Adaptation) is a technique for fine-tuning large language models without updating the original weights: you freeze the matrix W, learn only two low-rank matrices B and A, and the layer...
All articles are displayed
