~/blog

Blog

Articles, tutorials, and posts.

Jul 19, 202610 min read
0

Understanding NVFP4: From Decimal Values to 4-Bit Representation

A hands-on walkthrough of NVIDIA's NVFP4 4-bit format — how decimal values become E2M1 bit patterns, block scaling, and a complete PyTorch implementation.

NVFP4QuantizationGPUDeep LearningNVIDIA
Jul 19, 202615 min read
0

PagedAttention - Explained

A deep dive into PagedAttention and vLLM — how OS-inspired memory paging eliminates KV cache fragmentation and unlocks 2-4x higher throughput for LLM serving.

PagedAttentionvLLMLLM InferenceGPU MemoryKV Cache
Jul 19, 202614 min read
0

Building a Contract-Net Auction Market with LLM Agents

Contract-Net Marketplace — Auction Experiment When multiple specialized AI agents share a task queue, matching the right agent to the right job is a coordinatio…

pythonlangchainmulti-agentollamaauction
Jul 5, 202665 min read
0

What a Vision Transformer Sees First: A 16×16 Patch Walkthrough

A neural network for images is usually a CNN, and a CNN is usually a stack of small filters sliding over the picture. That is comfortable — each filter sees a s…

pythonpytorchvision-transformerhuggingface
Jun 28, 20268 min read
0

Hermes Agent's "Self-Improving" Backbone: What It Actually Does (And What It Doesn't)

Every few months, a new agent framework ships with "self-improving" stamped on the README. Most of the time, nobody asks the obvious follow-up: self-improving h…

ai-engineeringagent-architecturehermes-agentself-improving-agentsllm-agents