Topic index / 14 entries
Field notes, architecture decisions, and practical guides filed under this recurring subject.
← All topicsCLOUD
23 July 2026 · 5 MIN READ
AWS is deploying Cerebras CS-3 systems in its data centers, pairing Trainium for prefill with the Wafer Scale Engine 3 for decode. Why disaggregated inference is the right architecture, and what makes a 4-trillion-transistor chip the right tool for the decode problem.
AI
23 July 2026 · 5 MIN READ
Moonshot AI shipped a 2.8-trillion-parameter open-weight model with a 1M-token context, native vision, and a new attention stack. What's actually new in the architecture, what the benchmarks say, and why it matters for builders.
AI
10 March 2026 · 14 MIN READ
Most RAG tutorials stop at 'put vectors in a database.' This post covers what actually determines quality: how you chunk documents, which vector search engine to pick, and how to measure and iterate on retrieval performance using Bedrock Knowledge Bases and LLM-as-judge evaluation.
AI
01 March 2026 · 9 MIN READ
A deep dive into World Monitor — an open-source intelligence dashboard that aggregates 150+ feeds, 40+ geospatial layers, and AI-powered analysis into a real-time situational awareness platform. What OSINT is, how these platforms work under the hood, and why it matters now more than ever.
AI
26 February 2026 · 17 MIN READ
A beginner-friendly walkthrough of how an LLM actually works end-to-end: from typing a prompt to receiving a response — covering tokenization, embeddings, Transformer layers, KV cache, the training loop, embeddings for search, and why decoder-only models won.
AI
26 February 2026 · 13 MIN READ
The 5 key concepts every cloud architect should know about LLM serving: PagedAttention, KV cache mechanics, continuous batching, MoE trade-offs, and real production numbers.
AI
25 February 2026 · 9 MIN READ
Two strategies to shrink LLMs — one compresses weights, the other transfers knowledge. A practical guide to distillation and quantization: when to use each, how to implement them with Hugging Face, and why the real answer is both.
AI
24 February 2026 · 9 MIN READ
A practical walkthrough of two paths to working with Mistral — the managed API for fast prototyping and self-hosted deployment for full control — with real code covering prompting, model selection, function calling, RAG, and INT8 quantization.
AI
24 February 2026 · 14 MIN READ
Everything a cloud/AWS engineer needs to know about Python, the Hugging Face Transformers framework, SageMaker integration, quantization, CUDA, and AWS Inferentia — without being a data scientist.
AI
24 February 2026 · 9 MIN READ
What TFLOPS actually measures, why FP16 matters for LLMs, and why the most important GPU bottleneck for inference isn't compute at all.
AI
23 February 2026 · 15 MIN READ
A deep dive into the Transformer architecture — how attention connects tokens and why the Feed-Forward Network is the real brain of the model. Plus the key to understanding Mixture of Experts (MoE).
AI
22 February 2026 · 11 MIN READ
End-to-end guide: fine-tune Mistral models with LoRA using Hugging Face Transformers, then deploy at scale with vLLM on AWS — from training to production serving on SageMaker, ECS, or Bedrock.
AI
09 February 2026 · 9 MIN READ
A practical walkthrough of how large language models are aligned with human values — from collecting feedback to PPO optimization and the reward hacking pitfalls.
AI
07 February 2026 · 8 MIN READ
Understand how LLM fine-tuning works, when to use it, and how to choose between full fine-tuning, LoRA, soft prompts, and other PEFT methods.