Dossier / 18 articles
Deep dives into artificial intelligence, large language models, transformers, embeddings, and the core concepts powering modern AI systems.
← All seriesAI ENGINEERING
02 September 2026 · 5 MIN READ
I wanted a detection app my kids could use without a single camera frame leaving the device. The answer: RF-DETR quantized to int8, ONNX Runtime Web on threaded WASM, and a static Amplify site.
CLOUD
23 July 2026 · 5 MIN READ
AWS is deploying Cerebras CS-3 systems in its data centers, pairing Trainium for prefill with the Wafer Scale Engine 3 for decode. Why disaggregated inference is the right architecture, and what makes a 4-trillion-transistor chip the right tool for the decode problem.
AI
23 July 2026 · 5 MIN READ
Moonshot AI shipped a 2.8-trillion-parameter open-weight model with a 1M-token context, native vision, and a new attention stack. What's actually new in the architecture, what the benchmarks say, and why it matters for builders.
AI
05 June 2026 · 7 MIN READ
Amazon built two radically different approaches to predicting the future — a proprietary supply chain optimization pipeline (SCOT) and an open-source time series foundation model (Chronos). This post compares their architectures, trade-offs, and when each philosophy applies.
AI
14 May 2026 · 9 MIN READ
A decision framework for choosing between Amazon's Chronos-2 foundation model and custom XGBoost many-models pipelines for demand forecasting. Based on real patterns from SKU-level supply chain work.
AI
10 March 2026 · 14 MIN READ
Most RAG tutorials stop at 'put vectors in a database.' This post covers what actually determines quality: how you chunk documents, which vector search engine to pick, and how to measure and iterate on retrieval performance using Bedrock Knowledge Bases and LLM-as-judge evaluation.
AI
01 March 2026 · 9 MIN READ
A deep dive into World Monitor — an open-source intelligence dashboard that aggregates 150+ feeds, 40+ geospatial layers, and AI-powered analysis into a real-time situational awareness platform. What OSINT is, how these platforms work under the hood, and why it matters now more than ever.
AI
26 February 2026 · 17 MIN READ
A beginner-friendly walkthrough of how an LLM actually works end-to-end: from typing a prompt to receiving a response — covering tokenization, embeddings, Transformer layers, KV cache, the training loop, embeddings for search, and why decoder-only models won.
AI
26 February 2026 · 13 MIN READ
The 5 key concepts every cloud architect should know about LLM serving: PagedAttention, KV cache mechanics, continuous batching, MoE trade-offs, and real production numbers.
AI
25 February 2026 · 9 MIN READ
Two strategies to shrink LLMs — one compresses weights, the other transfers knowledge. A practical guide to distillation and quantization: when to use each, how to implement them with Hugging Face, and why the real answer is both.
AI
24 February 2026 · 9 MIN READ
A practical walkthrough of two paths to working with Mistral — the managed API for fast prototyping and self-hosted deployment for full control — with real code covering prompting, model selection, function calling, RAG, and INT8 quantization.
AI
24 February 2026 · 14 MIN READ
Everything a cloud/AWS engineer needs to know about Python, the Hugging Face Transformers framework, SageMaker integration, quantization, CUDA, and AWS Inferentia — without being a data scientist.
AI
24 February 2026 · 9 MIN READ
What TFLOPS actually measures, why FP16 matters for LLMs, and why the most important GPU bottleneck for inference isn't compute at all.
AI
23 February 2026 · 15 MIN READ
A deep dive into the Transformer architecture — how attention connects tokens and why the Feed-Forward Network is the real brain of the model. Plus the key to understanding Mixture of Experts (MoE).
AI
22 February 2026 · 11 MIN READ
End-to-end guide: fine-tune Mistral models with LoRA using Hugging Face Transformers, then deploy at scale with vLLM on AWS — from training to production serving on SageMaker, ECS, or Bedrock.
AI
09 February 2026 · 9 MIN READ
A practical walkthrough of how large language models are aligned with human values — from collecting feedback to PPO optimization and the reward hacking pitfalls.
AI
07 February 2026 · 8 MIN READ
Understand how LLM fine-tuning works, when to use it, and how to choose between full fine-tuning, LoRA, soft prompts, and other PEFT methods.
AI ENGINEERING
14 January 2026 · 5 MIN READ
Building a production forecasting application without the complexity of traditional ML model training and feature engineering.
Best practices and deep dives into cloud security — from zero trust architectures to WAF configurations and penetration testing.
21 ARTICLESPatterns, services, and architectural decisions for building on AWS — including Bedrock, SageMaker, Transfer Family, and more.
17 ARTICLESExploring the frontier of autonomous AI agents — multi-agent systems, RAG pipelines, and agentic frameworks like Strands.
17 ARTICLES