Posts tagged Transformers

3 posts

AIFeb 25, 2026

LLM Distillation vs Quantization: Making Models Smaller, Smarter, Cheaper

Two strategies to shrink LLMs — one compresses weights, the other transfers knowledge. A practical guide to distillation and quantization: when to use each, how to implement them with Hugging Face, and why the real answer is both.

9 min read

#AI#LLM

AIFeb 24, 2026

Python, Transformers, and SageMaker: A Practical Guide for Cloud Engineers

Everything a cloud/AWS engineer needs to know about Python, the Hugging Face Transformers framework, SageMaker integration, quantization, CUDA, and AWS Inferentia — without being a data scientist.

14 min read

#AWS#Python

AIFeb 22, 2026

Fine-Tuning Mistral with Transformers and Serving with vLLM on AWS

End-to-end guide: fine-tune Mistral models with LoRA using Hugging Face Transformers, then deploy at scale with vLLM on AWS — from training to production serving on SageMaker, ECS, or Bedrock.

11 min read

#AWS#Mistral

Back to Blog