opncrafter
📐

AI Engineering

The practical skills that separate AI hobbyists from AI engineers.

Knowing how to call the OpenAI API is the beginning. Building a production AI system — one that runs reliably, costs predictably, survives load spikes, and improves over time — requires a broader skill set: prompt engineering, local model deployment, fine-tuning, evaluation, observability, and cloud deployment. This track covers all of it.

I start with prompt engineering beyond the basics — Chain-of-Thought, ReAct prompting, few-shot structuring, and how to systematically test prompt changes. Then move to local deployment with Ollama (run Llama 3.1 on your laptop), quantization to fit large models on consumer hardware, fine-tuning with LoRA so your model learns your specific domain, and AI evaluation metrics (Ragas, TruLens, LLM-as-a-Judge).

The engineering track ends with production deployment: Dockerizing your agent, serverless deployment on Lambda and Vercel Edge, and a complete project — deploying a production agent to AWS ECS Fargate with auto-scaling. These are the patterns I've used to take AI features from prototype to production.

📚 Learning Path

  1. Advanced prompt engineering (CoT, ReAct)
  2. Local LLMs with Ollama and quantization
  3. Fine-tuning with LoRA and PEFT
  4. AI evaluation: Ragas, TruLens, LLM-as-judge
  5. Dockerizing and deploying agents to AWS ECS

10 Guides in This Track

Prompt Engineering

CoT, ReAct, and advanced prompting.

Read Guide →

Local LLMs (Ollama)

Run Llama 3 locally on your device.

Read Guide →

Quantization & GGUF

Running big models on small hardware.

Read Guide →

AI Evals & Metrics

Ragas, TruLens, and LLM-as-a-Judge.

Read Guide →

Fine-Tuning

LoRA, PEFT, and Axolotl.

Read Guide →

AI Safety

Guardrails, NeMo, and PII protection.

Read Guide →

LLMOps

Deployment, Tracing, and Monitoring.

Read Guide →

Dockerizing Agents

Containerizing Python agents.

Read Guide →

Serverless Agents

Lambda vs Edge Runtime.

Read Guide →

Project: Deploy to ECS

Production Fargate setup.

Read Guide →
← Browse all topics