How AI Works β€” Deep Technical Dive - Daftar Isi

Tujuan: Memahami cara kerja AI secara teknis dan mendalam β€” dari neuron pertama sampai LLM 100B parameter, dengan visualisasi dan analogi Level: Intermediate β€” Advanced (tidak perlu PhD, tapi perlu ketekunan) Prasyarat: Basic Python, matematika SMA (aljabar, probabilitas dasar) Estimasi Total: 12-16 jam baca


Struktur Materi

#FileTopikEstimasi
0101-what-is-ai-really.mdWhat Is AI, Really? AI vs ML vs DL vs GenAI β€” Hierarki & Sejarah Singkat25 menit
0202-neural-networks-fundamentals.mdNeural Networks dari Nol: Neuron, Layer, Activation, Weight, Bias45 menit
0303-training-and-backpropagation.mdTraining & Backpropagation: Gradient Descent, Loss Function, Chain Rule50 menit
0404-from-perceptron-to-deep-learning.mdDari Perceptron ke Deep Learning: CNN, RNN, LSTM, dan Kenapa β€œDeep”45 menit
0505-attention-is-all-you-need.mdβ€œAttention Is All You Need”: Transformer Architecture Dibongkar60 menit
0606-how-llms-work.mdHow LLMs Work: GPT, Claude, Gemini β€” Pretraining, Tokenization, Inference55 menit
0707-embeddings-and-vector-search.mdEmbeddings & Vector Search: Representasi Semantik, Similarity, Vector DBs40 menit
0808-multimodal-ai.mdMultimodal AI: Vision-Language Models, Text-to-Image, Text-to-Video40 menit
0909-reasoning-and-chain-of-thought.mdReasoning & Chain-of-Thought: o1, o3, DeepSeek-R1, dan Model yang β€œBerpikir”45 menit
1010-mixture-of-experts-and-scaling.mdMixture of Experts, Scaling Laws, dan Efisiensi: Kenapa Model Bisa Besar Tapi Cepat35 menit
1111-ai-safety-and-alignment.mdAI Safety & Alignment: RLHF, Constitutional AI, Red-Teaming, Mechanistic Interpretability40 menit
1212-future-architectures.mdFuture Architectures: Beyond Transformers β€” Mamba, JEPA, Liquid Networks30 menit

Peta Konsep

NEURON β†’ LAYER β†’ NETWORK
  ↓
BACKPROPAGATION (cara network belajar)
  ↓
CNN (gambar)  ← β†’  RNN/LSTM (teks/urutan)
  ↓
TRANSFORMER + ATTENTION (revolusi 2017)
  ↓
LLMs (GPT, Claude, Gemini, Llama)
  ↓
MULTIMODAL (teks + gambar + audio + video)
  ↓
REASONING (o1, R1 β€” model yang "berpikir")
  ↓
SAFETY & ALIGNMENT (RLHF, DPO)
  ↓
FUTURE (Mamba, JEPA, Liquid Networks)

Sumber Belajar Kunci

  • 3Blue1Brown β€” Neural Networks playlist (YouTube, gratis)
  • Jay Alammar β€” The Illustrated Transformer (blog, gratis)
  • Andrej Karpathy β€” Zero to Hero / nanoGPT (YouTube, gratis)
  • Distill.pub β€” Interactive ML articles (web, gratis)
  • Anthropic β€” Transformer Circuits (blog, gratis)
  • HuggingFace β€” NLP Course (web, gratis)