Week 6: RAG and MicroGPT

Section 1: 7/26,Section 2: 7/22

At a glance:

Slides

Topics:

• Ollama, RAG
• Markov Chains
• MicroGPT

Tech:

• Running scripts locally to work with RAG and MicroGPT

Homework:

• for next week, Finish creating your Local LLM. OR your MicroGPT. Share some screenshots of your project in discord.

Agenda:

• Share our LoRAs
• Ollama & Rag tutorial
• Quick Markov explanation

notebook/code links:

• RAG/ollama tutorial github
• MicroGPT tutorial
• Markov Chain example

suggested readings:

• Solar Archive - Computational Mama
• ChatGPT Is a Blurry JPEG of the Web By Ted Chiang
• Tropes.fyi
• sorri, my data is too dirty for your model