Week 4: Intro to Stable Diffusion Models and Fine-tuning

Section 1: 7/19,Section 2: 7/15

At a glance:

Slides

Topics:

• text-to-image models, LoRA

Tech:

• Running scripts in Google Colab to train a LoRA

Homework:

• finish training your LoRA model and upload some images/results in discord.
• Optional in prep for next week: download https://github.com/AaratiAkkapeddi/llllm

Agenda:

• Share our thoughts about the livestream
• Big Data pipelines (LAION 5B)
• finetuning and LoRA
• Share our LoRA datasets/questions/ideas

notebook/code links:

• Training LoRA
• Train a LoRA using Gooey.ai

suggested readings:

• The Internet’s AI Slop Problem Is Only Going to Get Worse (Read for free here)
• In Defense of the Poor Image
• Thread about LoRA Captioning on reddit
• Thread about LoRA Captioning on huggingface