Chat Fine tuning
*ADVANCED Fine-tuning Repository Access*
1. Unsupervised Supervised Fine-tuning Notebooks
2. Q&A Dataset Preparation Cleaning Scripts
3. Scripts to create and use Embeddings
4. Quantization Scripts
Learn more at:
*Chat fine-tuning Script*
Buy Access Here:
*Resources:*
- Presentation Slides:
- Runpod Affiliate Link: (supports Trelis)
- Llama 2 instruction fine-tuning dataset:
Relevant Videos:
- Tiny Llama (run a GGUF model on your laptop):
0:00 LLM instruction fine-tuning
0:07 Why do instruction fine-tuning?
1:10 Understanding special tokens and stop tokens
4:20 Instruction fine-tuning format
5:51 Guanaco instruction fine-tuning
6:05 Llama 2 prompt format
6:55 chatml prompt format
9:16 Instruction fine-tuning datasets
11:36 Fine-tuning a model for chat (in Jupyter lab)
16:00 Chat fine-tuning results
17:41 Pro tips