TT.
/
projects
/
distributed-finetune-pipeline
Architecture
Results
GitHub ↗
Colab ↗
Distributed LLM Fine-Tuning Pipeline
v1.0.0
Data curation → QLoRA + DPO training → TIES/DARE/SLERP merging → Evaluation → vLLM deployment
Python
PyTorch
DeepSpeed
TRL/PEFT
vLLM
Docker
Terraform
Prometheus
66
Files
11K+
LoC
11
Stages
11/11
Tests
🌐
Data Scraping
🧹
Data Cleaning
⚖️
LLM Judge
📦
Dataset Assembly
🏋️
SFT Training
🎯
DPO Alignment
🔀
Model Merging
📊
Evaluation
🔍
Contamination
🚀
vLLM Serving
☁️
Infrastructure
DATA CURATION
TRAINING & MERGING
EVALUATION
DEPLOYMENT
click any stage for details