Releasesby GlyphWhat's included:
- Three training methods: Supervised fine-tuning (SFT) , direct preference optimization (DPO) , and reinforcement learning with group relative policy optimization (GRPO) . Each method trains a low-rank adapter (LoRA) or the full model weights. Custom loss functions : Train with any objective you compute in PyTorch from the model's log-probabilities.