Research
DharmaOCR Uses DPO to Reduce Text Degeneration
Hugging Face Bloghigh confidence
Why it matters
- →DPO offers a new way to address text degeneration in AI models.
- →It provides a method to improve model performance without human preference labels.
- →This approach could lead to more robust AI systems in structured tasks.
Hugging Face's DharmaOCR has applied Direct Preference Optimization (DPO) to tackle text degeneration in OCR tasks. This method uses the model's own degenerate outputs as negative training signals, achieving an average degeneration reduction of 59.4%. Unlike supervised fine-tuning, which doesn't directly address degeneration, DPO targets the structural failure modes of models. This innovative approach shows promise for improving model performance in structured tasks, offering a new direction for AI training methodologies.
Read originalMore from Hugging Face Blog
© Hugging Face BlogModels & Labsagents
Reachy Mini Adds Remote Tool Capabilities
Reachy Mini, a conversational robot, now supports remote tools, expanding its capabilities beyond local Python scripts. This update allows the robot to access external tools like web search and weather information, enhancing its ability to provide real-time responses. By integrating these remote tools, users can easily share and update functionalities without altering the core app. This development marks a significant step in making Reachy Mini more versatile and interactive, as it can now handle complex queries involving both local and remote data sources.
Hugging Face Blog
© Hugging Face Blog
