Microsoft

Microsoft Orca AI Statistics Microsoft researchers introduce Orca, a 13-billion parameter model that learns complex explanation traces and step-by-step thought processes from GPT-4. Orca’s learning strategy significantly improves upon state-of-the-art instruction-tuned models, tackling task diversity, query complexity, and data scaling challenges. The researchers use GPT-4’s query and response pairs to guide student models, further enhanced … Read more