Microsoft is advancing small language models (SLM), introducing Phi-4-multimodal and Phi-4-mini after the Phi-4 open-source model’s 2024 release. These are tailored for low-computing environments and device applications. Meanwhile, other companies and research teams are also entering the small models competition.