AI Forum 2023 | The Small Models Revolution

I will discuss a new method we are pioneering at Microsoft Research to build smaller language models that exhibit many of the properties of the largest language models such as ChatGPT. The focus will be on our latest model, phi-1.5, which is a 1 billion parameters model that can rival competitor with 10 billion or more parameters.