Member-only story

Tiny Phi 3 Models Deliver GPT Power on Your Phone: Open Source and Ready for Production

Agent Issue
11 min readAug 24, 2024

--

You’ve been watching these language models get bigger and bigger, thinking, “How the hell am I supposed to run a language model on anything other than a supercomputer?

Everybody wants to maximize capabilities while keeping deployments cost-effective.

Whether you’re optimizing real-time interactions, autonomous systems, or apps that demand low latency, you want models to deliver the speed and efficiency you need.

Also whether you deploy it in the cloud, at the edge, or even on-device, they should give you the flexibility to integrate AI where it matters most.

SLMs such as Phi-3-mini are the answer.

In this article, I will explain,

  • why Phi-3-mini is important for developers
  • what’s under the hood of Phi-3-mini and why it’s significant
  • how you can use it with Ollama + OpenAI + Python

Let’s GO!

Phi is a family of open AI models developed by Microsoft.

Phi Open Models

Phi Open Models are Microsoft’s suite of highly efficient, small language models (SLMs) designed to deliver exceptional performance with minimal cost and ultra-low latency.

--

--

Agent Issue
Agent Issue

Written by Agent Issue

Your front-row seat to the future of Agents.

Responses (3)