Phi-3 model
Phi-3 modelModel scalePerformance performanceGot Phi-3Use Phi-3Run Phi-3DialogueEnd conversationReference material
Demonstration environment
Development Board: Raspberry Pi 5B
SD(TF)card：64G（Above 16G, the larger the capacity, the more models can be experienced）
xRaspberry Pi 5B (8G RAM): Run 8B and below parameter modelsRaspberry Pi 5B (4G RAM): Run 3B and below parameter models, can't run Phi-3 model.
Phi-3 is a powerful and cost-effective Small Language Model (SLM) launched by Microsoft, which outperforms models of the same size and higher in various language, inference, coding, and mathematical benchmarks.
Model scale
| Model | Parameter |
|---|---|
| Phi-3（Mini） | 3.8B |
| Phi-3（Medium） | 14B |
xRaspberry Pi 5B (8G RAM): Test Phi-3 model with 3.8B parameters!
Performance performance
Got Phi-3
Using the pull command will automatically pull the models from the Ollama model library.
xxxxxxxxxxollama pull phi3:3.8b
Use Phi-3
Run Phi-3
If the system does not have a running model, the system will automatically obtain the Phi-3 3.8B model and run it.
xxxxxxxxxxollama run phi3:3.8b
Dialogue
xxxxxxxxxxWrite a joke about dogs
xxxxxxxxxxChange another one
xxxxxxxxxxTell me a bedtime story
The time to reply to the question is related to the hardware configuration, please be patient.
End conversation
You can end the conversation by using the shortcut key 'Ctrl+d' or '/bye'.
Reference material
Ollama
Website: https://ollama.com/
GitHub: https://github.com/ollama/ollama
Phi-3
Ollama corresponding model: https://ollama.com/library/phi3