DeepSeek Coder

DeepSeek CoderModel sizePull DeepSeek CoderUse DeepSeek CoderRun DeepSeek CoderStart a conversationEnd the conversationReferences

Demo Environment

Development board: Jetson Orin series motherboard

SSD: 128G

Tutorial application scope: Whether the motherboard can run is related to the available memory of the system. The user's own environment and the programs running in the background may cause the model to fail to run

Motherboard modelOllamaOpen WebUI
Jetson Orin NX 16GB
Jetson Orin NX 8GB
Jetson Orin Nano 8GB
Jetson Orin Nano 4GB√(Need to run the small parameter version)√(Need to run the small parameter version)

DeepSeek Coder is an open source large language model (LLM) designed by DeepSeek to understand and generate code.

Model size

ModelParameters
DeepSeek Coder1.3B
DeepSeek Coder6.7B
DeepSeek Coder33B

Pull DeepSeek Coder

Using the pull command will automatically pull the model from the Ollama model library:

Model with small parameters: motherboards with 8G or less memory can run this

image-20240708184301495

Use DeepSeek Coder

Run DeepSeek Coder

If the system does not have a running model, the system will automatically pull the DeepSeek Coder 6.7B model and run it:

Model with small parameters: motherboards with 8G or less memory can run this

Start a conversation

The time to reply to the question depends on the hardware configuration, please be patient!

image-20240708184404733

End the conversation

Use the Ctrl+d shortcut key or /bye to end the conversation!

image-20240708184500439

References

Ollama

Official website: https://ollama.com/

GitHub: https://github.com/ollama/ollama

DeepSeek Coder

Ollama corresponding model: https://ollama.com/library/deepseek-coder

GitHub: https://github.com/deepseek-ai/DeepSeek-Coder