Run DeepSeek models on your own machine and interact with them using MATLAB

Generative AI
Follow


Run DeepSeek models on your own machine and interact with them using MATLAB

Mike Croucher on 4 Feb 2025 at 14:27
Latest activity Reply by Mike Croucher on 4 Feb 2025 at 17:35

You've probably heard about the DeepSeek AI models by now. Did you know you can run them on your own machine (assuming its powerful enough) and interact with them on MATLAB?
In my latest blog post, I install and run one of the smaller models and start playing with it using MATLAB.
How to run local DeepSeek models and use them with MATLAB » The MATLAB Blog - MATLAB & Simulink
Larger models wouldn't be any different to use assuming you have a big enough machine...and for the largest models you'll need a HUGE machine!
Even tiny models, like the 1.5 billion parameter one I demonstrate in the blog post, can be used to demonstrate and teach things about LLM-based technologies.
Have a play. Let me know what you think.

2 Comments

Sign in to participate
David
David on 4 Feb 2025 at 17:21
For comparison, I can run the 14b parameter distilled model just fine on my M1 Mac with 16 gigs of RAM.
Mike Croucher
Mike Croucher on 4 Feb 2025 at 17:35
Nice! I'll try that next
Mike Croucher

Mike Croucher

I write The MATLAB Blog at MathWorks and specialize in High Performance Computing, Research Software Engineering and Machine Learning. You can also follow me at BlueSky https://bsky.app/profile/walkingrandomly.bsky.social
25
Posts
225
Replies
40
Followers
Follow
View profile

Posts by this author

View all

Tags

No tags entered yet.

Go to top of page