You must log in or # to comment.
Neato, I want a small scale AI server at home with reasonable performance.
Running a 7B model is not very useful. What size of model could this run with usable speed?
Neato, I want a small scale AI server at home with reasonable performance.
Running a 7B model is not very useful. What size of model could this run with usable speed?
