Depends a lot on your hardware. I have a pretty old GPU (GTX 10xx series 8GB) and it's not too bad. You can try a more heavily quantized version (Q5 or Q4) which are smaller and faster, with the trade off being lower quality responses.
New here?
Create an account to submit posts, participate in discussions and chat with people.
You are viewing a single comment's thread. View all
0
1 year ago
0 points
(+0
/
-0
)
Permalink
Reply
Mirrored from scored.co
Toast message