You are viewing a single comment's thread. View all
1
ProductConnoisseur on scored.co
1 year ago1 point(+0/-0/+1Score on mirror)1 child
You should look into uncensored locally-run models if you haven't already. You'll want at least 8GB VRAM.
Grab LM Studio and use the search function (on the left) to look up and download uncensored models. I recommend trying Lexi LLama 3.1 8B uncensored Q8.
Depends a lot on your hardware. I have a pretty old GPU (GTX 10xx series 8GB) and it's not too bad. You can try a more heavily quantized version (Q5 or Q4) which are smaller and faster, with the trade off being lower quality responses.
Grab LM Studio and use the search function (on the left) to look up and download uncensored models. I recommend trying Lexi LLama 3.1 8B uncensored Q8.