You are viewing a single comment's thread. View all
2
el_hoovy on scored.co
6 hours ago2 points(+0/-0/+2Score on mirror)1 child
> You can't "intermix" models.
absolutely can, and at least for image generation it's downright common, civit.ai is chock full of merges for people trying to generate their five millionth anime breast. likely not how LLMs are done, though.
i don't merge models, i have no idea. [but here's a plebbit thread about it](https://www.reddit.com/r/StableDiffusion/comments/13dmeoq/checkpoint_merge/). i'm not sure why the idea is so contentious, i'm just describing tech...
Yea.. no.. it's what I thought. You're really just running them separately and then combining them as images in a separate step or steps. If you read carefully you can see where they're describing taking them into another tool where you basically manually stitch them together.
It's contentious because the underlying models mostly don't work in a way where you can _directly_ merge them. You can just train a new one with both sets of training data. The drawback is they get worse at certain things when you do this. So it's more worthwhile to have a bobs model and then a vagene model and then just sew that shit together like frakenstein.
Point being, this shit sucks, and if all it can do is accelerate basement dwelling masturbators into early onset chafed dick syndrome then I think it shows it is a dead end. All the larger youtube channels I'm watching are all taking a very vocal "we hear you, no more AI <anything> here!" People hate this shit, for good reason.
absolutely can, and at least for image generation it's downright common, civit.ai is chock full of merges for people trying to generate their five millionth anime breast. likely not how LLMs are done, though.
Ok. How?
It's contentious because the underlying models mostly don't work in a way where you can _directly_ merge them. You can just train a new one with both sets of training data. The drawback is they get worse at certain things when you do this. So it's more worthwhile to have a bobs model and then a vagene model and then just sew that shit together like frakenstein.
Point being, this shit sucks, and if all it can do is accelerate basement dwelling masturbators into early onset chafed dick syndrome then I think it shows it is a dead end. All the larger youtube channels I'm watching are all taking a very vocal "we hear you, no more AI <anything> here!" People hate this shit, for good reason.