6 hours ago2 points(+0/-0/+2Score on mirror)1 child
> You can't "intermix" models.
absolutely can, and at least for image generation it's downright common, civit.ai is chock full of merges for people trying to generate their five millionth anime breast. likely not how LLMs are done, though.
i don't merge models, i have no idea. [but here's a plebbit thread about it](https://www.reddit.com/r/StableDiffusion/comments/13dmeoq/checkpoint_merge/). i'm not sure why the idea is so contentious, i'm just describing tech...
Yea.. no.. it's what I thought. You're really just running them separately and then combining them as images in a separate step or steps. If you read carefully you can see where they're describing taking them into another tool where you basically manually stitch them together.
It's contentious because the underlying models mostly don't work in a way where you can _directly_ merge them. You can just train a new one with both sets of training data. The drawback is they get worse at certain things when you do this. So it's more worthwhile to have a bobs model and then a vagene model and then just sew that shit together like frakenstein.
Point being, this shit sucks, and if all it can do is accelerate basement dwelling masturbators into early onset chafed dick syndrome then I think it shows it is a dead end. All the larger youtube channels I'm watching are all taking a very vocal "we hear you, no more AI <anything> here!" People hate this shit, for good reason.
They're scraping everything they can get. They have a use for this data even if they're not presenting it to you.
> big companies are trying a lot of unique training methods
They're publishing a lot of white papers. It's not clear what they're actually doing.
> and constantly intermix their models
That's just another name multiple generation and then hand stitching the pieces together.
> lol, "genetic diversity" might be bullshit for humans, but not generative AI.
You can't "intermix" models. Even if you could the problem is overfitting. Which is why they generate them separately and then hand edit it together.
absolutely can, and at least for image generation it's downright common, civit.ai is chock full of merges for people trying to generate their five millionth anime breast. likely not how LLMs are done, though.
Ok. How?
It's contentious because the underlying models mostly don't work in a way where you can _directly_ merge them. You can just train a new one with both sets of training data. The drawback is they get worse at certain things when you do this. So it's more worthwhile to have a bobs model and then a vagene model and then just sew that shit together like frakenstein.
Point being, this shit sucks, and if all it can do is accelerate basement dwelling masturbators into early onset chafed dick syndrome then I think it shows it is a dead end. All the larger youtube channels I'm watching are all taking a very vocal "we hear you, no more AI <anything> here!" People hate this shit, for good reason.