If they were Edomites, they'd still be mostly Hebrew (though Esau was a race mixer), I think many of them are majority Canaanite, since they practice and promote the same degeneracy that the Canaanites themselves did. Israel did fall into Canaanite Idolatry some of the time, but I doubt they ever were *spreaders* of it.