Probably because we have millenia of working together to overcome hardships, harsh winters, etc., and so being cut out of society means being cut out of cooperating. This leads to not only your death, but the death of your family or the denial of having a family if you are young.
Do Whites fear getting canceled more than they fear Death?
What? Ok,Mom,I'll be right there.