Sometimes suffering separates people. When there is a divorce, children often tend to distance themselves from either parent.
When there is a tragic death in the family, it takes lots of cooperation on each member to come together for counseling. Otherwise, the anger and frustration might also distance them.
Suffering may at times unite people, but I think one person has to be very strong to carry the majority of the load. If a group of people are grieving equally, it is hard to fathom there would be any anchoring. For example, right now a close friend of mine is dying slowly- well, his family has completely disbanded from the wife, and everyone is accusing each other of not spending "enough time" with this person. I can see, however, it is the lack of anchoring I was just talking about.
Prosperity might divide people because not everyone is happy to see other people succeeding. Envy, jealousy, greed, and anger might get in the way of feeling close to someone who has clearly better luck. Hence, both suffering AND prosperity can be double edge swords.