It appears that your question is in reference to Basil Hallward, Dorian Gray, and Lord Henry Wotton.

Here is the quote your question references:

"...Your rank and wealth, Harry; my brains, such as they are,—my fame, whatever it may be worth; Dorian Gray’s good looks,—we will all suffer for what the gods have given us, suffer terribly."

During a conversation with his friend Lord Henry Wotton, the great painter Basil Hallward proclaims that men who possess physical or intellectual gifts will eventually be cursed by them.

Basil predicts that he will suffer for his intellectual and artistic abilities. He also predicts that Lord Henry's wealth and privileged social position will eventually cause his downfall. Additionally, Basil thinks that Dorian Gray will be destroyed by his extraordinary good looks. In short, Basil predicts that all three men (including himself) will suffer for being unusually blessed by the gods.

Basil believes distinctiveness in appearance or ability is an unfortunate gift to have. He imagines that ugly or foolish men have better survival odds in life. Even though such men will never scale the heights of excellence, they will at least not experience the terrible specter of defeat.

Basil's prediction at this early part of the story foreshadows his own death (at Dorian's hands) and Dorian Gray's tragic downfall towards the end of the story.