I would say that Ebeneezer Scrooge's ordeal in life is that he is going through most of his life without anyone to love him.
I think that we see this throughout the story. From the very beginning, it is clear that Scrooge has a lot of money. But it is also clear that he is very much alone. He has no wife or kids. His workers fear him and his relatives don't really like him much.
By the end of the story, of course, Scrooge reforms and is no longer lonely and unloved. But for most of the story (and much of his life) he has been that way and that would surely be an ordeal.