One night, after Daisy and Gatsby have begun their affair, Tom and Daisy show up for the first time at one of Gatsby's parties. They are unimpressed at the rag tag assortment of arriviste guests. Nick sees that Daisy doesn't like the party, and Gatsby senses this. When the Buchanans are gone and the party ended, Gatsby says to Nick:
"She didn’t like it," he said immediately.
"Of course she did." "She didn’t like it," he insisted. "She didn’t have a good time."
After this, there are no more parties: Gatsby has thrown them both to lure Daisy and to impress Daisy, and if having been lured she doesn't enjoy them, he has no reason to give them. It is only gradually that Nick notes that the parties have died away. The house becomes much quieter and more ghostly. Nick also finds out all the servants have been fired and replaced. Gatsby tells Nick this is because Daisy often comes over in the afternoons, and he needs servants who won't gossip. Nick writes,
So the whole caravansary had fallen in like a card house at the disapproval in her eyes.