I agree that losing, for a time, his close relationship with Joe is the loss Pip most regrets. He feels only a passing sorrow at his sister's death, as she was never kind to him. Depending on which ending of the novel is in question, Pip is either at peace over losing Estella or poised to marry her, so he doesn't have deep regrets either way. He says he can't feel sorry over Magwitch's death, because much as he has come to appreciate the man's goodness and compassion, he knows death is the best way out of his troubles.
However, the humbled and sobered Pip comes to deeply regret his snobbery to Joe, and the way he sidestepped the relationship because he decided that as a gentleman he was too good for his blacksmith brother-in-law. He is deeply moved by Joe paying his debts. At the end of the novel, he comes to the newly married Joe and Biddy seeking forgiveness and redemption. He now fully sees Joe's goodness again. Pip says to Joe and Biddy:
"I shall never rest until I have worked for the money with which you have kept me out of prison, and have sent it to you, don’t think, dear Joe and Biddy, that if I could repay it a thousand times over, I suppose I could cancel a farthing of the debt I owe you, or that I would do so if I could!"