At the beginning of the novel, hell is something that is somewhat of a joke for Huck. When told about "the bad place", Huck says he wishes he was there. He says,
"All I wanted was a change, I warn't particular."
Then Miss Watson says she is going to heaven but Tom Sawyer was going to hell. Huck says he was glad to be going to hell himself because he and Tom could be together. However, by the end of the novel, Huck has grown more serious about his beliefs. He writes Miss Watson a letter telling her where to find Jim. Then, in one of the most important scenes in the novel, he tears up the letter and says,
"All right, I'll go to hell."
This statement represents a total change in Huck's attitude from the beginning of the novel. Not only does he see hell as a risk he is taking, he is willing to take the risk in order to help free Jim. He has changed from a young boy who played tricks on a black man to one who is willing to break society's rules in order to help the man who has become his best friend.
We can look at some examples of what he has said regarding the issue, to get a clue to his feelings on the matter. Right in chapter one, Miss Watson is telling him all about "the bad place" (Hell) and how "she was going to live so as to go to the good place." Of this, Huck states, "I couldn't see no advantage in going where she was going, so I made up my mind I wouldn't try for it," and then, once Miss Watson said that Tom Sawyer for sure wouldn't be heading to heaven, Huck thinks, "I was glad about that, because I wanted him and me to be together." So, it's not exactly like he wants to go to Hell, heaven just doesn't sound like the place for him. He doesn't really have a fear of hell, he's just rather indifferent about it. He's more into being with Tom.
Later, after he tears up the letter that he wrote to Miss Watson telling her where Jim was, he proclaims, "All right then, I'll go to Hell!". He feels like he is doing the wrong thing by helping a runaway slave; according to the law, he is, but according to what is really right or wrong, he is actually doing the right thing. I don't think he really grasps what exactly Hell is, but he is willing to go there in order to save Jim, his friend. So in this case he is definitely not afraid of going to Hell, whatever Hell might be in his mind.
I hope that helps; good luck!