The speaker of "Stopping by Woods on a Snowy Evening" does not actually say exactly how far the woods are from the owner's house in the village. We can assume that it is quite some distance, perhaps several miles. At the very least, the woods are far enough away that the speaker is confident that the owner in the village has no chance of seeing him stop there. The woods are also far enough away from any farmhouse that the horse is confused as to why they have stopped.

The speaker is on a long journey, as he has "miles to go before [he] sleeps." These miles are likely both literal and figurative. They represent that the speaker is on a long journey. This could mean that he is far from the village and has much to accomplish before he arrives or returns there.

In this sense, the actual distance to the village is inconsequential. The speaker feels worlds away from civilization as he stops to take stock of his location. All he can see around him is the natural world of the snowfall, a frozen lake, and the dark trees of the forest. As much as the speaker would like to stay here, far from the life of the village, he knows that his responsibilities must keep him moving.