I agree that it would largely depend on where you lived. On the other hand, there is a degree to which this would be about your political attitudes. There were many in the North who disliked the war because they believed in states' rights or because they did not want the slaves to be freed and come North and compete for jobs.
So this kind of depends. I imagine that if I were a low-paid, unskilled worker in the North I would really worry about what would happen to my job if slavery ended and I would have been much less likely to fight for the North.