Lee publicly opposed Grant's presidency and the Republican Party, which he referred to as the Radical Party. He remained a dedicated white supremacist and defender of slavery and the Confederacy to the end of his life, even while supporters of the Lost Cause promoted him simultaneously as a symbol of both defiance and grace.

Lee had long been a brutal slave owner, taking part personally in punishing runaways. He believed slavery necessary to "instruct" Black people and that they were incapable of freedom. He opposed Black people's right to vote to the end of his life, and students at his University of Virginia were notorious for attacking local Black residents.

Lee's longtime ally Alexander Stuart wrote a letter opposing Grant for president. Lee was one of 31 Confederates to publicly sign it. The letter also argued Blacks were mentally inferior and incapable of voting or being elected officials. Lee had also argued in testimony to Congress that Black people were inherently lazy and allowing them to vote would lead to "demagoguism . . . and embarrassment."

Lee did agree to go to the White House to meet Grant and did call for an end to guerrilla warfare in the Civil War. For these reasons, the Lost Cause and apologists for Lee and the Confederacy often depict him as supporting "reconciliation," but Lee considered such reconciling dependent on having the old order of white supremacy continue.