Milley told the House Armed Services Committee that he supports setting up a commission to review all Confederate matters - from names of bases to memorials and the display of the Confederate Flag.
That's exactly what a major defense policy bill would do in the Senate - but even though that measure has bipartisan support - President Trump has threatened a veto.
Democrats in the Congress have dared the President to follow through on the veto - convinced that America has shifted on the Confederate flag in the aftermath of unrest linked to the police killing of George Floyd in Minneapolis.
Since that Memorial Day incident, Confederate statues have come down throughout the South, as local officials have said it's time to remove them from the public square.
"Honoring treasonous leaders, displaying their flag and other racist symbology have no place in our military," said Rep. Anthony Brown (D-MD), who served nearly three decades in the military.
"It weakens morale and undermines our values."