Former GOP presidential hopeful Ben Carson criticized the decision to replace President Andrew Jackson with Harriet Tubman on the $20 bill, saying the abolitionist would be better on the little-used $2 bill.

He spoke with Fox Business on Wednesday after reports surfaced that the U.S. Treasury Department plans to put Tubman's picture on the front of the $20 bill.

“Well, I think Andrew Jackson was a tremendous secretary -- I mean a tremendous president,” Carson said. “Andrew Jackson was the last president who actually balanced the federal budget, where we had no national debt.”

“And here he gets kicked off the $20 bill,” host Neil Cavuto said.

“Right, in honor of that we kick him off of the money,” Carson said.

Officials still plan to keep Jackson on the $20 bill, just not on the front, Politico reported.

“Are you anti-Harriet Tubman?” Cavuto asked Carson.

"No, I love Harriet Tubman,” Carson said. “I love what she did, but we can find another way to honor her. Maybe a $2 bill.”

The $2 bill currently features President Thomas Jefferson, but they're rare to see in circulation. According to NPR's Marketplace, the bills comprise less than .001 percent of all coins and bills in circulation.

Treasury Secretary Jacob Lew announced that he was considering replacing Alexander Hamilton's image on the $10 bill with that of a woman. He's expected to announce the change to the $20 bill, along with others, on Wednesday afternoon.