"Unfortunately the government continues to borrow money and to spend money it doesn't have," Cantor said.
Back in 1995, the new Republican majority in the Congress wanted to do exactly that on disaster funding, so they packaged up a bill that included extra money to deal with the aftermath of the Oklahoma City bombing and a series of natural disasters, along with budget cuts to pay for it.
Reading through that debate from May of 1995 also opens a window into what we may hear in coming weeks in the Congress.
Republicans talked about how the budget must be balanced; of how average families can't just spend extra cash because of a disaster - they have to cut elsewhere.
Democrats argued that Republicans were trying to cut the budget to pay for tax cuts for the rich.
Those are fairly familiar arguments now in 2011 as well.
What happened with that bill that combined extra billions for FEMA with budget cuts to pay for the disaster aid?
It was easily approved by the House and Senate just before Memorial Day 1995, then it was vetoed by President Clinton.
It won't surprise me if that was the last time that the Congress tried to pay for disaster relief money with budget savings.
We'll see if the outcome is any different after Hurricane Irene.