Under pressure from lawmakers in both parties, President Donald Trump on Wednesday said he would sign a new executive order to stop the forced separation of illegal immigrant children and parents at the southern border with Mexico, a 'zero tolerance' policy that had been put in place by his administration in early May.

"We want to keep families together, it's very important, I'll be signing something in a little while to do that," the President said, meeting with a number of GOP lawmakers from the House and Senate.

"We're keeping families together, but we have to keep our borders strong," Mr. Trump added.

It wasn't immediately clear what Mr. Trump would sign, but the action would run counter to arguments that he and other White House officials had said for days - that only the Congress could make the needed changes on immigration dealing with family separation.

It was a big reversal from the President.

"You can't do it through an executive order," Mr. Trump told reporters last Friday.

The President's move came amid a growing firestorm of criticism in Congress from members of both parties in the Congress, stirred by stories of young children taken away from their parents.

"This must stop NOW," tweeted Rep. Justin Amash (R-MI), as he noted a story from his home state, where an 8-month old baby had been brought, after being taken from her parents.

"He can sign an executive order today," said Sen. Bill Nelson (D-FL), who was blocked on Tuesday from visiting a group of detained children at a federal facility in Homestead, Florida.

"This shameful chapter in American history lies with the President and his pen," Nelson said, arguing the President started these separations, and should halt them.

"We must stop the madness, and stop it now," said Rep. John Lewis (D-GA).

"America is weakened in the eyes of the world," added Rep. Hank Johnson (D-GA).

"This is a policy straight from the pit of hell," said Sen. Bob Casey (D-PA).

GOP leaders also made clear they wanted the Trump Administration to change course.

"As I said last week, we do not want children taken away from their parents," said House Speaker Paul Ryan, as he urged GOP lawmakers to unite behind a pair of immigration bills which are expected to be voted on Thursday.

But while the Speaker and other Republicans said provisions in those bills would fix the family separation matter - those plans would not advance through the Senate - making it unlikely that Congress could anything done on the family separation matter.

That left the President with just one option - an administrative reversal on something that he had fiercely stood behind the effort.

The change on illegal immigrant families came in early May, when Attorney General Jeff Sessions announced a "zero tolerance" policy dealing with those illegally coming over the southern border.

"Today we are here to send a message to the world: we are not going to let this country be overwhelmed," Sessions said in that May 7 speech.