Right now, Speaker of the House Paul Ryan can count on a pretty solid Republican majority to keep him in his seat — but he is starting to caution supporters that Donald Trump's nomination might change the situation.

>> Watch the video from Newsy

According to a report in The New York Times, Ryan warned a conference of GOP donors that "even the party's substantial majority in that chamber might be in jeopardy." Since he was talking to donors, Ryan's comments could probably be more about funneling donor money to tight House races than expressing genuine electoral angst.

But even voicing the possibility is a big deal. Losing the Senate is one thing: Democrats only need to win five seats to take the majority. But to win the House, Dems need to gain 30 seats.

And the fact that Ryan is publicly sweating that flip is just a stark reminder of how Trump's candidacy is worrying donors and the GOP elite. And after a terrible week for Trump, those concerns are turning into full-on panic.

>> Read more trending stories

Ryan has been trying to show a unified, on-message GOP; his endorsement of Trump was based around those same ideas, trusting a President Trump will sign off on a conservative agenda. But even that endorsement seems to be up in the air now.

Ryan told a radio station just last week he is not above pulling his endorsement of his party's nominee, which would be unprecedented.

This video includes clips from Speaker of the House Paul RyanC-SPAN, the Republican National Committee and CNN.