MADISON, Wis.  — Outgoing House Speaker Paul Ryan on Thursday named immigration and the national debt as his two biggest regrets as he prepares to leave office after 20 years in Congress, saying he has no immediate plans to return to public office.

The Republican lawmaker from Wisconsin, the 2012 vice presidential nominee, sat for an interview with The Washington Post as he prepares to step down. Ryan also delivered one of his final floor speeches, thanking his staff and voters of his Wisconsin congressional district, where he first won election in 1998 at age 28.

In a break with the GOP-controlled Senate, Ryan said he opposes a resolution passed there calling for an end to U.S. involvement in the Yemen war, led by Saudi Arabia. Congress has been debating how to punish Saudi Arabia for its role in the killing of journalist Jamal Khashoggi.

Ryan said the Yemen resolution “isn’t the way to go” and instead he favored invoking the Global Magnitsky Human Rights Accountability Act, which gives the U.S. government the power to impose sanctions for human rights abuses.

“Yes, we have lots of strategic interests in alignment with the Saudis, no two ways about it,” Ryan said. “Still, we can speak with moral clarity. We can take actions that address these issues.”

Ryan sidestepped questions about his sometimes contentious relationship with President Donald Trump. But he bemoaned what he said was Trump’s “hostile” relationship with the media. He said that “tribalism” among Republicans and Democrats is “getting out of control” because “polarization sells.”

“That tribalism in our country, to me, is our undoing,” Ryan said. “Yes, the president has a hostile relationship with the press, no two ways about it. But that’s the new norm in this day and age.”

The interview came in the midst of a budget showdown with Trump over funding for Trump’s promised wall along the U.S-Mexico border. Ryan said he does not think Trump wants a government shutdown and “our hope is that we can get a successful conclusion.” He said the onus will be on the White House and Senate Democrats to find common ground on a budget bill.