Kashkari said the labor leader told him that her members were used to dealing with recessions, and the way they get through a recession is by relying on friends and family. For instance, if they lose their job, they can lean on a sibling, parents or friends for help.

But high inflation affects everybody, she told the Fed president. Meaning, there is no one in her members' networks that they can lean on for help because everyone they know is experiencing the same thing.

Neel Kashkari Minneapolis Fed

Minneapolis Federal Reserve Bank President Neel Kashkari visits "Maria Bartiromo's Wall Street" at Fox Business Network Studios in New York City on Oct. 11, 2019. (Roy Rochlin / Getty Images)

"That was a profound comment for me to hear," Kashkari told the podcast hosts. He said that comment led him and the economists at the Minneapolis Fed to debate it a lot because the labor leader "was on to something."

"If you look now, the economy is, in the U.S., quite strong, the labor market is strong, inflation is coming down, and many, many people are deeply unhappy about the status of the economy," Kashkair said. "I think it's because of the high inflation that they've experienced."