"You can't blame somebody for not embracing your message if they've literally never heard it," the former transportation secretary tells the "Smartless" podcast.