Olympic Champ Tyler Clary -- Declines White House Invite ... I'd Rather Race Cars

Olympic gold medalist Tyler Clary -- the guy who smashed Ryan Lochte's backstroke record -- turned down an invite to chill with President Obama at the White House ... all so he can race stock cars instead. If you didn't know ... POTUS and the First…