The White House press secretary rebuffed the French politician, saying he would be speaking German if it weren't for U.S. troops in World War II.