Actor John Lithgow, who is set to play Dumbledore, told the New York Times that he considered quitting the series because of ...