Should Lord Patten step down?