Well, that's put an end to that, then. Those hoping that Simon Cowell's return to The X Factor would mean that Dannii Minogue and Cheryl Cole would find their way back to those oh-so-coveted seats ...