Cowell set for X Factor return as pressure builds on Kelly Rowland