In addition, TMZ reported that Cole and fellow judge Paula Abdul had a "lack of chemistry." The question remains over whether Cole will return to the U.K. version of the show where she was a judge. Scherzinger, formerly a judge on NBC's "The Sing-Off," had been booked as one of the show's hosts.
Previous Internet reports suggested that Cowell wanted Cole to dress more provocatively on the show, which reportedly did not sit well with her. Cole's look at the L.A. auditions included a Barbarella-style hairdo, bright purple pants and an orange top.
Cole was present for the first round of auditions, held in Los Angeles. The next set of auditions will be held in Dallas.
'X Factor' Airtimes Revealed, 'American Idol' Returning Jan. 22