Nicole, 35, was a judge on the ITV talent show for two years but will not be returning this year, as she is busy focusing on her solo music.
Speaking to Alan Carr on his Chatty Man show, which will air tonight (13 June), Nicole dismissed rumours that Simon tried to lure her back.
"No, I haven't heard from Simon," she said. "He made his choice so I'm just going to support everybody and it doesn't matter as my panel last year was the absolute best."
Nicole, who was joined on last year's panel by Gary Barlow, Sharon Osborne and Louis, continued: "No one can replace Gazza and Mrs O and Louis for me. But you know what, the show's going to be crazy this year. I know it's going to be a banger as you guys say over here."
Nicole was also asked if she had any advice for Mel B, who was announced as the fourth X Factor judge this week.
"She's done this before," said Nicole. "She doesn't need any advice, she's gonna spice things up."
Nicole, who is making her music comeback with new single 'Your Love', later showed Alan some of her best yoga moves, which helped her to get in shape for the music video.
Nicole also performs 'Your Love' to the studio audience at the end of the show. 'Your Love' is released next month on 13 July.
Nicole Scherzinger, Phillip Schofield, Pharrell Williams and Cher Lloyd appear on Alan Carr: Chatty Man, which is the last episode of the current series. Catch it tonight (Friday 13 July) at 10pm on Channel 4.
Reveal is now on Google Plus! Join us here for the latest pictures, fashion and celebrity news!
Watch the video for 'Your Love' below: