The music mogul told ITV's This Morning that the judging panel on this year's show had all agreed to join because they were invested in finding a new superstar – not because of rumoured big money pay cheques.
Simon will judge alongside Cheryl Fernandez-Versini and newcomers singer Rita Ora and BBC Radio 1 Breakfast Show host Nick Grimshaw.
He sent a text message to Amanda Holden on today's
Amanda told viewers: "I've got a message on my phone, and I'm more surprised he's replied to be honest!"
Simon's message read: 'I'm very happy, they were all agreed because of their excitement for the show and how much they want to find someone special. Nobody has signed up for the money, it was passion for being on The X Factor.."
It was rumoured Rita had been offered £1.5 million in a bid to lure her from The Voice UK to its rival X Factor.
X Factor's most shocking moments:
For exclusive competitions and amazing prizes visit Reveal's Facebook page NOW!