The 'Shine Ya Light' singer, 24, is said to be in talks to be a judge on the ITV show which means she could not continue on the BBC1 equivalent.
According to The Mirror (Saturday 6 June), Rita has previously turned down a role on Simon Cowell's talent show.
But now, she is reportedly considering it after friend Nick Grimshaw is rumoured to have joined the line-up.
Last month, Louis Walsh seemed to confirm he had left the panel, and that Radio 1 DJ Nick had replaced him...
A show source told the newspaper: "Rita was out of the frame a couple of months ago, but things have changed and everything has come full circle. The fact Grimmy is now involved makes The X Factor a more exciting proposition for her.
"You could say it is the Grimmy factor that is influencing her decision."
Simon himself has previously admitted: "I saw Rita on The Voice and I thought she was very good. When it comes to asking her over, you know, it's fair game."
Rita is currently a mentor on the BBC singing show opposite Sir Tom Jones, Kaiser Chief frontman Ricky Wilson and will.i.am, after replacing Kylie Minogue who only stayed for one season.
It is thought that ITV will announce the final X Factor judging line-up in the next couple of weeks as filming kicks off in July.
And we can't wait to find out!
Check out The X Factor's most shocking moments:
For exclusive competitions and amazing prizes visit Reveal's Facebook page NOW!