Last night, viewers watched Paul's emotional exit from the show after he ended up in the bottom two alongside Jay James.
Stevi, who has previously said he doesn't mind "being called the joke act", tweeted straight after the show: "Peeps thank you for your support and votes but I would like to say I feel terrible and guilty that great singers have gone instead of me."
And speaking to Reveal this morning, Paul tells us: "It's not Stevi's fault and he's doing the best he can with every performance. He's quite a good singer. He shocked me when he did 'Music of The Night' from Phantom of The Opera. I was like, 'Mate, where did you pull that out from?'
"I have nothing against Stevi," Paul continues. "If he was to go out of the house then the mood would be gone. It'd be crap in there. He's so nice and funny and he keeps the mood going."
Peeps thank you for your support and votes but I would like to say I feel terrible and guilty that great singers have gone instead of me— STEVI RITCHIE (@THESTEVIRITCHIE) November 9, 2014
Stevi, who is mentored by Simon Cowell, made the live shows after Cheryl Fernandez-Versini picked him as a wildcard.
Throughout the weeks, Stevi has been described by some as a novelty act, with Simon previously describing him as a "guilty pleasure".
Former X Factor contestant Jake Quickenden has also defended Stevi, saying the hopeful "deserves his place" in the competition.
Reveal is now on Google Plus! Join us here for the latest pictures, fashion and celebrity news!
Watch Stevi's performance below: