The 19-year-old singer from Leeds, who made it through to Judges' Houses after getting a seat during the Six Chair Challenge, has withdrawn from the competition due to "personal reasons".
Tom said in a statement: "Due to personal reasons I have decided to withdraw from The X Factor. Thank you to all the Judges, especially Nick for his belief in me.
"I want to wish all the contestants the best of luck and thank you to the public for supporting me and my dream."
On Sunday, viewers saw Tom win a seat, earning him a place in Nick Grimshaw's final six boys. However, Tom ended up losing his seat to Ben Clark.
It was only after the crowd reacted with disbelief that Tom had been replaced, that Nick changed his mind and brought Tom back, swapping him with Nathanael Landskroner.
A X Factor spokesperson confirmed: "We can confirm that Tom Bleasby has chosen to withdraw from the competition due to personal reasons."
Taking to Twitter, Tom added: "Make no mistake about it. I'm not stopping singing, the X Factor is just one path...one that wasn't right for me. I will make music."
In the coming days, X Factor are expected to confirm what will happen with Nick's category and his Judges' Houses.
But following the announcement of Tom, fans have been quick to trend the name of one contestant who narrowly missed out on a place in Nick's final six.
On Twitter, there appeared to be a huge number trending "#BringOllieMarlandBack"in support of 20-year-old Ollie Marland, who was the last person to lose his seat after being swapped with Che Chesterman.
Ollie has since tweeted: "Wow.. Just seen what you all did for me tonight, thanks for the love, you're all the best."
For exclusive competitions and amazing prizes visit Reveal's Facebook page NOW!
X Factor's most shocking moments: