Louis, 62, claims music mogul Simon will deeply regret his decision and he says he will "never" let Simon forget it.
On Sunday, Louis' group Stereo Kicks ended up in the bottom two with Cheryl Fernandez-Versini's act Lauren Platt. Louis and Mel B chose to save Stereo Kicks, while Cheryl and Simon chose to save Lauren.
With the vote going to deadlock, Stereo Kicks' singing dreams came to an end as it was revealed they had the fewest public votes.
Speaking to The Metro, Louis said: "It was totally the wrong decision by Simon. I am never going to let him forget it. And when they sell all those records I will say, 'Do you remember when you voted them off?'"
Louis has now become the first judge to lose all of his acts on this year's show, and he didn't seem to happy on Sunday when he spoke to Xtra Factor host Sarah-Jane Crawford in his dressing room.
"I'm not a happy bunny," Louis began. "I think Simon made a big mistake. He shouldn't have sent them home. I didn't try to convince him but he should know that the boys have amazing potential."
Sinitta seemed confident they would go on to great success, declaring: "This time next year, Stereo Kicks will be performing live."
Stereo Kicks - Barclay Beales, Chris Leonard, Casey Johnson, Jake Sims, James Graham, Tom Mann, Charlie Jones and Reece Bibby - spoke to Reveal yesterday morning, telling us: "We're staying together. We're not going anywhere.
"So far it's been amazing for us and we're going to stick around and do our best to come back bigger and stronger from this."
Reveal is now on Google Plus! Join us here for the latest pictures, fashion and celebrity news!
Watch a video of Stereo Kick's X Factor journey below: