The change in format was a bid to boost show ratings and viewers saw the results from Judges' Houses announced live in front of a studio audience. Each judge and their contestants got to watch back their latest auditions, before Simon, Rita Ora, Nick Grimshaw and Cheryl Fernandez-Versini cut their categories from six acts to three.
Viewers at home didn't seem too impressed, though. Many criticised the live shows over the weekend, with Simon now admitting himself, they were "hell".
Our friends at Digital Spy had asked head judge Simon whether he would be bringing back live Judges' Houses next year and he said: "Probably not."
Opening up about how he found the new live element for that stage of the competition, Simon continued: "It was hell. For the first time, I know what it feels like to be a contestant at that stage listening to people boo you."
Saturday night's show (24 October) saw Simon whittle his six acts down to three. He will be taking Bupsi Brown, Anton Stephans and Max Stone through to the live shows, after changing his mind last minute.
Simon had bagged on bringing show favourite Jennifer Phillips through to the lives with him, but he admitted on the night, Max's performance had forced him to change his mind.
Before making his decision, Simon had got to re-watch his category's auditions, with the music mogul saying that part of the revamped Judges' Houses had actually made things easier than previous years.
"I'm 100% fine with my decision," he added. "This is the first time I've made a decision on Judges' Houses watching it back as a member of the public. Normally I make it and watching it back I regret my decisions, so this was easier in a way."
Simon's final three will join Cheryl and her groups - 4th Impact, Reggie 'N' Bollie and Alien Uncovered, Rita and her girls - Louisa Johnson, Lauren Murray and Kiera Weathers - and Nick and his boys - Che Chesterman, Sean Miley Moore and Mason Noise in the first live show this weekend.
Ahead of their performances, the final 12 have moved into the X Factor house and have already been spotted at rehearsals. And it seems they could be making room for one more in their pad, as rumour has it Monica Michael could be given a shot at the live shows as a wildcard.
After Rita chose not to pick her, Monica has been inundated with support from fans hoping to get her back on the show. And adding fuel to the fire, Monica cryptically posted a tweet that hinted she'd had some unexpected news.
She tweeted: "So much for thinking I was getting a few days off! ;)."
Anyone else intrigued?
For exclusive competitions and amazing prizes visit Reveal's Facebook page NOW!