According to Nick, Simon encouraged producers to put out a disclaimer explaining that the judges didn't use their homes for the filming of the competition.
Simon took his Overs category to Château de Moh, in the heart of the Loire Valley, France, where he was joined by One Direction singer Louis Tomlinson as a guest judge.
Speaking to Alan Carr on Chatty Man (which will air tonight), Nick explains: "Yeah they do make you pretend that you live there. They actually did a disclaimer this year to say this is not actually the judge's actual house because Simon didn't want everyone thinking that he lived in such a small house."
Nick says Simon was embarrassed by the fact the château only had 10 rooms. Sounds like a lot of rooms to us!
"I am serious," Nick continues. "He was like we need to let them know because it only had like 10 bedrooms and that to him is really embarrassing. A castle is really embarrassing. That is like a flat above Lidl for him."
Well, isn't that quite a revelation?!
Speaking about the show boss, Grimmy adds: "Simon loves a ciggie. When we did the first live show last week, he loves a ciggie during the break so he will go and have a smoke but the nearest dressing room to the stage is mine. So every break he will run off and I wouldn't see him and I'd keep forgetting and I would go in my dressing room and open the door and he would be looking in the mirror in the chair, with the white shirt and black high trousers looking really like Simon Cowell with a cigarette.
"Every time I'd open the door he would be like 'Hello darling' and I would scream!"
Chatty Man airs tonight (Friday 30 October) at 10pm on Channel 4.
Try Reveal's digital edition on iPhone & iPad. Subscribe now & never miss an issue!