It was reported last month that Dermot was in talks to sign a new three-year contract, and one star who is hoping he makes a return is former Stereo Kicks singer Jake Sims.
Speaking to Jake at Shelter's Vertical Rush charity race, he tells us: "Dermot was amazing and as lovely on camera as he was off camera. He's got so much time for you and I'd love to see him back.
"I think he completes the show and it's a bit weird without him," Jake continues. "He's so good at what he does and he's so loveable, he's such a genuine bloke, it'd be good to see him back."
Jake rose to fame on The X Factor in 2014 as part of Stereo Kicks. The eight-piece boy band were mentored by Louis Walsh, and after the show they released a single but split soon after.
Jake is now focusing on his solo career and is gearing up to release his debut EP, Long Time Coming.
Shelter helps 4 million people a year fight bad housing and homelessness. For free and independent advice from Shelter visit shelter.org.uk/advice or call the helpline on 0808 800 4444