They told The Sun that while Louis is a "lovely" guy, they think they're better off doing their own thing when it comes to music and their career.
Band member Tom Mann said: "I'd be lying if I said I wish we were still with Louis. If I'm honest, then I'd say we're glad to be away from him.
"Louis is lovely but I don't think he was right for us. Sometimes he does say the wrong things, so we're happy to be doing our own thing now."
One such thing he said wrong? That Stereo Kicks would be better off if they chucked a couple of the eight members out of the band!
Stereo Kicks appeared on last year's X Factor, where they were eliminated in week eight. Despite not winning, they've gained quite the fanbase and recently finished a ten-date tour of the UK.
They announced today their debut single 'Love Me So' – written by Tom – will be released 21 June.
X Factor's most shocking moments: