Paul, who was mentored by Mel B, fell into the bottom two alongside Simon Cowell's act Jay James, and both had to sing for survival in a bid to secure a place for next week's show and 'The X Factor Live Tour'.
Louis was left with the deciding vote but he took it to deadlock by voting for Paul to go home. Once it reached deadlock, Dermot O'Leary announced that Paul would be leaving the competition after receiving the fewest votes from the public.
Speaking to Reveal this morning, Paul tells us that Louis shouldn't have taken it to deadlock.
"He should have said who he likes the best, whether that was me or Jay," Paul tells us. "And to be honest, Jay shouldn't have been in the bottom two."
Paul also says that Louis didn't approach him after the show. "No, I haven't spoken to him," Paul continues. "I would've loved to [have spoken to him afterwards], he'd probably just have had a massive smile on his face."
> WE WANT PAUL BACK! X Factor fans react to shock exit
> James Arthur talks Paul Akister: 'The only way is up'
> X Factor contestant "feels guilty" about Paul Akister exit
Paul had performed 'Don't Stop Me Now' on Saturday night's Michael Jackson versus Queen show and impressed all four judges with his vocals. However, the public obviously weren't so bowled over.
Paul and Louis have history on the show too. Paul narrowly missed out on appearing on the live shows last year when Louis chose not to take him further at the Judges' Houses stage of the competition.
After waiting a year to make a return, Paul wowed the judges with his room audition, with Simon Cowell even telling Louis that he owed Paul an apology. Paul sailed through to the live shows with Mel as his mentor, until his dreams came to an end on Sunday night's results show.
Asked if Louis has ever apologised, Paul tells us: "No, he's never, never apologised. I still like him a lot. I think he's amazing, but he just has some funny ways."
Paul says he had a suspicion that he would be going home this weekend. "I knew it was going to happen," he continues. "I knew from the sing-off that I was going to go home. We got to rehearsals in the morning and I told everyone, 'I'm definitely off tonight'. You just get a feeling... a negative vibe."
Reflecting on his tearful exit, Paul says: "It was emotional. I couldn't stop crying. As soon as someone talked to me I started welling up again, it was horrible.
"I went to Mel's dressing room and she just couldn't talk to me because I was that bad, then she had to leave [to appear on Xtra Factor]. And Brian Friedman came into the dressing room as well, and he was welling up and saying how much of a loss it was.
"He just congratulated me on putting 100% into the choreography because it's not me. I would never ever dance on the stage, like ever, and I did it like three times."
Reveal is now on Google Plus! Join us here for the latest pictures, fashion and celebrity news!
Watch Paul's exit below: