The 18-year-old has admitted that he didn't trust the former Spice Girls' judgement and felt that she favoured her other act Jake Quickenden, who was booted out of the show the week before.
"Mel B was honest but I didn't quite get what she was trying to get out of me," Jack told the Mirror. "I was doing completely different stuff every week."
He also confessed that he felt slightly intimidated by the mother of four, adding: "It's difficult to pipe up in front of someone like that."
The aspiring singer formed a bond with One Direction's Louis Tomlinson, who visited the X Factor studios to offer the contestants advice and took a special interest in Jack.
"I wish I had listened to him [Louis Tomlinson] a little bit more," added Jack. "He's been so involved. I trusted his judgment more than Mel B."
The 'Steal My Girl' singer showed his support for Jack on Twitter after his exit: "Gutted. Don't think he was given a fair chance with his songs. #xfactor," he wrote.
Louis had earlier defended his friend after he failed to impress the judges with his rendition of Leona Lewis' 'Bleeding Love'.
He tweeted: "Still need to find the right song for @jwaltonmusic and to get rid off all the gimmicks! He's best with his guitar with a current song!!"
But not even Louis' support could save Jack and he was announced as the person with the lowest number of public votes and sent home instantly, leaving Mel B with two act's left in the competition, Paul Akister and Andrea Faustini.
Jack wasn't the only contestant who was shown the door last weekend, Lola Saunders was eliminated on Sunday's live show.
Reveal is now on Google Plus! Join us here for the latest pictures, fashion and celebrity news!