The Made In Chelsea star entered the jungle this week, but a show spokesperson has today revealed: "We're sorry to see him leave."
There has been no official confirmation from ITV about the reason behind his exit, but reports say he has left on medical grounds.
Spencer was brought in as a late arrival with Vicky Pattison and Ferne McCann. The trio were taken to Snake Rock camp where they stayed for the night before going head-to-head in a trial.
Spencer took part in his first Bushtucker Trial called Dicing with Danger on Thursday night's show, in which he was joined by various creepy crawlies, including crickets and cockroaches, in a perspex box.
Before entering the jungle, Spencer said he was up for anything. Admitting to having no phobias, he said: "I am really looking forward to going in the Jungle. I am excited and it will be nice to change the perception of posh people."
Spencer - nicknamed Spenny - also admitted that he was looking forward to not having any contact with the outside world.
"Whenever I lose my phone, I am delighted," he said. "I don't like my phone! Not having it will be a welcome break, and I think being in the jungle is going to be so much fun. Hopefully the gory trials will come up and we will have some full on stuff that is hard to do."
Spencer's MIC co-stars had all been backing him to go far in the show. Mark-Francis Vandelli said: "I think he'll do really well. I think he'll be in his element. I mean, he's used to being around creepy crawlies…so, nothing new."
Meanwhile, former stars of the show Stevie Johnson and Hugo Taylor said Spenny would be "TV gold".
Try Reveal's digital edition on iPhone & iPad. Subscribe now & never miss an issue!
I'm A Celeb full line-up: