The Made In Chelsea star was famously removed from the jungle after just three days over use of steroid pills.
Speaking on Loose Women, Spencer said: "Ultimately I made a very stupid mistake, and it's my own fault and ITV did what they had to do and unfortunately I found myself of the plane home. I really hope one day to get another shot at it."
Spencer had been an early favourite on the show before his time was cut short.
The reality star said he took the pills for "vanity" as he had an upcoming charity boxing match and his opponent was "a lot bigger and heavier" than him.
Spencer continued: "I would love to do it again. ITV are a class act, I have so much respect for them, they dealt with things so well. I was so at home in the jungle, I really really loved it, and I thought I had a really good shot of doing well."
After landing back in the UK, Spencer said he was "pretty much running away" because he was forced to "face the music pretty hard".
Spencer ended up going to Africa, where he helped to build a school and worked with children in the community.
Try Reveal's digital edition on iPhone & iPad. Subscribe now & never miss an issue!