The 25-year-old model entered the house last week, but was eliminated after just one day, when the islanders chose to give Troy Frith the only available place in the villa instead.
Now, speaking to The Sun, he's claimed Sophie was way more into him than suggested on the show.
He said: "As soon as I came in Sophie was all over me. They didn't really show it on camera as much as it was. In the hot tub, she was wiping her leg across my leg and I was like hmm okay. She was quite clearly trying it."
Oliver had asked former Miss Great Britain Sophie, 30, on a date during his day in the villa, and although they seemed to have chemistry, Sophie told him she wasn't ready to date after splitting with Tom Powell just days before.
"I'm going to be honest. I just feel it's too soon for me to really get to know you any further. I think you're lovely, calm. pleasant, really nice to speak to. You're absolutely gorgeous but right now... [shakes her head]."
Sophie added in the Beach Hut: "You know when you know, you just know. I think I'd eat him alive."
Sophie then reunited with Tom, just before Tom was eliminated from the show. While Tom told Sophie he loved her and would wait for her outside, Sophie's moved on, kissing newcomer Katie Salmon during a dinner date.
Meanwhile, Oliver also claimed to have "a lot of eye contact" with Kady, saying: "I would be doing something and she'd look over at me holding eye contact and because she's quite stand-off-ish with other people, I thought that might be something."
Well, we're not sure that Kady's other half Scott Thomas would agree!
Ahead of entering the villa, Oliver had admitted to fancying Kady, saying: "Kady's also caught my eye. She's hard work and I can tell she's crying out for someone who can actually take control of her."
But he didn't get the chance, as the islanders chose to keep Troy and dump Oliver, reasoning Troy had a good bond with single Tina Stinnes and they wanted to give them the chance to develop that.
Love Island airs 9pm on ITV2.