Dragons' Den star Duncan was voted out of the I'm A Celebrity...Get Me Out Of Here! jungle on Thursday after receiving the fewest public votes.
While appearing on Good Morning Britain, Duncan was asked about his constant conflicts with Lady C in camp.
Following Lady C's exit earlier this week, she said both Duncan and Tony Hadley took the decision to "shut me up, shut me down and run me out of the camp".
But when questioned over their disagreements, something which Lady C's son Dima has called "bullying", Duncan replied: "I did almost have a breakdown at the end when Lady C was popping at me all the time. Then she left, and everything, it was good again."
When asked if he will speak to Lady C now that they are both out of the jungle, Duncan said: "What I don't want is to bring any negativity into my life. I will not be involved with negative people. So that's it."
Try Reveal's digital edition on iPhone & iPad. Subscribe now & never miss an issue!
I'm A Celeb: who's left in the jungle?