Caroline spoke out on Sunday night (22 November) after the live results show, where she slammed those for making "vile" remarks.
Some online users had said Caroline's black mini dress was "unflattering", while others said it made her look "pregnant'.
Hitting back, Caroline tweeted: "It's very easy to take a shot at someone online. The vile comments about my weight and just all round look tonight are quite shocking. Have never said I'm the prettiest or thinnest or even anything special... But thank god I'm not horrible... Cool attitudes."
Fans were in support of Caroline, with many tweeting words of encouragement straight after.
One user said: "@carolineflack1 please ignore them all! You're better than them, you're brilliant! Head high and smile."
Another wrote: "@carolineflack1 take no notice!!! I thought you looked absolutely stunning! You're perfect the way you are."
Try Reveal's digital edition on iPhone & iPad. Subscribe now & never miss an issue!
X Factor's most shocking moments: