Despite the sweltering heat in England, the pop star couple have headed to even sunnier shores in Portugal to make the most of their summer with their little one and it sounds like the trio are having the best time.
Not only has Marvin been lounging by the pool and tucking into some tasty salmon sashimi with his wife, the first-time father has also been teaching Alaia-Mai to swim with her very first dip in the water.
The JLS singer tweeted: "Took my princess swimming for the first time today..she's a water baby!!!"
Rochelle, 24, then added that watching her daughter and Marvin in the pool had been "priceless" and proceeded to post a picture of Alaia-Mai's miniature floatation device, as well as her adorable pink swimming costume. Aww!
The Saturdays' songstress captioned the snap: "Something tells me a Princess has been swimming here..."
While overseas it seems Rochelle - who gave birth in May - can't get enough of her bandmates, as she and Marvin were joined by The Saturdays' Una Healy, her husband, rugby player Ben Foden and their daughter, Aoife Belle.
Una revealed that the girls had been taking it easy and catching up with one another during their break (no doubt swapping parenting tips too!), leaving the boys to keep themselves entertained with a game of golf.
She tweeted: "Had such a lovely day chilling by the pool us mamas @RochelleTheSats and our babies while the boys played golf, finished by yummy dins! X"
And given that Una and Rochelle's bandmate Frankie Sandford is also pregnant now, it looks like there will be another pop star baby lounging in the sun with them next year!
What do you think of the name Alaia-Mai? Let us know below!