Brian was brought back onto the ITV talent show as creative director and choreographer last year for series 11, but he is yet to get a call confirming if they want him back this year.
Brian told The Mirror: "I haven't had the call yet so I don't know if I'm doing it yet."
Brian, 37, has a long history with X Factor, having actually briefly appeared as a judge on the show in 2007 to replace Louis Walsh. But he stepped down and was then named creative director.
He left the show in 2010 to follow Simon Cowell and Cheryl Fernandez-Versini Stateside for the US version. He was then brought back into the fold last year.
X Factor is said to be undergoing a major overhaul ahead of the new series. With Olly Murs and Caroline Flack now co-hosts of the main series, and with Sarah-Jane Crawford no longer hosting Xtra Factor, there will be plenty of new faces on screen.
Another talking point has been Louis Walsh and whether the long-standing judge will leave the show for good. It seems Louis is unsure whether he is staying or going himself, but Brian doesn't want to see him leave.
He told the newspaper: "I hate to see Louis go as he has great chemistry with everyone. I am for keeping the judging panel the same."
For exclusive competitions and amazing prizes visit Reveal's Facebook page NOW!
X Factor's most shocking moments: