The ITV talent contest is currently searching for a fourth permanent judge to join Gary Barlow, Tulisa Contostavlos and Louis Walsh.
"I'd like to see Dannii back on the TV," Cardle told Digital Spy at last night's Arqiva British Academy Television Awards.
"I know she's not doing it, but it would've been nice, as long as it's right for her and it's something that she wanted to do."
Cardle also offered his advice to any potential new judge: "Don't sit on the fence, but make sure that what you say is well thought-out - constructive criticism as opposed to just nasty comments, or good comments where they're not due."
Rita Ora, Geri Halliwell and another former winner Leona Lewis are among those to temporarily fill the fourth spot on the X Factor panel.
