I wondered this too, but Cersei isn't the queen so it has to be Dany. It also seems a lot more practical to take him to Mereen vs Kings Landing since they are in Essos.
Also, what do you think Varys thinks about when he's in a brothel? Must be very awkward, right?