What is the boyfriend of a married woman called?

These two words are borrowed directly from French, in which language they have equivalent but gendered meanings: fiancé refers to a man who is engaged to be married, and fiancée refers to a woman.