I have held back from commenting because I didn't want to be judgemental.

That question you asked "who he liked better me or her" is one that really should not have been asked. Its is setting yourself up for a fall, especially since you are married to another.

I counselled against you having sex with someone outside your marriage because invariably it causes pain. You are having some now, I think a good dose of monogamy is indicated.

It is a personal decision for you and I wish you all the best in resolving it.