If you are truly infatuated with trans women, the it would be best to man up and get a divorce. Otherwise you will end up cheating on your wife and be always have that sense of guilt. Or you can just be faithful to her and forever regret ever getting married. And that's not good for any relationship.
And who knows, if you get a divorce e and start dating, you just might meet the woman of your dreams, get married and be forever happy.
The choice is yours.