It all sounds very odd. Yet, it just might cause less trouble to have a story floating around about a female coworker stopping by a friend's house to look for something on lunch break, than to explain why someone's husband, that was supposed to be out of town, is somehow home & not clothed with a female other than his wife in his house....I'm surprised a twist like that has somehow escaped the gossips.
Gossip is vicious.
Gossip is vicious.