I guess the best way is to be honest with your mate and with yourself. Do the two really spend enough time together? Is there something that is bugging you about the spouse, that you are trying to avoid, so you avoid him or her? Seems the best way is to talk it out, without being insulting.