I agree with enjoying the "quiet time". If you're having fun without him, he's gonna wonder what's up, and maybe he'll come around when he realizes that you CAN have fun without his grumpy company. I do hope it works out for you though.
Paul and I have been married almost 33 years, so I've experienced those silent times just as he has experienced my moods etc., and when we lost one of our (much loved) hens on Friday, I never expected my hubby to cry as much as he did. It somehow made me appreciate him a lot more than I would have imagined.
Guys generally don't show much emotion, hence the silent treatment.