Christmas can be religious or secular. The US pretty much cemented it as being destined for a more secular existance when it became a government sanctioned holiday with paid time off work. Some include it in Paganistic belief systems as it definitely is in origin, right down to decorating trees (Eater fertility fest too for that matter, etc). Some prefer to celebrate it as Yuletide, Saturnalia, a winter solstice celebration, etc. If Christmas is about celebrating Christ for you, that's great. If it's about recognizing and appreciating the change in seasons and what that means, awesome. If it is about time with family, super sweet.
The only things I find distasteful personally about the holiday is using it for a negative outlet, such as demanding others celebrate it as you do and for the same reasons. I do personally find basking in the material and commercial to be distasteful, but many people who complain about it happening on Christmas aren't exactly free of it during the year. I'm not even sure I'm really behind the 'giving' aspect of it. Having several relatives give 'strings attached' gifts, and studying gifts and the ways they normally operate between givers and recievers means I have a slightly different outlook on it than most, often tied to senses of obligation or hope for return. That said, it doesn't mean everyone views giving and recieving in that light.
Differences are amazing and engaging things. It's great to find ways to celebrate them too.