If you want them to stay good for longer, you want to do the water bath. If you just want to pickle them and plan to eat them within a couple months, then you don't need to. Pickling is a preservation method, after all.
I like spicy pickled eggs. Use white vinegar (I've tried apple cider...