I have been doing the samething. I work at a different place all the time, and heard going from refrigerated to not refrigerated is bad for them, so I just leave them out. Haven't had any problems so far. I also don't wash them til I use them. And when I do I use warm water instead of cold.
From what I have read, they do stay fresher longer in the fridge, but if you eat them regularly and timely, you shouldn't notice any difference (I have no proof of this). If you may be worried about an egg going bad from sitting on the counter, then crack the egg into a cup first. If it's good use it, if its bad then you haven't wasted the rest of the recipe by dumping a bad egg ontop of everything.
1 theory that I came up with about the refrigerating and then not refrigerating being bad is because of condensation. I noticed that when I got to work all of my cold eggs were sweating. And since its not warm water, the condensation may let bacteria from the outside she'll get into the egg. ****I have NO proof that this is the reason, just a thought of mine.****