I used to do everything without a reference too, but only familiar things. I did manage some cute new farm animals with no references, but they were cartoony (on purpose). But yes, like you, my art is so much better with a reference.I have done stuff without a reference before... In fact, most of my art was without one, but now I'm discovering that my art is better with a reference and on some of it, I've been starting to trace. That's only on my digital though, and is only on the outline. I fill everything in and add details using a reference. (I haven't shared any of my pieces that I've traced the outline on because I sorta feel like it's cheating.)
I would trace horse outlines out of a breeds book, then fill them in, and it was a great help for fine tuning my independent horse drawing. I almost never used references for my horses, and they got to a pretty good point.

