If the oil of oregano doesn't help, then you might try using a syringe to see if you can draw anything out. Since it feels hard and moves around it may be pus. I'd be inclined to observe for a while and see if it gets better slowly, or gets worse. If you decide to mess with it, I would have...