It sounds like your honey is fermenting! It sometimes happens with raw honey. www.kimesapiary.com has a page all about this and what to do about it. In a nutshell you are going to have to re-liquefy the honey, re-pot it and keep it somewhere below 50F to avoid spoilage.