Thanks for the tips and kind words everyone! He is still kicking and trying to be his fiesty self. He voraciously ate pieces of a pea off the end of a tooth pick. I haven't fed him for two days now and I think I got about half a pea in him. I also changed the water in his tank because it was starting to get a bit icky on top where he's been spending his time.
It may be my imagination, but he looks a little better to me. How long does it usually take for the pea to help? I'm guessing by morning I may see some improvements. I think mostly he just got some energy from the water change. I'm pretty sure it is definitely a swim bladder problem because he can right himself to swim, but has trouble swimming and staying at the bottom. He uses his little cave to stay down.
I think I will not feed him for another few days days to let his system clear out. If the pea helps, I will give him some more in a day or two. I was surprised how easily he ate it! Then again, he will eat anything I think!