We have them all over too. Mostly growing up in the trees and yopon. We always try to get as many as we can reach and snatch before all the critters attack them.
That looks like "American Beauty Berry". Does it have purpilish berries later in summer. Wild birds love it and spread the seeds everywhere.
Edit ... Posted this before I got to the end of the thread.