You have to port occasionally, and you are always literally on the radar and radio frequencies for freighters and their crews, pirates and lots of casual sailors who are not only a danger to themselves but to others as well. And when landing in ports or dealing with anyone in general really, there is always danger. I live just south of Charleston, SC. In my twenties, I was mugged 4 times, twice by freighter crews. I can run really fast and scream really loudly. I learned the lesson fast when docked at the marina here, back when I was 13, which would make that 46 years ago- it hasn't improved much.
I would say no. Even with a companion. Time enough for that later.