I have lived in large metropolises, medium cities, and small towns. I lived in Philadelphia, which has over twice the amount of people as Baltimore. The specific issue I responded to is not something I have ever experienced in any of the places I lived, which is why I responded to it.
I feel like I struck a nerve with you and I apologize for that if I did.
You never ran into squeegee people or panhandling in Philadelphia? That doesn't match my experience.
That said, it definitely sounds like you are looking for reasons to be afraid/not like Baltimore. Maybe you don't like the job offer, maybe there are family issues at play. But focusing on one negative experience of one random internet poster compared to the many other positive/normal experiences suggests that you're not really interested in hearing the good things. Since so much of life is about attitude and perspective, it's probably not going to be a good experience if you do move to Baltimore.
Like Philadelphia, Baltimore has a ton of suburbs where you can live to avoid the panhandling if you want.