If we’re talking about next-door neighbors yes, sure.

I reckon it means people living in the same neighborhood as you, which in big cities can be quite large.