"They hate the fact that we're moving into neighborhoods"