Man says neighbors expressed concerns about building allegedly tied to shocking case of kidnapping, sexual assault