Rabbi Smuley Boteach is one of the neighbors most affected. He owns the mansion next door.