I would tell the neighbor you don't like it, and want him to move it or turn it from viewing
your property.  If he agrees great.  If he doesn't then remove it yourself.  
Simple, don't let someone do that to you.