Sounds like a classic prescriptive easement to me:

Actual and open use, use adverse to the owner, min. 5 years use, and does not exclude the owner.

Still you won't want to deal with them and just need to put your own in.