I've probably missed something obvious but...
Why not just put less Nitrogen on your soil?  If this is the excessive amount your forage is carrying....how much is leaching into the ground water?

I thought in WI the potatoes were not grown on "good ground" but rather on sandy, low CEC type soils.