We gave up growing potatoes 5 years ago and are still getting volunteers in wheat. The frost might kill the tubers, but it won't kill the seeds from the fruit. One year in 5 is tight enough on the rotation before you start getting PCN and other pests build up.