"But it sure was hard to kill that rye"

Are you using glyphosate or Gramoxone?

Maybe you need to switch burndown products as you let the rye age?