I think there is something to that.

I find sometimes when I don't take the jug of milk out of the refrig often, that it lasts longer.  I think taking that jug of milk out of the refrig subjects it to fluctuating temps.  And I am not a person who takes milk out of the refrig and lets it out.  I get what I want and put it back it.  still........

It seems like there is a trend lately to push for lower bacteria and Somatic cell counts in milk.  Theoretically, this would have an impact on the shelf life of milk.  Not saying this is true in your case, but.......