Yes! It gets stale and funky! Did you ever leave icecubes in your freezer for a few months, then taste them (what's left of them)? Gross, huh? Bottled water which is refrigerated should last awhile, but you don't know how long it was in those same bottles unrefrigerated! When it expires, dump it!