It's mostly an OCD thing. Higher bitrates like 96khz are, yes, far higher than vinyl actually produces (which is, like you say, 50khz - still higher than CDs, though arguably outside the range of the average human ear). But it does produce an indefinable "something" in my recordings sometimes...