[D] How can attention mechanisms retrieve meaningful information over long distances when using RoPE or ALiBi?

If both RoPE and ALiBi work under the assumption that we should assign increasingly lower scores the further apart two tokens are, wouldn't the score be so penalized at some point that even if there is an interesting fact 1 million tokens away, we couldn't retrieve it because the positional encoding would force it to have such a low score?

attention attention mechanisms information machinelearning rope tokens work