[D] Is EOS token crucial during pre-training?

The EOS token used during pretraining marks "end of sequence", but it does not prevent information to flow across potentially unrelated documents. If so why to even include it during pretraining when we can add it later in SFT phase?

documents eos flow information machinelearning marks pre-training pretraining sft token training