https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8045461/
This is a common attribute of infections and is really more of a math issue than anything SARS-specific. The bigger the initial dose, the sooner it will get to the impact stage, and the less prepared your immune system will be at that time.