Your reasoning is somewhat sound. History has not been so generous. Source: son of a trucker.

Also consider that minimal academic education and minimal specialized training is often sufficient to do the work. So the supply of those willing to do the work has often exceeded demand, so there's naturally downward pressure on pay.