I understand being unconformable with one's country's past, but the mental hoops to try to get some justification to colonization is so strange.
Even if (and that's a BIG if) those societies ended up "freer" let's not fool ourselves, not a single country went to colonise another for hundreds of years to make it freer, they went there to exploit it. If 500 years later that country is in a better shape now (again a BIG if), that's an unintended side effect.