To remove humans from power in all cases where our biases and animalistic nature would cause unnecessary suffering to others. As a species we are quickly approaching some very hard problems that no individual, or even small group, is capable of handling in a consistently rational manner. On our current trajectory of resource constraints and habitability constrictions, ethics by the numbers is inevitable.
We are either going to leave it to the powerful to sacrifice those they consider undesirable, as we have throughout history, or replace them with something not afflicted by the flawed elements of human nature to make the most compassionate decision possible amidst the horror.
This is a hard problem, and the human mind is not naturally equipped to work at the scales in question. Perhaps the solution is a thing (e.g a program), a process like democracy of some ilk, or something else entirely. The important part is recognizing our limits and working to account for them in our solutions. Acting without that awareness is a recipe for disaster.
Of course this goes both ways. Some things I could name here everyone would agree I shouldn't be allowed to do. Other things are things that it wouldn't be hard to convince everyone here (but the opposition would remind you that I'm ignoring their points)...