I don't see why non-invertibility matters. Lots of useful features are non-invertible.
Edit: and if you are dealing with real data sets or producing real datasets for analysis you will often have only approximations to the thing you want to measure. Determining whether your proxy variable is worth including or how to interpret your results in light of it are necessary skills to develop.