Very true but not applicable to all. In fact the texts mention these sort of "sidetracks" as something to watch out for and avoided actively. It is one of the main reasons to only attempt such extreme practices strictly under the guidance of a "realized guru".