The danger lies in how your ‘surplus time’ is spent. If the ‘surplus time’ is spent for one’s own Soul, then it is (like) watering your own farm, but when it is used for other things [other than one’s own self], it is wasted water. Therefore, anyone whose ‘surplus time’ is spent on the Self, all his time is considered to have gone towards one’s own Self [The Soul].