When you do not bother anyone at night, does anyone bother you? No one scolds you at night, do they? During the daytime, you create interferences, and that is why you suffer. Nature’s law is such that not a single difficulty will affect you, provided you do not interfere. All that affects you is your own interferences.