Abu Sulaymaan [rahimahullaah] said:

“Abstinence from the worldly life is to abandon that which preoccupies you away from [the remembrance and obedience to] Allaah.” He (rahimahullaah) also said: “Everything that preoccupies you away from [remembrance and obedience to] Allaah- be it [your] family, wealth and children- then indeed it is misfortune.”

[Jaami-ul Uloom Wal-Hikam: page: 315-316]