Abu Hurairah (radiyallaahu-anhu) narrated that the Messenger (sallal-laahu-alayhi-wasallam) said: “Travelling is a portion of torment. It prevents one of you from your sleep, food, and drink. So when one of you fulfils his (need behind that travelling), then let him hurry back to his family” [Muslim 1927].
Imaam An-Nawawi (rahimahullaah) commented on this hadeeth saying that it means that one is prevented from full sleep and its full enjoyment due (to what travelling involves pertaining to) difficulties, tiredness, heat and cold, worries, fear, isolation from one family and rough (circumstances). So it is recommended that one returns to his family after fulfilling his business and does not delay his return due to something else that is not important.
[Source: Saheeh Muslim Bi-Sharh An-Nawawi Vol 13-14’ page 60. Publisher: Dar Al-Kotob Al-Ilmiyyah’ 1st edition 1421AH (Year 2000). Abridged and slightly paraphrased]