Sahih Muslim
1928.02

Another version of the tradition narrated on the same authority worded slightly differently. It says:(He) would not enter (upon his household at night)