When people are not sleeping well or enough, stress hormones, in particular cortisol, shift to peaking later in the day, and those elevated cortisol levels later in the day cause a bunch of different problems in both males and females, many of which impact fertility.