Too little or too much testosterone can affect your overall health and impact the levels of other sex hormones in your body.