TTC with disappointing results?

due to health issues in my early teenage years i've always had irregular periods. 3 years ago I went on birth control. In august of last year my husband and I decided that it would be ok for me to go off of the bc and whatever happened happened. Its been nearly a year now and we're still not pregnant. I had my yearly exam in january and was told that my hormones were off but nothing terrible. I'm taking vitamins, am at a healthy weight level, i've lowered my stress levels, and i'm getting enough sleep. I'm honestly doing everything right so I don't understand.