Going off birth control and late period

So this whole mess started when I wanted to skip my period. As soon as I was to start my sugar pills I began a new pack of birth control pills. I skipped my period successfully but I couldn't deal with how hormonal the skip made me and after about week I stopped my pills and let my period come. After my period I decided to stop taking my birth control pills altogether. I later had sex 4 days after the end of my period while I was not in birth control but we used a condom. Now it's been 5 weeks and I have not had my period at all. I took a pregnancy test and it came back negative but I'm still worried for some reason. Any advice?

Going off birth control and late period