Broken, really, don't worry about it or get annoyed with yourself. There are plenty of other men out there who honestly will be pleased to treat you properly and with respect and affection. This guy just wasn't the one for you. It's nothing at all to do with you, and everything to do with him. I know that can be a bit hard to believe, but it's the truth. If he doesn't get in contact, it's not because of something you did/didn't do or say, it's because of his own particular issues and state of mind.
I decided that I personally wasn't comfortable with sleeping with people early on before I felt a proper emotional connection (after I had done precisely that and ended up not feeling too great about it. It didn't kybosh things with the man but I just didn't feel like it was the right thing for me to do as although physically it was fantastic, emotionally I felt a bit blah and empty about it all). That's something to learn about yourself, and again nothing to be annoyed with yourself about.
Don't let this put you off - learn what there is to be learned from it and move lightly on.