How long should I wait without contact until I give up on him?

The guy sounds like a jerk. The "never having a girlfriend thing" is a really poor excuse. He's either just not that into you, or you are a call. Move on and put your time and effort into a guy that respects you and is willing to put time into developing a relationship