You shouldn't be scared losing your virginity. You just need to find the right guy to do it. Pain is quite optional, I should say. Yet, that still depends on the experience your partner has.
That "Pain" is only in your mind. You should really clear up your mind, and think again. Do it when YOU think you're ready, don't listen to the others AKA us.
Good luck.