Nope, I always have that problem. Someone suggested using conditioner to shave with, I do that too! I haven't used soap or women's shaving cream for years. Just really good conditioner. There is something to be said for waxing I guess.
Try using a good exfoliator before you shave. Also, there is a product called Tend Skin that is good for getting rid of the bumps caused by ingrown hairs. I'm not sure if that is what is causing your bumps though.