Drugs which are vasoconstrictors (usually uppers) will make your dick shrink up due to less blood flow, but it's only temporary. No different than going out in the cold, and I've never heard anything about the cold making your dick permanently small.