Technically, yes. Practically? Nah.
Like everyone else said, unless they are able to catch you in the act - and I've heard of LEO leaving cameras trained on a grow in hopes of catching an image of the grower's face - there is very little chance that they will trace a grow back to the grower. Hell, even in INDOOR grows sometimes they never find the person behind the growing... they just arrest all the workers who live in the house and tend the plants.
This is, of course, assuming that you don't leave them any evidence. If you've ever been fingerprinted then it wouldn't be hard for them to pull prints of water jugs, nute bottles, etc, and trace it back to you. If you aren't in the system then even fingerprints won't do them any good but it's better not to leave them in the first place =)