Depending on the state, growing can be a much bigger offense.
And not for nothing, I think any seeds would be seized. (not sure about seeds) But customs doesn't like agricultural items to cross borders.
Ever fill out that form coming back to the states? "Did you visit a farm?"