If plants do not have a constant source of light for a certian amount of time per day they dont do so well.
Moving them from indoors then out then back in will just fuck with their crazy little plant minds. You need to keep it in one place where it will get sun/light all the time , maybe ( depending on laws in your country) near a window sill with a few flueros shining to supplement the natural light. Also u need to know your soil ph. Ph is ultra important this will cause your soil to stund growth due to the inability of roots to absorb nutrients thus less growth.
Soil grows can be a bitch, aeration of roots can be an issue and soils with fertilisers can be hard to mantain correct nutrient levels , i suggest you do a good search for "hempy buckets" And look for the rollitup.org and cannabis.com forums about them , they are alot simpler and get great results. Good luck dude.