yea, if you wait and try to pull it out later on, the roots will be so interwoven by then you will be sure to do more damage than if you did it now....
Might be scary cause you dont want to hurt then, but just be gentle, take your time, and you should have no problems, there still pretty young...