It pretty much comes down to if the present trichome color will give you the most of what you like the best that can be gotten from the strain you are growing. If so, chop. If not … wait and watch and when the trichome color that is BEST FOR YOU is spotted .. chop.
Based on your description of the trichome color I would harvest, if I had not already a few days earlier …. I am not one who likes to lose THC by letting it oxidize and become CBN so I avoid amber trichomes … but that is only my preference.
Do what is best for you and for you alone.