It just means your plants are not performing at peak because some of their energy has to go in to defending and healing themselves. Mites can destroy crops if left alone. You should look into some pest control, there are tons of threads on here with good solutions. You still got a little ways to go before harvest, once all those hairs on your plant start to shrivel up and change color you will know your getting close.