Harvest?

Hey fellow bud growers, I am a noob grower who found a couple seeds during quarantine. Planted 2 in late June and now 6 weeks into flowering. Flowering started on Sept 11 so I'm on week 7 today. I've grown completely outdoor in 5 gallon pots on the rooftop of my place in Los Angeles. Weather has been great for growing, lots of sunshine.

I ran into issues 2 weeks ago w leaves turning yellow, stems turning purple/brown and flushed for a week every other day with hose/tap water. Asked the guy at hydro store and he said he thinks it's a Nitro deficiency. Bought some different nutes (Biothrive bloom 2-4-4) and feed 3x within an 8 days period. Didn't see any recovery. Some leaves worsened and started turning brown and crispy. Some bud growth was noted but nothing dramatic.

I checked the trichomes and mostly milky white, no amber. Pistals are mostly brown, not many white pistals any more. Buds look like buds.

3 weeks ago while defoliating I discovered a few caterpillars...only on 1 plant...the one that is doing bad. I caught them early and picked them off and used BT, never saw another caterpillar after or any evidence of pest damage. I trimmed off the affected buds. As mentioned, growth has occurred since then.

So my question is...should I harvest the one plant w issues (and continue flowering with the other)? Week 6 seems early but I'm concerned it is doing nothing out there productive, just dying.

Pics posted below are from plant I'm concerned about, will post other plant after.

Any input on these guys would be greatly appreciated!

Here is the better looking plant that had no issues. They are not the same strain.