I didn't harvest my last two plants until the beginning of December last year. They both came out fine. I did have to heat the hoop house near the end though. And I ran a big dehumidifer just to help out a little. Not sure how it would work out in the high desert climate, as I'm in Illinois. I do remember how the winter weather changed quickly when I lived out there. I was by Lancaster and Palmdale, cold as heck at night with 60mph winds. Then 80f and calm the next day...
If you can cover them, like you mentioned it should be completely doable.
Good luck friend!