Data Logging questions

Rckola

Well-Known Member
I have a ton of temperature and humidity data in excel workbook form and no idea what to do with it.
and I am aware this is is a text document. I have the .xlxs don't worry. This is just easier to upload and deal with so you can see the amount of data.

I use a govee H5072 for those wondering.

What do you guys do with your data?
 

Attachments

hot_box_enthusiast

Well-Known Member
How is this working out for you? I've started "researching" solutions like this and have been surprised at the lack of threads. My initial google searches were around Raspberry Pi and using little sensors (for example https://tutorials-raspberrypi.com/raspberry-pi-measure-humidity-temperature-dht11-dht22/). I haven't done computer programming since C++ in 1996 lol, and so although the Raspberry Pi solution looks cheaper (want to be able to outfit a 10x15 grow with multiple sensors to log data). Given the high time cost of entry to learn to do the raspberry pi thing, these govee sensors might be a reasonable tradeoff.

(I am an excel nerd and have just been manually entering my temp/rh data once per hour and monitoring max/mins. It would be so fun to have continuous streams of data from multiple locations in my home to dial in the grow and condition the environment around it).
 

Rckola

Well-Known Member
How is this working out for you? I've started "researching" solutions like this and have been surprised at the lack of threads. My initial google searches were around Raspberry Pi and using little sensors (for example https://tutorials-raspberrypi.com/raspberry-pi-measure-humidity-temperature-dht11-dht22/). I haven't done computer programming since C++ in 1996 lol, and so although the Raspberry Pi solution looks cheaper (want to be able to outfit a 10x15 grow with multiple sensors to log data). Given the high time cost of entry to learn to do the raspberry pi thing, these govee sensors might be a reasonable tradeoff.

(I am an excel nerd and have just been manually entering my temp/rh data once per hour and monitoring max/mins. It would be so fun to have continuous streams of data from multiple locations in my home to dial in the grow and condition the environment around it).
The Govee works great. You can export directly from the app into excel
 

dunphy

Well-Known Member
Check out the programming language Python.... Its very versatile, easy to learn, but extremely powerful... Its popularity means theres tons of support and resources, also there these things called librariess, they are collections of packages, with prewritten modules to accomplish common tasks... Because of the languages popularity there are tons of useful collections available... Data scientists use python to infer patterns, trends and visualize, calculate data, make pretty charts and graphs, and overall just make it easier to sift through data for new insights...
In a growing situation there are already tons of packages available to handle weather forecasting, greenhouse data logging, and python is so versatile its able to connect to tons of different systems and is very good at automating things for this reason also. You can write or just run simple programs that can import all that excel data, or directly from your sensors, and present it to you in different types of graphs, The point of this would be to make it easier to see changes in your data.... If you're looking at an excel chart, you may not notice a certain columns numbers rising, or spike on a couple rows and go back to normal... If that data is automatically plotted on a line/bar graph and matched with time, temp, RH, light timer/fan/etc. then you can see very easily.... Hey there was a spike every night around 7:23 pm wtf is going on here... and come to find out something happened like a mechanical timer was accidentally shut off for a 30 minute interval, and you would never know this because it spikes for such a short time... Theres millions of things you can do with that data, pattern and trend identification is just one... you can set up alerts for rising temps, you can set up automatic execution scripts using IFTTT (If this then that) logic... e.g. If temp rises 5°, shut off Co2, turn exhaust/intake fan on 5min and text my cell the current temp with a spike alert message.... You get the idea... Its very interesting and fun once you get into it, and you can tailor your systems, python is a great first language to learn IMO because you can do all these cool automations, as I said there are tons of resources, and when writing it its just more natural to read than a C++ or something with a very awkward syntax... Also because you can implement these small but powerful changes very quickly and easily... you get a quicker sense of reward than someone struggling and trudging through programming in C or something and having to do a million things just to see a small change in a program... and if you cant see the value in any of those small changes, or its too confusing, then you wont have the motivation to learn, or the ability to retain the information if you don't get any sense of joy or power out of it... Python is definitely better for first timers, but like I said still extremely powerful especially for data science.

Here are just some weather charts you can get an idea of seeing what line charts could do for a High and Low Temp/RH% for the last 15min/hour/day...check out if there any significant swings (remember when growing marijuana it is the swing of temp/humidity that causes the issues more so than the amount as in high/low humidity... So finding spikes in temp/rh is extremely important for marijuana)

 
Last edited:

Rckola

Well-Known Member
Check out the programming language Python.... Its very versatile, easy to learn, but extremely powerful... Its popularity means theres tons of support and resources, also there these things called librariess, they are collections of packages, with prewritten modules to accomplish common tasks... Because of the languages popularity there are tons of useful collections available... Data scientists use python to infer patterns, trends and visualize, calculate data, make pretty charts and graphs, and overall just make it easier to sift through data for new insights...
In a growing situation there are already tons of packages available to handle weather forecasting, greenhouse data logging, and python is so versatile its able to connect to tons of different systems and is very good at automating things for this reason also. You can write or just run simple programs that can import all that excel data, or directly from your sensors, and present it to you in different types of graphs, The point of this would be to make it easier to see changes in your data.... If you're looking at an excel chart, you may not notice a certain columns numbers rising, or spike on a couple rows and go back to normal... If that data is automatically plotted on a line/bar graph and matched with time, temp, RH, light timer/fan/etc. then you can see very easily.... Hey there was a spike every night around 7:23 pm wtf is going on here... and come to find out something happened like a mechanical timer was accidentally shut off for a 30 minute interval, and you would never know this because it spikes for such a short time... Theres millions of things you can do with that data, pattern and trend identification is just one... you can set up alerts for rising temps, you can set up automatic execution scripts using IFTTT (If this then that) logic... e.g. If temp rises 5°, shut off Co2, turn exhaust/intake fan on 5min and text my cell the current temp with a spike alert message.... You get the idea... Its very interesting and fun once you get into it, and you can tailor your systems, python is a great first language to learn IMO because you can do all these cool automations, as I said there are tons of resources, and when writing it its just more natural to read than a C++ or something with a very awkward syntax... Also because you can implement these small but powerful changes very quickly and easily... you get a quicker sense of reward than something struggling and trudging through programming in C or something and having to do a million things just to see a small change in a program... and if you cant see the value in any of those small changes, or its too confusing, then you wont have the motivation to learn, or the ability to retain the information if you do get any sense of joy or power out of it... Python is definitely better for first timers, but like I said still extremely powerful especially for data science.

Here are just some weather charts you can get an idea of seeing what line charts could do for a High and Low Temp/RH% for the last 15min/hour/day...check out if there any significant swings (remember when growing marijuana it is the swing of temp/humidity that causes the issues more so than the amount as in high/low humidity... So finding spikes in temp/rh is extremely important for marijuana)

You sir are a gentleman and a scholar
 

hanimmal

Well-Known Member
Popped your data into STATA (or any data analysis like @dunphy showed using a program like Python) and you can also find out things like as your temperture increases by a degree you will see about a 13% decrease in your rooms relative humidity.
Screen Shot 2020-06-18 at 8.54.42 AM.png
 
Top