Author Topic: Uploading Historical data to WU and CWOP  (Read 131 times)

yardy

  • Gentle Breeze
  • **
  • Posts: 10
    • EW4351
    • KMEBLUEH8
  • Station Details: Mac Mini desktop running Sonoma, Davis Vantage wireless with Cache
Uploading Historical data to WU and CWOP
« on: March 22, 2024, 08:32:57 PM »
Hi, I'm a novice so please bear with me. I have been away from home for the winter and the computer was powered down while I was away. Having returned I was hoping that the data stored in the Davis Cache, would be uploaded to WU and CWOP. However looking at both the WU and CWOP websites nothing is showing up for the period prior to my return. I have 'Log Historical Uploads' turned on. So the question to the community is "does WU and CWOP accept historical records' ?  If they do, why do they not show in my online records.

In a related question, when I go away again I can set the computer to startup for say 2 hours every week using the  MacOS Terminal 'pmset' command (I didn't know I could do this) , which gives it time to download the weeks data from the cache and upload it to WU and CWOP. but if they don't take older data this method won't help. It will fill in my local WeatherCat database I agree.  I don't want to leave the computer powered up for weeks without me being here -
any suggestions ?  Thanks

Ray Yardy in the beautiful State of Maine.

elagache

  • Global Moderator
  • Storm
  • *****
  • Posts: 6494
    • DW3835
    • KCAORIND10
    • Canebas Weather
  • Station Details: Davis Vantage Pro-2, Mac mini (2018), macOS 10.14.3, WeatherCat 3
WU yes - CWOP no (Re: Uploading Historical data to WU and CWOP)
« Reply #1 on: March 22, 2024, 09:50:29 PM »
Dear Ray and WeatherCat troubleshooters,

Hi, I'm a novice so please bear with me. I have been away from home for the winter and the computer was powered down while I was away. Having returned I was hoping that the data stored in the Davis Cache, would be uploaded to WU and CWOP. However looking at both the WU and CWOP websites nothing is showing up for the period prior to my return. I have 'Log Historical Uploads' turned on. So the question to the community is "does WU and CWOP accept historical records' ?  If they do, why do they not show in my online records.

Weather Underground does except historical downloads; however CWOP does not.  Did WeatherCat successfully import all the data from the data logger?  There is a trick to coax WeatherCat to try to make a historical upload to Weather Underground again:

https://athena.trixology.com/index.php?topic=3284.msg31493#msg31493

From that thread:

Quote
WeatherCat support responded, with a suggestion to disable historical uploads for Wunderground, and see if the Wunderground starts properly and begins uploading data.  If that works, then enable historical uploads again to cover future WC downtime.

Let us know if that solves your problem.

In a related question, when I go away again I can set the computer to startup for say 2 hours every week using the  MacOS Terminal 'pmset' command (I didn't know I could do this) , which gives it time to download the weeks data from the cache and upload it to WU and CWOP. but if they don't take older data this method won't help. It will fill in my local WeatherCat database I agree.

Unfortunately, indeed it won't help you for CWOP.  Is there some reason why you don't want to leave your computer running?  If it is only running WeatherCat, the setup should extremely stable.  You might want to add an uninterruptible power supply in case of power outages, but there are a number of WeatherCat users who leave their computers on when they aren't at a location.  For example at a vacation home.

Let us know how we could help you more.

Edouard 

yardy

  • Gentle Breeze
  • **
  • Posts: 10
    • EW4351
    • KMEBLUEH8
  • Station Details: Mac Mini desktop running Sonoma, Davis Vantage wireless with Cache
Re: Uploading Historical data to WU and CWOP
« Reply #2 on: March 23, 2024, 02:33:20 AM »
Edouard, Thanks for your response,

You say   "Weather Underground does accept historical downloads; however CWOP does not.  Did WeatherCat successfully import all the data from the data logger?  There is a trick to coax WeatherCat to try to make a historical upload to Weather Underground again"

How can I tell if WU accepted the historical uploaded ?  I does not show on my WU dashboard. 

Also I assume this 'trick' involves stopping Weather-Cat uploads,  and then restarting the upload process again.  Is this correct ?  As I said I'm a novice so plain instructions are appreciated.  Please assume I know very little of the process.

I understand occasional powering up the computer once a week won't help with CWOP but presumably it will with WU. I'm away all winter so really don't want to leave the computer running even with just one app. If I get a power-cut I can use the 'pmset' commands to reboot the system when power returns, so a UPS is not necessary for a once per week type operation. 

Finally, does Weather-Cat upload from the cache or does it upload from the Weather-Cat database ?  Looking at my local Weather-Cat database the entire Cached record from when I was away is there.  If it uploads from the database can I assume that I don't need a internet connection while I'm away ?

Lots of dumb questions I know - but I appreciate any and all explanations you can give.

Thanks again

Ray Yardy

elagache

  • Global Moderator
  • Storm
  • *****
  • Posts: 6494
    • DW3835
    • KCAORIND10
    • Canebas Weather
  • Station Details: Davis Vantage Pro-2, Mac mini (2018), macOS 10.14.3, WeatherCat 3
Check WeatherCat manual. (Re: Uploading Historical data to WU and CWOP)
« Reply #3 on: March 23, 2024, 10:09:25 PM »
Dear Ray and WeatherCat troubleshooters,

How can I tell if WU accepted the historical uploaded ?  I does not show on my WU dashboard. 

If it doesn't show up on the dashboard, the data wasn't uploaded successfully.

Also I assume this 'trick' involves stopping Weather-Cat uploads,  and then restarting the upload process again.  Is this correct ?  As I said I'm a novice so plain instructions are appreciated.  Please assume I know very little of the process.

Take a look at the WeatherCat manual (which you can access from the WeatherCat Help menu).  On page 139 of the current manual is a screenshot of the preferences for Weather Underground.  Start by turning off the Historical Uploads and making sure that your computer is connecting successfully to Weather Underground.  Then, turn Historical Uploads back on.  Also, check the Log Historical Uploads option in that same preference.  You can then see if WeatherCat is successful making a Historical Upload by looking at the Log (which can be accessed from the Tools menu.)

I understand occasional powering up the computer once a week won't help with CWOP but presumably it will with WU. I'm away all winter so really don't want to leave the computer running even with just one app. If I get a power-cut I can use the 'pmset' commands to reboot the system when power returns, so a UPS is not necessary for a once per week type operation. 

I don't know much about the 'pmset' command.  I don't know if your computer is completely cut off from power, if it can restart anyway.  At the very least you would need to have WeatherCat automatically launched on startup and you would need to not use the quit check option (see page 178 of the user manual.)

Finally, does Weather-Cat upload from the cache or does it upload from the Weather-Cat database ?  Looking at my local Weather-Cat database the entire Cached record from when I was away is there.  If it uploads from the database can I assume that I don't need a internet connection while I'm away ?

You couldn't upload to Weather Underground without an Internet connection.  Isn't the plan to upload to Weather Underground once a week?  Sorry, I don't understand this particular question.

Let us know.

Edouard

Blicj11

  • Storm
  • *****
  • Posts: 3941
    • EW3808
    • KUTHEBER6
    • Timber Lakes Weather
  • Station Details: Davis Vantage Pro2 Plus | WeatherLinkIP Data Logger | iMac (2019), 3.6 GHz Intel Core i9, 40 GB RAM, macOS Ventura 13.6 | Sharx SCNC2900 Webcam | WeatherCat 3.3 | Supportive Wife
Re: Uploading Historical data to WU and CWOP
« Reply #4 on: March 25, 2024, 10:48:01 PM »
Finally, does Weather-Cat upload from the cache or does it upload from the Weather-Cat database ?  Looking at my local Weather-Cat database the entire Cached record from when I was away is there.  If it uploads from the database can I assume that I don't need a internet connection while I'm away ?

Ray, there are no dumb questions. Each one of us has to figure out this stuff at some point and many of us are in still in the process.

Whilst figuring out your uploading to WU, you also need to look at how your data logger is configured. The data logger stores weather info in its cache for those times your Davis Console may not have a current connection to your Mac.

You set the data logger sampling interval in WeatherCat Tools | Station Hardware Options

Check out this article in the WeatherCat Wiki for more information: https://wiki.trixology.com/index.php?title=Capacity_of_the_Davis_data-logger_to_store_weather_data_depending_on_the_chosen_sampling_interval
Blick