Author Topic: Did not collect data overnight  (Read 5768 times)

Neil

  • Gentle Breeze
  • **
  • Posts: 12
  • Station Details: Maplin N96GY (Fine Offset) MacBook Pro OS 10.6.8
Did not collect data overnight
« on: January 06, 2013, 12:10:50 PM »
For some reason WeatherCat did not collect any data between 00.13 and 07.23 this morning. All data points remained the same during this period and then at 07.23 (before we'd got up so it's not as if I did anything!) it started collecting data as normal again. The station was collecting data at this time as I plugged it in to my old PC and the software it came with extracted all of the data it had stored and all looked fine. Having plugged it back into my Mac, WeatherCat was able to reconnect OK and extract the data from the period it was unplugged OK, but there is still this gap of some 7 hours. Any ideas about what has gone on?

Neil

WCDev

  • WeatherCat Developer
  • Administrator
  • Storm
  • *****
  • Posts: 2987
    • CW9739
    • IIBSTO2
    • Trixology
  • Station Details: Main Station: Vantage Pro-2, 24hr fars, solar, extra temp stations, no U.V. WeatherLinkLive.
Re: Did not collect data overnight
« Reply #1 on: January 06, 2013, 01:37:37 PM »
Do you know if you were getting any sensor errors overnight? Any admin emails sent out?

Neil

  • Gentle Breeze
  • **
  • Posts: 12
  • Station Details: Maplin N96GY (Fine Offset) MacBook Pro OS 10.6.8
Re: Did not collect data overnight
« Reply #2 on: January 06, 2013, 03:31:47 PM »
No admin e-mails sent out and as far as I can tell no sensor errors as if I download data to a PC everything looks OK and I can see that during this period changes in temperature and humidity etc were recorded. One odd thing is that although the wind direction sensor is not connected (weather has been too awful to get out to set everything up properly yet!), WeatherCat does record a direction as either 0, 180 or 5 and this varies throughout the day changing every few hours or so, but doesn't usually correlate with a 'data lock'. Nothing is recorded by the PC software for wind direction. At the time of the data lock the most notable anomalies were that the wind direction switched from 5 to 180 and the outside temp 'jumped from 7.7 to 9.2 (PC data only show change from 7.7 to 7.6) and inside temp from 22.2 to 22.9 (whereas PC data show drop to 22.1). The WeatherCat data don't change for the next 7 hours at which time the wind direction changes to 5 for one reading and then back to 180 for subsequent readings (until a couple of hours later when it changes to 0), and from this point onwards the remains in sync with the data I can download from my PC.

WCDev

  • WeatherCat Developer
  • Administrator
  • Storm
  • *****
  • Posts: 2987
    • CW9739
    • IIBSTO2
    • Trixology
  • Station Details: Main Station: Vantage Pro-2, 24hr fars, solar, extra temp stations, no U.V. WeatherLinkLive.
Re: Did not collect data overnight
« Reply #3 on: January 06, 2013, 05:01:17 PM »
OK, let's switch on the logging then so if it happens again we have a record of what happened, but I can guess with the anemometer missing you are getting slow updates as WeatherCat will be waiting between samples to see if the wind data comes on-line.

Go to Advanced Preferences pane of WeatherCat's preferences and tick 'Copy Log Entries To Console'. Then if you open Applications->Utilities->Console.app, you should see lots of output from WeatherCat as it runs.

Neil

  • Gentle Breeze
  • **
  • Posts: 12
  • Station Details: Maplin N96GY (Fine Offset) MacBook Pro OS 10.6.8
Re: Did not collect data overnight
« Reply #4 on: January 06, 2013, 06:30:25 PM »
Although this wasn't checked (although I have it checked now) I looked through the log and came across these entries:

At around the time data logging stalled:
06/01/2013 00:10:25   WeatherCat[2020]   WeatherCatController:do_sleep called

Next WC related entries were these:
06/01/2013 03:46:48   WeatherCat[2020]   ***Hardware comms fail (stale data)***
06/01/2013 03:46:58   WeatherCat[2020]   ***Hardware comms fail (stale data)***
06/01/2013 03:47:19   WeatherCat[2020]   ***Hardware comms fail (stale data)***

Nothing for the next couple of hours then:

06/01/2013 05:35:06   WeatherCat[2020]   ***Hardware comms fail (stale data)***
06/01/2013 05:35:11   WeatherCat[2020]   ***Hardware comms fail (stale data)***
06/01/2013 05:35:17   WeatherCat[2020]   ***Hardware comms fail (stale data)***

then:
06/01/2013 07:23:19   WeatherCat[2020]   ***Hardware comms restored***
06/01/2013 07:23:26   WeatherCat[2020]   DM: Want 433 historical minutes.
06/01/2013 07:23:27   WeatherCat[2020]   DM 0: Initialising sample cache
06/01/2013 07:23:27   WeatherCat[2020]   DM 0: Sample cache initialised. Took 0.03 seconds
06/01/2013 07:23:27   WeatherCat[2020]   Loading current month...


Data collection looks normal from this point although these errors were reported:
06/01/2013 09:11:39   WeatherCat[2020]   ***Hardware comms fail (stale data)***
06/01/2013 09:11:44   WeatherCat[2020]   ***Hardware comms fail (stale data)***
06/01/2013 09:11:49   WeatherCat[2020]   ***Hardware comms fail (stale data)***
06/01/2013 09:12:09   WeatherCat[2020]   ***Hardware comms fail (stale data)***


It was at this time that I first had a look at my Mac this morning:
06/01/2013 10:11:22   WeatherCat[2020]   ***Hardware comms restored***
06/01/2013 10:11:42   WeatherCat[2020]   Loading current month...
06/01/2013 10:11:43   WeatherCat[2020]   DM: Want 168 historical minutes.
06/01/2013 10:11:43   WeatherCat[2020]   Starting archive download
06/01/2013 10:11:43   WeatherCat[2020]   Reading historical block 1 of 17. 0% done. Addr=25024
06/01/2013 10:11:44   WeatherCat[2020]   Block has invalid winddirection 2520.0
06/01/2013 10:11:44   WeatherCat[2020]    6-1-2013 10:1 OT=8.7C Rain=0.0mm, Baro=1031.31mB IT=18.6C IH=55 OH=93 WSAv=0.0kmh WSG=0.0kmh WDir=180.0
06/01/2013 10:11:44   WeatherCat[2020]   Reading historical block 2 of 17. 5% done. Addr=25008
06/01/2013 10:11:44   WeatherCat[2020]   Block has invalid winddirection 2520.0
06/01/2013 10:11:44   WeatherCat[2020]    6-1-2013 9:51 OT=8.6C Rain=0.0mm, Baro=1031.21mB IT=18.5C IH=55 OH=93 WSAv=0.0kmh WSG=0.0kmh WDir=180.0
06/01/2013 10:11:44   WeatherCat[2020]   Reading historical block 3 of 17. 11% done. Addr=24992
06/01/2013 10:11:45   WeatherCat[2020]   Block has invalid winddirection 2520.0
06/01/2013 10:11:45   WeatherCat[2020]    6-1-2013 9:41 OT=8.5C Rain=0.0mm, Baro=1031.31mB IT=18.6C IH=55 OH=93 WSAv=0.0kmh WSG=0.0kmh WDir=180.0
06/01/2013 10:11:45   WeatherCat[2020]   Reading historical block 4 of 17. 17% done. Addr=24976
06/01/2013 10:11:46   WeatherCat[2020]   Block has invalid winddirection 2520.0
06/01/2013 10:11:46   WeatherCat[2020]    6-1-2013 9:31 OT=8.4C Rain=0.0mm, Baro=1031.31mB IT=18.6C IH=55 OH=93 WSAv=0.0kmh WSG=0.0kmh WDir=180.0
06/01/2013 10:11:46   WeatherCat[2020]   Reading historical block 5 of 17. 23% done. Addr=24960
06/01/2013 10:11:46   WeatherCat[2020]   Block has invalid winddirection 2520.0
06/01/2013 10:11:46   WeatherCat[2020]    6-1-2013 9:21 OT=8.3C Rain=0.0mm, Baro=1031.21mB IT=18.6C IH=55 OH=93 WSAv=0.0kmh WSG=0.0kmh WDir=180.0
06/01/2013 10:11:46   WeatherCat[2020]   Reading historical block 6 of 17. 29% done. Addr=24944
06/01/2013 10:11:47   WeatherCat[2020]   Block has invalid winddirection 2520.0
06/01/2013 10:11:47   WeatherCat[2020]    6-1-2013 9:11 OT=8.3C Rain=0.0mm, Baro=1031.31mB IT=18.7C IH=55 OH=93 WSAv=0.0kmh WSG=0.0kmh WDir=180.0
06/01/2013 10:11:47   WeatherCat[2020]   Reading historical block 7 of 17. 35% done. Addr=24928
06/01/2013 10:11:47   WeatherCat[2020]   Block has invalid winddirection 2520.0
06/01/2013 10:11:47   WeatherCat[2020]    6-1-2013 9:1 OT=8.3C Rain=0.0mm, Baro=1031.41mB IT=18.7C IH=55 OH=93 WSAv=0.0kmh WSG=0.0kmh WDir=180.0
06/01/2013 10:11:48   WeatherCat[2020]   Reading historical block 8 of 17. 41% done. Addr=24912
06/01/2013 10:11:48   WeatherCat[2020]   Block has invalid winddirection 2520.0
06/01/2013 10:11:48   WeatherCat[2020]    6-1-2013 8:51 OT=8.3C Rain=0.0mm, Baro=1031.41mB IT=18.7C IH=55 OH=93 WSAv=0.0kmh WSG=0.0kmh WDir=180.0
06/01/2013 10:11:48   WeatherCat[2020]   Reading historical block 9 of 17. 47% done. Addr=24896
06/01/2013 10:11:49   WeatherCat[2020]   Block has invalid winddirection 2520.0
06/01/2013 10:11:49   WeatherCat[2020]    6-1-2013 8:41 OT=8.2C Rain=0.0mm, Baro=1031.31mB IT=18.7C IH=55 OH=93 WSAv=0.0kmh WSG=0.0kmh WDir=180.0
06/01/2013 10:11:49   WeatherCat[2020]   Reading historical block 10 of 17. 52% done. Addr=24880
06/01/2013 10:11:49   PhoneDisk[153]   getDeviceInfo:{
    FSBlockSize = 8192;
    FSFreeBytes = 9376006144;
    FSTotalBytes = 30561214464;
    Model = -9223372036854775808;
}
06/01/2013 10:11:49   WeatherCat[2020]   Block has invalid winddirection 2520.0
06/01/2013 10:11:49   WeatherCat[2020]    6-1-2013 8:31 OT=8.2C Rain=0.0mm, Baro=1031.51mB IT=18.7C IH=55 OH=93 WSAv=0.0kmh WSG=0.0kmh WDir=180.0
06/01/2013 10:11:49   WeatherCat[2020]   Reading historical block 11 of 17. 58% done. Addr=24864
06/01/2013 10:11:50   WeatherCat[2020]   Block has invalid winddirection 2520.0
06/01/2013 10:11:50   WeatherCat[2020]    6-1-2013 8:21 OT=8.2C Rain=0.0mm, Baro=1031.20mB IT=18.8C IH=55 OH=93 WSAv=0.0kmh WSG=0.0kmh WDir=180.0
06/01/2013 10:11:50   WeatherCat[2020]   Reading historical block 12 of 17. 64% done. Addr=24848
06/01/2013 10:11:51   WeatherCat[2020]   Block has invalid winddirection 2520.0
06/01/2013 10:11:51   WeatherCat[2020]    6-1-2013 8:11 OT=8.2C Rain=0.0mm, Baro=1031.30mB IT=18.9C IH=55 OH=93 WSAv=0.0kmh WSG=0.0kmh WDir=180.0
06/01/2013 10:11:51   WeatherCat[2020]   Reading historical block 13 of 17. 70% done. Addr=24832
06/01/2013 10:11:51   WeatherCat[2020]   Block has invalid winddirection 2520.0
06/01/2013 10:11:51   WeatherCat[2020]    6-1-2013 8:1 OT=8.2C Rain=0.0mm, Baro=1031.30mB IT=18.9C IH=55 OH=93 WSAv=0.0kmh WSG=0.0kmh WDir=180.0
06/01/2013 10:11:51   WeatherCat[2020]   Reading historical block 14 of 17. 76% done. Addr=24816
06/01/2013 10:11:52   WeatherCat[2020]   Block has invalid winddirection 2520.0
06/01/2013 10:11:52   WeatherCat[2020]    6-1-2013 7:51 OT=8.2C Rain=0.0mm, Baro=1031.30mB IT=18.9C IH=55 OH=93 WSAv=0.0kmh WSG=0.0kmh WDir=180.0
06/01/2013 10:11:52   WeatherCat[2020]   Reading historical block 15 of 17. 82% done. Addr=24800
06/01/2013 10:11:52   WeatherCat[2020]   Block has invalid winddirection 2520.0
06/01/2013 10:11:52   WeatherCat[2020]    6-1-2013 7:41 OT=8.2C Rain=0.0mm, Baro=1031.19mB IT=19.0C IH=54 OH=93 WSAv=0.0kmh WSG=0.0kmh WDir=180.0
06/01/2013 10:11:52   WeatherCat[2020]   Reading historical block 16 of 17. 88% done. Addr=24784
06/01/2013 10:11:53   WeatherCat[2020]   Block has invalid winddirection 2520.0
06/01/2013 10:11:53   WeatherCat[2020]    6-1-2013 7:31 OT=8.2C Rain=0.0mm, Baro=1031.39mB IT=19.0C IH=54 OH=93 WSAv=0.0kmh WSG=0.0kmh WDir=180.0
06/01/2013 10:11:53   WeatherCat[2020]   Reading historical block 17 of 17. 94% done. Addr=24768
06/01/2013 10:11:54   WeatherCat[2020]   Block has invalid winddirection 2520.0
06/01/2013 10:11:54   WeatherCat[2020]    6-1-2013 7:21 OT=8.2C Rain=0.0mm, Baro=1031.29mB IT=19.0C IH=54 OH=93 WSAv=0.0kmh WSG=0.0kmh WDir=180.0
06/01/2013 10:11:54   WeatherCat[2020]   DM 0: Initialising sample cache
06/01/2013 10:11:54   WeatherCat[2020]   DM 0: Sample cache initialised. Took 0.01 seconds
06/01/2013 10:11:54   WeatherCat[2020]   Loading current month...

Think I restarted at this point to see if old data would get reloaded:
06/01/2013 10:13:29   WeatherCat[2020]   Loading current month...
06/01/2013 10:13:44   WeatherCat[4621]   NSPanel does not support NSUnifiedTitleAndToolbarWindowMask in a utility window
06/01/2013 10:13:44   WeatherCat[4621]   Checking System Version is 10.5 or later...
06/01/2013 10:13:44   WeatherCat[4621]   System Version Check OK, running...
06/01/2013 10:13:44   WeatherCat[4621]   Main Controller initialised.
06/01/2013 10:13:44   WeatherCat[4621]   WeatherCat is Running...
06/01/2013 10:13:45   WeatherCat[4621]   DM 0: ***Hello!***
06/01/2013 10:13:45   WeatherCat[4621]   DM 0: Initialising sample cache
06/01/2013 10:13:45   WeatherCat[4621]   DM 0: Sample cache initialised. Took 0.00 seconds
06/01/2013 10:13:45   WeatherCat[4621]   Loading current month...
06/01/2013 10:13:46   WeatherCat[4621]   StatsInit took 0.004046 seconds to process
06/01/2013 10:13:46   WeatherCat[4621]   Stats(0) took 0.013716 seconds to parse
06/01/2013 10:13:47   WeatherCat[4621]   WeatherCatPlugInManager: Examining /Users/neilfraser/Desktop/Weather Station/WeatherCat112/WeatherCat.app/Contents/Resources//IntegratedPlugins/CurrentConditionsCalculator.bundle.
06/01/2013 10:13:47   WeatherCat[4621]   WeatherCatPlugInManager: Loaded Current Conditions Calculator.
06/01/2013 10:13:47   WeatherCat[4621]   WeatherCatPlugInManager: Examining /Users/neilfraser/Desktop/Weather Station/WeatherCat112/WeatherCat.app/Contents/Resources//IntegratedPlugins/WCStatus.bundle.
06/01/2013 10:13:47   WeatherCat[4621]   WeatherCatPlugInManager: Loaded Live Data View.
06/01/2013 10:13:47   WeatherCat[4621]   WeatherCatPlugInManager: Examining /Users/neilfraser/Desktop/Weather Station/WeatherCat112/WeatherCatPlugIns/AppPlugIns/BannerGenerator.bundle.
06/01/2013 10:13:47   WeatherCat[4621]   WeatherCatPlugInManager: Loaded Banner Generator.
06/01/2013 10:13:48   WeatherCat[4621]   Trying to bind to network port
06/01/2013 10:13:48   WeatherCat[4621]   Got network port
06/01/2013 10:13:48   WeatherCat[4621]   getFTPPassword failed with code -25300
06/01/2013 10:13:48   WeatherCat[4621]   CustomWebGetFTPPassword failed with code -25300

It's now started more frequent logging since checking the box e.g.:
06/01/2013 18:20:20   WeatherCat[323]   Fetching data from weather station...
06/01/2013 18:20:21   WeatherCat[323]   Temperature: 10?C  Dewpoint: 8?C  Windchill: 10?C Pressure: 1028 hPa  Av. Windspeed: 0 MPH from North. Current Conditions: Heavy Clouds
06/01/2013 18:22:00   WeatherCat[323]   ***Unregistered Version**** 3 days of evaluation period left.
06/01/2013 18:22:00   WeatherCat[323]   Fetching data from weather station...
06/01/2013 18:22:01   WeatherCat[323]   Temperature: 10?C  Dewpoint: 8?C  Windchill: 10?C Pressure: 1028 hPa  Av. Windspeed: 0 MPH from North. Current Conditions: Heavy Clouds
06/01/2013 18:25:20   WeatherCat[323]   Fetching data from weather station...
06/01/2013 18:25:21   WeatherCat[323]   Temperature: 10?C  Dewpoint: 8?C  Windchill: 10?C Pressure: 1028 hPa  Av. Windspeed: 0 MPH from North. Current Conditions: Heavy Clouds

Any help?

Neil

WCDev

  • WeatherCat Developer
  • Administrator
  • Storm
  • *****
  • Posts: 2987
    • CW9739
    • IIBSTO2
    • Trixology
  • Station Details: Main Station: Vantage Pro-2, 24hr fars, solar, extra temp stations, no U.V. WeatherLinkLive.
Re: Did not collect data overnight
« Reply #5 on: January 06, 2013, 08:08:59 PM »
Yes, thank you. So we can see the USB comms failed - it looks like it's because the computer went to sleep at 00:10:25; at 7:23 comms recovered, but no data to cover the blank period was available (I'm guessing comms failed pretty much immediately again). The second time this happened, it did manage to download the missing data, maybe because the computer was properly awake.

It looks like your Mac went partially to sleep in that it cut-off the USB ports, but kept various processes running. Maybe some peripheral stopping the machine from sleeping properly?

I'd advise turning the sleep on your machine off, just set the display to sleep.

Neil

  • Gentle Breeze
  • **
  • Posts: 12
  • Station Details: Maplin N96GY (Fine Offset) MacBook Pro OS 10.6.8
Re: Did not collect data overnight
« Reply #6 on: January 06, 2013, 08:54:37 PM »
I can do that, but why is it that if I close down WC and unplug the station, WC can then retrieve the data from the station for the period it's been disconnected when it's plugged back in and WC is opened up again but is unable to do so if my Mac sleeps? That reads a bit garbled, but I think you'll get what I mean!

Neil

WCDev

  • WeatherCat Developer
  • Administrator
  • Storm
  • *****
  • Posts: 2987
    • CW9739
    • IIBSTO2
    • Trixology
  • Station Details: Main Station: Vantage Pro-2, 24hr fars, solar, extra temp stations, no U.V. WeatherLinkLive.
Re: Did not collect data overnight
« Reply #7 on: January 06, 2013, 09:19:08 PM »
Hi Neil,
In this particular case because it seems the computer only went partially to sleep; in that it appeared to shutdown the USB ports, told WeatherCat it was going to sleep but then continued to run it. Other cases where sleep might be problematical is when a driver doesn't wake up quickly enough, or is buggy when waking from sleep, which again can cause a comms fail.

Neil

  • Gentle Breeze
  • **
  • Posts: 12
  • Station Details: Maplin N96GY (Fine Offset) MacBook Pro OS 10.6.8
Re: Did not collect data overnight
« Reply #8 on: January 06, 2013, 09:31:59 PM »
Thanks - interesting. I've often had sleep issues with Macs over the years, time to keep it off again.

Steve

  • Global Moderator
  • Storm
  • *****
  • Posts: 1592
    • DW8454
    • KOHAVON11
    • Avon Weather
  • Station Details: Davis Wireless VP2 Plus w/24 hr FARS, 2023 Mac mini M2 Pro, 32GB RAM, Mac OS 15, WeatherCat 3.3
Re: Did not collect data overnight
« Reply #9 on: January 06, 2013, 10:36:30 PM »
Hi Niel,

I run my iMac 24/7, and have it set to never sleep. I do have the screen shut down after an hour, though.

Steve
Steve - Avon, Ohio, USA


CWOP: DW8454 - WU: KOHAVON11 - AWEKAS
PWSweather - WeatherCloud - Facebook