2016 Beta versions ready to test!

First, thanks to everybody for the continued feedback! I think we’re getting much closer to having things resolved.

OK, to Christian and Henrik:

First, I’d like to see the file (probably a .wxf file) from where autolearn crashed in January. I think wret may identify it in the error message. If not, please try to figure it out from looking at details.txt to see where it stopped. I’d like to try to run that file myself to see what’s wrong with it. Another customer recently sent me such a .wxf file and it had a really hard to explain error where a line essentially got written twice!

Regarding the old data message … can you send a screen shot of that? I have seen several cases, sent by customers, of the fdata.txt file being basically four days old. In those cases, somehow wxsimlite has run a forecast based on the last day of the analysis run, instead of on just-downloaded data. This might happen if a user manually clicked the forecast button without downloading, but more likely somehow the download failed (“bad data” could do it, combined with no other good downloads recently). On the other hand, if the WXSIM message is about old READY or GFS data, it could be a problem getting fresh data into wdata.txt, via WXSIMATE.

Please send or post any screen shots or information you may have.

Tom

Tom

Everything ran perfectly overnight and this morning with “Include last year” checked in “Lite” and “Include data from same season” checked in Autolearn - SUCCESS!

Thanks for all your efforts and Great support.

Now hopefully you can have a relaxing weekend.

Cheers

:smiley:

MikeyM

Great job Tom !!! :D/ . I was very busy with some other issues and couldn’t take part with all of the beta testing. All the other
users and you did the heavy lifting. It’s (beta4) working really smooth for me.

One question. What should be the date range in the file "cortest.txt?

Great update … =D>

Jeff

Beta4 works just as fine as Beta3 for me.

Thank you, Tom! :slight_smile:

I’ve used Beta4 with 4 runs this morning and all is working well.

Steve

Thanks for the good news - so far, at least! :slight_smile:

To answer Breezy’s question, cortest.txt should be showing data from about the first of April through June of both 2014 and 2015, at least if you’ve been using autolearn that long. Realize that it’s using 90 day chunks, whose analysis runs up until a forecast 4 days before the indicated date. Suppose you were using something like 90 days in autolearn, with recent weighted more, or maybe 60 days with equally weighted data, a year or two ago. Then the effective midpoint of that data would represent about 30-40 days earlier than the midpoint of that period (mid-May). So, you would have early April represented by the 1-2 year old. That sounds “late”, but realize that just-run data from wret.exe is centered about 30-40 days before now. Averaged together, the represented season is centered almost exactly NOW, whichj is what we want, and which is better than the perpetual lag we’ve always had before.

I think this will be a real help during seasonal transitions. One thing autolearn had trouble with in the apst, for instance, was the first cool spell in the fall. It had been learning from the monotonous weather over the summer (and doing well with that) and then the first cool snap in September or October would “fool” it, and the forecast would timidly remain too warm. Now, it’s “looking ahead” just the right amount and should handle the seasonal transitions much better.

I probably need to be careful with the early optimism, but I am excited by what I see so far in my forecasts here. They’ve been quite accurate the last few days and I’m seeing more of a steady change across the “spectrum” of WXSIM-Lite weightings (0, 40, 60, 80, and 100%) I’m using. One thing that alerted me to problems a couple months ago was that I had cases where the 0 and 100% weightings would essentially agree, but the others would all be warmer (and sometimes worse instead of better). This was the result of a pretty complex, interconnected set of effects on the correction factors that could sort of “boot-strap” and get unrealistic. In the process, I also discovered a small (but occasionally significant) glitch in how WXSIM was handling max and min temperature data coming in from WXSIM-Lite. I think I’ve fixed all of this, AND the new version is smart enough to understand the likely problems from earlier and compensate for them, so we don’t have to wait a long time for things to “settle down”; the improvements should be almost instantaneous.

A good sign that things are better in my case is that the correction factors from autolearn/wret are now much more consistent across my range from 0 to 100% usage of WXSIM-Lite. Also, the range correction and the slope figure are both closer to 1 now, which should be the case for me since I have pretty much the “original” customization here!

I’ll watch this a few more days, and if all is well, I’ll prepare for an official release of Version 2016! Hopefully, autolearn/wret and WXSIM-Lite are now “good students” who will learn well on their own and then collaborate successfully! :slight_smile:

Tom

Hi Tom

I upgraded to beta4 yesterday - and I have seen no errors so far. Been running almost 24 hours with forecasts every hour. Autolearn and WXSIMLITE has been running fine too (Silkeborg).

At Christian (Langesoe) there has been no errors too - and details.txt was created as scheduled. One thing I not about Christians details.txt (see attached) is that he has many forecasts that were skipped - compared to my details.txt.

Should we change something at Christian?

Bottom summary at details.txt:

Silkeborg:
Note: Values below are weighted towards more recent forecasts, unless otherwise indicated.
Forecasts for Silkeborg. Using Celsius.
Time to complete run = 71 min, 59 sec
Number of forecasts used = 1786 (99,9% of total checked)
Number of forecasts rejected (I) due to incomplete verification data = 2 (0,1% of remaining candidates)

Langesoe:
Note: All forecasts are weighted equally.
Forecasts for Langesoe. Using Celsius.
Time to complete run = 59 min, 17 sec
Number of forecasts used = 1301 (73,3% of total checked)
Number of forecasts rejected (>) due to temperature error more than 10 deg = 20 (1,1% of remaining candidates)
Number of forecasts rejected (C) due to bad bias correction factors = 454 (25,9% of remaining candidates)

As you can see, the two text sections from details.txt are very different. As far as I can see we have the excact same setup in WXSIM, WXSIMATE, WXSIMlite, AutoLearn and Wret.

Thanks for your great support and improvements.

Best regards,
Christian and Henrik


SILKEBORG - details.txt (210 KB)

LANGESOE - details.txt (209 KB)

After 24 Hour all working well =D>

Hi Tom,

Thanks again for a brilliant upgrade, all working fine here.
Also updated my wxsim-lite DST Day/Month figures for 2016.

Thanks for update Tom
Here is my details.txt:

Note: Values below are weighted towards more recent forecasts, unless otherwise indicated.
Forecasts for Carmignano. Using Celsius.
Time to complete run = 6 min, 18 sec
Number of forecasts used = 161 (100% of total checked)

Regards,

Alessandro

I’m late on parade as usual :oops: and have only upgraded today but everything here is working normally with beta4. Thanks Tom!

Hi Tom,

As per earlier post all was running fine until overnight last night.

Background: installed 2016beat4 prior to my 2016022706z run, that ran without error.
Overnight that night wxsimlite did analysis at 01:20 (no error) Autolearn ran at 02:40 (no error) all following forecasts (wxsim/wxsimate/wxsim-lite) all ran without error (2016022712z/18z/2016022800z/06z)

Then last night wxsim-lite failed while doing the overnight analysis at 01:20 this morning (with attached error): Though seems as though Autolearn ran at 02:40 this morning without error ?
This morning wxsim wxsim-lite auto forecast 2016022812z failed due to above and gfs data 2016022812z had not downloaded prior to 12z wxsim forecast as wxsin-lite was still in error during that time (prior to me waking up).

Though the wxsim forecast did look ok at 2016022812z (which ran at 05:00 while wxsim-lite was still in error) ?

just an observation or rather question, in my earlier post I mentioned as per documentation wxsim-lite states that DST(Start/End)(Day/Month) entries to be adjusted yearly (so I did that the other day. Just curious how wxsim-lite handles the previous years DST situation ? In my case this year both start and end days changed by 2 days versus 2015.


cortest.txt (13.8 KB)

correc.txt (131 KB)

I had an Error 62 at my 2200 auto run in WXSIM-Lite - no idea why as all data looks good. :-k I then scheduled an auto run at 2300 and everything was fine.

Thanks for all this (mostly!) good news!

To answer some specific questions:

Christian and Henrik: That Langesoe data suggests there was a max temperature of 44.2 C one day!!! It appears this was on February 1. Of course, that’s not real, but wret.exe did read it out of the log file, so you might want to go back and look. It might be a single “typo” that you could manually fix, and then wret could learn from that data after all. To change to weighting recent data more, check the box in wret.exe about that.

Tony, it looks like there was a crash on some old data, from April, 2015. Maybe it’s a bad GFS file (???). You could remove it. One change I may need to make is that it really shouldn’t have made a fdata.txt file from that. I’ll look into that.

Thanks again! :slight_smile:

Tom

Just a follow-up: I’ve confirmed that WXSIM-Lite is making and exporting fdata.txt files all during its analysis run. That’s not a problem, until it either gets hung up on bad old data or the current forecast fails to run. I can change that pretty easily (haven’t yet - want to be careful!). I think that will pretty much cure the “old” fdata problem. The only drawback is that it could mask symptoms when there are problems like bad downloads. Almost all those are brief, though, and fresh forecasts would be restored well within the 24 hour window. I do think I will make the change and post a new version in the next couple of days. However, if you are seeing this message (about old fdata.txt) I would be interested in posted screen shots. I think most of them are 4-day old data, from some failure to run a fresh forecast after the analysis (could be from bad scheduling or an unexpectedly long analysis run). If it’s a lot older than 4 days, it’s probably old bad GFS data, which could happen now that it can look back a year. There could be old bad GFS files which haven’t been analyzed in many months and which could now show up like that. That also means they can be weeded out.

Thanks for all your patience and help with this. I think we are on the verge of a real improvement across the board! :slight_smile:

Tom

Tom, thanks for the explanation concerning the data included in “cortest.txt”. I must have started autolearn later or deleted 2014 autolearn data as I only have 2015 history #-o. It will catch up in 2017. I have another question. Looking at the very bottom of my “cortest.txt” file I see these statements.

Current date and midpoint, and average values to be sent to wret.exe for inclusion
2/27/2016 5861 -0.01679 0.9627 0.0028 0.02429 67.22088 n = 91

Average corrected values for analyses done with WXSIM-Lite before February 20, 2016
-0.01679 0.9627 0.0028 0.02429 67.22088 n = 91

The data is the same. Is this correct? :?

Cheers,

Jeff

Hi Tom,

I looked at all the gfs files around that time 22/04/2015 and all seem perfect, not only that but wxsim all previous forecasts had been error free.

When I look at the detail of that message I just thought it must have been due to the changes I made to the DST Days/Month for 2016 as it’s saying (rounding up hour) = 2016-02-28-19z (so the 19z throws me) as there would only be 00/06/12/18z files (the 19z I thought was being derived from my local time of forecast being 2016-02-29-05:00 back the current +11hrs for DST would be 2016-02-28-18z (which would be correct if that’s what it was doing) though 2016-02-28-19z if we had been in ST being +10hrs. Don’t mind me just a play on numbers I suppose. I did check the fdata.file after wxsim had run the forecast with wxsim-lite and wxsim error messages still up and all it contained was 0

Once I accepted both error dialogs wxsim-lite automatically went into a complete analysis run and completed successfully. Then I checked fdata again and it was as normal full of what seemed correct data.

No no change to GFS Files (ie. I have deleted none since your suggestion).

On 2016-03-02 04:00 (AEDT) I awoke before the wxsim forecast (for at 2016-02-29-12z) and found that Autolearn had run without error, wxsim-lite had run an analysis without error but when I checked fdata.txt it just had:
0
0
in it. so I just let wxsimate and the forecast run and it all went without error.

Same again this morning 2016-03-02 04:00 (AEDT) Autolearn had complated no errors, but wxsim-lite had been in error as it run prior to Autolearn.
wxsim-lite had error52 (sorry did not have time to screen dump it), accepted that error and lite continued with it’s analysis, then had 2 more error52’s, then once it was completed, checked fdata.txt and it contained only:
0
0
again, did a Run Immediately on wxsim-lite (Analysis) this time it ran start to finish no errors, once complete I checked and found fdata.txt still only contained:
0
0
again, did a Run Immediately on wxsim-lite (forecast) which downloaded the latest gfs data and completed correctly, then checked fdata.txt and found it contained the correct data.

Subsequent wxsim forecast ran in auto an hour later without error.

Tony


Hi Tom,
this night Wxsimlite had run with fdata error:

…with GFS old data window:

Regards,

Alessandro

Hi Tom

At Christian from Langesoe beta4 is now running without any errors…BUT…in his detailes there are 490 forecasts (yesterday it was 1301 and after that we corrected a bad logfiles from WD) that were skipped due to bad correction factors - can we in any way correct that so his forecast can be used?

Note: Values below are weighted towards more recent forecasts, unless otherwise indicated.
Forecasts for Langesoe. Using Celsius.
Time to complete run = 59 min, 2 sec
Number of forecasts used = 1285 (72,4% of total checked)
Number of forecasts rejected (C) due to bad bias correction factors = 490 (27,6% of remaining candidates)

See attached details.txt

Best regards,

Christian and Henrik


details.txt (209 KB)

Tom - had the attached message this morning. The 0700 forecast completed okay and I can’t find anything wrong. The gfsdat0dt=2016-03-01-00 downloaded fine with no errors so I don’t know what the error message refers to…

Edit - same thing happened at the 1200 forecast but it completed okay.

Edit…and again at the 1800 and 2300 forecasts…


wxsim13.JPG