Hi,
I have the problem that in my averages/extremes in some months the last two or three days are missing. (Most of the time it’s 29, 30, 31).
For example in October of 2010. It’s only shown until the 28th.
I took a look at the logfile which is correct. The rest of the month ist not missing.
So I recreated all the logfiles but this didn’t change anything.
It’s the same with 3/2011, 1/2011, 11/2010, 9/2010, 7/2010, 6/2010, 5/2010.
Does anybody know whats wrong?
Thanks!
have you tried converting the log files to data files for those months, then rerunning the reports?
Is there data missing around the daily reset times, i.e. around midnight for most in the U.S. or 9 A.M. for many others?
I like to open the log file in a text editor and see if I can spot any obvious problems like dates missing. The other thing you can check is how many records are in the file. The file is written once per minute, so 60 X 24 = 1440 is the number of lines per day, then multiply by the number of days in the month to get the total. Check one of the files you listed as not complete and let us know what you find.
I’d be interested to hear how get on too, because I’ve had this exact same problem for many months since I started using WD in 2009 - for me it’s usually the last day or the last day’s graph that is missing, even on re-creation. I’ve never been able to find a reason why.
Yes, I have been converting all the logfiles. Nothing changed.
And there is no data missing around se reset times.
So I tried this for October 2010. It had 31 days which makes a total amount of 44640 logs.
In the logfile of 10/2010 I have 48192 logs. So you might be right. This could be a problem. But what to do?
I uploaded the txt. File so that you can check it.
http://uploaded.to/file/l47yf2ld
We will keep you updated;)
@all:
Thanks for your help, really appreciate it!
I noticed a bunch of doubles:
1 10 2010 5 34 09.1 95 08.3 1014.0 1 1 45 0.0 0.2 0.2 665.3 9.1 [b][color=red]1 10 2010 5 35 09.1 95 08.3 1014.0 1 1 45 0.0 0.2 0.2 665.3 9.1 1 10 2010 5 35 09.1 95 08.3 1014.0 1 1 45 0.0 0.2 0.2 665.3 9.1[/color][/b] 1 10 2010 5 36 09.2 95 08.4 1014.0 0 1 45 0.0 0.2 0.2 665.3 9.2 1 10 2010 5 37 09.1 95 08.3 1014.0 1 2 90 0.0 0.2 0.2 665.3 9.1
Seems to happen once or twice an hour (from just glancing at the file). I am going to take a look at my file to see if I have the same problem. Hopefully others will check there log files as well. Need to know if this is happening in the latest builds of WD.
Anyways, you can edit those files manually and remove the extra lines and then try to convert the log file and I suspect it will pick up the end of the month data correctly once you get the file length fixed.
Since April 2011 this problem is gone and didn’t show up in the av/ex.
Editing over 4000 lines is possible, but I think would take several hours. Isn’t there an easier way to get rid of these doubles?
which verson/build of WD?
as I have added a check for duplicate lines in the logfile when converting the logfile to data file
also there is a logfile checker that a member of the forum developed (Murray?)
which you can download
Broadstairs has his online version at WD Log Checker and I ran the previously posted 102010lg.txt file through it. The page spit out a bunch of errors, but it did finally appear to process the file. It showed a bunch of errors in the file, ie.:
Error Description Record Contents Timestamp does not increase (from 01 10 2010 00 03) in record 1 10 2010 0 3 10.0 85 07.6 1016.0 1 0 45 0.0 0.0 0.0 665.1 10.0 Timestamp does not increase (from 01 10 2010 00 05) in record 1 10 2010 0 5 10.0 86 07.8 1016.0 2 0 45 0.0 0.0 0.0 665.1 10.0 Timestamp does not increase (from 01 10 2010 00 11) in record 1 10 2010 0 11 10.0 85 07.6 1016.0 0 0 22 0.0 0.0 0.0 665.1 10.0 Timestamp does not increase (from 01 10 2010 00 21) in record 1 10 2010 0 21 10.0 86 07.8 1016.0 1 1 68 0.0 0.0 0.0 665.1 10.0 Timestamp does not increase (from 01 10 2010 00 26) in record 1 10 2010 0 26 10.0 86 07.8 1016.0 1 0 45 0.0 0.0 0.0 665.1 10.0 Timestamp does not increase (from 01 10 2010 00 35) in record 1 10 2010 0 35 10.0 86 07.8 1016.0 0 0 90 0.0 0.0 0.0 665.1 10.0 Timestamp does not increase (from 01 10 2010 00 44) in record 1 10 2010 0 44 10.0 86 07.8 1016.0 0 0 45 0.0 0.0 0.0 665.1 10.0 Timestamp does not increase (from 01 10 2010 00 55) in record 1 10 2010 0 55 10.0 86 07.8 1016.0 1 3 45 0.0 0.0 0.0 665.1 10.0 Timestamp does not increase (from 01 10 2010 01 04) in record 1 10 2010 1 4 10.0 85 07.6 1016.0 1 0 90 0.0 0.0 0.0 665.1 10.0 Timestamp does not increase (from 01 10 2010 01 14) in record 1 10 2010 1 14 10.0 85 07.6 1016.0 0 2 68 0.0 0.0 0.0 665.1 10.0 Timestamp does not increase (from 01 10 2010 01 17) in record 1 10 2010 1 17 10.0 85 07.6 1016.0 0 0 22 0.0 0.0 0.0 665.1 10.0 Timestamp does not increase (from 01 10 2010 01 23) in record 1 10 2010 1 23 10.0 85 07.6 1016.0 1 0 68 0.0 0.0 0.0 665.1 10.0 Timestamp does not increase (from 01 10 2010 01 35) in record 1 10 2010 1 35 10.0 85 07.6 1016.0 0 0 45 0.0 0.0 0.0 665.1 10.0 Timestamp does not increase (from 01 10 2010 01 52) in record 1 10 2010 1 52 09.9 86 07.7 1016.0 0 2 112 0.0 0.0 0.0 665.1 9.9 Timestamp does not increase (from 01 10 2010 02 01) in record 1 10 2010 2 1 09.8 86 07.6 1016.0 1 0 45 0.0 0.0 0.0 665.1 9.8
I do not know an easy way to edit out the duplicate entries…
Newest Version: 10.37Qb80 (where do I find the check for the duplicated lines?)
I can’t get this other log file checker running:(
Ok, so I’ll try it with the 10/2010 file. If I’m succesfull I’ll let you know!
Edit: It’s just not possible to delete them all manually. Hope there is another solution!
Newest Version: 10.37Qb80 (where do I find the check for the duplicated lines?)it should give info about that under view, WS2010/WS2500 data setup
Edit: It's just not possible to delete them all manually.
it is possible
just will take some time
There is no problem under the WS 2010/WS2500.
I know it’s possible, but it would take several hours for every month. So I think it has to stay like it is, I don’t have the time to do that.
Thank you all!
Been watching this thread with interest but you came to the same conclusion as me. Pity it just can’t work out of the box.
(Will await the “It works for others so it should work for you” replies :roll:)
Regards,
Simon
Here’s something that might work…I ran your 102010lg.txt file through Websters DOS based checker and it creates an text file of the errors (see attached). Perhaps someone could write some code to use this file to make corrections to the file. It’s based on line numbers in the file, just read into an array all the line numbers, then delete those line numbers from the logfile.
If you don’t have the log checker you can download it at: http://wdworldmap.com/public/WD-LogfileUtility.zip
LG102010.ERR.zip (41.6 KB)
I can’t get this programm running on my computer. Think it’s not working with Windows 7 64Bit.
Very difficult :oops:
If you can put the log files on your server and send me the links to the files I can run them thru the checker and email you the results file. Do you have some code that read the line numbers from the error file and delete those lines from the log file?
I even can’t open the Error file. Maybe because I can’t run the programm.
And I’m sorry, I don’t have a code to delete the lines. But maybe some other user does?!
So I think I have to live with this problem;)
Thank you all for your help,
Stefan