Clientraw upload failing

Ask a Question
, , , , , ,
1

After upgrading to the latest Mac version of WD, I noticed my clientraw updates / uploads are failing after about one hour. Quitting WD and restarting gets the updates / uploads working again.

When the client upoads are starting to fail the ftp logs show:

FTP real vers 1.4 15:25:23
logging on to 72.167.232.152
login OK to 72.167.232.152
Change directory Ok to /wx
Result 250 OK. Current directory is /wx
uploaded /Library/Application Support/wdisplay/webfilesclientraw.txt OK
uploaded /Library/Application Support/wdisplay/webfilesclientrawhour.txt failed
uploaded /Library/Application Support/wdisplay/webfilesclientrawextra.txt OK
uploaded /Library/Application Support/wdisplay/webfilesclientrawdaily.txt failed
Logging off

Any ideas what would cause the clientraw files to update / upload normally and then fail after a short period of time. It can’t be a permissions or password
problem or the update /uploads would always fail.

When the updates and uploads of the clientraw files are working normally, the ftp logs shows:

Client raw FTP Upload 15:50:45 15-5-09
Port to use 21
Passive mode on
FTP real vers 1.4 15:50:45
logging on to 72.167.232.152
login OK to 72.167.232.152
Change directory Ok to /wx
Result 250 OK. Current directory is /wx
uploaded /Library/Application Support/wdisplay/webfilesclientraw.txt OK
uploaded /Library/Application Support/wdisplay/webfilesclientrawhour.txt OK
uploaded /Library/Application Support/wdisplay/webfilesclientrawextra.txt OK
uploaded /Library/Application Support/wdisplay/webfilesclientrawdaily.txt OK
Logging off

2

you will find that it should come correct again, no need to restart
but try reducing the frequency of uploads

3

It’s sending the clientraw files about once every 30 seconds or so. Where do I adjust the frequency? Once every 5 minutes would be fine.

4

Hi Les, I think you do this in Control Panel>Web Files/Web Page>Real Time FTP and check the Upload extra file every 5 minutes, and Upload clientrawhour every 5 minutes.

Or uncheck them and they will be sent on the hour. Also I note it took me a reboot of WD MAc to se it happening, although it probably would have if I had left it alone lol.

Hope this helps,
Jim

5

I checked them both, but still had the same problem. I think I’ll do a clean install and slowly turn thing on one at a time and see if that fixes things.
[color=red]
Even after a clean install and not using any previous WD settings, I still have the same problem.

Everything works fine for about 30 minutes or so, the ftplogfull file shows:

Client raw FTP Upload 17:04:04 16-5-09
Port to use 21
Passive mode on
FTP real vers 1.4 17:04:04
logging on to 72.167.232.152
login OK to 72.167.232.152
Change directory Ok to /wx
Result 250 OK. Current directory is /wx
uploaded /Library/Application Support/wdisplayclientraw.txt OK
uploaded /Library/Application Support/wdisplayclientrawhour.txt OK
uploaded /Library/Application Support/wdisplayclientrawextra.txt OK
uploaded /Library/Application Support/wdisplayclientrawdaily.txt OK
Logging off

Then after about 30 minutes or so, the ftplogfull shows:

FTP real vers 1.4 17:28:56
logging on to 72.167.232.152
login OK to 72.167.232.152
Change directory Ok to /wx
Result 250 OK. Current directory is /wx
uploaded /Library/Application Support/wdisplayclientraw.txt failed
Result 250 OK. Current directory is /wx
Logging off

There is nothing showing the other clientraw files are being uploaded and according to the main webpage they are not being uploaded.

For some reason the clientraw files are all called wdisplayclientraw instead of just clientraw

They are also going into the /Library/Application\ Support directory and not into /Library/Application\ Support/wdisplay/ per the settings in WD

When the clientraw files are being uploaded properly, they get uploaded with these intervals:

Client raw FTP Upload 17:00:48 16-5-09
Client raw FTP Upload 17:02:02 16-5-09
Client raw FTP Upload 17:03:03 16-5-09

When the clientraw files are failing to be uploaded, the uploads are attempted with these intervals:

Client raw FTP Upload 17:06:06 16-5-09
Client raw FTP Upload 17:07:07 16-5-09
Client raw FTP Upload 17:08:08 16-5-09

I have the clientraw uplads set to every 10 minutes in the WD settings, but the clinetraw uploads are not following the settings for some reason.[/color]

6

C[s]heck Control Panel> Web files> Setup #1 and set your webfiles locarion and clientraw files location to the proper directories (inside Application Support/wdisplay/webfiles directory

Restart WD Mac

After you get that reset, you need to go into the Application Support and delete those files, that is not a good thing
[/s]
Did you run the WD Set Owners permissions app inside your wdisplay folder in Applications? Do it with the program off.

Also, what version WD are you on Les?

EDIT: Last question - did you bring over the wdisplayftp.ini file from Windows to add to the Mac version if you recently switched? Don’t know if you’re newly returning to the MAc or have been here for a while) That file can give issues.

7

Hold up!

I got it too,

Windy, I went in and duplicated Les’ problem by reselecting my clientraw and webfiles location in the Setup#1 screen,

In build 08 it drops the last slash in the file path, and now my site is stuck also with no files.

I will also PM Windy.

In the meantime, in build 8 do not reselect the clientraw or webfiles locations in Setup #1

8

restarting will fix that missing / on the end

but I will fix that problem

9

I think it actually started in the previous build, I was not sure if it’s actually dropping the slashes or having problems with the directory path where the direcotry name has a space it it.

If you try to run the following command

/Library/Application Support/wdisplay/webfilesclientraw*

It will fail, if you change the command to

/Library/Application\ Support/wdisplay/webfilesclientraw*

It will work fine. Notice the "" right after Application

You need to trap the space character using the \ character to get OS X to be able to follow the path correctly.

I don’t know if that’s part of the problem or not.

It doesn’t matter where I try to put the clientraw files, the uploads fail repeatedly. I even try putting them into the / directory but they still had the wdisplay
added to the front of their names.

10

Restarting didn’t do it for me Windy. I had to manually edit the files to add the slash

/Library/Application Support/wdisplay/wdisplayftp.ini and manually
edited the first item
client raw location=/Library/Application Support/wdisplay/webfiles/

same in the WDISPLAY.ini file for the webfiles location
[New webfiles location]
client raw location=/Library/Application Support/wdisplay/webfiles/

Then it all came back :slight_smile:

EDIT - that "" character is used in terminal only, for spaces in file names, but don’t use it in the ini files or in WD.

11

yes, editing the ini file is the fix

note that my WDL is still updating after 24 hours of running non stop wd mac
(there might be times when the upload fails, but it does recover again)

12

YES!

All better now.

How about you dafuser? is this resolved for you?

13

It appears it’s fixed after the edit of the ini files. If it continues running for more then 45 minutes or so I’ll know for sure :smiley:

[color=red]The path problem appears to be fixed, but the failure of the clientraw files to be uploaded is still a problem. From a WD restart at 21:07 to the failure at

Client raw FTP Upload 21:36:08 16-5-09
Port to use 21
Passive mode on
FTP real vers 1.4 21:36:08
logging on to 72.167.232.152
login OK to 72.167.232.152
Change directory Ok to /wx
Result 250 OK. Current directory is /wx
uploaded /Library/Application Support/wdisplay/webfiles/clientraw.txt failed

It’s now 22:26 and the last clientraw upload in the ftplogfull file was at

Client raw FTP Upload 21:59:59 16-5-09
Port to use 21
Passive mode on
FTP real vers 1.4 21:59:59
logging on to 72.167.232.152
login OK to 72.167.232.152
Change directory Ok to /wx
Result 250 OK. Current directory is /wx
uploaded /Library/Application Support/wdisplay/webfiles/clientraw.txt failed
Result 250 OK. Current directory is /wx
Logging off

The file times for the clientraw files are:

-rw-r–r-- 1 diefelr admin 737 May 16 22:00 clientraw.txt
-rw-r–r-- 1 diefelr admin 2745 May 16 21:04 clientrawdaily.txt
-rw-r–r-- 1 diefelr admin 2933 May 16 21:35 clientrawextra.txt
-rw-r–r-- 1 diefelr admin 2323 May 16 21:59 clientrawhour.txt

[/color]

14

what real time ftp upload frequency do you have?

one thing I want to change is to have the cronftpreal log to a different file other than ftplogfull.txt (i.e ftplogfullreal.txt)
I will do that for the next release

15

In the Real Time FTP screen I have a 60 second delay between uploading data. It was originally 25 seconds but I changed it to 60 to try and slow down
all the uploads.

I’m using Restart instead of re-login with every five minutes checked. In the Internet File Creation & Upload screens, all the uploads are scheduled for 10 intervals or longer.

[color=red]I pulled the datafiles, logfiles, and webfiles from the PC version. Also pulled the wdisplay.ini from the PC, renamed it WDISPLAY.INI and fired up WD on the Mac.
It ran for about the same length of time around 40 minutes or so, then the clientraw files began to fail to be uploaded again.

slash:wdisplay diefelr$ tail -f ftplogfull.txt
Port to use 21
Passive mode on
FTP real vers 1.4 09:29:44
logging on to 72.167.232.152
login OK to 72.167.232.152
Change directory Ok to /wx
Result 250 OK. Current directory is /wx
uploaded /Library/Application Support/wdisplay/webfiles/clientraw.txt failed
Result 250 OK. Current directory is /wx
Logging off

I thought it was something I had set wrong on the Mac version of WD. But it appears to be something else.

Pulling the settings from the PC version by using wdisplay.ini from the PC should of made the settings the same. Unless it’s something in the

I have left WD running for several hours and after the clientraw files start failing to upload, my webpage will continue to show the time since he last clientraw update and I have seen it showing more then two hours since the last successful clientraw update.
[/color]

16

The clientraw upload just failed while I was looking at the Activity monitor. There is no cronftpreal or cronftp process running at all, even when the tail on the ftplogfull.txtx file shows:

Client raw FTP Upload 13:59:21 17-5-09
Port to use 21
Passive mode on
FTP real vers 1.4 13:59:21
logging on to 72.167.232.152
login OK to 72.167.232.152
Change directory Ok to /wx
Result 250 OK. Current directory is /wx
uploaded /Library/Application Support/wdisplay/webfiles/clientraw.txt failed
Result 250 OK. Current directory is /wx
Logging off

I can see no cronftpreal or cronftp process in the activity monitor. Once I restart WD, I see the cronftpreal / cronftp process start again and the files being to upload normally.
It looks like cronftpreal only runs when WD transfers the clientraw files. The cronftp only runs when WD is transferring other files.

17
It looks like cronftpreal only runs when WD transfers the clientraw files. The cronftp only runs when WD is transferring other files.
correct from the linux section, it seems that if I get the program to change to the directory where the files are first then that might help with the upload failing I will try that
18

Maybe that’s the fix, that would be great. The ftplogfull.txtx will continue to show the one clientrawhourly file as the only failed upload, but really nothing is being transferred because the cronftpreal does not run when it’s in that particular failure mode.

19

seems to have helped here
new update:
http://www.weather-display.com/downloadfiles/cronftpreal.dat
(remove the .dat after downloading to /Applications/wdisplay/
)
(now logs to Ftplogfullreal.txt)

20

Just installed the new cronftpreal and restarted WD. I should know something in around 40 minutes or so if the problem is still there.
I see it’s logging to the new log file called ftplogfullreal.txt

Client raw FTP Upload 21:18:59 17-5-09
FTP real vers 1.5 21:18:59
Port to use 21
Passive mode on
logging on to 72.167.232.152
login OK to 72.167.232.152
Change directory Ok to /wx
Result 250 OK. Current directory is /wx
uploaded /Library/Application Support/wdisplay/webfiles/clientraw.txt OK
uploaded /Library/Application Support/wdisplay/webfiles/clientrawhour.txt OK
uploaded /Library/Application Support/wdisplay/webfiles/clientrawextra.txt OK
uploaded /Library/Application Support/wdisplay/webfiles/clientrawdaily.txt OK
Logging off

Thanks for the quick work on a fix.