Upload broken with small files

[KalleB]

No change here with #128, sorry

I think what we need is a totally different approach to this problem. Could you make a separate beta version of HFS with the uploading part totally rewritten and using totally different "methods" for delivering the data? Don't mind if it would break everything else in HFS... We need something radical to beat this irritating little bug.

[TSG]

Tested again, it appears fixed to me...

[maverick]

Strange, but I never had that problem with any build.  Everything is working just fine.

[Giant Eagle]

Yes, it seems to be fixed on my end aswell, however, i have noticed something weird.

When uploading a small .gif file of around ~300 bytes. The status on HFS displays that the file has been received for 99%, the byte counter displays: 450/450 and it just hangs there for a minute. After that, the file has been fully uploaded.

In that minute when HFS 'hangs', you can already access the uploaded file with no problems. But if you do, hfs creates a second file image(1).gif when the minute is over.

very strange

[maverick]

Yes, it seems to be fixed on my end aswell, however, i have noticed something weird.

When uploading a small .gif file of around ~300 bytes. The status on HFS displays that the file has been received for 99%, the byte counter displays: 450/450 and it just hangs there for a minute. After that, the file has been fully uploaded.

In that minute when HFS 'hangs', you can already access the uploaded file with no problems. But if you do, hfs creates a second file image(1).gif when the minute is over.

Tested here again, this time with small thumbs (gif) 10-12 kb in size.  No problem.  All uploaded successfully.

I didn't see anything in HFS status saying 99% received or HFS hanging for a minute.  Nothing like that at all.  As the files I uploaded were small, the uploads happened very quickly and the log shows 'Fully Uploaded' with the correct filesize for all of files.

What I find strange is that some people report problems uploading small files and others like myself have never seen this problem.  To me, it seems system specific for some reason.  As everyone is running the same HFS engine, it might have something to do with the o/s, browser, or maybe even the template used.

Edit:
I don't think this was mentioned in this thread or not, but for the ones who noticed problems did they appear when testing locally, remotely, or both?

[Giant Eagle]

Try 1kb at most when testing images, cause everything above 1kb seems to upload fine (or a very low chance to get an error)

I tested it under the following circumstances:

both locally and remotely on 4 different pc's.
windows 2k pro sp4 - windows xp pro sp2 - windows server 2k3 enterprise
default template - terayon - tog

speed of the pc's varies from 500mhz to dual core 2.4ghz
memory from 384 to 2048mb

browser: IE6 and FireFox 2.0

Seems like it has nothing to do with the system..

[Foggy]

When uploading a small .gif file of around ~300 bytes. The status on HFS displays that the file has been received for 99%, the byte counter displays: 450/450 and it just hangs there for a minute. After that, the file has been fully uploaded.

I got the same but not too sure about the last part about accessing it and a image(1) being created because I've been uploading the same 800byte gif.

I also got a screen shot of my hfs while it is stuck on 99%

also some of my tests have been timing out without hfs receiving any data and some are succesful

[maverick]

Just tested with smaller files.  Uploaded successfully.  No errors.  HFS not stuck at 99%.  No second file created with (1) added to filename.

Don't know why some of you are having problems.  I can't think of anything else to suggest.

[KalleB]

Tested locally with three small files using build #128. Here's the log w/ comments:

20:53:07 127.0.0.1:3180 Requested GET /upload folder/~upload
20:53:07 127.0.0.1:3180 Served 1,30 KB
20:53:07 127.0.0.1:3180 Got 601 bytes
20:53:16 127.0.0.1:3181 Disconnected - 92642 bytes sent
20:53:16 127.0.0.1:3186 Got 712 bytes
20:53:16 127.0.0.1:3186 Uploading 9B_test_file.txt
 ### only 9B_test_file.txt visible in the upload folder
 ### 76B_test_file.txt stuck at 99% in the connections table
20:54:08 127.0.0.1:3180 Disconnected by server: inactivity - 46061 bytes sent
20:54:17 127.0.0.1:3186 Disconnected by server: inactivity
 ### Browser returns "page not found"
 ### 9B_test_file.txt disappears from the upload folder, folder empty

So not much change from my previous logs reports.

Second test:

21:00:19 127.0.0.1:3207 Got 580 bytes
21:00:19 127.0.0.1:3207 Requested GET /upload folder/
21:00:19 127.0.0.1:3207 Served 1,02 KB
21:00:19 127.0.0.1:3208 Got 594 bytes
21:00:19 127.0.0.1:3209 Got 594 bytes
21:00:19 127.0.0.1:3210 Got 594 bytes
21:00:27 127.0.0.1:3207 Disconnected - 2668 bytes sent
21:00:27 127.0.0.1:3211 Got 712 bytes
21:00:27 127.0.0.1:3211 Uploading 9B_test_file.txt
21:00:27 127.0.0.1:3211 Fully uploaded -  9 B @ 0 KB/s
21:00:27 127.0.0.1:3211 Uploading 76B_test_file.txt
 ### 9B_test_file.txt & 76B_test_file.txt visible in the upload folder
 ### The last file, 261B_test_file.txt, stuck at 99%
21:01:20 127.0.0.1:3208 Disconnected by server: inactivity - 583 bytes sent
21:01:20 127.0.0.1:3209 Disconnected by server: inactivity - 118 bytes sent
21:01:20 127.0.0.1:3210 Disconnected by server: inactivity - 578 bytes sent
21:01:28 127.0.0.1:3211 Disconnected by server: inactivity
 ### Browser returns "page not found"
 ### 76B_test_file.txt disappears from the upload folder, only 9B_test_file.txt left there

Third test same as the second.

Fourth one:

21:04:32 127.0.0.1:3215 Got 555 bytes
21:04:32 127.0.0.1:3215 Requested GET /upload folder/
21:04:32 127.0.0.1:3215 Served 1,02 KB
21:04:39 127.0.0.1:3215 Disconnected - 1046 bytes sent
21:04:39 127.0.0.1:3216 Got 712 bytes
21:04:39 127.0.0.1:3216 Uploading 9B_test_file.txt
21:04:39 127.0.0.1:3216 Fully uploaded -  9 B @ 0 KB/s
21:04:39 127.0.0.1:3216 Uploading 76B_test_file.txt
21:04:39 127.0.0.1:3216 Fully uploaded -  76 B @ 5 KB/s
21:04:39 127.0.0.1:3216 Uploading 261B_test_file.txt
 ### All three files visible in the upload folder
 ### 261B_test_file.txt stuck "receiving" (no %-bar visible)
21:05:39 127.0.0.1:3216 Disconnected by server: inactivity
 ### Browser returns "page not found"
 ### 261B_test_file.txt disappears from the upload folder, 9B_test_file.txt and 76B_test_file.txt succesfully uploaded

Fifth test same as the first one.

Sixth test same as the second one.

Seventh & eighth test same as the first one... so it's totally random.

...exactly the same results as before.

[Guest]

Small file bug
All small files do upload suscessfully for me, but
I notice that anything 200 bytes or below doesn't give upload
sucess page, nor are they added to upload total. 204 bytes does.
Note that when no upload sucess page comes up I must after
a few seconds use cancel upload to return to the folder uploaded to.
 I also notice that the file size will not show in the windows
folder window status bar for any 200 bytes or smaller, yet
when I copy and paste a 195 byte file it does show. This
might be because of the cancel?
This is build 128 on Win 98se uploaded on local address (lan),
not across internet. Using mod template, but with default template
upload page. I noticed some time ago, when I used a mod (js) upload
page, I had the files being combined problem, so I went back to default.
For me this goes back a long time. I always thought the transaction
just occured to fast to be recorded when local, and never considered
it a real problem, as very small files are rarely sent to me.
If I get time I'll try the same on Vista.
Best test would be between one with the problem and one
without across open internet, though?
Hope this info is of some meaning to someone.

[maverick]

All small files do upload suscessfully for me, but
I notice that anything 200 bytes or below doesn't give upload
sucess page

I get the upload success page.  Here is a screenshot of my upload success page for a 45 byte file.

Maybe the other problems you mention have something to do with Win98.

[rejetto]

the bugs i already fixed depend on how the stream data is splitted in chunks while transfered.
this depends both on the underlying network and the client application.
i will try to make a test application that sends the data byte by byte... it may help discovering more bugs.

[rejetto]

i made the test, and it was very useful because i found some bugs, all possibly affecting the upload procedure.
i fixed them, so let me know if the problem is fixed for those of you still experiencing the problem.
www.rejetto.com/forum/?topic=4890

[Foggy]

I just tried uploading some files one 800byte file and some around 40-100kb and all worked 100% of the time.

[KalleB]

No change here with #129, randomly stuck 99% or "receiving" on some file. On first test I got the List index out of bounds (1) when HFS was disconnecting a timed out upload ...but not after that anymore.

Here's the log of the third test:

17:28:56 127.0.0.1:1280 Got 555 bytes
17:28:56 127.0.0.1:1280 Requested GET /upload folder/
17:28:56 127.0.0.1:1280 Served 1,02 KB
17:29:03 127.0.0.1:1280 Disconnected - 1047 bytes sent
17:29:03 127.0.0.1:1281 Got 712 bytes
17:29:03 127.0.0.1:1281 Uploading 9B_test_file.txt
17:29:03 127.0.0.1:1281 Fully uploaded -  9 B @ 0 KB/s
17:29:03 127.0.0.1:1281 Uploading 76B_test_file.txt
17:29:04 127.0.0.1:1281 Fully uploaded -  76 B @ 4 KB/s
17:29:04 127.0.0.1:1281 Uploading 261B_test_file.txt
 ## All three files visible in the upload folder
 ## 261B_test_file.txt stuck "receiving"
*** I think here should be "Disconnected by server: inactivity" but it gave it only in the first test (along with List index out of bounds (1)).
 ## Browser returns "page not found"
 ## 127.0.0.1 displaying "disconnected" in connections dialog, cannot be kicked!
 ## Unable to delete 261B_test_file.txt from the upload folder, other two delete OK

..had to restart HFS to be able to delete the file and get 127.0.0.1 away from the connections dialog.