rejetto forum

Software => HFS ~ HTTP File Server => Topic started by: rejetto on February 16, 2009, 10:01:15 AM

Title: speed test
Post by: rejetto on February 16, 2009, 10:01:15 AM
hello, i'm trying to improve transfer speed of HFS 2.2
is anyone willing to help me test it?
you need to have an high upload speed on the internet, like 5 megabps or more. (please, don't confuse with your download speed. it's different)
contact me at support@rejetto.com


[please refer to this post below (http://www.rejetto.com/forum/index.php?topic=6662.msg1042023#msg1042023)]
Title: Re: speed test
Post by: luca69 on February 16, 2009, 12:44:48 PM
I can test it in the intranet, where we use a 100MB lan.
The actual download rate reported by DownThemAll is between 12 and 50 MB/s  ;D

But I don't see any speed issue with HFS  ;)
Title: Re: speed test
Post by: rejetto on February 16, 2009, 03:07:48 PM
sorry, forgot to specify "internet" :)
Title: Re: speed test
Post by: floppes on March 09, 2009, 07:27:18 PM
I have 5 MBit upload (Verizon FiOS).
Right now I am in the US and I'm trying to transfer files to Germany. But it goes only up to 40 KB/s although there is no speed limit set. The reason seems to be HFS because with an other HTTP server software (Abyss Webserver) I get the full speed.
Title: Re: speed test
Post by: bacter on March 09, 2009, 09:56:29 PM
Rejetto:

Speak with bennony: He has a speed problem and good connection to the internet http://www.rejetto.com/forum/index.php?topic=6549.msg1041451#msg1041451 (http://www.rejetto.com/forum/index.php?topic=6549.msg1041451#msg1041451)
Title: Re: speed test
Post by: rejetto on March 09, 2009, 11:19:19 PM
thanks bacter, but i need an english speaker.
at the moment i have no time for this. :(
i will come back on it ASAP (as my job gives me some time)
Title: Re: speed test
Post by: rejetto on March 26, 2009, 06:36:27 PM
ok guys, whoever wants to test.
at www.melauto.it/rejetto/beta/hfs-speed.exe you will find this experimental variation of version 2.2 (stable), with faster file transfer.

from those who test, i need to know
- how fast you go by using official 2.2
- how fast you go by using this experimental 2.2
- what's your connection upload speed

please, don't report anything with incomplete information.


this "faster" thing is what version 2.3 beta sports since long.
Title: Re: speed test
Post by: bigonboatin on May 04, 2009, 11:56:35 PM
thank you so much i am going to give it a try tonight
Title: Re: speed test
Post by: Vik on October 20, 2009, 03:57:30 AM
Results of HFS High Speed Version:
I was able to saturate my friend's downlink of 10Mbits with my Upload connection of 20MBits using a single connection on HFS. I am waiting for my friend with a >20MBit downlink to test the full speed capabilities of a single connection with this version. I will keep you apprised.

Comparison to 2.2f Official:
The official version caps my speed at ~250-300KB/s (aka 2-3Mbit) PER connection, global speed can exceed this, however this requires use of multiple connection download accelerators.


Thank you Rejetto for continuuing to improve this awesome program.
Title: Re: speed test
Post by: cool0 on October 22, 2009, 03:45:16 AM
I tested my internet connection speed using the http://www.ip-details.com/ (http://www.ip-details.com/).
It's too slow...Is there any way to increase this?
Title: Re: speed test
Post by: rejetto on October 22, 2009, 10:35:21 AM
i guess there's no button to increase the speed. such information would spread quickly. ;)
ask your internet provider for a faster connection.
Title: Re: speed test
Post by: Vik on October 23, 2009, 03:06:39 PM
Ok, I have tested the High Speed HFS with my friend who also has Fios. I was able to upload at my maximum speed on a single connection. So I guess the new record upload speed for this version is 2500KB/s aka 20Mbit. Congrats Rejetto!
Title: Re: speed test
Post by: rejetto on October 26, 2009, 01:39:31 AM
and thank you vik for collaboration
Title: Re: speed test
Post by: mrprozac on November 11, 2009, 10:49:21 PM
Is there still need for a fast internet connection?

I have 100mbs down/up FTTH Connection in Netherlands.

(http://www.speedtest.net/result/460732633.png)

I have my HFS Server setup (2.3) with large files.
Title: Re: speed test
Post by: mrprozac on November 12, 2009, 01:53:20 AM
Forgot to add the following:

Just tested the speed in intranet (all friends within same ISP are afk).

Running HTTP File Server 2.3 beta (Build #248)
Top Speed: 77252.2KB/s
Downloaded 112,96MB @ avg. 3159KB/s

Anyone with high-speed internet feel free to check the upload-speed using the following link.
http://www.ccseindhoven.nl:8080/Downloads/Music/Random/10-16-09.mp3
Title: Re: speed test
Post by: rejetto on November 14, 2009, 04:39:05 PM
wow, i didn't expect so much.
thank you mrprozac, your feedback is very appreciated.
Title: Re: speed test
Post by: mrprozac on November 20, 2009, 01:40:02 AM
wow, i didn't expect so much.
thank you mrprozac, your feedback is very appreciated.


Glad i could help, i enjoy using your program.
I am setting up my webserver (accidently deleted vmdisk  >:( ;D ), i'll set-up a mirror for you once everthing is done.

Kudo's to you for making such a great app
Title: Re: speed test
Post by: r][m on November 21, 2009, 02:54:42 PM
Same subject, slightly off topic.
Everyone is aware that faster processors and more efficent os (arguably) yield higher (faster)
speed test results?
On the same connection and router here, my dual core ubantu box repeatedly yields
extremely higher test results than any one of my older single cores on an older windows os.
Title: Re: speed test
Post by: Kremlin on November 21, 2009, 03:50:44 PM
Wouldn't that be more influenced by the newer ethernet card than the processor? OS wise, I might concur with that idea
Title: Re: speed test
Post by: r][m on November 22, 2009, 05:14:22 AM
Wouldn't that be more influenced by the newer ethernet card than the processor? OS wise, I might concur with that idea
Not that I can tell. One of my older boxes has had the card replaced not to many months ago.
From what I see here, processor speed does appear to play a role. Not as sure about the dual
core part though, as far as on line (website) tests.
Title: Re: speed test
Post by: bacter on November 22, 2009, 06:08:01 AM
There are many factors involved in possible speed of hfs, there are many bottlenecks:

HFS is not multi-threaded, so only one core is used. Look to verify at the processor load graphics: Build a filelist (~files?recursive) of a big filesystem, and you will see that processor load reaches only 50% on a dual core, one core uses 100%, on quadcore hfs can use one core at 100% and total cpu-use gets 25%.

Other differences between windows and Ubuntu machines: Most probably, your Ubuntu is a 64bit OS, and older windows would be a XP with 32 bits. This might be irrelevant to hfs, as hfs is a 32 bit application, but other OS tasks will go faster in 64 bit OS. Ubuntu needs less memory to work fine, windows needs a lot of memory (perhaps not available on older machines), and fewer available memory involves swapping: In an 2GB memory machine, ubuntu normally not even uses the swap partition, windows swaps even with 2 GB of free memory!

Things that slow down in windows:
- bad use of virtual memory (windows shuffles in and out data to and from disk even when there is enough memory available): this are a lot of disk operations.
- antivirus under windows: some of them verify data when read and written to and from files on disk. This in some cases reduce the throughput of data to less than a third of its possible value!
- network operations under windows may not be as efficient as under linux.

For internet access, network cards are rarely a bottleneck: Even the oldest cards are 10 Mb/s, since years they are 100 Mb/s and 1 Gb/s , and very few users have intenet connections above this values (especially for outgoing traffic!),

Title: Re: speed test
Post by: rejetto on November 25, 2009, 10:49:43 PM
Everyone is aware that faster processors and more efficent os (arguably) yield higher (faster)
speed test results?

you can make such assumption every time an operation is taking all available CPU.
if HFS is not taking all the available CPU core (to measure while you get the speed problem), then a faster CPU won't help.
Title: Re: speed test
Post by: r][m on November 26, 2009, 08:09:48 AM
you can make such assumption every time an operation is taking all available CPU.
if HFS is not taking all the available CPU core (to measure while you get the speed problem), then a faster CPU won't help.
I see your point, and it stands to reason that should always be the case, but....
using one of the speed test web sites, that is the result I see.
Even more, I see some (not great) difference here, apparently, between Vista and Ubantu
(or perhaps its the browser?)
on the same computer, and its pretty consistent?

Title: Re: speed test
Post by: rejetto on November 27, 2009, 03:29:54 PM
network transfers, on Windows at least, takes a lot of CPU.
with my 1.2GHz i've been able to reach 50MB/s, and couldn't get more without an upgrade.
Title: Re: speed test
Post by: mrprozac on November 28, 2009, 05:47:47 PM
network transfers, on Windows at least, takes a lot of CPU.
with my 1.2GHz i've been able to reach 50MB/s, and couldn't get more without an upgrade.


I got the above mentioned speed (in the post with the same uname) on my old development machine with the following specs.
Intel Celeron 1,7 GHz
with a whoping 512 MB RAM of which 523 is in use by other apps and windows (beat that :P)
100Mb ethernet

Memory use by hfs.exe (RAM/Virtual Memory) in kB
3.684/11.244
Title: Re: speed test
Post by: nuvolablu on December 01, 2009, 04:44:32 AM
ciao,
   io dispongo di una linea internet fibra su 100 megabit simmetrica.
hfs sta girando da diverso tempo su una macchina virtuale vmware
le prestazioni non sono troppo entusiasmanti...
parlo di scarico massimo attorno ai 20megabit al secondo, aiuta molto se da lato browser si utilizzano dei programmi per il download con più thread...sono riuscito ad arrivare a 5/6 megabyte al secondo in download
per l'upload purtroppo non dispongo di un'altro collegamento ad internet a 100 megabit, quindi il massimo raggiunto è stato limitato a 8 megabit (fastweb fibra)
Spero di essere stato d'aiuto.
Saluti.
S.
Title: Re: speed test
Post by: marbulas on December 01, 2009, 01:46:03 PM
my speed of connection IPS services is :
Download : 11.59MB/s, Upload : 11.59MB/s

Can I help something for this?
Title: Re: speed test
Post by: rejetto on December 01, 2009, 10:04:40 PM
@nuvolablu
con rammarico ti dico che probabilmente HFS non arriverà mai alle velocità di apache e simili.
punta all'usabilità anziché alle prestazioni.
se arriva a servire 20mbps in uscita mi ritengo soddisfatto, perché sono già pochi quelli che hanno tale banda in ingresso, e credo pochissimi quelli che hanno una velocità superiore a questa in uscita.

@marbulas
available results may be enough, but if you'd like to contribute with your testings, it's welcomed.
Title: Re: speed test
Post by: m107 on December 07, 2009, 07:30:35 AM
I have a strange results from a test:

I did test to remote upload a 200 Mg file from my server (100Mb/k , I can Transfer files from rapidshare.com with 10MGB/s).
I tried these website:
Hotfile.com
Storage.to

The same file in Hotfile shows me ~65KB/s but in Storage.to It was ~800 KB/s  :o
Also I did test it with my linux host and the speed was same az Hotfile, 65 KB/s  ???
Title: Re: speed test
Post by: bacter on December 07, 2009, 11:39:18 AM
Sorry m107, but without saying how many ms/kg hfs needs to get 1 MGB  y can't get any remote idea what is the weight (in mg) of your server .. nor what you try to say.

Perhaps 'remote upload from' means download? ¿ and then what?
Title: Re: speed test
Post by: m107 on December 07, 2009, 12:08:20 PM
Sorry m107, but without saying how many ms/kg hfs needs to get 1 MGB  y can't get any remote idea what is the weight (in mg) of your server .. nor what you try to say.

Perhaps 'remote upload from' means download? ¿ and then what?

Sorry, but i didn't understand you :-[

If you mean "remote upload"T I mean that speed of transferring from file from my win 2003 server to Hotfile.com is ~65 but transferring speed to storage.to is ~800 .
Title: Re: speed test
Post by: rejetto on December 08, 2009, 12:55:09 PM
@m107
use www.speedtest.net for your testings
Title: Re: speed test
Post by: m107 on December 08, 2009, 04:47:10 PM
@m107
use www.speedtest.net for your testings

Here:
(http://www.speedtest.net/result/646338718.png) (http://www.speedtest.net)
Title: Re: speed test
Post by: rejetto on December 09, 2009, 10:06:30 AM
sometimes i'm slightly envious  :-X
Title: Re: speed test
Post by: Mars on December 09, 2009, 05:29:03 PM
You should postulate for a work for the NASA

That leaves dreamer, is not it? ;)
Title: Re: speed test
Post by: m107 on December 09, 2009, 05:40:31 PM
Is there any way to have more speed?
is there any similar software?
Title: Re: speed test
Post by: rejetto on December 10, 2009, 01:53:03 PM
here you can find
http://www.rejetto.com/wiki/index.php/HFS:_Similar_software

you have 20Mbit/s in upload, so you can get a max of 2.5 MByte/s
to get such speed with a single download, anyway, the downloader must have a true(tested) 20Mbps connection on its side.
Title: Re: speed test
Post by: GaMEChld on June 29, 2011, 05:19:47 AM
I've been using the 2.2f Speed Test version from this thread basically straight from October 2009 till now (I was on the first page as Guest "Vik").

I was just wondering if there has been any shocking developments in the beta versions that should warrant leaving this trusty version behind? I notice the official stable version is still 2.2f, so I wasn't too sure.

Thanks again for this program Rejetto, it is so useful that it defies description.
Title: Re: speed test
Post by: rejetto on July 06, 2011, 12:05:36 PM
2.3 has a number of new features I cannot remember.
My favorite ones are scripting and user groups.
30% of users are already using it.
Title: Re: speed test
Post by: raybob on July 08, 2011, 07:26:51 PM
For me, my internet connection is what limits my bandwidth.

When transferring over my 100Mb/s LAN, I typically get speeds in excess of 5 MB/s with one connection, upload and download.  That's plenty.

For me, the real speed is problem is when generating very large pages.  For example, building a page of 242 mp3 files (that's 23,000 HTML lines based on my template  :D ) takes HFS around 2.8 seconds.  This number increases dramatically based on the number of conditionals in the [file] section.  This is on a Core i7 system.  Again, that's not too slow considering my internet speed, but other pages normally take less than 0.1 seconds to generate.
Title: Re: speed test
Post by: raybob on August 02, 2011, 11:07:36 PM
For me HFS supports a maximum global speed upload and download of around 5.0 MB/s.  From what I see the limitation is CPU, where when transferring at this speed HFS is using 100% of its CPU core.

Title: Re: speed test
Post by: joske on January 11, 2012, 08:14:33 AM
For me, my internet connection is what limits my bandwidth.

When transferring over my 100Mb/s LAN, I typically get speeds in excess of 5 MB/s with one connection, upload and download.  That's plenty.

For me, the real speed is problem is when generating very large pages.  For example, building a page of 242 mp3 files (that's 23,000 HTML lines based on my template  :D ) takes HFS around 2.8 seconds.  This number increases dramatically based on the number of conditionals in the [file] section.  This is on a Core i7 system.  Again, that's not too slow considering my internet speed, but other pages normally take less than 0.1 seconds to generate.
We are talking about upload on an internet connection, read the topic before answering with useless facts. Off course your LAN speed is that high. The speed problem only happens on internet connections. It has probably something to do with latency and the amount of hops in the route between HFS server and downloader. The speed version speed is a bit better but the speed is not stable, it's climbing up until max upload and falling back every 15 seconds, then climbing up back..
Title: Re: speed test
Post by: raybob on January 11, 2012, 11:42:20 AM
Right.  I was saying my LAN speed so I could illustrate to you that HFS is NOT what's causing your guys' speed problems, because it is capable of much higher.
Title: Re: speed test
Post by: joske on January 11, 2012, 12:30:37 PM
hfs IS the problem.
The problem is less clear on LAN connections but the HFS (http) speed is still slower than for example an FTP transfer over your LAN.
In my case: The same file, transfered with HFS: 2,23MB/s, transfered with Filezilla: 2,7MB/s
On a WAN connection, the situation is much worse.
I have an upload limit of 450KB/s but my upload speed with a single file transfer with HFS varies between 15KB/s and 200KB/s !!!!

Screenshot of a transfer on a dedicated 450KB/s upload line:
(http://www.mattiassercu.be/wp-content/uploads/2012/01/HFS_speed_problem.jpg)

Update
With the normal 2.2 version, the speed is very limited but stable (on LAN and on WAN connections)
+- stable 40% of max possible speed.

With 2.2 speed edition, the speed is less limited but very unstable.
+- variable speed between 5% and 70% of max possible speed.
Title: Re: speed test
Post by: rejetto on January 15, 2012, 08:58:17 PM
In my case: The same file, transfered with HFS: 2,23MB/s, transfered with Filezilla: 2,7MB/s

i wouldn't expect more than that. HFS efforts are not focused on speed.
for the other problem, let's continue on the other topic.
Title: Re: speed test
Post by: daddycaddy on June 29, 2012, 04:48:02 PM
hi there,
i'm having problems with speed per connection with HFS
hes currently hosted on a professional server Intel Quad Core Q6600 with 4 gb ram
he has dedicated connection of 100 mb download/upload
i do not host many applications there, just sometimes test servers for different applications i run but they do not run all the time
so basically most of the time hes alone

i have problems with connection speed per peer or user
i did myself some tests and i wasn't able to reach my full speed downloading big size files, i got close to my max speed for few moments then speed drops then later on gets big again and so on

anyway with this HFS-Speed i get the best so far regarding speed per connection from all 3 HFS i tryed:
1) HFS 2.2 has the worst speed per connection...i tried to download from another server of mine which has 100 mb download/upload also and i should reach a speed of at least few mb/s but in reality i got a max of 100-150 kb/s
2) HFS build #279 has a better speed per connection/peer BUT still its lacking at that chapter ... i wasn't able to score at least 1 mb connection between 2 dedicated 100 mbs servers (i can get that speed using apache...but i don't want to use apache)
3) HFS-speed a bit better then build 279 but still lacking at chapter speed per connection

for some reason i wasn't able to get an speed higher then 600 kb/s and that for few seconds as it drop down

any ideas?
Title: Re: speed test
Post by: rejetto on June 30, 2012, 12:19:09 AM
welcome daddycaddy,

when you tested with apache, did you use a browser to download or a different kind of software?
Title: Re: speed test
Post by: raybob on August 17, 2012, 12:41:02 AM
Well I've determined that my website's slowness is due to the very large VFS.

I did some testing in FHFS and everything is perfectly fast with a VFS of zero size.  Typically build time for a blank page (but there are macros in [request]) is either 0.000 or 0.013.

With a VFS of 1000 items build times can be up to 0.200 seconds or longer, which increases very quickly when there are people downloading files.  I haven't tested with a VFS bigger than 1000 items.