rejetto forum

Software => HFS ~ HTTP File Server => Bug reports => Topic started by: davidam2 on June 17, 2019, 09:28:02 AM

Title: Out Of Memory (multiple connections)
Post by: davidam2 on June 17, 2019, 09:28:02 AM
Hi!
I recently observed a problem with HFS:
I have started using a download manager to be able to make multiple download connections of a file.

Memory consumption grows continuously. Suddenly it shows a message, and another and another: OUT OF MEMORY. Finally the program is closed.

I have done these checks:
4 ~ 5 simultaneous connections seems to support them. Although at 5 minutes the memory usage has grown from 80 MB to 1.2 GB (after 5 minutes). My machine has 24 GB of RAM.

I use a LIVE 3.0.1 template.
I have tried to disable different options (remove template, remove limits, disable macros ...) but I always get the memory error.

Only when I activated DEBUG: RESET TEMPORALILY has everything OK. 24 connections without breaks (although the HFS interface froze)

Any idea why this happens?

Thanks a lot!
Title: Re: Out Of Memory (multiple connections)
Post by: SilentPliz on June 17, 2019, 06:29:20 PM
Welcome, :)

Some RAWR templates cause a memory leak with HFS.

Have you tried to do the same test with the default template of HFS ?

Title: Re: Out Of Memory (multiple connections)
Post by: davidam2 on June 17, 2019, 07:22:59 PM
Yes!! when I checked that in the RESET TEMPORARY mode I did not have the memory problem, I thought it was caused to the template.

But it was still exactly the same as with the template.

Thanks!!
Title: Out Of Memory, multiple connections of download manager server abuse
Post by: danny on June 21, 2019, 10:38:35 AM
Copied from my server, in the zip are, events, ini, template.   

You'd need to load your filesystem.vfs and user accounts.
If on a home connection, you'd need to set custom port and dns updater (probably).
The events file enables caching.
In the ini file, there's whatever settings I've used for efficiency
In the ini file, connections-per-user set to 8 and total is 40 (these are set too high; certainly higher is unnecessary)

The point is:  There is no memory leak in this zip file or HFS 2.3k.
https://drive.google.com/open?id=1TVfCfxygKXShEIZT9cnumO_jX_9Ssefy
So, you can isolate to see if the problem is your windows box or hfs. 
Don't forget the zip file (attached).  There are 2 downloads HFS299 and the zip file too.

P.S.
See the automatic error-handler in the Throwback templates--You can set connection limits; and, when over the mark, users Don't see the standard 'it has death' messages, but Instead there is auto-queue which doesn't cause support phone calls.  Feel free to lower the connection limits as defense against abusive download manager software. 
Title: Re: Out Of Memory, multiple connections of download manager server abuse
Post by: davidam2 on June 21, 2019, 12:35:15 PM
Copied from my server, in the zip are, events, ini, template.   
Best used with HFS 2.3k (299-1/2) https://drive.google.com/open?id=12GRINYSKe8H-VZtpsbvJkabvdTrB48F3

You'd need to load your filesystem.vfs and user accounts.
If on a home connection, you'd need to set custom port and dns updater (probably)......

Thanks a lot!!! This weekend I probe it. I Will post with results
Title: Re: Out Of Memory (multiple connections)
Post by: davidam2 on June 24, 2019, 03:29:49 PM
 ;D ;D
THANKS!! Your config and template works ok!!
 ;D ;D
 
First tries:
36 connections simuntaneously = 27 MB

When I discover the problem with my old configuration, i will post it.
Title: Re: Out Of Memory (multiple connections)
Post by: danny on June 25, 2019, 01:51:07 PM
I updated that 'care-pack' zip file (3 posts up). 

Estimate:  Depending on how many users, set 'max connections from single address' limit to assure that one user can't overwhelm the whole system. Also, it is gracious to limit the individual so they can't slow themselves down to a pointless state.  Plausible range for individual is 6 to 36.  Try a setting of 8.

EDIT:  My new template has this automated, based on server load:  http://rejetto.com/forum/index.php?topic=12055.msg1064825#msg1064825
On my server, the ram usage seems to be 10 megabytes.  No inconvenience at all.  Thank you for the clues which helped with the development. 
Title: Re: Out Of Memory (multiple connections)
Post by: davidam2 on July 10, 2019, 11:40:34 AM
Welcome, :)

Some RAWR templates cause a memory leak with HFS.

Have you tried to do the same test with the default template of HFS ?

The problem is Limit Bandwith Speed (any template, default template too). I Change all parameters one by one. If I active Limit Bandwith speed (Global or per User), the memory increases to hang HFS.

I desactivated this limit and now Run OK. Free Bandwith is not a problem, I have another programs to limit Bandwith to a program o interface.

Thanks a lot (Danny too) for your answers and help.  :)
Title: Re: Out Of Memory (multiple connections)
Post by: danny on September 08, 2019, 04:18:29 PM
...I have another programs to limit Bandwith to a program o interface....
Could you tell me the name of the program?
Title: Re: Out Of Memory (multiple connections)
Post by: davidam2 on September 09, 2019, 08:53:50 AM
NetLimiter.

https://www.netlimiter.com/ (https://www.netlimiter.com/)