Author Topic: Out Of Memory (multiple connections)  (Read 273 times)

0 Members and 1 Guest are viewing this topic.

Offline davidam2

  • Occasional poster
  • *
  • Posts: 5
    • View Profile
Out Of Memory (multiple connections)
« on: June 17, 2019, 09:28:02 AM »
Hi!
I recently observed a problem with HFS:
I have started using a download manager to be able to make multiple download connections of a file.

Memory consumption grows continuously. Suddenly it shows a message, and another and another: OUT OF MEMORY. Finally the program is closed.

I have done these checks:
4 ~ 5 simultaneous connections seems to support them. Although at 5 minutes the memory usage has grown from 80 MB to 1.2 GB (after 5 minutes). My machine has 24 GB of RAM.

I use a LIVE 3.0.1 template.
I have tried to disable different options (remove template, remove limits, disable macros ...) but I always get the memory error.

Only when I activated DEBUG: RESET TEMPORALILY has everything OK. 24 connections without breaks (although the HFS interface froze)

Any idea why this happens?

Thanks a lot!

Offline SilentPliz

  • Operator
  • Tireless poster
  • *****
  • Posts: 1232
  • ....... chut ! shh!
    • View Profile
Re: Out Of Memory (multiple connections)
« Reply #1 on: June 17, 2019, 06:29:20 PM »
Welcome, :)

Some RAWR templates cause a memory leak with HFS.

Have you tried to do the same test with the default template of HFS ?


Offline davidam2

  • Occasional poster
  • *
  • Posts: 5
    • View Profile
Re: Out Of Memory (multiple connections)
« Reply #2 on: June 17, 2019, 07:22:59 PM »
Yes!! when I checked that in the RESET TEMPORARY mode I did not have the memory problem, I thought it was caused to the template.

But it was still exactly the same as with the template.

Thanks!!

Offline danny

  • Occasional poster
  • *
  • Posts: 98
    • View Profile
    • Startfetch
Out Of Memory, multiple connections of download manager server abuse
« Reply #3 on: June 21, 2019, 10:38:35 AM »
Copied from my server, in the zip are, events, ini, template.   

You'd need to load your filesystem.vfs and user accounts.
If on a home connection, you'd need to set custom port and dns updater (probably).
The events file enables caching.
In the ini file, there's whatever settings I've used for efficiency
In the ini file, connections-per-user set to 8 and total is 40 (these are set too high; certainly higher is unnecessary)

The point is:  There is no memory leak in this zip file or HFS 2.3k.
https://drive.google.com/open?id=1TVfCfxygKXShEIZT9cnumO_jX_9Ssefy
So, you can isolate to see if the problem is your windows box or hfs. 
Don't forget the zip file (attached).  There are 2 downloads HFS299 and the zip file too.

P.S.
See the automatic error-handler in the Throwback templates--You can set connection limits; and, when over the mark, users Don't see the standard 'it has death' messages, but Instead there is auto-queue which doesn't cause support phone calls.  Feel free to lower the connection limits as defense against abusive download manager software. 
« Last Edit: July 17, 2019, 11:44:07 AM by danny »
Production/stable template located at: First post in the Throwback thread.

Follow members gave a thank to your post:


Offline davidam2

  • Occasional poster
  • *
  • Posts: 5
    • View Profile
Re: Out Of Memory, multiple connections of download manager server abuse
« Reply #4 on: June 21, 2019, 12:35:15 PM »
Copied from my server, in the zip are, events, ini, template.   
Best used with HFS 2.3k (299-1/2) https://drive.google.com/open?id=12GRINYSKe8H-VZtpsbvJkabvdTrB48F3

You'd need to load your filesystem.vfs and user accounts.
If on a home connection, you'd need to set custom port and dns updater (probably)......

Thanks a lot!!! This weekend I probe it. I Will post with results

Offline davidam2

  • Occasional poster
  • *
  • Posts: 5
    • View Profile
Re: Out Of Memory (multiple connections)
« Reply #5 on: June 24, 2019, 03:29:49 PM »
 ;D ;D
THANKS!! Your config and template works ok!!
 ;D ;D
 
First tries:
36 connections simuntaneously = 27 MB

When I discover the problem with my old configuration, i will post it.

Offline danny

  • Occasional poster
  • *
  • Posts: 98
    • View Profile
    • Startfetch
Re: Out Of Memory (multiple connections)
« Reply #6 on: June 25, 2019, 01:51:07 PM »
I updated that 'care-pack' zip file (3 posts up). 

Estimate:
Depending on connection speed, set global 'max connections' limit for assuring that accumulated connections are functional (instead of piling up until blockade).  Plausible range for global is 36 to 280 depending mainly on server-tuning/capacity and only somewhat depending on internet upload rate.  Try a setting of 40.  It may take testing to determine a just-right number for the global connections setting. 

Depending on how many users, set 'max connections from single address' limit to assure that one user can't overwhelm the whole system. Also, it is gracious to limit the individual so they can't slow themselves down to a pointless state.  Plausible range for individual is 6 to 36.  Try a setting of 8.

If more than 1 user, set the individual allotment lower than the global, because it takes 2 connections 'margin' for each additional user, if simultaneous.
« Last Edit: July 09, 2019, 10:07:26 PM by danny »
Production/stable template located at: First post in the Throwback thread.

Follow members gave a thank to your post:


Offline davidam2

  • Occasional poster
  • *
  • Posts: 5
    • View Profile
Re: Out Of Memory (multiple connections)
« Reply #7 on: July 10, 2019, 11:40:34 AM »
Welcome, :)

Some RAWR templates cause a memory leak with HFS.

Have you tried to do the same test with the default template of HFS ?

The problem is Limit Bandwith Speed (any template, default template too). I Change all parameters one by one. If I active Limit Bandwith speed (Global or per User), the memory increases to hang HFS.

I desactivated this limit and now Run OK. Free Bandwith is not a problem, I have another programs to limit Bandwith to a program o interface.

Thanks a lot (Danny too) for your answers and help.  :)

Follow members gave a thank to your post: