Author Topic: Out Of Memory (multiple connections)  (Read 1014 times)

0 Members and 1 Guest are viewing this topic.

Offline davidam2

  • Occasional poster
  • *
  • Posts: 6
    • View Profile
Out Of Memory (multiple connections)
« on: June 17, 2019, 09:28:02 AM »
Hi!
I recently observed a problem with HFS:
I have started using a download manager to be able to make multiple download connections of a file.

Memory consumption grows continuously. Suddenly it shows a message, and another and another: OUT OF MEMORY. Finally the program is closed.

I have done these checks:
4 ~ 5 simultaneous connections seems to support them. Although at 5 minutes the memory usage has grown from 80 MB to 1.2 GB (after 5 minutes). My machine has 24 GB of RAM.

I use a LIVE 3.0.1 template.
I have tried to disable different options (remove template, remove limits, disable macros ...) but I always get the memory error.

Only when I activated DEBUG: RESET TEMPORALILY has everything OK. 24 connections without breaks (although the HFS interface froze)

Any idea why this happens?

Thanks a lot!

Offline SilentPliz

  • Operator
  • Tireless poster
  • *****
  • Posts: 1243
  • ....... chut ! shh!
    • View Profile
Re: Out Of Memory (multiple connections)
« Reply #1 on: June 17, 2019, 06:29:20 PM »
Welcome, :)

Some RAWR templates cause a memory leak with HFS.

Have you tried to do the same test with the default template of HFS ?


Offline davidam2

  • Occasional poster
  • *
  • Posts: 6
    • View Profile
Re: Out Of Memory (multiple connections)
« Reply #2 on: June 17, 2019, 07:22:59 PM »
Yes!! when I checked that in the RESET TEMPORARY mode I did not have the memory problem, I thought it was caused to the template.

But it was still exactly the same as with the template.

Thanks!!

Offline danny

  • Tireless poster
  • ****
  • Posts: 194
    • View Profile
    • Startfetch
Out Of Memory, multiple connections of download manager server abuse
« Reply #3 on: June 21, 2019, 10:38:35 AM »
Copied from my server, in the zip are, events, ini, template.   

You'd need to load your filesystem.vfs and user accounts.
If on a home connection, you'd need to set custom port and dns updater (probably).
The events file enables caching.
In the ini file, there's whatever settings I've used for efficiency
In the ini file, connections-per-user set to 8 and total is 40 (these are set too high; certainly higher is unnecessary)

The point is:  There is no memory leak in this zip file or HFS 2.3k.
https://drive.google.com/open?id=1TVfCfxygKXShEIZT9cnumO_jX_9Ssefy
So, you can isolate to see if the problem is your windows box or hfs. 
Don't forget the zip file (attached).  There are 2 downloads HFS299 and the zip file too.

P.S.
See the automatic error-handler in the Throwback templates--You can set connection limits; and, when over the mark, users Don't see the standard 'it has death' messages, but Instead there is auto-queue which doesn't cause support phone calls.  Feel free to lower the connection limits as defense against abusive download manager software. 
« Last Edit: July 17, 2019, 11:44:07 AM by danny »

Follow members gave a thank to your post:


Offline davidam2

  • Occasional poster
  • *
  • Posts: 6
    • View Profile
Re: Out Of Memory, multiple connections of download manager server abuse
« Reply #4 on: June 21, 2019, 12:35:15 PM »
Copied from my server, in the zip are, events, ini, template.   
Best used with HFS 2.3k (299-1/2) https://drive.google.com/open?id=12GRINYSKe8H-VZtpsbvJkabvdTrB48F3

You'd need to load your filesystem.vfs and user accounts.
If on a home connection, you'd need to set custom port and dns updater (probably)......

Thanks a lot!!! This weekend I probe it. I Will post with results

Offline davidam2

  • Occasional poster
  • *
  • Posts: 6
    • View Profile
Re: Out Of Memory (multiple connections)
« Reply #5 on: June 24, 2019, 03:29:49 PM »
 ;D ;D
THANKS!! Your config and template works ok!!
 ;D ;D
 
First tries:
36 connections simuntaneously = 27 MB

When I discover the problem with my old configuration, i will post it.

Offline danny

  • Tireless poster
  • ****
  • Posts: 194
    • View Profile
    • Startfetch
Re: Out Of Memory (multiple connections)
« Reply #6 on: June 25, 2019, 01:51:07 PM »
I updated that 'care-pack' zip file (3 posts up). 

Estimate:  Depending on how many users, set 'max connections from single address' limit to assure that one user can't overwhelm the whole system. Also, it is gracious to limit the individual so they can't slow themselves down to a pointless state.  Plausible range for individual is 6 to 36.  Try a setting of 8.

EDIT:  My new template has this automated, based on server load:  http://rejetto.com/forum/index.php?topic=12055.msg1064825#msg1064825
On my server, the ram usage seems to be 10 megabytes.  No inconvenience at all.  Thank you for the clues which helped with the development. 
« Last Edit: August 05, 2019, 08:11:11 PM by danny »

Follow members gave a thank to your post:


Offline davidam2

  • Occasional poster
  • *
  • Posts: 6
    • View Profile
Re: Out Of Memory (multiple connections)
« Reply #7 on: July 10, 2019, 11:40:34 AM »
Welcome, :)

Some RAWR templates cause a memory leak with HFS.

Have you tried to do the same test with the default template of HFS ?

The problem is Limit Bandwith Speed (any template, default template too). I Change all parameters one by one. If I active Limit Bandwith speed (Global or per User), the memory increases to hang HFS.

I desactivated this limit and now Run OK. Free Bandwith is not a problem, I have another programs to limit Bandwith to a program o interface.

Thanks a lot (Danny too) for your answers and help.  :)

Follow members gave a thank to your post:


Offline danny

  • Tireless poster
  • ****
  • Posts: 194
    • View Profile
    • Startfetch
Re: Out Of Memory (multiple connections)
« Reply #8 on: September 08, 2019, 04:18:29 PM »
...I have another programs to limit Bandwith to a program o interface....
Could you tell me the name of the program?

Offline davidam2

  • Occasional poster
  • *
  • Posts: 6
    • View Profile
Re: Out Of Memory (multiple connections)
« Reply #9 on: September 09, 2019, 08:53:50 AM »

Follow members gave a thank to your post:


Offline sonjaclarke

  • Occasional poster
  • *
  • Posts: 1
    • View Profile
Re: Out Of Memory (multiple connections)
« Reply #10 on: December 03, 2019, 02:44:02 AM »