[request] download logs in W3C format

[ninjapimp]

I'm a heavy user of IIS7
one feature of IIs7 i find help is the IIs logs it generates from users hitting my website
i then run a freeware app called analog which helps me dtermine how much traffic and how much has been downloaded. quite informative to parse the logs so one can see whats really going on.

here is a small cut n paste of my iis7 logs to give you an idea

#Software: Microsoft Internet Information Services 7.0
#Version: 1.0
#Date: 2009-11-17 23:33:06
#Fields: date time cs-method cs-uri-stem cs-uri-query cs-username c-ip cs(User-Agent) sc-status sc-substatus sc-win32-status sc-bytes cs-bytes time-taken
2009-11-17 23:33:06 GET /iphone/Customization+images+&+files/Winterboard/Themes/Un-UnLockable.theme/Folders/SpringBoard.app/ru.lproj/ - - 66.249.68.144 Mozilla/5.0+(compatible;+Googlebot/2.1;++http://www.google.com/bot.html) 200 0 0 845 396 1092
2009-11-17 23:37:01 GET /iphone/xxxxxxx/An+Origami+Crane+Learning+1.1-Cuibap.ipa - - 118.100.93.197 Mozilla/4.0+(compatible;+MSIE+6.0;+Windows+NT+5.1;+SV1;+.NET+CLR+1.1.4322;+.NET+CLR+2.0.50727) 404 0 2 1382 342 358
2009-11-17 23:37:02 GET /robots.txt - - 193.47.80.38 Mozilla/5.0+(compatible;+Exabot/3.0;++http://www.exabot.com/go/robot) 404 0 2 1401 261 280
2009-11-17 23:37:02 GET /iphone/xxxxxxxxx/An+Origami+Crane+Learning+1.1-Cuibap.ipa - - 118.100.93.197 Mozilla/4.0+(compatible;+MSIE+6.0;+Windows+NT+5.1;+SV1;+.NET+CLR+1.1.4322;+.NET+CLR+2.0.50727) 404 0 2 1401 331 702


the iis log captures all data you need which can be parsed via a 3rd aprty app

it would be helpful if you could add this feature and perhaps put it in W3C format so we could use already established apps to parse the data.

because currently its like driving blind with HFS, there seems to be no log or any way to know and or capture history for bandwidth and traffic which is crucial when hosting files on the net. at least for me it is. as it lets me plan ahead, this way i can know how much bandwidth to allocate.

thanks again.

[maverick]

currently its like driving blind with HFS, there seems to be no log or any way to know and or capture history for bandwidth and traffic which is crucial when hosting files on the net. at least for me it is. as it lets me plan ahead, this way i can know how much bandwidth to allocate.

HFS does produce logs.  You can even select to produce in apache format.  Go to t Menu -> Logs  or right click on the HFS gui log pane and select what you want logged.

[ninjapimp]

ah ok
i failed to remember ya gota right click on the right side pane.
i was expecting to see it in the menu list.
thanks for the help

[r][m]

Recent HFS betas have Menu > Log, as well as the right click.

Analog uses cfg settings to read various types of log files.
I used to use it for HFS apache log out put, but HFS has log capabilities
beyond what analog is capable of now.
Now I link the log file to a Access database. Much more informative,
although not available for remote viewing, but for me thats not important.

[ninjapimp]

%h %l %u %t "%r" %>s %b "%{Referer}i %z" "%{User-Agent}i" : log to apache format

hfs_log_month-%m%  : log to file format   

i then click save and it creates a file named hfs.txt and has this in it:
11/22/2009 1:42:37 PM 6x.16x.7.11x:2332 Sent 130070 bytes


i dont see the file being created...does it save file after 30min or something??
i would think it would be instant and updated line by line as downloads happen


i'm using this for my apache log capture but alas i'm not familiar with apache
does anyone have apache strings handy? can more be added or is this the limit?
127.0.0.1 - - [22/Nov/2009:13:17:19 -0600] GET /iPhone/ HTTP/1.1 200 3595.log
that my capture above...but i'm not seeing what the % symbols add up to
i simply would like to add more detail in them like in iis7 so when i parse it with analog i get more info.

[maverick]

i dont see the file being created...does it save file after 30min or something??
i would think it would be instant and updated line by line as downloads happen

Log files are created and updated in what seems to be realtime.  When you set up the log the way you wanted (HFS log or apache log), did you also include a path and filename so HFS knows where to save it so you could find it?

i'm using this for my apache log capture but alas i'm not familiar with apache
does anyone have apache strings handy? can more be added or is this the limit?

Do a google search.  Here's one to get you started.
http://httpd.apache.org/docs/1.3/logs.html

[ninjapimp]

ok i checked about 5min later and file finally appeared.
it does not seem to be instant
7x.14x.18x.12x - - [22/Nov/2009:14:02:31 -0600] "GET / HTTP/1.1" 200 2879 " " "Mozilla/5.0 (iPhone; U; CPU iPhone OS 3_1_2 like Mac OS X; en-us) AppleWebKit/528.18 (KHTML, like Gecko) Version/4.0 Mobile/7D11 Safari/528.16"

thank you kind sir for the link i'll mkae sure to read up on it.