Comments on: Parsing and analysing IIS W3C log files http://blog.davidhuby.com/index.php/2010/02/parsing-and-analysing-iis-w3c-log-files/ Technical and business stuff Tue, 22 Nov 2011 12:45:09 +0000 http://wordpress.org/?v=2.9.2 hourly 1 By: Jorge Gomes http://blog.davidhuby.com/index.php/2010/02/parsing-and-analysing-iis-w3c-log-files/comment-page-1/#comment-1552 Jorge Gomes Tue, 07 Dec 2010 16:20:17 +0000 http://blog.davidhuby.com/?p=110#comment-1552 I forgot to mention ... each of the daily log files of about 120 MB is 1,000,000 lines! Thank you for your consideration, JGomes I forgot to mention …
each of the daily log files of about 120 MB is 1,000,000 lines!

Thank you for your consideration,
JGomes

]]> By: Jorge Gomes http://blog.davidhuby.com/index.php/2010/02/parsing-and-analysing-iis-w3c-log-files/comment-page-1/#comment-1551 Jorge Gomes Tue, 07 Dec 2010 15:56:54 +0000 http://blog.davidhuby.com/?p=110#comment-1551 hello, currently i use LogParser to create reports using the IIS log files - i have a job that runs automatically at night. I also work with SQL Server/ASP and is much more convenient for further analysis interfaces to the logs. It has also created a table for listing of online logs, to test. My question is: which is best for performance/resources: keep writing logs in text file *. log to file system or change to record online in SQL DB? My *. log are already occupy about 120 MB per day. How can increase my SQL DB? Thank you for your consideration, Jorge Gomes hello,
currently i use LogParser to create reports using the IIS log files – i have a job that runs automatically at night.

I also work with SQL Server/ASP and is much more convenient for further analysis interfaces to the logs. It has also created a table for listing of online logs, to test.

My question is:

which is best for performance/resources: keep writing logs in text file *. log to file system or change to record online in SQL DB?

My *. log are already occupy about 120 MB per day. How can increase my SQL DB?

Thank you for your consideration,
Jorge Gomes

]]> By: PatrickMc http://blog.davidhuby.com/index.php/2010/02/parsing-and-analysing-iis-w3c-log-files/comment-page-1/#comment-355 PatrickMc Wed, 10 Feb 2010 15:02:01 +0000 http://blog.davidhuby.com/?p=110#comment-355 Nice article and good resources. Sometimes, one needs to write ones own customized parser (based on whatever new BI (Business Intelligence) craze has captured our top management :-) For that, I have been using this script - http://www.biterscripting.com/SS_WebLogParser.html . I start with that script and modify to parse the logs in my customized way. Try it out one of these days. It works pretty good. Nice article and good resources.

Sometimes, one needs to write ones own customized parser (based on whatever new BI (Business Intelligence) craze has captured our top management :-)

For that, I have been using this script – http://www.biterscripting.com/SS_WebLogParser.html . I start with that script and modify to parse the logs in my customized way. Try it out one of these days. It works pretty good.

]]>