Proxy Logs Analysis

[Red]

This is a bit of a tough question.

I'm currently grepping through a lot of proxy logs for particular malware related strings. The proxy logs are currently compressed in gzip files and using the command line to analyze through proxy logs.

gzip.exe -v -c -d C:\logs\regex.gz | perl ack.pl -i -h "stringtosearchfor" > output.txt

Ultimately, I'm researching a way to just take an entire input.txt file to grep with. I've found other means using BASH. I'm also restricted to the Windows CLI at the moment. There is also another option of using Cygwin. Although, I'm not sure how the formatting should be. I'm also concerned about performance since I'd like to grep for about 100-500 lines of entries.

Does anyone have a suggestion?

THANKS!

[Shawn Jefferson]

Don't know if this will work for you or not, but there are windows versions of grep available, and grep allows you to specify a text file of search terms.

[RS-232]

Kinda late reply,but anyway...
This one might be as well of interest to you,since you referred specifically to Windows systems:
http://www.microsoft.com/downloads/details.aspx?FamilyID=890cd06b-abf8-4c25-91b2-f8d975cf8c07&displaylang=en

[h4h4h4h4]

This is a bit of a tough question.

I'm currently grepping through a lot of proxy logs for particular malware related strings. The proxy logs are currently compressed in gzip files and using the command line to analyze through proxy logs.

gzip.exe -v -c -d C:\logs\regex.gz | perl ack.pl -i -h "stringtosearchfor" > output.txt

Ultimately, I'm researching a way to just take an entire input.txt file to grep with. I've found other means using BASH. I'm also restricted to the Windows CLI at the moment. There is also another option of using Cygwin. Although, I'm not sure how the formatting should be. I'm also concerned about performance since I'd like to grep for about 100-500 lines of entries.

Does anyone have a suggestion?

THANKS!

The proxy logs i use are bziped.

make an input file called input.txt and inside of it put what you want to search.

bzgrep -f input.txt logstosearchagainst | tee output.txt

[Red]

Don't know if this will work for you or not, but there are windows versions of grep available, and grep allows you to specify a text file of search terms.

Yes, I'm already using gzip.exe which is a win32 binary.

[Red]

The proxy logs i use are bziped.

make an input file called input.txt and inside of it put what you want to search.

bzgrep -f input.txt logstosearchagainst | tee output.txt

This might be of some use, I'll give it a shot.

Thanks to all who replied. This put me in the right direction.