Convert LOG file to CSV

PowerShell Help
1

Hi,
I have a logfile in a folder. I am searching a word (externalsystemorderservice) in that logfile and converting those lines to CSV.
Below is the script:

$log = Get-ChildItem -Path C:\temp*.log
$col = {@()}.invoke()
switch -Regex -File $log
{
‘#Fields.*’ {$fields = $_}

‘\d+.externalsystemorderservice.’ {$col.add($Matches[0])}
}

$fields = $fields -replace ‘#Fields:’
$fields = $fields.trim() -split ’ ’

$col -replace ’ ‘,’,’ | convertfrom-csv -Header $fields |
Export-Csv -Path C:\temp\final.csv -NoTypeInformation

I am able to convert for one log, but i have 7 logfiles in a folder. I am not able to perform this operation.
Can some please help me on this.

NOTE: logfiles names will be different, but it has extension.log

-Kalyan

2

You could simply use a foreach loop to perform your action on every logfile:

$logFiles = Get-ChildItem -Path 'C:\temp' -Filter *.log

foreach ( $logFile in $logFiles ) {

your code goes here

}
3

Hi,
Thanks, I tried the script. It is doing some thing, but the exact result is not coming.
Ex: I have five IIS logs files in a folder & running this script as below:

NOTE: Logfile names: u_ex160609.log, u_ex160610.log, u_ex160611.log, u_ex160612.log, u_ex160613.log
These keep on changing as per date.

$logFiles = Get-ChildItem -Path ‘C:\temp\Test’ -Filter *.log
foreach ( $logFile in $logFiles ) {

$col = {@()}.invoke()
switch -Regex -File $logFile
{
‘#Fields.*’ {$fields = $_}
‘\d+.externalsystemorderservice.’ {$col.add($Matches[0])}
}

$fields = $fields -replace ‘#Fields:’
$fields = $fields.trim() -split ’ ’
$col -replace ’ ‘,’,’ | convertfrom-csv -Header $fields |
Export-Csv -Path C:\temp\Test\final_dsfprdapp711.csv -NoTypeInformation
}

But, the date column is showing with latest log file date.

Any suggestions?

-Kalyan

4

Make this change. A csv is created for each log file.

Export-Csv -Path C:\temp\Test\final_$($logFile.basename).csv -NoTypeInformation
5

Do you want to have every single line in a separate csv file?

6

Hi,
I am planning to have all log files in one CSV file.
But the headers column should be only one.

-Kalyan

7

Hi,
To be more precise, requirement goes like the below:
I have seven logfiles.
> I need to go through each logfile and find a string (externalsystemorderservice) and get that line with limited headers (date,time,s-computername,s-ip,time-taken) to csv file.

All logfiles data to a single CSV file.

I am able to do for one logfile. But it comes to seven logfiles, I am not able to do.

-Kalyan

8

What does your first matched line and fields look like? You will need to specify headers for the lines in your collection before exporting.
This is an example.

$col | ConvertFrom-Csv -Header 'cs','cs-host','sc-status','sc-bytes' -Delimiter ' ' |
Export-Csv -Path C:\temp\Test\final_dsfprdapp711.csv -NoTypeInformation -Append

# Results
# cs                              cs-host                sc-status             sc-bytes             
# --                                -------                ---------             --------             
# https://domain.foo...  domain.foo           301                   581
9

Thanks. Let me try.

-Kalyan