Eclipse Community Forums: BIRT » Concatenating logfiles as datasource based on report parameters

Help

Home

Home » Archived » BIRT » Concatenating logfiles as datasource based on report parameters

Show: Today's Messages :: Show Polls :: Message Navigator

Concatenating logfiles as datasource based on report parameters [message #856031]

Wed, 25 April 2012 09:54

Ruben Durk

Messages: 8
Registered: April 2012

Junior Member

Hey there,

I have a folder full of log files. Each logfile contains 3 columns:

functionName (String of the function that is called)
data (dateTime of the measurement)
calls (integer of the number of calls in the 5 minute period)

I have 2 servers that each make one logfile a day.

Now what I want to do is to select the appropriate logfiles based on report paramters (e.g. select the data of both servers for the last two days) and merge/join these in one datasource so I can visualize the data.

When joining logfiles from the same server, I just want to keep the 3 columns, but more rows.
When joining logfiles from different servers, I want 4 columns. The 4th column indicates which server produced the data.

Can this be done within Birt? I know of joint data sets, but these produce more columns.

I added 4 example logfiles.

Thanks in advance!

Attachment: s01_2011-1-1.tsv
(Size: 26.04KB, Downloaded 140 times)
Attachment: s01_2011-1-2.tsv
(Size: 26.03KB, Downloaded 130 times)
Attachment: s02_2011-1-1.tsv
(Size: 26.04KB, Downloaded 123 times)
Attachment: s02_2011-1-2.tsv
(Size: 26.06KB, Downloaded 247 times)

Report message to a moderator

Re: Concatenating logfiles as datasource based on report parameters [message #856418 is a reply to message #856031]

Wed, 25 April 2012 16:34

Jason Weathersby

Messages: 9167
Registered: July 2009

Senior Member

You can do this but you will have to use a scripted data source. Take a
look at the attached example that combines multiple csv files. You
could add some parameters to determine which tsv files to combine.

Jason

On 4/25/2012 5:54 AM, Ruben Durk wrote:
> Hey there,
>
> I have a folder full of log files. Each logfile contains 3 columns:
>
> functionName (String of the function that is called)
> data (dateTime of the measurement)
> calls (integer of the number of calls in the 5 minute period)
>
> I have 2 servers that each make one logfile a day.
>
> Now what I want to do is to select the appropriate logfiles based on report paramters (e.g. select the data of both servers for the last two days) and merge/join these in one datasource so I can visualize the data.
>
> When joining logfiles from the same server, I just want to keep the 3 columns, but more rows.
> When joining logfiles from different servers, I want 4 columns. The 4th column indicates which server produced the data.
>
> Can this be done within Birt? I know of joint data sets, but these produce more columns.
>
> I added 4 example logfiles.
>
> Thanks in advance!