Eclipse Community Forums: BIRT » Concatenating logfiles as datasource based on report parameters

Home » Archived » BIRT » Concatenating logfiles as datasource based on report parameters

Concatenating logfiles as datasource based on report parameters [message #856031]

Wed, 25 April 2012 05:54

Eclipse User

Hey there,

I have a folder full of log files. Each logfile contains 3 columns:

functionName (String of the function that is called)
data (dateTime of the measurement)
calls (integer of the number of calls in the 5 minute period)

I have 2 servers that each make one logfile a day.

Now what I want to do is to select the appropriate logfiles based on report paramters (e.g. select the data of both servers for the last two days) and merge/join these in one datasource so I can visualize the data.

When joining logfiles from the same server, I just want to keep the 3 columns, but more rows.
When joining logfiles from different servers, I want 4 columns. The 4th column indicates which server produced the data.

Can this be done within Birt? I know of joint data sets, but these produce more columns.

I added 4 example logfiles.

Thanks in advance!

Attachment: s01_2011-1-1.tsv
(Size: 26.04KB, Downloaded 159 times)
Attachment: s01_2011-1-2.tsv
(Size: 26.03KB, Downloaded 149 times)
Attachment: s02_2011-1-1.tsv
(Size: 26.04KB, Downloaded 144 times)
Attachment: s02_2011-1-2.tsv
(Size: 26.06KB, Downloaded 268 times)

Re: Concatenating logfiles as datasource based on report parameters [message #856418 is a reply to message #856031]

Wed, 25 April 2012 12:34

Eclipse User

You can do this but you will have to use a scripted data source. Take a
look at the attached example that combines multiple csv files. You
could add some parameters to determine which tsv files to combine.

Jason

On 4/25/2012 5:54 AM, Ruben Durk wrote:
> Hey there,
>
> I have a folder full of log files. Each logfile contains 3 columns:
>
> functionName (String of the function that is called)
> data (dateTime of the measurement)
> calls (integer of the number of calls in the 5 minute period)
>
> I have 2 servers that each make one logfile a day.
>
> Now what I want to do is to select the appropriate logfiles based on report paramters (e.g. select the data of both servers for the last two days) and merge/join these in one datasource so I can visualize the data.
>
> When joining logfiles from the same server, I just want to keep the 3 columns, but more rows.
> When joining logfiles from different servers, I want 4 columns. The 4th column indicates which server produced the data.
>
> Can this be done within Birt? I know of joint data sets, but these produce more columns.
>
> I added 4 example logfiles.
>
> Thanks in advance!

Attachment: combinecsv.zip
(Size: 2.47KB, Downloaded 242 times)

Re: Concatenating logfiles as datasource based on report parameters [message #857116 is a reply to message #856418]

Thu, 26 April 2012 04:57

Eclipse User

I see! Thanks, haven't looked into scripted sources yet.

Previous Topic:	Using joined Dataset twice
Next Topic:	Problem with Birt Viewer 3.7.1 using Scripted data source

Goto Forum:

-=] Back to Top [=-

Current Time: Tue Jul 22 23:44:45 EDT 2025

.:: Contact :: Home ::.

Breadcrumbs

Sign up to our Newsletter