BusinessObjects Board

Flat File to Oracle Tuning.

dataservices performance
#1

Hi All,

I am new to BODI and would like some feedback on performance tuning.

I am reading from a text file with pipe-delimited data. Each record is 4K at most. The DEV machine and DB are not the fastest, but I think these numbers seem too slow for an ETL tool for me. Any feedback would be appreciated.

Run # #Records Array Fetch Size Appr. Total Time (min)

1 10000 1000 12.5
2 10000 2000 12
3 10000 5000 13

andresimmons1 (BOB member since 2008-06-03)

#2

I would run the benchmark:

Could be network, swamped disk I/O, etc.

  • Ernie

eepjr24 :us: (BOB member since 2005-09-16)

#3

Here seems to be a major culprit in the performance.

select (PURCHASE_DATE - SUBJECT_DOB)/365 from PURCHASE where TRAN_ID=’’||$TranID||’’ AND SOURCE_RECORD_ID=’’||$inRecordId||’’’

We have this as a mapping to a field in a query transformer. We are using the Oracle DB to calculate the age of a subject at the time they made a purchase. We want to know if they were a minor (< 18yr old). Can this time of date arithmetic be done with BODI. I am a Java guy and know how to do it in Java, but do not know the flexibility of the scripting language in BODI.

Any examples would be appreciated.

andresimmons1 (BOB member since 2008-06-03)

#4

That would be best accomplished by a lookup or if you have both fields available at that point you could use:

date_diff(PURCHASE_DATE, SUBJECT_DOB, 'D')/365
  • Ernie

eepjr24 :us: (BOB member since 2005-09-16)

#5

Thanks… that seems to have done the trick…

andresimmons1 (BOB member since 2008-06-03)