BusinessObjects Board

do it faster ? sybase -> oracle

dataservices performance
#1

Hi,
i ve got a simple dataflow working like this:

source(view sybase 12x ASE- 700k rows) -> query -> target(table oracle 10g)

there is no change between the two tables but im really surprise by the time of execution! 16 min!

For the load, i only use parameter by default.
Before this DF, i use a script to drop and create the target.

Have you a way to perform faster this DF?

thanks for your answers

edit:

I ve change the script of table’s creation by adding the CACHE command and i change parameter of load by using API/TRUNCATE/commit 10000.
Its a bit faster :wink: -> 8min

I havn’t precised, i drop and create table but also, create index and after DF runnig, i analyzed the table.

The last but not the least, i m using DI 11.5

cau :fr: (BOB member since 2007-05-30)

#2

https://wiki.sdn.sap.com:443/wiki/display/BOBJ/Performance+of+Reader%2C+Engine+and+Loader

https://wiki.sdn.sap.com:443/wiki/display/BOBJ/High+Performance+Loads+with+Oracle

You could run the benchmark and compare with others: Benchmark YOUR hardware and compare the results V1.1

Werner Daehn :de: (BOB member since 2004-12-17)

#3

thanks for your answer.
I will test the benchmark to see my performance!

cau :fr: (BOB member since 2007-05-30)

#4

If you execute SELECT COUNT(*) FROM VIEW how long does it take? If you aren’t doing anything special in your data flow (Table->Table) I don’t know that enabling cache would be of much benefit. The bulk loader commit has been show to be about optimal at 5,000. 10,000 may be a bit high but probably isn’t a huge negative on performance.

If you don’t have a simple data flow check to see what the optimized SQL is. It might be doing something that you aren’t expecting. Perhaps you could change or simplify something that would greatl improve the performance.

eganjp :us: (BOB member since 2007-09-12)

#5

I would agree that the most likely bottleneck is the sybase view. Look into tuning that view. I can move 700K records in less than a minute when moving from Oracle to Oracle.

Also make sure your monitoring rate is set to 50,000 (instead of default 1000) as that can affect performance by writing too many log messages.

Chris

cfachris :us: (BOB member since 2003-09-03)