I have a requirement to extract from very large BW DSOs into Data Services 4.0 and further to HANA. For the HANA table I tried to enable bulk loading with a few parallel loaders.
I went by the book and created Open Hub destinations, Process Chains etc. The performance was surprisingly bad, though:
The load to Data Services didn’t start until Open Hub DTP completed. I guess it’s reasonable in order to avoid partial load of the data in case the DTP fails in the middle.
The load from Data Services to HANA didn’t start until all data has been read from BW – I checked that using the Batch Job Monitor and polling number of records in HANA. Now, that’s quite a surprise, and I wonder if the reason is the same as in #1. Having two points of “all or nothing” doesn’t make sense.
Have I missed to make some extra specific tunings? 4 Mio records in 4 hours is soooo 2000-s
Also, a side thought – with introduction of ODP, all this Open Hub-based extraction kinda loses the point: if ODP was able to work not only with ECC BusinessContent Extractors, but with BW Export DataSources (including customer-specific), wouldn’t it be faster and more convenient?
Codehopper (BOB member since 2010-05-14)