table comparison

dataservices performance
1

I have 2 sources of data loading on to same dimension table.
Each source generate different set of primary keys for the target.

It is required to use table comparison.

Q)Is it possible to compare data from source1 with data alredy loded into
the dimension because of source1 only.
I feel that it is waste of time to compare the entire target.
Is there any way to achieve this?

shankar_bo (BOB member since 2009-10-19)

2

Not sure if I got your point. You are saying you have to merge (union all) two tables and load them via TC in one target but you fear that for some keys both, source1 and source2 has data and hence TC will not recognize it?


S1
   \
     -- Merge -- TC --- Target
   /
S2

And in TC you check the flag input-contains-duplicates so the transform will remember what rows have been inserted already and update the second occurrence hence.

Werner Daehn :de: (BOB member since 2004-12-17)