bulk loading with append option

dataservices job design
1

In the dataflow one query transform is used and in target table bulk loading is enabled with the Append mode . the data is already loaded with this option. Now today I got new file to load which contains new data as well it have the same data which target table already have. If I load this file I will have the duplicate data in the target. how I can get only the new data from source to the target . I want the previous data as well with the new data. Please help me. What setting I need to do to achieve this.
Example–target data---- a 123, b 456 source-- c 678, a 123, d 567

Now target should have a 123
b 456
c 678
d 567

I have to achieve this without changing append mode.

Jyotimoon (BOB member since 2017-07-17)

2

Add the target table as another source table
Add to the query with an outer join to the original source table
Add a where clause where new source table is null

Output of the query should now only be from the original source table where a match was not found in the target table

Otherwise, use a Table Comparison transform and a couple of data flows.

Darth Services :uk: (BOB member since 2007-11-20)