Table_Comparison and flat file

dataservices job design
1

Hello,

I try to do a Table_Comparison with, as a “schema in”, a standard table, from a datastore and as “schema out” a flat file structure. I tried almost everything in “Table name” field, it doesn’t work…

I tried FF_AIMS_Cargo_Tmp.“D:\Projets\Arrivals.tmp” (Where FF_AIMS_Cargo_Tmp" is the name of my File Format), FF_AIMS_Cargo_Tmp.$_GlobalVariableWithPath
…

Someone can help me ?

Thank you

monnyann (BOB member since 2009-08-13)

2

TC transform needs a comparison table, flat file is not allowed (how would you update a row in a file?)

Werner Daehn :de: (BOB member since 2004-12-17)

3

Hello wdaehn,

I don’t want to update a flat file. In fact, I just need the structure of it. After my TC, I use a Map_Operation, where I change “Insert” to “Normal”. Just after, i use a query to fill another flat file, with the same type thant the first one.

But I’ll use a Template Table (instead of this flat file), it will be more easier.

Thank you for your help

monnyann (BOB member since 2009-08-13)

4

Not getting it. The output structure is the structure of the comparison table specified in the TableComparison transform. And this comparison table has to be a table, not file.

Werner Daehn :de: (BOB member since 2004-12-17)

5

To say it a different way:

You cannot use a Table Compare if the target of your dataflow is a Flat File. The Target must be a Table. (That’s why it’s called Table Compare.)

So in the dropdown field at the top of the Table Compare, the Table Name, you need to pick a datastore, and then the table from inside a datastore, that matches your target table.

dnewton :us: (BOB member since 2004-01-30)

6

Okay I also have a similar Requirement.

Any suggestions like a optimum way to do a Incremental Load where the Target is going to be a Flat File

I am thinking about the Persistent Cache concept. However, if my target is going to have some 10 Millon records or some sort of count, then the time it is going to Load in a new file is going to be long.

Some idea on this requirement? Please pour here

ganeshxp :us: (BOB member since 2008-07-17)

7

I would still use Table Comparison against a database table. And then read the database table for all the changes made and copy that into the flat file.

Werner Daehn :de: (BOB member since 2004-12-17)

8

Using Persistent Cache or a DB table will be the same performance? Please suggest

ganeshxp :us: (BOB member since 2008-07-17)

9

Under normal conditions the persistent cache will be slightly slower, but still fast enough.

Werner Daehn :de: (BOB member since 2004-12-17)