Hash Values in BODS

dataservices job design
1

Hello Experts,

I am a newbie to Data Services. We are using Data Services XI 3.0 Premium. I was given a task to identify duplicates by using hash values so that there is no loss of data and at the same time we can identify the duplicates. I was able to find that functionality in Oracle. But client wants the functionality in Data Services, before it loads into Oracle. I looked everywhere, couldn’t find the right information. Help would be really appreciated. Please let me know if any further information needed.
Thank you for going through my post. I really appreciate your time.

Thank you,
Sandeep.

sandeepgandam (BOB member since 2013-04-29)

2

Would you give some example on what you would like to achieve? I am not exactly following what you mean by Hash Value?

ganeshxp :us: (BOB member since 2008-07-17)

3

I’m not quite sure why you would create a hash value to compare rows but if that’s what you have to do…

The closest I see is the double_metaphone() function. I’ve never used it so it may not be what you want.

eganjp :us: (BOB member since 2007-09-12)

4

Hello Ganesh,

Thank you for responding. Hash value is nothing but, some number or string which gets generated based on the values we feed.
My purpose is to generate a string or numeric value for each row which is inserted into a table in database. That way I can identify the duplicates. I am not sure if I have explained it the right way. Here is a nice reference just in case: http://blogs.msdn.com/b/sqlsecurity/archive/2011/08/26/data-hashing.aspx
Client wants me to do hashing in BODS before the data hits the database.
Please let me know if anything needed.

Thank you,
Sandeep.

sandeepgandam (BOB member since 2013-04-29)

5

In your SQL Server DataStore, import the HashBytes() SQL function.
You can then use it throughtout Data Services.

Nicolas Hadj-Blaha :new_zealand: (BOB member since 2005-03-10)

6

Thank you Jim and Nicholas. I really appreciate your time. I will try to use sql function in BODS and see if it works.
Thank you for your help.

sandeepgandam (BOB member since 2013-04-29)