DS 4.1 - Installing Cleansing Package Problems

dataservices administration
1

I want to extend our existing Data Services 4.1 SP1 installation with the DQM 4.1 Cleansing Pack or to be more precise:


SBOP DQM CLEANSING PACKAGE 4.1
WINDOWS JUN-12
Number 51043266

So I’ve downloaded the file and I am following the instructions in the Data Services 4.1 Install Guide (Windows):

As described above, I copy the PEOPLE_FIRM.ZIP file into the mentioned directory. There is already a PEOPLE_FIRM.txt file in that location so I am pretty sure this is the right place to put the ~850 MB zip file. As instructed, I leave the file ZIPPED up.

Through Control Panel → Programs and Features → Uninstall/Change Data Services 4.1 I bring up the setup program where I select MODIFY.


But… in the tree list of options, I cannot select the Cleansing Package option!!

I checked this several times and I restarted the installer several times but no luck…

Any ideas?

ErikR :new_zealand: (BOB member since 2007-01-10)

2

Just checking: do you have a license for the DQ part? I guess so because you are working with UDT’s…

Johannes Vink :netherlands: (BOB member since 2012-03-20)

3

Yes, it’s the full Data Services license.

ErikR :new_zealand: (BOB member since 2007-01-10)

4

Manoj, Werner, anyone?

ErikR :new_zealand: (BOB member since 2007-01-10)

5

I solved the installation problem by not going to the control panel but to the local directory from where I had ran setup to install Data Services but this time I ensured that I kicked off the setup program with “Run as Administrator”.

After selecting “Modify” the installer would let me select the Cleaning Package option.

However, after installation I noticed that I still could not select any output columns from the Data Cleanse transform. Clearly something was still not right.

I ensured that the firewall was turned off to prevent any issues with ports etc. But still nothing.

But when I checked the installation log, I found this entry:


22:22:00.585 Error reading data deployment file(D:\Download\SAP\BODS 4.1 SP1\install\SAP_DATA_SERVICES_4.1_MULTIOS__DL__\DATA_UNITS\DS_41_WIN64\dunit\product.dataservices64-4.0-core-32\..\..\im.lac.ds.cpdata.cp-4.0-core-64\*\actions\data\PERSON_FIRM.txt).
Cannot find file: D:\Download\SAP\BODS 4.1 SP1\install\SAP_DATA_SERVICES_4.1_MULTIOS__DL__\DATA_UNITS\DS_41_WIN64\dunit\product.dataservices64-4.0-core-32\..\..\im.lac.ds.cpdata.cp-4.0-core-64\*\actions\data\PERSON_FIRM.txt
Fatal exception: Cannot find file: D:\Download\SAP\BODS 4.1 SP1\install\SAP_DATA_SERVICES_4.1_MULTIOS__DL__\DATA_UNITS\DS_41_WIN64\dunit\product.dataservices64-4.0-core-32\..\..\im.lac.ds.cpdata.cp-4.0-core-64\*\actions\data\PERSON_FIRM.txt

I put the PERSON_FIRM in the “im.lac.ds.cpdata.cp-4.0-core-64” directory under actions/data as the documentation told me to do so.

Does the above error make any sense to anybody???

UPDATE:

I completely uninstalled Data Services but left the config in place. I then reinstalled from the installer directory where I copied the PEOPLE_FIRM.ZIP into the right location.

Sure enough - I can now select the Cleansing Package as part of the installation. During the installation I point to the existing DSCONFIG and everything is up and running.

However, I still DO NOT get any output fields when dragging the Data Cleanse transform into the DF.

Also, when running the setup from Control Panel -> Programs and Features -> SAP Data Services 4.1 SP1 -> MODIFY … The Cleansing Package is unticked!!

So I’m now uninstalling Data Services again and this time I will wipe my DSCONFIG as well. Although I do have a feeling I’ll be having the same result .

I’m rapidly running out of ideas here though…

UPDATE 2: Ok, wiped the config, reinstalled Data Services and it didn’t make a darn difference.

Designer shows no output fields for the Data Cleanse transaction.
Also the Content Domain Sequence Option window shows no available values.

Forget good ideas… I’m open to any suggestion, good or bad, at this point. Or raise a SAP case?

ErikR :new_zealand: (BOB member since 2007-01-10)

6

Looking into the installer logs, I found that it had problems finding the PERSON_FIRM file.

I figured this maybe caused by the fact that the installer directory (where I had extracted the Data Services 4.1 package for installation) had spaces in the name. (“BODS 4.1 SP1”).

So I uninstalled the lot again, removed the DataServices directory from the SAP BusinessObjects folder, rebooted, renamed the installer directory and checked that none of its subdirectory names contained any spaces as well.

Reinstalled Data Services (for the 4th time). Following installation I checked the log and this is where it gets confusing.

It first raises again an error for not being able to find the files:

But the PERSON_FIRM.txt and PERSON_FIRM.zip files are located in the …\im.lac.ds.cpdata.cp-4.0-core-64\actions\data directory - as per the manual.

What is causing this error? Is the tree structure nested too deep? But anything after “D:\Download\SAP\BODS41SP1\install” was created automatically while extracting Data Services. Very odd. Should I try again with a shorter path?

But further in the log file - it reports this:

Now that seems to mark success to me! I can’t remember seeing this the first time around so perhaps we’re making progress?

Well not really - still the same old issue:

  1. I can’t get any output fields from the Data Cleanse transform.
  2. The DF raises these errors on validation:

But I am certain I have used the same configuration options as used in the SAP Data Cleanse Wiki and other examples. So it seems that Data Services simply does not have the PERSON_FIRM package installed at all?

I also can’t find these files anywhere:

Can I just extract the PERSON_FIRM.ZIP manually and put the files in the proper location?

Is there anyone else out there with the same issue? Or at least can provide some feedback on this topic?

ErikR :new_zealand: (BOB member since 2007-01-10)

7

Sorry, not many people are using cleansing packages I think… maybe it is better to open up a case with SAP… it should install out of the box correct and it seems to me that you have done all the investigation that you could have done…

Johannes Vink :netherlands: (BOB member since 2012-03-20)

8

I had the exact same issue. It was not a firewall problem.

Did you install the files to BOTH the job server and to your client machine where Designer is running?

eganjp :us: (BOB member since 2007-09-12)

9

Yes - as so far that we are using a single server for our 4.1 POC, using the Designer on that server. So it’s all one environment.

I discussed this problem with someone today that had a similar issue and he recommended downloading the DQM Cleansing Package 4.0 Installer (for BODS 4.0) … run that setup program and afterwards update the installed cleansing packages with the 4.1 PERSON_FIRM version.

I’ll give that a try as well.

ErikR :new_zealand: (BOB member since 2007-01-10)

10

It sucks that this is so difficult. It took us WEEKS to get it working.

eganjp :us: (BOB member since 2007-09-12)

11

I just noticed that my IPS is not feeling well - the EIM APS is refusing to start up, this could possibly be the cause of the DQM package installation issues. (Or the DQM package installer just wrecked the ISP - who knows!)

Off to another complete uninstall, cleanup and reinstall.

Seriously SAP - can you please make this a little easier on us? Installing Data Services XI 3.2 was an absolute walk in the park compared to this enduring nightmare.

ErikR :new_zealand: (BOB member since 2007-01-10)

12

This is where VMWare comes in handy. Once I get an install stable I make a clone of it so that if the next step totally hoses things up I can go back to the clone without having to start all over.

eganjp :us: (BOB member since 2007-09-12)

13

IPS reinstalled, DS reinstalled, all working fine and dandy … install DQM packages, set the subst. directories to point to the right folders … and still no Data Cleanse output. :hb: :hb:

I’m this close to recommend the customer to just buy Informatica PowerCenter 9. :reallymad:

On a more serious note:

I just noticed that the documentation states:

I actually do not have a directory called “im.lac.ds.cpdata.dp-4.0-core-64” in the InstallCache directory.

I do have a directory called “im.lac.ds.cpdata.cp-4.0-core-64” - is this a typo in the manual?

ErikR :new_zealand: (BOB member since 2007-01-10)

14

No, it’s not a typo. I recall that I had to create that directory also.

eganjp :us: (BOB member since 2007-09-12)

15

DUH! :blue: :blue:

Now that would explain the “file not found” error message I saw in the install log files earlier on!

OK, removing DS 4.1 again and starting from scratch.

Just for reference sake - when installing DS 4.1 SP1 directly (so no DS4.0 upgrade), do you still need to use the DQM Cleansing Package 4.0 installer?

Or can you use the method described in the 4.1 installation manual, which just means copying the PERSON_FIRM.ZIP in the directory described above?

Update:

On comparison, are you sure its not a typo in the manual?

Because for a new installation the manual refers the directory:

But to modify an existing installation, the manual refers to:

I would expect these directories to be named the same?

ErikR :new_zealand: (BOB member since 2007-01-10)

16

It’s been six months since I had to do the install. I’m sorry, but I don’t remember. Plus, we didn’t install 4.1. We were still on 4.0 at the time.

Attached is a document that our sysadmin put together to keep track of what we did to get it working. She’s way better than I am at documenting stuff like this and all credit goes to her for having made it work.
ISSUE_-_Blank_Output_Tab_in_PERSON_FIRM_EN.doc (197.0 KB)

eganjp :us: (BOB member since 2007-09-12)

17

Thanks Jim - that’s mighty nice of you! :+1: :+1: :yesnod:

I am rebuilding this system now and I will incorporate the steps in the document you so kindly shared with us!

ErikR :new_zealand: (BOB member since 2007-01-10)

18

Keep in mind this was for 4.0, not 4.1. Things may have changed.

eganjp :us: (BOB member since 2007-09-12)

19

Jim, if we are ever at a conference together your drinks will be on me.

Your hint about having to create the missing directory name (which obviously points to a huge typo in the manual!!!) seemed to have done the trick.

I removed IPS, DS and the packages and deleted all remaining files and directories to ensure a clean reinstall.

I then created the “dp” directory in the dunit directory (opposed to the “cp” directory as indicated in the manual) and placed the PERSON_FIRM.zip in that directory.

I then reinstalled IPS 4.0 SP4 and Data Services 4.1 SP1. After quickly creating a job server and a repository, I created a dataflow with a data cleanse transform and sure enough… it generated the output fields that it had been missing before! Magic!!

:+1: :+1: :+1: :+1:

:wave: :wave: :wave: :wave:

ErikR :new_zealand: (BOB member since 2007-01-10)

20

I am having the same issue here. I followed all the recomendations posted on this thread, but no luck. Anyone find a sure way to fix this without having to rely on ‘magic’?

Update: Figured out what is happening. The data cleanse package cannot be accessed while using Windows AD Authentication in Designer. I’m talking to SAP support about it.

DanHosler :us: (BOB member since 2013-06-19)