Metadata Integrator

dataservices metadata reports
1

Hi,
I have configured Metadata Integrator(BODS XI3.1) with BOE CMC to collect metadata of BOE XI3.1(Reports and Universe).

I have used Administrator login to configure the integrator. After running the Job in CMC. I can see metadata of CMC in to my local repository (Management Console - Impact Analysis). But Its only shows the default universe and reports which comes along with BOE installation, None of my Webi Report is listed.

What is the reason for not showing any of my Webi report metatdata. I am not able to carry out impact analysis

Thanks
Rajendra

rajendra.c (BOB member since 2009-08-10)

2

check if the CMS Collector is able to collect all the objects successfully
check the history of the meteadata integrator object in CMC, click on the run date and time this will open the output file of the program which will have the details of the collection

do you see lot of errors and warnings for collection in that file?

manoj_d (BOB member since 2009-01-02)

3

Yes… here is the error log. Not able to make out any thing out of it…

CMS Version: 1210
Locale= en_US
CMS Version: 1210
Metadata Integrator version: 12.1.1.1
Collecting metadata that has changed since: 2009 08 18 05 13 58 187
Aug 18, 2009 6:19:35 AM com.acta.db.ActaDbManager addDBConnectionFactory
SEVERE: Unable to create connection factory for Informix:com.acta.db.ActaInformixConnectionFactory. null (BODI-3013019)
Aug 18, 2009 6:19:35 AM com.acta.db.ActaDbManager init
INFO: Delaying the loading of DB2 JDBC driver classes. (BODI-3013011)
CMS folder processed [Universes]
CMS folder processed [Report Conversion Tool Universes]
CMS folder processed [webi universes]
CMS folder processed [IP Universe]
CMS folder processed [Administration Tools]
CMS folder processed [Auditor]
CMS folder processed [en]
CMS folder processed [Calculate Compression Charges]
CMS folder processed [Daily Meter Prime Reconciliation]
CMS folder processed [Data Services]
CMS folder processed [Email Reporting Service]
CMS folder processed [Email Reports]
CMS folder processed [Feature Samples]
CMS folder processed [IFA Invoice]
CMS folder processed [Large Load Reports]
CMS folder processed [LDZ Capacity Invoice]
CMS folder processed [Management Information]
CMS folder processed [MOD 517]
CMS folder processed [NG Shared area Reports]
CMS folder processed [P&S Daily Meter Online Reconciliation]
CMS folder processed [Postcode Allocation Error Analysis]
CMS folder processed [Report Conversion Tool]
CMS folder processed [Report Conversion Tool Documents]
CMS folder processed [Report Conversion Tool Audit Documents]
CMS folder processed [Report Conversion Tool Temporary Documents]
CMS folder processed [Report Samples]
CMS folder processed [Demonstration]
CMS folder processed [Feature Samples]
CMS folder processed [Financial]
CMS folder processed [IP Universe Reports]
CMS folder processed [Report Data]
CMS folder processed [Run AQ Tracker]
CMS folder processed [Schedule Adhoc Invoice]
CMS folder processed [Search Program]
CMS folder processed [Terminations]
CMS folder processed [TOG Reports]
CMS folder processed [User Folders]
CMS folder processed [Weekly Reporting]
Start universe collection: 0 universes to process.
CMS Version: 1210
Desktop Intelligence document collector thread started.
Start Crystal report collection. 0 reports to process.
Start Web Intelligence document collection. 3 reports to process.
WebI document [IFA Validation]. Start collection for Web Intelligence Document.
Start Desktop Intelligence document collection. 0 reports to process.
WebI document [IFA Validation]. Added universe usage. univ: [IP Universe ITR-1], class: [Etl Exception Item], obj: [Field Name]
WebI document [IFA Validation]. Added universe usage. univ: [IP Universe ITR-1], class: [Etl Exception Item], obj: [Field Data]
WebI document [IFA Validation]. Added universe usage. univ: [IP Universe ITR-1], class: [Etl Process Filter], obj: [Etl Process Name]
WebI document [IFA Validation]. Added universe usage. univ: [IP Universe ITR-1], class: [Etl Process Filter], obj: [Etl Filter Name]
WebI document [IFA Validation]. Added universe usage. univ: [IP Universe ITR-1], class: [Etl Process Filter], obj: [Etl Process Name]
WebI document [Large Loads Exceptions]. Start collection for Web Intelligence Document.
WebI document [Large Loads Exceptions]. Added universe usage. univ: [IP Universe ITR-1], class: [Confirmation], obj: [Confirmation Reference Number]
WebI document [Large Loads Exceptions]. Added universe usage. univ: [IP Universe ITR-1], class: [Confirmation], obj: [AQ]
WebI document [Large Loads Exceptions]. Added universe usage. univ: [IP Universe ITR-1], class: [Confirmation Dates], obj: [Confirmation Effective Date]
WebI document [Large Loads Exceptions]. Added universe usage. univ: [IP Universe ITR-1], class: [Confirmation Dates], obj: [Confirmation End Date]
WebI document [Large Loads Exceptions]. Added universe usage. univ: [IP Universe ITR-1], class: [Customer], obj: [Shipper Short Code]
WebI document [Large Loads Exceptions]. Added universe usage. univ: [IP Universe ITR-1], class: [Customer], obj: [Shipper Name]
WebI document [Large Loads Exceptions]. Added universe usage. univ: [IP Universe ITR-1], class: [Gas Nomination Type], obj: [Gas Nomination Type Code]
WebI document [Large Loads Exceptions]. Added universe usage. univ: [IP Universe ITR-1], class: [Meter Point], obj: [MP In Code]
WebI document [Large Loads Exceptions]. Added universe usage. univ: [IP Universe ITR-1], class: [Meter Point], obj: [MP Out Code]
WebI document [Large Loads Exceptions]. Added universe usage. univ: [IP Universe ITR-1], class: [Meter Point], obj: [MP Reference Number]
WebI document [Large Loads Exceptions]. Added universe usage. univ: [IP Universe ITR-1], class: [Network Zone], obj: [Local Distribution Zone Id]
WebI document [Large Loads Exceptions]. Added universe usage. univ: [IP Universe ITR-1], class: [Site], obj: [Large Load Flag]
WebI document [Large Loads Exceptions]. Added universe usage. univ: [IP Universe ITR-1], class: [Supply Point], obj: [Supply Point Id]
WebI document [Large Loads Exceptions]. Added universe usage. univ: [IP Universe ITR-1], class: [Supply Type], obj: [Supply Type Code]
WebI document [Large Loads Exceptions]. Added universe usage. univ: [IP Universe ITR-1], class: [Meter Point], obj: [MP Building Name]
WebI document [Large Loads Exceptions]. Added universe usage. univ: [IP Universe ITR-1], class: [Meter Point], obj: [MP Principal Street]
WebI document [Large Loads Exceptions]. Added universe usage. univ: [IP Universe ITR-1], class: [Meter Point], obj: [MP Post Town]
WebI document [Large Loads Exceptions]. Added universe usage. univ: [IP Universe ITR-1], class: [Meter Point], obj: [MP County]
WebI document [Large Loads Exceptions]. Added universe usage. univ: [IP Universe ITR-1], class: [Confirmation Dates], obj: [Month of Confirmation Effective Date]
WebI document [Large Loads Exceptions]. Added universe usage. univ: [IP Universe ITR-1], class: [Months and Dates], obj: [Month of Previous Month]
WebI document [Large Loads Exceptions]. Added universe usage. univ: [IP Universe ITR-1], class: [Months and Dates], obj: [Year of Previous Month]
WebI document [Large Loads Exceptions]. Added universe usage. univ: [IP Universe ITR-1], class: [Confirmation Dates], obj: [Year of Confirmation Effective Date]
WebI document [Large Loads Exceptions]. Added universe usage. univ: [IP Universe ITR-1], class: [Meter Point], obj: [End Date]
WebI document [Large Loads Exceptions]. Added universe usage. univ: [IP Universe ITR-1], class: [Confirmation], obj: [End Date]
WebI document [Large Loads Exceptions]. Added universe usage. univ: [IP Universe ITR-1], class: [Site], obj: [Large Load Flag]
WebI document [Large Load Report]. Start collection for Web Intelligence Document.
WebI document [Large Load Report]. Added universe usage. univ: [IP Universe ITR-1], class: [Confirmation], obj: [Confirmation Reference Number]
WebI document [Large Load Report]. Added universe usage. univ: [IP Universe ITR-1], class: [Confirmation], obj: [AQ]
WebI document [Large Load Report]. Added universe usage. univ: [IP Universe ITR-1], class: [Confirmation Dates], obj: [Confirmation Effective Date]
WebI document [Large Load Report]. Added universe usage. univ: [IP Universe ITR-1], class: [Confirmation Dates], obj: [Confirmation End Date]
WebI document [Large Load Report]. Added universe usage. univ: [IP Universe ITR-1], class: [Consumption Dates], obj: [Gas Flow Date]
WebI document [Large Load Report]. Added universe usage. univ: [IP Universe ITR-1], class: [Consumption Dates], obj: [Month of Gas Flow Date]
WebI document [Large Load Report]. Added universe usage. univ: [IP Universe ITR-1], class: [Consumption Dates], obj: [Year of Gas Flow Date]
WebI document [Large Load Report]. Added universe usage. univ: [IP Universe ITR-1], class: [Consumption], obj: [Energy Value]
WebI document [Large Load Report]. Added universe usage. univ: [IP Universe ITR-1], class: [Gas Nomination Type], obj: [Gas Nomination Type Code]
WebI document [Large Load Report]. Added universe usage. univ: [IP Universe ITR-1], class: [Customer], obj: [Shipper Short Code]
WebI document [Large Load Report]. Added universe usage. univ: [IP Universe ITR-1], class: [Meter Point], obj: [MP Reference Number]
WebI document [Large Load Report]. Added universe usage. univ: [IP Universe ITR-1], class: [Meter Point], obj: [MP Building Name]
WebI document [Large Load Report]. Added universe usage. univ: [IP Universe ITR-1], class: [Network Zone], obj: [Local Distribution Zone Id]
WebI document [Large Load Report]. Added universe usage. univ: [IP Universe ITR-1], class: [Network Zone], obj: [Exit Zone Id]
WebI document [Large Load Report]. Added universe usage. univ: [IP Universe ITR-1], class: [Supply Point], obj: [Supply Point Id]
WebI document [Large Load Report]. Added universe usage. univ: [IP Universe ITR-1], class: [Supply Type], obj: [Supply Type Code]
WebI document [Large Load Report]. Added universe usage. univ: [IP Universe ITR-1], class: [Site], obj: [Site Reference Id]
WebI document [Large Load Report]. Added universe usage. univ: [IP Universe ITR-1], class: [Site], obj: [Site Reference Name]
WebI document [Large Load Report]. Added universe usage. univ: [IP Universe ITR-1], class: [Site], obj: [LDZ Name]
WebI document [Large Load Report]. Added universe usage. univ: [IP Universe ITR-1], class: [Site], obj: [Site Street Name]
WebI document [Large Load Report]. Added universe usage. univ: [IP Universe ITR-1], class: [Site], obj: [Site Town]
WebI document [Large Load Report]. Added universe usage. univ: [IP Universe ITR-1], class: [Site], obj: [Site County]
WebI document [Large Load Report]. Added universe usage. univ: [IP Universe ITR-1], class: [Site], obj: [Large Load Flag]
WebI document [Large Load Report]. Added universe usage. univ: [IP Universe ITR-1], class: [Site], obj: [Large Load Flag]
WebI document [Large Load Report]. Added universe usage. univ: [IP Universe ITR-1], class: [Confirmation], obj: [End Date]
WebI document [Large Load Report]. Added universe usage. univ: [IP Universe ITR-1], class: [Meter Point], obj: [End Date]
Web Intelligence collection progress: 3 of 3 completed
Folder collection complete. Total 38: 38 successfully added; 0 errors
Universe collection complete. Total 0: 0 successfully added; 0 added with warnings; 0 errors
Crystal Report collection complete. Total 0: 0 successfully added; 0 added with warnings; 0 errors
Web Intelligence document collection complete. Total 3: 3 successfully added; 0 added with warnings; 0 errors; 0 in personal folder and not processed
Desktop Intelligence document collection complete. Total 0: 0 successfully added; 0 added with warnings; 0 errors
CMS folder processed [Root Folder 98]
CMS folder processed [Dynamic Cascading Prompts]
Processing Business View: Customer Name_BV
Processing Business View: Country > Region > City_BV
Processing Business View: Country > Region > City_BV_1

An unexpected error has been detected by HotSpot Virtual Machine:

EXCEPTION_ACCESS_VIOLATION (0xc0000005) at pc=0x6d81dc26, pid=3136, tid=9436

Java VM: Java HotSpot™ Client VM (1.5.0_11-b03 mixed mode)

Problematic frame:

V [jvm.dll+0xddc26]

An error report file with more information is saved as hs_err_pid3136.log

If you would like to submit a bug report, please visit:

http://java.sun.com/webapps/bugreport/crash.jsp

Thanks
Rajendra

rajendra.c (BOB member since 2009-08-10)

4

how many WebI documents you have in your BOE system ? the MetadataIntegrator runs in incremental mode, so it will collect only the object modfied since last run

to force collector to run in Full Extract mode, open the
%LINK_DIR%/ext/cmsCollector/conf/crawler.xml file in wordpad and search for tag set this value to null

change something as below
1233956805055
to

and run the MetadataIntegrator again from CMC

from the log you have only 3 WebI reports that it can collect, one more thing MetadataIntegrator doesn’t collects reports that are in Personal Folder, it will collect reports that are in Public folders

manoj_d (BOB member since 2009-01-02)

5

Moving this thread into the DI “Metadata” sub-forum.

dnewton :us: (BOB member since 2004-01-30)

6

I have around 266 Webi Report. This the first time i am running for the repsitory…

Thanks
Rajendra

rajendra.c (BOB member since 2009-08-10)

7

have you tried by setting the lastcrawlerrun value to null ?
are these reports in public folder in BOE ?

manoj_d (BOB member since 2009-01-02)

8

I test after removing the value from xml. This time it ran and collected all data.

However, when i try to run a lineage report from Management Console for report, I am getting following error:

  1. When i click lineage, I get
    “Unable to retrieve columns from Data Services”

  2. For reports which are using derived tables, the lineage report only
    shows data till universe objects

rajendra.c (BOB member since 2009-08-10)

9

this error will happen if the table and column doesn’t exists in DI, DI is not able to find the column for the table that the report is using

Metadata Integrator for CMS provided with Data Services is not capable of extracting details information for Derived tables, it will stop at Derived table. This functionality is available in Metadata Management (BOMM)

manoj_d (BOB member since 2009-01-02)