Today we will look at usage/preference of Change Data Capture and Journal tables in ODI
Journal Tables : Creating a journal tables have a copy/track a table whether you insert the records or update the records the journal table itself have the copy of updated/inserted record.
Change Data Capture : Oracle Changed Data Capture Adapters offer log-based change data capture (CDC) for enterprise data sources such as CICS(Customer Information Control System - Transactional server) Captured changes are stored in a storage called Staging Area (which is different from the Oracle Data Integrator interfaces' staging areas).
Oracle Data Integrator supports two journalizing modes:
Open Designer Goto Model->Data Store -->Table -->Right click Change Data Capture .In the below scree i added employee table to CDC
- Simple Journalizing tracks changes in individual datastores in a model.
- Consistent Set Journalizing tracks changes to a group of the model's datastores, taking into account the referential integrity between these datastores. The group of datastores journalized in this mode is called a Consistent Set.
Open Designer Goto Model->Data Store -->Table -->Right click Change Data Capture .In the below scree i added employee table to CDC
Subscribing a table :
In the below you need to enter your subscriber name "Employee_Details" and click on Down arrow button click ok.
In the below you need to enter your subscriber name "Employee_Details" and click on Down arrow button click ok.
Session creation for the Subscriber :
Once you click on OK it will start a session you can refer whether your session is executed or not.Goto Operator there you can find log.
Details will be stored in SNP_CDC_SUBS table
Two triggers (DT$
UT$Employee_Details & DT$Employee, one trigger will monitor for any updates or inserts and the other monitors deletions. Once a change occurs a table named J$
Inserted a record in Employee you can see the J$DEmployee_Detail view has been updated.
Where JRN_Flag : I - Insert/Update.
D - Delete.
- JRN_FLAG: Flag indicating the type of change. It takes the value I for an inserted/updated record and D for a deleted record.
- JRN_SUBSCRIBER: Name of the Subscriber.
- JRN_DATE: Timestamp of the change
We can view the journalized data from the desinger itself Right click on table-->CDC-->Journal Data it will show all journalized data.
Note: Without having primary key you can't subscriber a table
Reference :
http://john-goodwin.blogspot.com/2009/02/odi-series-essbaseplanning-automating.html
http://download.oracle.com/docs/cd/B10500_01/server.920/a96520/cdc.htm
http://gerardnico.com/wiki/dit/odi/cdc
Hi Friends,
ReplyDeleteChange data capture is a set of software design patterns used to determine the data that has changed so that action can be taken using the changed data. Also, it is an approach to data integration that is based on the identification, capture and delivery of the changes made to enterprise data sources. Thanks for sharing it.......
Hi all...
ReplyDeleteChange data capture is designed to capture insert, update, and delete activity applied to SQL Server tables, and to make the details of the changes available in an easily consumed relational format.
Thanks.
hi,
ReplyDeletecan anyone please provide screenshots for Log Based Change data Capture
Regards,
Hemamalini.