In one of the the earlier posts we had discussed the GoldenGate 12c Integrated Apply or Integrated Replicat feature. It enables high volume transactions to be applied in parallel.
But it was only supported for Oracle databases and also required to be version 11.2.0.4 and higher.
The Coordinated Replicat feature
This note describes how to run an Initial Load along with Change Data Capture from a source Oracle 11g R2 Active Standby database (ALO Archived Log Only mode capture) to a MS SQL Server 2012 target database.
The table is a 6.3 million row table – AC_AMOUNT in the IDIT_PRD
In this post we will look at three different methods of performing an initial data load from an Oracle 11g source database running on an HP-UX IA64 platform to a SQL Server 2012 target database hosted on Windows 2012 Datacenter.
The three methods we are using here are:
1) Oracle
We will look at an example of GoldenGate replication of a table having a BLOB column and how an INSERT and UPDATE statement on the table with BLOB data is handled by GoldenGate.
We create an APEX 4.2 application to illustrate this example where we create a form and report
After a recent Oracle GoldenGate installation at a client site running on Solaris 11, we observed memory related errors in the GoldenGate error log like the ones mentioned below as well as extract processes were abending on start up.
ERROR OGG-01841 CACHESIZE TOO SMALL:
ERROR OGG-01843 default maximum buffer size
The Oracle online redo log files contain both committed as well as uncommitted transactions, but Oracle GoldenGate only writes committed transactions to the trail files. So the question which can be asked is what happens to the transactions which are not committed or especially what happens to those uncommitted
The GoldenGate Director (Server and Client) is part of the Oracle GoldenGate Management pack suite of products.
Let us see how security is managed in the Director.
We launch the Director Administration tool on Unix via the run-admin.sh shell script.
If we are using Oracle WebLogic Server 12c and above
Let us look at an example of using Oracle Golden Gate to achieve a near zero (not zero!) downtime for performing an upgrade from Oracle 9i (9.2.0.5) to Oracle 11g (11.2.0.4) as well as a platform migration from Solaris SPARC to Linux X86-64.
With no downtime for the application we
Let us take a look at the process of configuring Goldengate 12c to work in an Oracle 12c Grid Infrastructure RAC or Exadata environment using DBFS on Linux x86-64.
Simply put the Oracle Database File System (DBFS) is a standard file system interface on top of files and directories that
At the recent Oracle Open World 2015 conference I was fortunate to attend a series of very informative presentations on Oracle GoldenGate from senior members of the Product Development team.
Among them was the presentation titled GoldenGate 12.2 New Features Deep Dive which is now available for download via the
One of the top new features introduced in Oracle GoldenGate 12.2 is the Self-describing trail files feature.
What this means is that no more do we have to worry about differences in table structures in the source and target databases and no more do we have to use the defgen
Oracle Goldengate 12.2 now provides support for replication of tables with INVISIBLE columns which was not possible in earlier releases.
Let us look at an example.
We create a table on both the source as well as target databases with both an INVISIBLE and VIRTUAL column COMMISSION.
SQLcreate table
Is Oracle GoldenGate really designed for batch processing or “large” transactions? – not sure what the official Oracle take on this is but I would hazard a guess and say maybe no. Maybe that is something better suited to an ETL type of product like Oracle Data Integrator.
Goldengate considers
In GoldenGate 12.2 we can now validate parameter files before deployment.
There is a new utility called chkprm which can be used for this purpose.’
To run the chkprm utility we provide the name of the parameter file and can optionally indicate what process this parameter file belongs to using the COMPONENT keyword.
Let us look at an example.
In earlier versions when we had to do an Oracle database table instantiation or initial load, we had to perform a number of steps – basically to handle DML changes which were occurring on the source table while the export was in progress.
So we had to first ensure that
This note describes the procedure used to configure high availability for Oracle GoldenGate 12.2 on Oracle Database Machine (Exadata X5-2) using Oracle Database File System (DBFS), Oracle Clusterware and Oracle Grid Infrastructure Agent.
The note also describes how we can create different DBFS file
The Goldengate INSERTALLRECORDS commands can be used in cases where the requirement is to have on the target database a transaction history or change data capture (CDC) tables which will keep a track of changes a table undergoes at the row level.
So every INSERT, UPDATE or DELETE statement on
Download the note on installing and configuring the 13.2.1.0.0 plug-in for OEM Cloud Control 13c Release 2 ….
https://gavinsoorma.com/wp-content/uploads/2016/12/OGG_OEM_13.2_plugin.docx
GoldenGate Monitor is a web-based monitoring console that provides a real-time graphical overview of all the Oracle GoldenGate instances in our enterprise.
We can view statistics and alerts as well as monitor the performance of all the related GoldenGate components in all environments in our enterprise from a single console.
This note outlines the procedure followed to upgrade GoldenGate 12.3 to the latest 18c version (18.1.0.0.0).
Note:
In this example, the source database version is higher than 11.2.0.4 and we are using Integrated Extract where DDL capture support is integrated into the database logmining server.
GGSCI (rac01.localdomain) 2> send ext1 showtrans Sending SHOWTRANS request to EXTRACT EXT1 ... No transactions found. GGSCI (rac01.localdomain) 3> send ext1 logend Sending LOGEND request to EXTRACT EXT1 ... YES
GGSCI (rac01.localdomain) 5> stop extract * Sending STOP request to EXTRACT EXT1 ... Request processed. Sending STOP request to EXTRACT PUMP1 ... Request processed.
Issue the command SEND REPLICAT with the STATUS option until it returns a status of “At EOF” to indicate that it finished processing all of the data in the trail file.
GGSCI (rac01.localdomain) 4> send rep1 status Sending STATUS request to REPLICAT REP1 ... Current status: At EOF Sequence #: 2 RBA: 1,538 0 records in current transaction. GGSCI (rac01.localdomain) 6> stop replicat * Sending STOP request to REPLICAT REP1 ... Request processed.
GGSCI (rac01.localdomain) 7> stop mgr ! Sending STOP request to MANAGER ... Request processed. Manager stopped.
We do not need to backup up the dirdat folder which contain the trail files.
It is recommended to upgrade both the source as well as target Oracle GoldenGate environments at the same time.
If we are not upgrading Replicat on the target systems at the same time as the source, add the following parameter to the Extract parameter file(s) to specify the version of Oracle GoldenGate that is running on the target.
This parameter causes Extract to write a version of the trail that is compatible with the older version of Replicat.
{EXTTRAIL | RMTTRAIL} file_name FORMAT RELEASE major.minor
For example:
EXTTRAIL ./dirdat/lt FORMAT RELEASE 12.3
Note: Ensure the checkbox to start the Manager is not ticked.
[oracle@rac01 sf_software]$ cd 181000_fbo_ggs_Linux_x64_shiphome [oracle@rac01 181000_fbo_ggs_Linux_x64_shiphome]$ cd fbo_ggs_Linux_x64_shiphome/ [oracle@rac01 fbo_ggs_Linux_x64_shiphome]$ cd Disk1 oracle@rac01 Disk1]$ ./runInstaller
[oracle@rac01 goldengate]$ sqlplus sys as sysdba SQL*Plus: Release 12.2.0.1.0 Production on Tue Jan 8 11:26:34 2019 Copyright (c) 1982, 2016, Oracle. All rights reserved. Enter password: Connected to: Oracle Database 12c Enterprise Edition Release 12.2.0.1.0 - 64bit Production SQL> @ulg.sql Oracle GoldenGate supplemental log groups upgrade script. Please do not execute any DDL while this script is running. Press ENTER to continue. PL/SQL procedure successfully completed.
Reposition both the existing Extract Pump as well as the Replicat processes to start reading from and processing the new trail file.
[oracle@rac01 goldengate]$ ./ggsci
Oracle GoldenGate Command Interpreter for Oracle
Version 18.1.0.0.0 OGGCORE_18.1.0.0.0_PLATFORMS_180928.0432_FBO
Linux, x64, 64bit (optimized), Oracle 12c on Sep 29 2018 04:22:21
Operating system character set identified as UTF-8.
Copyright (C) 1995, 2018, Oracle and/or its affiliates. All rights reserved.
GGSCI (rac01.localdomain) 1> info all
Program Status Group Lag at Chkpt Time Since Chkpt
MANAGER STOPPED
EXTRACT STOPPED EXT1 00:00:00 01:13:55
EXTRACT STOPPED PUMP1 00:00:00 01:13:55
GGSCI (rac01.localdomain) 2> alter extract ext1 etrollover
2019-01-08 00:44:13 INFO OGG-01520 Rollover performed. For each affected output trail of Version 10 or higher format, after starting the source extract, issue ALTER EXTSEQNO for that trail's reader (either pump EXTRACT or REPLICAT) to move the reader's scan to the new trail file; it will not happen automatically.
EXTRACT altered.
GGSCI (rac01.localdomain) 3> alter extract pump1 etrollover
2019-01-08 00:44:51 INFO OGG-01520 Rollover performed. For each affected output trail of Version 10 or higher format, after starting the source extract, issue ALTER EXTSEQNO for that trail's reader (either pump EXTRACT or REPLICAT) to move the reader's scan to the new trail file; it will not happen automatically.
EXTRACT altered.
GGSCI (rac01.localdomain) 4> info ext1 detail
EXTRACT EXT1 Initialized 2019-01-07 14:36 Status STOPPED
Checkpoint Lag 00:00:00 (updated 00:00:53 ago)
Log Read Checkpoint Oracle Integrated Redo Logs
2019-01-07 23:29:38
SCN 0.3272690 (3272690)
Target Extract Trails:
Trail Name Seqno RBA Max MB Trail Type
./dirdat/ogg1/lt 3 0 500 EXTTRAIL
GGSCI (rac01.localdomain) 5> alter pump1 extseqno 3 extrba 0
EXTRACT altered.
GGSCI (rac01.localdomain) 6> info pump1 detail
EXTRACT PUMP1 Initialized 2019-01-08 00:45 Status STOPPED
Checkpoint Lag 00:00:00 (updated 00:00:08 ago)
Log Read Checkpoint File /acfs_oh/app/goldengate/dirdat/ogg1/lt000000003
First Record RBA 0
Target Extract Trails:
Trail Name Seqno RBA Max MB Trail Type
./dirdat/ogg2/rt 3 0 500 RMTTRAIL
GGSCI (rac01.localdomain) 7> alter rep1 extseqno 3 extrba 0
2019-01-08 00:46:08 INFO OGG-06594 Replicat REP1 has been altered. Even the start up position might be updated, duplicate suppression remains active in next startup. To override duplicate suppression, start REP1 with NOFILTERDUPTRANSACTIONS option.
REPLICAT (Integrated) altered.
GGSCI (rac01.localdomain) 8> start mgr Manager started. GGSCI (rac01.localdomain) 9> info all Program Status Group Lag at Chkpt Time Since Chkpt MANAGER RUNNING EXTRACT STARTING EXT1 00:00:00 00:02:06 EXTRACT STARTING PUMP1 00:00:00 00:00:50 REPLICAT STARTING REP1 00:00:00 00:00:11 GGSCI (rac01.localdomain) 10> GGSCI (rac01.localdomain) 10> ! info all Program Status Group Lag at Chkpt Time Since Chkpt MANAGER RUNNING EXTRACT RUNNING EXT1 00:00:00 00:00:06 EXTRACT RUNNING PUMP1 00:00:00 00:00:07 REPLICAT RUNNING REP1 00:00:00 00:00:03