Data Change Stream Tutorials

Set up Faircom DB (or RTG) to be able to be a Data Change Streaming source server.

Add the REPL_NODEID <nodeid> configuration option to the server configuration file, ctsrvr.cfg. Specify the <nodeid> value in IPv4 format, for example 10.0.0.1. The value should be unique for each FairCom server that is used in the system.

REPL_NODEID  10.0.0.1

If DBNotify has been used, disable it. It is not possible to use DBNotify and Data Change Streaming together.

	{
		"serviceName": "dbnotify",
		"serviceLibrary": "./dbnotify/fcdbnotify.dll",
		"enabled": false
	},

Configure Faircom MQ to use the Data Change Streaming API.

Enable the datachangestream plugin in the otherServices array in services.json.

"otherServices": [
  {
	"serviceName": "datachangestream",
	"serviceLibrary": "./datachangestream/datachangestreamservice.dll",
	"enabled": true
  }
]

Restart FairCom DB and FairCom MQ

In Faircom DB (or RTG), create the custmast table within the ctreeSQL database.

There are two SQL scripts to assist with this tutorial. The custmast1.sql script creates files to monitor, and custmast2.sql modifies the files. Copy both of the script files to your .\tools directory.

copy config\x509.auth.demo\custmast1.sql .\tools
copy config\x509.auth.demo\custmast2.sql .\tools

Run the following command from the .\tools directory to create custmast.

isql -s custmast1.sql -u ADMIN -a ADMIN ctreeSQL

INIT
DEFINE
Create table...
MANAGE
Add records...
1 record inserted.
1 record inserted.
1 record inserted.
1 record inserted.
Display records...
NUMBER NAME
------ ----
1000 Bryan Williams
1001 Michael Jordan
1002 Joshua Brown
1003 Keyon Dooling
4 records selected
DONE

The resulting files are saved in <faircom>/data/ctreeSQL.dbs

Create Data Change Streaming connection.

Within Faircom MQ, start the FairCom browser-based tool MQ Explorer. Pull down the hamburger menu (the 3 horizontal bars in the top left) and select "API Explorer". In the API Request editor place the following JSON:

{
  "api": "admin",
  "action": "createStreamingConnection",
  "params": {
    "streamingConnectionName": "db1",
    "sourceServers": [
      {
        "purpose": "Primary Server",
        "sourceServerName": "FAIRCOMS",
        "sourceHostname": "localhost",
        "sourceUsername": "ADMIN",
        "sourcePassword": "ADMIN"
      }
    ],
    "metadata": {}
  },
  "authToken":"' + token + '"
}

Click Apply defaults to JSON request (

) to replace the "authToken" value with the valid one from your session.

Click Send request (

) to issue the JSON-based request.

Observe the response and ensure the action is completed successfully.

Start Data Change Streaming connection for custmast file.

Following the same sequence of previous step, run this command to start Data Change Streaming for custmast using db1 DCS connection.

{
   "api":"admin",
   "action":"createAndStartDataChangeStreams",
   "params":{
      "streamingConnectionName":"db1",
      "streams":[
         {
            "description":"ctreesql_admin_custmast",
            "topic":"topic1",
            "sourceTableName":"custmast",
            "sourceOwnerName":"admin",
            "sourceDatabaseName":"ctreeSQL",
            "sourceDataFilePath":"",
            "recordFilter":"atoi(cm_custnumb) >= 1000",
            "triggers":["insert","update","delete"],
            "tagChanges":"forEachField",
            "includePrimaryKey":"never"
         }
      ]
   },
  "authToken":"' + token + '"
}

Observe the response and also look at the FairCom MQ CTSTATUS.FCS file to make sure it was executed with success.