As many of you know, Scribe has two separate integration offerings , an On-Premise software called Scribe Insight, and a cloud based integration platform called Scribe Online. These two products offer some unique sets of capabilities when it comes to integration designs and solutions, but are both great at solving integration tasks across any number of end points. Many people often ask us which one to choose, or they might have one for some tasks but would like to use the other for some other integration workflows. When it comes down to it, you don’t really need to choose one or the other, they share a fair set of capabilities and common technologies, so they can be used together to accomplish any integration task at hand.
One great way to manage this is to use the Scribe Online Connector for Scribe Insight, which allows us to trade XML files via Microsoft Message Queue between the two products for bi-directional synchronization of data. This connector is located in our Marketplace in the Online platform, and basically creates XML Schemas (XSD) that is tied to a connection in Scribe Online. These XSDs are based on the entities found in that Online Connection, and can be used to read and write data with Insight DTS packages. With this method you can easily tie Insight and Online together.
Below I will walk you through this setup with an example between Online and Insight. You must have a on premise agent for this to work that has access to the Insight server.
- Install the Connector from the Marketplace
- Make sure you have the connection in place that you want to use as a part of the Insight data feed (Marketo in my example)
- Create a new Connection using the Insight connector and associate this connection to your existing one
- For a one-direction Sync, you only need to use the ScribeIn queue, for two way, you will need to create a new Queue (If you enter a name in the Connection UI, the connector will auto-create that Queue)
- Create a Map that uses that Scribe Insight Connection – it will load the metadata and when its fully loaded you should be able to see a new Folder in the Scribe Online Agent\Connectors\Scribe.Connector.Insight folder with the same name as your linked connection plus a series of numbers appended on.
- To get data into Insight, you first need a DTS file setup with Dynamic XML as the source using that XSD file that was generated
- Its important to note that the data that comes across will be one single transaction per XML message, so there will be no repeating nodes setup in the source configuration
- Next you need a Queue based Integration Process to read data from the ScribeIn queue with the proper Message Label (AssociatedConnectionName_EntityName)
- Create a DTS using XML and MSMQ as the Target with the XSD file generated by Scribe Online as the Schema
- Then define your destination Queue and Message Label. As with your source it needs to be the AssociatedConnectionName_EntityName label
- Make sure to setup the XML connection to only pass 1 transaction per XML file
- Once you have this setup you can finish your DTS to pull data from somewhere and move it into MSMQ for Online to pick up. You should use a Query on your source that uses a feature like :LastRunDateTime
- To automate the process moving data into the Queue, use a Query Integration Process to schedule the DTS you created and feed data to your Queue for Online to pickup