Stream data from Salesforce organizations

Datastream supports replicating change events from a Salesforce instance, often referred to as a Salesforce organization, or a Salesforce org. Salesforce is a cloud-based CRM platform, and you can replicate data from it just as you would from other sources that Datastream supports.

This page contains information about:

  • The key terms that you need to understand when replicating from Salesforce.
  • The behavior of how Datastream handles data that's being pulled from a source Salesforce org.
  • The versions and editions of Salesforce that Datastream supports.
  • Known limitations for using Salesforce as a source.

Key terms

Salesforce operates using objects, records and fields:

  • An object is a class entity, and is similar to a table in relational databases nomenclature. Objects can be standard or custom. Standard objects are included in Salesforce by default, while custom objects are created by users to store data specific to their use-cases.
  • A record is a specific instance of an object, similar to a row in relational databases.
  • A field is a specific attribute of an object, similar to a column in relational databases.

Behavior

The Salesforce source support in Datastream relies upon the REST and Bulk 2.0 APIs. Salesforce polls for source changes based on the interval that you set to allow control over the API usage.

When replicating data from a Salesforce source, the following behavior is observed:

  • Replicateable and queryable standard objects which either have the SystemModstamp field or the LastModifiedDate can be replicated. For an object to be replicateable, it needs to support the getUpdated() and getDeleted() API calls. For more information, see API Calls for Data Replication in Salesforce documentation.
  • Custom objects can be replicated.
  • If configured, all historical data is replicated for included objects.
  • All changes, such as inserts, updates, and deletes from the specified objects are replicated.
  • Datastream polls for changes according to the configured polling interval. This is reflected in the stream's data freshness metric. The metric can grow up to the configured polling interval value and reflects the time passed from the most recent poll.

Versions

Datastream supports the following Salesforce editions:

  • Pro Suite
  • Developer
  • Professional
  • Enterprise
  • Unlimited

Datastream uses the Salesforce API version 61.0.

For more information about available Salesforce editions, see the Salesforce documentation.

Known limitations

Known limitations for using Salesforce as a source include:

  • Calculated fields (also known as formulas) aren't supported.
  • Only queryable and replicateable objects are supported.
  • Compound fields are replicated as flattened fields.
  • Up to 600,000 deletes per minute are supported (Salesforce limitation).
  • Streams are limited to 3000 objects.
  • Stream recovery isn't supported.

What's next