Latest Post:

What is incremental sync?

Definition

An incremental sync fetches new or changed records using a cursor, timestamp or another change indicator. This can reduce the amount of data transferred and processed compared with a full import.

Handling deletions, late updates and missed changes requires explicit support. Some connectors combine incremental updates with periodic full reconciliation.

Why it matters

Fetching only changed records can make frequent updates more practical than repeatedly importing a complete dataset. The benefit grows when a source is large but only a small part changes between runs. It can reduce transfer and processing work while keeping a local copy useful for analysis.

The challenge is deciding what counts as a change. A new record, a corrected old record and a deletion may be exposed differently by the provider. Check how the connector handles late updates, lost cursors and a failed run that needs to be retried. Some workflows also need periodic reconciliation to detect changes that an incremental feed does not capture. The schedule alone does not establish how these cases are handled.