Configuring Sources

Data Syncer is a service provided in TIR where users can migrate their data from a data source onto their Datasets. For syncing data users will need to configure their sources and provide data for accessing the data from sources.

AWS S3

Connect an S3 bucket using IAM user credentials. Supports incremental and full-refresh sync.

↗

Azure Blob Storage

Connect an Azure Blob container using a storage account connection string.

↗

Google Drive

Connect a Google Drive folder using OAuth 2.0 credentials and a refresh token.

↗

Google Cloud Storage

Connect a GCS bucket using a service account JSON key. Supports incremental sync.

↗

MinIO

Connect a MinIO bucket using access and secret keys. Works with public and private buckets.

↗