Prerequisites

  • A delimited file is required to use this source.

  • The first line of the file must be column headers.

S3 File Transport Prerequisites

In File Transport, you can use AWS S3 mode to access the file. To connect to Amazon S3, you must use IAM user credentials (Access Key ID and Secret Access Key) that have the following permissions on the target bucket and objects:

Permission

Purpose

List (list bucket, list objects)

List bucket and list/iterate objects in the bucket

Get (get object, get bucket location)

Read object contents and get bucket metadata (for example, region)

Without these permissions, the connector receives a 403 Forbidden error from S3. AWS returns 403 for both invalid credentials and insufficient permissions. Ensure your credentials are valid and have the required access.

Required S3 Permissions

The IAM principal (user or role) whose Access Key and Secret Key you use must have at least the following S3 actions:

S3 Action

Resource

Use

s3:ListBucket

Bucket ARN

List bucket and list objects

s3:GetBucketLocation

Bucket ARN

Determine bucket region (used by the SDK)

s3:GetObject

Bucket and object ARNs

Read object contents

Identity Security Cloud File Upload Utility

The Identity Security Cloud File Upload Utility provides a way for you to upload files to the cloud automatically.

You may use the Identity Security Cloud File Upload Utility with the Delimited File source. For more information about downloading and using the Identity Security Cloud File Upload Utility, refer to Identity Security Cloud File Upload Utility.

Best Practice
For best results, delimited files should not exceed 500 MB.