Data Transfer: AWS S3 Bucket Configuration

Overview: 

IL supports a range of export options, including AWS S3 bucket data transfers. Customers can use their own AWS buckets to retrieve data from IL, and this data can be used to feed existing BI tools. The purpose of this article is to walk through the configuration process for IL's S3 bucket data transfer functionality.

Solution:

There are two main steps in order to activate AWS bucket data transfers. The first is within the customer's AWS settings, and the second is within the Manage Destinations app in IL.

AWS Settings

1. Create the bucket where reports are to be sent. Bucket names are unique across AWS, so you will only need the name here.

2. Navigate to IAM dashboard. Select Policies on left sidebar and then select Create Policy.

3. Create a policy that grants PutObject access. Fill in the provided fields as documented below:

• • Choose a Service --> S3
  • Actions --> Check PutObject (Write)
  • Resources --> Assign ARN of Bucket 
  • Request Conditions (Optional)

4. Navigate to IAM dashboard. Select Roles on left sidebar and then select Create Role.

5. Choose "Custom Trust Policy" and enter the following trust policy.

{
  "Version": "2012-10-17",
  "Statement": [
    {
      "Sid": "IntelligentLogisticsS3Access",
      "Effect": "Allow",
      "Principal": {
        "AWS": "arn:aws:iam::902853448858:user/SKIPUM_API"
      },
      "Action": "sts:AssumeRole"
    }
  ]
}

7. Click next and assign the policy created in step 2-3 to this role. .

8. Click next and give the Role a name and description; then click Create Role.

9. Make note of the account id and role name, you will need this when creating the destination in IL. These can be obtained from the newly created Role ARN, which should be in the form:

• • arn:aws:iam::<ACCOUNT_ID>:role/<ROLE_NAME>

IL Configuration

Customers will need to create their own S3 configuration to gather the necessary details to complete this process. This article will explain setting up an S3 transfer bucket.

IL Configuration

1.   Utilizing the Manage Destinations app, create a destination and enter the appropriate S3 bucket details.
2. Directory Path" should be a relative path from the root of the "Bucket"; this folder structure will get created and used to drop files in the bucket if it doesn't already exist.
3. When entering the Role Name and Account ID, only enter the individual elements from Step 9, as instructed in the image below. 
4. Once you have entered your credentials, utilize the 'Test' button to finish the configuration
5. The 'Test' Button should upload a test file, this test file is a key indicator that the connection is working.