Data Source - Amazon Athena

Prev Next

summary

Help Page for ETL Configuration of Data Settings from Amazon Athena.

constraints

https://github.com/trocco-io/embulk-input-athena

Setting items

STEP1 Basic settings

(data) item indispensable default value Contents
Athena Connection Configuration Yes - Select the previously registered Connection Configuration that has the necessary permissions for this ETL Configuration.
Database Name Yes - Specify the name of the database containing the data you wish to retrieve.
SQL Yes - Enter SQL to retrieve transfer data from Amazon Athena.
column (esp. in chemistry, file, equipment, etc.) Yes - Specify the column name and data type of the column you wish to retrieve.
The data type is
  • string
  • long
  • double
  • timestamp
  • boolean
  • json
    • can be specified.

    Required Authority

    The following permissions are required to use this service.

    • Amazon Athena object read permission
      • Action
        • s3:GetObject
        • s3:ListBucket
      • Resource
        • arn:aws:s3:::your-data-source-bucket/path-prefix/*
        • arn:aws:s3:::your-data-source-bucket
    • Permission to write to S3
      • Action
        • s3:PutObject
        • s3:GetObject
        • s3:ListBucketMultipartUploads
        • s3:AbortMultipartUpload
        • s3:ListBucket
        • s3:GetBucketLocation
        • s3:ListMultipartUploadParts
      • Resource
        • arn:aws:s3:::your-result-bucket
        • arn:aws:s3:::your-result-bucket/path-prefix/*
    • Permission to run Amazon Athena
      • Action
        • athena:StartQueryExecution
        • athena:StopQueryExecution
        • athena:GetQueryResults
      • Resource
        • *