AWS S3 Lambda

Sending a data stream from S3 to Decodable is accomplished in two stages, first by populating an AWS Kinesis stream via an AWS lambda function, and then by adding and configuring a Kinesis source connector in Decodable.

If you are interested in a direct Decodable Connector for S3 via an AWS lambda function, please contact support@decodable.co or join our Slack community and let us know!

Connector name

s3-lambda

Type

source

Delivery guarantee

exactly once

Create Kinesis Data Source

To capture events for S3, an AWS lambda function is used to populate an AWS Kinesis stream.

  1. Configure S3 read permissions

  2. Create a Kinesis stream

  3. Configure Kinesis write permissions

  4. Create the AWS lambda function

  5. Create a notification trigger

For more detailed information, please refer to the S3 Lambda example in the Decodable GitHub repository.

Configure A Kinesis Source

Sign in to Decodable Web and follow the configuration steps provided for the AWS Kinesis to create a source connector. For examples of using the command line tools or scripting, see the How To guides.