Ingest Data into DynamoDB

Start DynamoDB Database and Create Table

Set up a DynamoDB database, taking Mac OSX for instance:

$ brew install dynamodb-local

$ dynamodb-local -sharedDb

For details about how to deploy DynamoDB and AWS CLI locally, please see Deploying DynamoDB Locally

Initiate the DynamoDB table:

1). Create table definition file "mqtt_msg.json" for DynamoDB:

{
    "TableName": "mqtt_msg",
    "KeySchema": [
        { "AttributeName": "msgid", "KeyType": "HASH" }
    ],
    "AttributeDefinitions": [
        { "AttributeName": "msgid", "AttributeType": "S" }
    ],
    "ProvisionedThroughput": {
        "ReadCapacityUnits": 5,
        "WriteCapacityUnits": 5
    }
}

2). Create the DynamoDB table:

$aws dynamodb create-table --cli-input-json file://mqtt_msg.json --endpoint-url http://localhost:8000

Create a Rule

Go to EMQX Dashboard, select the "rule" tab on the menu to the left.

Select "message.publish", then type in the following SQL:

SELECT id as msgid, topic, payload FROM "#"

Add an Action

Click on the "+ Add" button under "Action Handler", and then select "Data to DynamoDB" in the pop-up dialog window.

Fill in the parameters required by the action:

Four parameters is required by action "Data to DynamoDB":

1). DynamoDB Table. Here set it to "mqtt_msg".

2). Hash Key. Here set it to "msgid".

3). DynamoDB Range Key. Leave it empty as we didn't define a range key in the dynamodb definition file.

4). Bind a resource to the action. Since the dropdown list "Resource" is empty for now, we create a new resource by clicking on the "New Resource" to the top right, and then select "DynamoDB":

Fill in the configs as follows:

• DynamoDB Region: us-west-2
• DynamoDB Server: http://localhost:8000
• AWS Access Key Id: "AKIAU5IM2XOC7AQWG7HK"
• AWS Secret Access Key: "TZt7XoRi+vtCJYQ9YsAinh19jR1rngm/hxZMWR2P"

And then click on the "Create" button.

Back to the "Actions" dialog, and then click on the "Confirm" button.

Back to the creating rule page, then click on "Create" button. The rule we created will be show in the rule list:

Test the Rule

We have finished creating the rule, test the rule by sending an MQTT message to EMQX:

> Topic: "t/a"
>
> QoS: 1
>
> Payload: "hello"

Then inspect the DynamoDB table, and verify if a new record is inserted:

And from the rule list, verify that the "Matched" column has increased to 1: