Python 3 - Unable Save Data Into IoTDB Via MQTT Method

[jerrychong25]

Hi all,

Recently I've tested publish data via MQTT into IoTDB successfully, and no error is prompted from MQTT or IoTDB side.

However, no data is actually stored when I execute SELECT query in IoTDB CLI.

Is anyone know if there is good method to trouble this issue?

Since I can't get any error logs.

Python 3 Codes:

import paho.mqtt.publish as publish

IOTDB_SERVER_ADDRESS = "172.21.0.2"
IOTDB_SERVER_PORT = 2883
        
if __name__ == "__main__":
    try:
        payload=f"""{{\n"device":"root.location.data",\n"timestamp":100,\n"measurments":["site", "tag_id", "x", "y", "z", "confidence"],\n"values":["testsite1", "test111", -16.00000, -12.00000, 10.00000, 99.9]}}"""

        publish.single(topic='root.location.data', payload=payload, hostname=IOTDB_SERVER_ADDRESS, port=IOTDB_SERVER_PORT, auth={'username':'root', 'password':'root'})

        print("MQTT Publish Success!!!")
    except Exception as e:
        print("MQTT Publish Error: ")
        print(str(e))
        
        # client.disconnect()

        print("MQTT Publish Failed!")

MQTT Config in /iotdb/conf/iotb-engine.properties:

####################
### MQTT Broker Configuration
####################

# whether to enable the mqtt service.
# Datatype: boolean
enable_mqtt_service=true

# the mqtt service binding host.
# Datatype: String
mqtt_host=0.0.0.0

# the mqtt service binding port.
# Datatype: int
mqtt_port=2883

# the handler pool size for handing the mqtt messages.
# Datatype: int
mqtt_handler_pool_size=100

# the mqtt message payload formatter.
# Datatype: String
mqtt_payload_formatter=json

# max length of mqtt message in byte
# Datatype: int
mqtt_max_message_size=1048576

Thanks in advance!

[HTHou]

Hi, please try the code below.

if __name__ == "__main__":
    try:
        payload = f"""{{\n"device":"root.location.data",\n"timestamp":100,\n"measurements":["site", "tag_id", "x", "y", "z", "confidence"],\n"values":["testsite1", "test111", -16.00000, -12.00000, 10.00000, 99.9]}}"""

        publish.single(topic='root.location.data', payload=payload, hostname=IOTDB_SERVER_ADDRESS,
                       port=IOTDB_SERVER_PORT, protocol=3, auth={'username': 'root', 'password': 'root'})

        print("MQTT Publish Success!!!")
    except Exception as e:
        print("MQTT Publish Error: ")
        print(str(e))

        # client.disconnect()

        print("MQTT Publish Failed!")

[jerrychong25]

Hi @HTHou ,

Tested with your code, but still same result.

No data is stored into IoTDB table.

Thanks for helping.

[HTHou]

The code is actually working on my machine.

Which version of IoTDB you used and which query statement you executed?

[jerrychong25]

Hi @HTHou ,

Interesting that your end working good.

Version of IoTDB (Docker Version):

• V0.13.3

DB Query Used To Read Data:

select * from root.location.data

Here is my screenshot:

Thanks for following up.

[HTHou]

I tried the IoTDB v1.0 on my local machine.

Did you set protocol=3 when you call publish.single? I found if use the default protocol version 4, the data won't be inserted.

[jerrychong25]

Hi @HTHou ,

Really interesting to see your end working on IoTDB v1.0 =D

Yes, you can see following screenshots (Left is full Python codes, right is IoTDB logs)

Here is my Publish Python 3 complete codes, running Docker container details and Docker Compose codes.

Publish Python 3 Complete Codes:

import paho.mqtt.publish as publish

IOTDB_SERVER_ADDRESS = "172.21.0.2"
IOTDB_SERVER_PORT = 2883

if __name__ == "__main__":
    try:
        payload = f"""{{\n"device":"root.location.data",\n"timestamp":100,\n"measurements":["site", "tag_id", "x", "y", "z", "confidence"],\n"values":["test", "test111", -16.00000, -12.00000, 10.00000, 99.9]}}"""

        publish.single(topic='root.location.data', payload=payload, hostname=IOTDB_SERVER_ADDRESS,
                       port=IOTDB_SERVER_PORT, protocol=3, auth={'username': 'root', 'password': 'root'})

        print("MQTT Publish Success!!!")
    except Exception as e:
        print("MQTT Publish Error: ")
        print(str(e))

        # client.disconnect()

        print("MQTT Publish Failed!")

Docker Compose Codes:

version: "3"
services:
  iotdb:
    container_name: iotdb
    image: apache/iotdb:latest
    volumes:
      - ./iotdb-engine.properties:/iotdb/conf/iotdb-engine.properties
      - "iotdb_data:/iotdb/data"
      - "iotdb_logs:/iotdb/logs"
    ports:
      - "6667:6667"
      - "31999:31999"
      - "8181:8181"
      - "5555:5555"
      - "2883:2883"      
    restart: always
volumes:
  iotdb_data:
  iotdb_logs:

Running Docker Container Details:

CONTAINER ID   IMAGE                 COMMAND                  CREATED      STATUS      PORTS                                                                                                                                                                                                                       NAMES
f2ef6d7303f5   apache/iotdb:latest   "/iotdb/sbin/start-s…"   6 days ago   Up 6 days   0.0.0.0:2883->2883/tcp, :::2883->2883/tcp, 0.0.0.0:5555->5555/tcp, :::5555->5555/tcp, 0.0.0.0:6667->6667/tcp, :::6667->6667/tcp, 0.0.0.0:8181->8181/tcp, :::8181->8181/tcp, 0.0.0.0:31999->31999/tcp, :::31999->31999/tcp   iotdb

Thanks for helping.