ThingsBoard IoT Gateway

Minor release of ThingsBoard IoT gateway.

This release contains:

Improvements:

1. General service improvements for remote configuration and general performance.
2. Added rate limits, they are required to avoid issues with online ThingsBoard servers. In case of using the gateway with ThingsBoard on premise installation - rate limits can be changed using TB_GW_RATE_LIMITS environment variable. You can set the value for this variable to 1000:1; 60000:60 (Number before ":" - amount of the messages, Number after ":" - time in seconds), if you are using rate limits on ThingsBoard. Otherwise you can set the value of TB_GW_RATE_LIMITS to 10000:1. Rate limits will be received automatically in future releases

Fixes:

1. Modbus connector fixes
2. OPC-UA connector fixes
3. MQTT connector fixes
4. General service fixes

List of PRs:

• opcua: Fixes issues with computing "information" based on path by @wilterdinkrobert in #1270
• Minor fixes for Socket and REST connectors by @samson0v in #1273
• Bugfix/fix double slash by @wilterdinkrobert in #1274
• Feature/connector id instead of name identification by @imbeacon in #1276
• Added blackbox tests for Modbus connector by @samson0v in #1280
• fixbug:the rpc request in progress got replaced by the new rpc request by @donghbcn in #1242
• Added blackbox tests for Modbus attribute updates by @samson0v in #1285
• Added blackbox tests for Modbus RPC by @samson0v in #1289
• Fixed modbus server host by @samson0v in #1301
• Tests improvement by @imbeacon in #1302
• Fixed attributes request method for MQTT connector by @samson0v in #1306
• Fixed reading GUID nodes for OPC-UA connector by @samson0v in #1307
• Fixed reading base64string nodes for OPC-UA connector by @samson0v in #1308
• Fixed reading two same nodes for OPC-UA connector by @samson0v in #1309
• Fixed stopping REST connector by @samson0v in #1310
• Fixed stopping Modbus connector without exception raise by @samson0v in #1313
• Fixed connectors duplication start during gRPC config changed by @samson0v in #1315
• Fixed TbLogger initialization by @samson0v in #1320
• Increased timeout for Modbus RPC blackbox tests by @samson0v in #1321
• Added RATE_LIMITS env variable by @samson0v in #1324

Full Changelog: 3.4.4...3.4.5

ThingsBoard IoT Gateway

Minor release of ThingsBoard IoT Gateway.

Contains bug fixes and improvements.

Changes:

• Fixed OCPP Connector stopping by @samson0v in #1244
• Optimized sending logs and info by @samson0v in #1245
• Fixed config converting by @samson0v in #1246
• Changed log level from ERROR to WARNING when connectors were not found by @samson0v in #1248
• Fixed sending default connectors config by @samson0v in #1253
• Include sub variables by @samy4sam in #1251
• Fixed REST Connector stopping by @samson0v in #1259
• Fixed FTP RPCs processing by @samson0v in #1260

New Contributors

• @samy4sam made their first contribution in #1251

Full Changelog: 3.4.3.1...3.4.4

ThingsBoard IoT Gateway

Minor release with hotfixes and improvements.

What's Changed

Full Changelog: 3.4.3...3.4.3.1

ThingsBoard IoT Gateway

Minor release of ThingsBoard IoT gateway.
Contains fixes and minor features for remote contiguration.

Features:

• Added default connectors configurations by @samson0v in #1210 - expected to be available in ThingsBoard 3.6.2+

Major fixes:

• Refresh sys.path after lib install by @dmohns in #1235
• Fixes in BACnet connector by @samson0v

Full list of Pull requests

• Added default connectors configurations by @samson0v in #1210
• Fixed BACnet logging by @samson0v in #1213
• Fixed BACnet stopping bug by @samson0v in #1219
• Fixed BACnet application by @samson0v in #1224
• Fixed and improved default JSON MQTT uplink converter. by @devaskim in #1190
• Fixed backup making by @samson0v in #1229
• Fixed XMPP Connector backup making by @samson0v in #1230
• Fixed XMPP Connector lib name by @samson0v in #1231
• Refresh sys.path after lib install by @dmohns in #1235
• bugfix:deviceName is not in content['data'] but in content, and shoul… by @donghbcn in #1234

New Contributors

• @dmohns made their first contribution in #1235
• @donghbcn made their first contribution in #1234

Full Changelog: 3.4.2...3.4.3

ThingsBoard IoT Gateway

Minor release, contains bug-fixes and improvements.

What's Changed

• Change thingsboard-gateway.service to use tb_gateway.json instead yaml by @LukaszDuss in #1194
• Fixed MQTT RPC by @samson0v in #1201
• Fixed Modbus installation and converter by @samson0v in #1202
• Added Modbus version compatibility for converter by @samson0v in #1203
• Fixed config modification bug for Modbus Connector by @samson0v in #1207
• Fixed Modbus Slaves stopping by @samson0v in #1208
• Fixed OPC-UA remote logging by @samson0v in #1209

New Contributors

• @LukaszDuss made their first contribution in #1194

Full Changelog: 3.4.1...3.4.2

ThingsBoard IoT Gateway

What's Changed

Added minor fixes for modbus connector.
Fixed error with logLevel key in connector configuration.

Added backing up for connectors configuration files on update and tb_gateway.json on remote configurator start.

• Fixed send_current_configuration method by @samson0v in #1183
• Fixed modbus slave init by @samson0v in #1192

Full Changelog: 3.4...3.4.1

ThingsBoard IoT Gateway

What's Changed

Service:

• New remote configuration dashboard - Can be used with ThingsBoard version 3.6 or above. Contains new, more convenient dashboards and improved functionality, in comparison to the old one.
• New Configuration Wizard - Now, you can run tb-gateway-configurator, configure general parameters, like host, port, credentials and connect your gateway to your ThingsBoard account easily. Then, you can use Remote Configuration dashboard to configure other parameters from UI.
• Added RPC through Connector - Added ability to send "service" RPCs (get/set) to connectors and receive or write a data, without actual device.
• Changed GRPC library to 1.58.0.
• General Improvements

Modbus Connector:

• Fixed RPC processing
• Fixed uplink converter
• General Improvements

Rest Connector:

• General Improvements

SQLite Storage:

• Fix for bug with stale data by @mursisoy

Warning: Old yaml file configuration is deprecated, it is recommended to make a backup of your configuration before updating.

New Contributors

• @mursisoy made their first contribution in #1173

Full Changelog: 3.3...3.4

ThingsBoard IoT gateway

Minor release of ThingsBoard IoT gateway. Contains usability improvements and bug fixes.

What's changed:

Gateway service:

• Added data duplicate detector
• Added statistics files examples for different OS
• Added minEventsProcess parameter
• Added Gateway Shell
• Added device filtering
• Fixed reconnecting
• Added device provisioning
• Added converter remote configuration update
• General Improvements
  ​

Docker Image:
​

• General Improvements
  ​

MQTT Connector:
​

• Added sendDataOnlyOnChange parameter
• Added shared subscriptions support
• General Improvements
  ​

Modbus Connector:

• Added TLS connection support
• General Improvements
  ​

BLE Connector:

• Added advertising mode support
• General Improvements
  ​

OPC-UA AsyncIO Connector:

• General Improvements
  ​

REST Connector:

• General Improvements
  ​

FTP Connector:

• General Improvements
  ​

SNMP Connetor:

• General Improvements
  ​

Request Connector:

• General Improvements
  ​

OCPP Connector:

• General Improvements

List of pull requests:

• Fixed getting converter type by @samson0v in #970
• Fixed Dockerfile by @samson0v in #971
• Fixed getting custom converter by @samson0v in #972
• Added converter config error for MQTT Connector by @samson0v in #974
• Updated GRPC Connectors by @samson0v in #976
• Fixed grpcio version in requirements.txt by @samson0v in #979
• Added sendDataOnlyOnChange parameter for MQTT Connector by @samson0v in #991
• Fixed data-sending delay by @samson0v in #994
• Fixed data misplaced for OPC-UA AsyncIO Connector by @samson0v in #996
• Added shared subscriptions support for MQTT Connector by @samson0v in #997
• Added statistics file examples for different OS by @samson0v in #1001
• Change ERROR to WARNING in statistics service log by @samson0v in #1002
• Updated SNMP Connector by @samson0v in #1003
• Fixed RPC for Request Connector by @samson0v in #1004
• Added parameter minEventsProcess by @samson0v in #1005
• Updated commands in linux statistics file by @ahmed-0011 in #1008
• fix statistics service thread is blocking on rasperberry pi by @xunyuw in #1009
• [Core] Data duplicate detector feature. by @devaskim in #1000
• Deleted requirements.txt from docker folder by @samson0v in #1011
• Revert code for fix rasperberry PI, block Statistics function work by @xunyuw in #1026
• [Core] Support of TTL in duplicate filtering. by @devaskim in #1019
• Duplicate Detector: Configuration parameter mistype by @devaskim in #1027
• Added responseValueExpression RPC param for Request Connector by @samson0v in #1031
• Fixed on_attributes_update for OPC-UA AsyncIO Connector by @samson0v in #1034
• Fixed writing multiple registers for Modbus Connector by @samson0v in #1035
• Fixed reading boolean for Modbus Connector by @samson0v in #1036
• Updated modbus.json file by @samson0v in #1038
• Added device filtering by @samson0v in #1039
• Fixed version resolving by @samson0v in #1040
• [WIP] Added Gateway Shell by @samson0v in #1017
• Added entrypoint for Gateway Shell by @samson0v in #1047
• Added BLE Advertising mode support by @samson0v in #1049
• Fixed modbus_serial.json config file by @samson0v in #1053
• Fixed imports in OCPP Connector by @samson0v in #1057
• Fixed starting Gateway with incorrectly closed manager by @samson0v in #1058
• Fixed modbus reconnecting by @samson0v in #1062
• Fixed Shell connection for Windows by @samson0v in #1067
• Added additional error log for Modbus Connector by @samson0v in #1069
• Request connector bug by @Kevin-ox in #1072
• Fixed TB Gateway Service reconnect by @samson0v in #1076
• Updated submodule by @samson0v in #1078
• Updated requires by @samson0v in #1081
• Updated submodule by @samson0v in #1082
• Added TLS support for Modbus TCP Connection by @samson0v in #1083
• Added Gateway Provisioning by @samson0v in #1084
• Updated submodule by @samson0v in #1085
• Added converter update from shared attr for Connectors by @samson0v in #1087
• Updated generate_certificate method by @samson0v in #1088
• Added on demand caching of custom MQTT converters. by @devaskim in #1090
• Load .pyc modules by @CoderPuppy in #1086
• Changed queries using for REST Connector by @samson0v in #1095
• Fixed process_remote_converter_configuration_update method by @samson0v in #1101
• Get rid of warning while setting connector name. by @devaskim in #1100
• [FEATURE] Add sharing id instead of global converter cache for MQTT connector. by @devaskim in #1099
• Updated converter update request for MQTT Connector by @samson0v in #1104
• Fixed FTP Converter by @samson0v in #1107
• Fixed statistics sending period by @samson0v in #1109
• Fixed KeyError for some edge cases. by @devaskim in #1111
• Changed the default converters to use local instead of class variables by @mircopz in #1110
• Added synchronizing method for converters config by @samson0v in #1112
• Fix a race condition in the Sqlite storage which caused all data to stop by @CoderPuppy in #1114
• Remove sleep per data point pushed by @CoderPuppy in #1113
• bug tb_gateway_service.py -> __form_statistics by @Kevin-ox in #1122
• Updated tests by @samson0v in #1132
• Fixed modbus tests by @samson0v in #1133
• Updated submodule by @samson0v in #1134

New Contributors

• @ahmed-0011 made their first contribution in #1008
• @xunyuw made their first contribution in #1009
• @Kevin-ox made their first contribution in #1072
• @CoderPuppy made their first contribution in #1086

Full Changelog: v3.2...3.3

ThingsBoard IoT gateway

Gateway:
​

• Added configurable statistics collecting
• Added ⚡️ HotReloader for dev mode
• Fixed and optimized data packing algorithm
• Added certificates end date checking and generation new one
• SDK as a dependency for Gateway
• Added ability to connect to ThingsBoard via the username and password
• General Improvements
  ​

MQTT Connector:
​

• Added default bytes data converter
• Added MQTT 5 support
• Added get/set RPC methods
• General Improvements
  ​

Modbus Connector:

• Updated version of the used Modbus library to version >=3.0.0.
  (Installation required, after installation gateway restart required)
• Added get/set RPC methods
• General Improvements
  ​

Socket Connector:
​

• Added set RPC method
  ​

OPC-UA AsyncIO Connector:

• Bug fixes
• General Improvements
  ​

REST Connector:
​

• Added get/set RPC methods
  ​

OPC-UA Connector:
​

• General Improvements
  ​

SNMP Connector:
​

• General Improvements
  ​

ODBC Connector:
​

• General Improvements
  ​

GRPC Service:
​

• General Improvements
  ​

Docker Image:
​

• Gateway configuration via the env variables
• Fix for logs location folder
• Fixed and optimized
  ​

[NEW] XMPP Connector
​

[NEW] OCPP Connector
​

[NEW] GRPC MQTT Connector
​

[NEW] GRPC Modbus Connector
​

[NEW] GRPC OPCUA Connector
​

Contributors:
​

• @devascim
• @JavierNR
• @KevinPoole
• @zhufeng88
• @anirudh-mehta
• @MicRoPz
• @nagarjunredla
• @wilterdinkrobert
• @bcl-dev
• @Maksym2022

ThingsBoard IoT gateway

Gateway:

• Added functionality for checking devices activity
• General Improvements
• Added new statistic service, it may configured like regular connector by configuration file

Remote Configurator:

• General Improvements

All Type of Connectors:

• From now users can add the useGRPC flag for on/off the default GRPC connector realization (using GRPC allows you to get real multiprocessing for the gateway and gives more hardware resources to the gateway)

MQTT Connector:

• General Improvements
• From now connector won't pass the None value from the converter

BLE Connector:

• Improved stability
• General Improvements

Modbus Connector:

• General Improvements
• Improved Modbus Compatibility Adapter
• Added tests

OPC-UA Connector:

• From now connector will use node name if key not found in config file
• Perfomance Improvements
• General Improvements

REST Connector:

• Added Remote Response and Custom Response
• Added opportunity to process query params
• Added opportunity to receive different data types
• Added Attribute Request
• General Improvements

Request Connector:

• General Improvements

GRPC:

• Perfomance Improvements
• General Improvements

Docker Image:

• Added support for ARM v.7

[New] Socket Connector

• Added Attribute Request

[New] GRPC Socket Connector

[New] OPC-UA AsyncIO connector
Designed to have better performance and stay updated with actual

Contributors:
ysimonx,
jeffreylauck,
wilterdinkrobert,
VeryBitter,
ferguscan,
Liangzx,
Kretiss,
DavideBorsatti.

Full Changelog: 3.0.1...3.1