[paho-dev] Paho Clients Conformance Testing

[Alexander Kaiser <alexander.kaiser@xxxxxxxxx>]

Hello Paho Enthusiasts,

some of you might already have heard about the Eclipse IoT-Testware[1] project.

Within the IoT-Testware we have also MQTT v3.1.1 Conformance Tests für Brokers and Clients.

However, while testing Brokers is quite straightforward, testing Clients is a bit more challenging. The reason, MQTT Client libraries are required to be triggered by an application. So for conformance testing, we required some sort of a testing application which can trigger the Implementation Under Test (IUT) on behalf of the Test System (TS). Such a testing application can be imagined as remote control (to be precise the receiver of an RC), though we call the concept Upper Tester (UT) which is sketched in the attached (mqtt_client_testing.png) picture.

The IoT-Testware has already the TS side of the UT (the RC itself) and a simple JSON definition for the PCO (Point of Control and Observation)[2], let's imagine this one as the RC protocol.

Well, while the TS is complete from this perspective, we still require RC receivers (UT part on the IUT side).

For testing purposes, I have built UTs for two of the available Paho clients (Java and Python) and looking now for a new home for these components. 

Have you any ideas on how we could manage that and if cooperation between IoT-Testware and Paho would be beneficial? Maybe as an addition to Paho's Interoperability Testing efforts?

[1] https://projects.eclipse.org/projects/technology.iottestware

[2] https://github.com/eclipse/iottestware.mqtt/tree/master/src/client_testing/upper_tester

Best regards

--

Alexander Kaiser

IoT Researcher

relayr GmbH • Bergmannstraße 102/103 • 10961 Berlin

Managing Directors: Josef Brunner, William Hite

Commercial Register Number: HRB 234794

Tax ID: 37/503/21630, VAT ID: DE288362290

Attachment: mqtt_client_testing.png
Description: PNG image