Are you trying to build a Smart Home solution/product yourself or are you rather looking for an existing solution that you want to use? If the latter, you might want to have a look at openHAB. If you want to build something new, please provide log excerpts and details about the errors that you experience.
This still sounds to me as if you are rather looking for a solution that you can extend yourself to also support your protocol. This is can be done as a so-called binding.
You can find information on how to implement a binding for openHAB right here: https://github.com/openhab/openhab/wiki/How-To-Implement-A-Binding
For Eclipse SmartHome itself, we are currently still working on defining new APIs for bindings (see other threads in this forum), that's why you won't find anything similar here right now.
I have recently tried to build and run the demo runtime, however I encountered some issues. Building with Maven went fine, but when trying to run the server, I see the following message:
java.lang.ClassCastException: org.eclipse.equinox.http.servlet.HttpServiceServlet cannot be cast to javax.servlet.Servlet
Interestingly, all of the debug messages for status updates are being printed in the terminal, and there a is warning: no default persistence service configured (I assume this is OK, but might give you a hint what's going on)
The Java version I am running is 1.7.0_60.
Do you have any guess what the problem might me?
You are right, the demo runtime is currently broken due to some recent changes in the target platform.
I actually do not want to spend time fixing it as I plan to setup a completely new demo, based on Concierge, Kura and other Eclipse projects. I guess I will best remove the current demo runtime for the time being.
If you want to see a working solution on the Eclipse SmartHome framework, you can have a look at https://github.com/openhab/openhab2.
I have updated the github readme accordingly.
The new demo is planned for JavaOne this year, i.e. end of September.
But to have a working demo, the openHAB2 build is working already and produces binary artefacts: https://openhab.ci.cloudbees.com/job/openHAB2/