Eclipse Community Forums: EMF » [CDO] Need help resolving query latency

Help

Home

Home » Modeling » EMF » [CDO] Need help resolving query latency

Show: Today's Messages :: Show Polls :: Message Navigator

[CDO] Need help resolving query latency [message #1611782]

Wed, 11 February 2015 16:07

Thomas Gerlitz

Messages: 9
Registered: November 2013

Junior Member

Hello everybody,

we currently encounter some problems when executing queries from a client on a CDO server that is located in our local network. When executing arbitrary queries we experience latencies of approximatly 200ms, while executing the same queries on a server that is running on the same machine as the client only takes about 1-5ms. In both scenarios the database is located on the same machine as the server.

Does anyone of you have an idea where the packets might get stuck within the cdo/java stack and what can be done about it? Or are these query execution times considered normal when the packets go through the java tcp stack?

A few general information about our setup:
We are currently using CDO 4.3.0.v20140520-1823 and Java 1.8.0_31
Server and Client machines both run windows and firewalls are configured to allow communication on the cdo port.

To test general network latency we already performed a TCP latency test based on the powershell tool suite PSTools with 10000 iterations and a packet size of 50kB in our network and observed average roundtrip latencies of 5ms on packets send between the machines running the server and the client.

I have attached our cdo-server.xml and a minimal example which reproduces the latency in our setup.

Thank you in advance
Thomas Gerlitz

Attachment: server-config.xml
(Size: 1.10KB, Downloaded 118 times)
Attachment: QueryLatency.java
(Size: 1.70KB, Downloaded 105 times)

[Updated on: Wed, 11 February 2015 16:55]

Report message to a moderator

Re: [CDO] Need help resolving query latency [message #1611802 is a reply to message #1611782]

Wed, 11 February 2015 16:19

Esteban Dugueperoux

Messages: 472
Registered: July 2009

Senior Member

Hi Thomas,

Yes it is a known issue when the DB and the CDO server are on different
machines. The technical reason is that CDO make many SQL queries to get
CDORevisions. It's for that we advice to have both DB and CDO servers on
a same machine.

Best Regards.

Le 11/02/2015 17:07, Thomas Gerlitz a écrit :
> Hello everybody,
>
> we currently encounter some problems when executing queries on a CDO server that is located in our local network. When executing arbitrary queries we experience latencies of approximatly 200ms, while executing the same queries on a server that is running on the same machine only takes about 1-5ms.
>
> Does anyone of you have an idea where the packets might get stuck within the cdo/java stack and what can be done about it? Or are these query execution times considered normal when the packets go through the java tcp stack?
>
> A few general information about our setup:
> We are currently using CDO 4.3.0.v20140520-1823 and Java 1.8.0_31
> Server and Client machines both run windows and firewalls are configured to allow communication on the cdo port.
>
> To test general network latency we already performed a TCP latency test based on the powershell tool suite PSTools with 10000 iterations and a packet size of 50kB in our network and observed average roundtrip latencies of 5ms on packets send between the machines running the server and the client.
>
> I have attached our cdo-server.xml and a minimal example which reproduces the latency in our setup.
>
> Thank you in advance
> Thomas Gerlitz
>

--
Esteban Dugueperoux - Obeo

Need professional services for Sirius?
http://www.obeodesigner.com/sirius

Report message to a moderator

Re: [CDO] Need help resolving query latency [message #1611825 is a reply to message #1611802]

Wed, 11 February 2015 16:37

Thomas Gerlitz

Messages: 9
Registered: November 2013

Junior Member

Hello Esteban,

thank you for your reply. It seams that I have not described my setup correctly:
We are currently using hsqldb that is started directly by the cdo server. Latencies (>200ms) can be observed when I use two machines in our setup. One running the cdo client application and one running the cdo server and the database.

When we move all these components (client,server and db) on the same machine we do not observe the described latencies.

I have now corrected this in my first post.

I hope these clarifications help to understand my problem.

Best Regards

[Updated on: Wed, 11 February 2015 16:55]

Report message to a moderator

Re: [CDO] Need help resolving query latency [message #1613059 is a reply to message #1611782]

Thu, 12 February 2015 11:29

Leonid Ripeynih

Messages: 150
Registered: February 2012

Senior Member

Hello! To fix this, you should patch TCPAcceptor class.
In handleAccept method, add additional option:

socketChannel.socket().setTcpNoDelay(true);

This should work.

Report message to a moderator

Re: [CDO] Need help resolving query latency [message #1614397 is a reply to message #1613059]

Fri, 13 February 2015 08:08

Esteban Dugueperoux

Messages: 472
Registered: July 2009

Senior Member

Hi Leonid and Thomas,

Interesting to know, looking at the CDO git history I see there was an
attempt to use this API for issue
https://bugs.eclipse.org/bugs/show_bug.cgi?id=213748 .

Best Regards.

Le 12/02/2015 12:29, Leonid Ripeynih a écrit :
> Hello! To fix this, you should patch TCPAcceptor class.
> In handleAccept method, add additional option:
>
>
> socketChannel.socket().setTcpNoDelay(true);
>
>
> This should work.

--
Esteban Dugueperoux - Obeo

Need professional services for Sirius?
http://www.obeodesigner.com/sirius

Report message to a moderator

Re: [CDO] Need help resolving query latency [message #1614438 is a reply to message #1614397]

Fri, 13 February 2015 08:45

Esteban Dugueperoux

Messages: 472
Registered: July 2009

Senior Member

In fact not, this bugzilla is about connection inactivity.

Le 13/02/2015 09:08, Esteban Dugueperoux a écrit :
> Hi Leonid and Thomas,
>
> Interesting to know, looking at the CDO git history I see there was an
> attempt to use this API for issue
> https://bugs.eclipse.org/bugs/show_bug.cgi?id=213748 .
>
> Best Regards.
>
> Le 12/02/2015 12:29, Leonid Ripeynih a écrit :
>> Hello! To fix this, you should patch TCPAcceptor class.
>> In handleAccept method, add additional option:
>>
>>
>> socketChannel.socket().setTcpNoDelay(true);
>>
>>
>> This should work.
>
>
>

--
Esteban Dugueperoux - Obeo

Need professional services for Sirius?
http://www.obeodesigner.com/sirius

Report message to a moderator

Re: [CDO] Need help resolving query latency [message #1614459 is a reply to message #1611825]

Fri, 13 February 2015 08:57

Eike Stepper

Messages: 6682
Registered: July 2009

Senior Member

Am 11.02.2015 um 17:37 schrieb Thomas Gerlitz:
> Hello Esteban,
>
> thank you for your reply. It seams that I have not described my setup correctly:
> We are currently using hsqldb that is started directly by the cdo server. Latencies (>200ms) can be observed when I
> use two machines in our setup.
I'd expect longer server round-trips if the server is not on the same machine. And 200ms sounds also reaonable to me. So
I'm not exactly sure about the problem. Am I missing something?

Cheers
/Eike

----
http://www.esc-net.de
http://thegordian.blogspot.com
http://twitter.com/eikestepper

> One running the cdo client application and one running the cdo server and the database.
> When we move all these components (client,server and db) on the same machine we do not observe the described latencies.
>
> I hope these clarifications help to understand my problem.
>
> Best Regards
>

Cheers
/Eike

----
http://www.esc-net.de
http://thegordian.blogspot.com
http://twitter.com/eikestepper

Report message to a moderator

Re: [CDO] Need help resolving query latency [message #1614470 is a reply to message #1614397]

Fri, 13 February 2015 09:06

Thomas Gerlitz

Messages: 9
Registered: November 2013

Junior Member

Hi Leonid and Esteban,

thank you for your replies. I tried the workaround that Leonid suggested and query execution times are now in the range of my initial setup (1-5ms).

Thank you very much for your help!

Best Regards

Report message to a moderator

Re: [CDO] Need help resolving query latency [message #1614477 is a reply to message #1614470]

Fri, 13 February 2015 09:10

Eike Stepper

Messages: 6682
Registered: July 2009

Senior Member

Am 13.02.2015 um 10:06 schrieb Thomas Gerlitz:
> Hi Leonid and Esteban,
>
> thank you for your replies. I tried the workaround that Leonid suggested and query execution times are now in the
> range of my initial setup (1-5ms).
That is interesting! Maybe you want to submit an enhancement request so that we can investigate how to make this
configurable...

Cheers
/Eike

----
http://www.esc-net.de
http://thegordian.blogspot.com
http://twitter.com/eikestepper

Cheers
/Eike

----
http://www.esc-net.de
http://thegordian.blogspot.com
http://twitter.com/eikestepper

Report message to a moderator