Skip to main content



      Home
Home » Modeling » EMF "Technology" (Ecore Tools, EMFatic, etc)  » EMFStore or (and) CDO
EMFStore or (and) CDO [message #1187847] Fri, 15 November 2013 05:02 Go to next message
Eclipse UserFriend
Hi there,

I am working on an application, which needs so manage Ecore Data as the applications master data and create, in a second layer, many many instances of the EMF nodes. For the first part of managing master data, I'm using ECP and EMFStore. It brings everything I need in a quick pace. Editing master data is possible by just using my Ecore with ECP. EMFStore brings the functionality for save working in master data.

On the second layer, I want a dynamic creation of master-data-node instances and persisting them. My understanding of EMFStore persistency is based on XMI (which is a XML). The goal is to store unlimited instances without losing performance. For not running in "Out of memory", I need a database-based approach, I guess? In addition, I need a Query Language (Select, Aggregating sum count etc.) for searching and aggregating instances.

Therefore, my idea was to set up a hybrid environment, where EMF and ECP are responsible for master data and CDO for instances and searching them.

Now I come to a point where I want to rely on a more progressive experience then mine. I am happy about any contribution!

My Questions:

1) Is my depicted approach the right one?

2) Is CDO the right choice for storing massive data and being able to query the instances? Or is EMFStore still the right choice?

3) Is EMFStore also able to query huge amount of data?

4) What about the projects:
- mongo-emf (github.com/BryanHunt/mongo-emf/wiki/User-Guide) and EMF Teneo Model: Database approach with Query Language? Any experience with it? Is it suitable for my concerns?
- IncQuery: I just read that there will be a prototype implementation with EMF Store (http://www.eclipse.org/forums/index.php/mv/msg/404512/958921/#msg_958921)
- EMFQuery? Still alive?

Thanks in advanced

Cheers
Philippe
Re: EMFStore or (and) CDO [message #1193023 is a reply to message #1187847] Sun, 17 November 2013 17:11 Go to previous messageGo to next message
Eclipse UserFriend
Hi Phil,
the general question you raise is rather difficult to answer. The best
technology decision depends on many aspects and I think one would have
to know your use case very precisly to make a good choice. There also
some organizational aspects involved in your question, e.g. how active a
certain project is. I will try to answer the detailed questions, if you
need more help with the general decision, feel free to contact me via mail.

Am 15.11.2013 14:35, schrieb Phil Wim:
> Hi there,
>
> I am working on an application, which needs so manage Ecore Data as the
> applications master data and create, in a second layer, many many
> instances of the EMF nodes. For the first part of managing master data,
> I'm using ECP and EMFStore. It brings everything I need in a quick pace.
> Editing master data is possible by just using my Ecore with ECP.
> EMFStore brings the functionality for save working in master data.
>
> On the second layer, I want a dynamic creation of master-data-node
> instances and persisting them. My understanding of EMFStore persistency
> is based on XMI (which is a XML). The goal is to store unlimited
> instances without losing performance. For not running in "Out of
> memory", I need a database-based approach, I guess? In addition, I need
> a Query Language (Select, Aggregating sum count etc.) for searching and
> aggregating instances.
>
> Therefore, my idea was to set up a hybrid environment, where EMF and ECP
> are responsible for master data and CDO for instances and searching them.
>
> Now I come to a point where I want to rely on a more progressive
> experience then mine. I am happy about any contribution!
>
> My Questions:
>
> 1) Is my depicted approach the right one?
Hard to answer without understanding your use case more in detail
>
> 2) Is CDO the right choice for storing massive data and being able to
> query the instances? Or is EMFStore still the right choice?
CDO offers more scalability options than EMFStore does. Especially the
weak references might be interesting for you if the data you store is
connected. This allows lazy loading and garbage collection of objects.
CDO supports several backends, mostly databases. CDO has an own query
language.

EMFStore has also an exchangable backend, only the default is XMI. It is
also possible to store EMFStore data into a database or even into a CDO
repository.
>
> 3) Is EMFStore also able to query huge amount of data?
EMFStore currently does not provide a query mechanism itself.
>
> 4) What about the projects:
> - mongo-emf (github.com/BryanHunt/mongo-emf/wiki/User-Guide) and EMF
> Teneo Model: Database approach with Query Language? Any experience with
> it? Is it suitable for my concerns?
Depending on your requirements, but of course it is possible to
implement persistence qithout EMFStore or CDO.

> - IncQuery: I just read that there will be a prototype implementation
> with EMF Store
> (http://www.eclipse.org/forums/index.php/mv/msg/404512/958921/#msg_958921)
IncQuery is independat of EMFStore or CDO, should be easy to fully
integrate it.
> - EMFQuery? Still alive?
Hmm, probbaly not.

Last but not least, I would like to mention, that you can use ECP with
other backends, such as CDO or even a custom solution..
Regards

Jonas

>
> Thanks in advanced
>
> Cheers Philippe
>
Re: EMFStore or (and) CDO [message #1194269 is a reply to message #1193023] Mon, 18 November 2013 07:22 Go to previous messageGo to next message
Eclipse UserFriend
A small correction regarding CDO:
CDO has no own query language. It can use existing query languages that are available in the backend.
For example, if you use an RDBMS as your backend (via the DBStore), then, you can use SQL as query language.

Jonas Helming wrote on Sun, 17 November 2013 23:11
Hi Phil,
the general question you raise is rather difficult to answer. The best
technology decision depends on many aspects and I think one would have
to know your use case very precisly to make a good choice. There also
some organizational aspects involved in your question, e.g. how active a
certain project is. I will try to answer the detailed questions, if you
need more help with the general decision, feel free to contact me via mail.

Am 15.11.2013 14:35, schrieb Phil Wim:
> Hi there,
>
> I am working on an application, which needs so manage Ecore Data as the
> applications master data and create, in a second layer, many many
> instances of the EMF nodes. For the first part of managing master data,
> I'm using ECP and EMFStore. It brings everything I need in a quick pace.
> Editing master data is possible by just using my Ecore with ECP.
> EMFStore brings the functionality for save working in master data.
>
> On the second layer, I want a dynamic creation of master-data-node
> instances and persisting them. My understanding of EMFStore persistency
> is based on XMI (which is a XML). The goal is to store unlimited
> instances without losing performance. For not running in "Out of
> memory", I need a database-based approach, I guess? In addition, I need
> a Query Language (Select, Aggregating sum count etc.) for searching and
> aggregating instances.
>
> Therefore, my idea was to set up a hybrid environment, where EMF and ECP
> are responsible for master data and CDO for instances and searching them.
>
> Now I come to a point where I want to rely on a more progressive
> experience then mine. I am happy about any contribution!
>
> My Questions:
>
> 1) Is my depicted approach the right one?
Hard to answer without understanding your use case more in detail
>
> 2) Is CDO the right choice for storing massive data and being able to
> query the instances? Or is EMFStore still the right choice?
CDO offers more scalability options than EMFStore does. Especially the
weak references might be interesting for you if the data you store is
connected. This allows lazy loading and garbage collection of objects.
CDO supports several backends, mostly databases. CDO has an own query
language.

EMFStore has also an exchangable backend, only the default is XMI. It is
also possible to store EMFStore data into a database or even into a CDO
repository.
>
> 3) Is EMFStore also able to query huge amount of data?
EMFStore currently does not provide a query mechanism itself.
>
> 4) What about the projects:
> - mongo-emf (github.com/BryanHunt/mongo-emf/wiki/User-Guide) and EMF
> Teneo Model: Database approach with Query Language? Any experience with
> it? Is it suitable for my concerns?
Depending on your requirements, but of course it is possible to
implement persistence qithout EMFStore or CDO.

> - IncQuery: I just read that there will be a prototype implementation
> with EMF Store
> (http://www.eclipse.org/forums/index.php/mv/msg/404512/958921/#msg_958921)
IncQuery is independat of EMFStore or CDO, should be easy to fully
integrate it.
> - EMFQuery? Still alive?
Hmm, probbaly not.

Last but not least, I would like to mention, that you can use ECP with
other backends, such as CDO or even a custom solution..
Regards

Jonas

>
> Thanks in advanced
>
> Cheers Philippe
>

Re: EMFStore or (and) CDO [message #1194394 is a reply to message #1194269] Mon, 18 November 2013 08:41 Go to previous message
Eclipse UserFriend
Am 18.11.2013 13:22, schrieb Erdal Karaca:
> A small correction regarding CDO:
> CDO has no own query language. It can use existing query languages that are available in the backend.
> For example, if you use an RDBMS as your backend (via the DBStore), then, you can use SQL as query language.
Well, OCL queries can be used with many different CDO backends and you should mention your interesting effort for a
model-centric query language with SQL and HQL transformations ;-)

Cheers
/Eike

----
http://www.esc-net.de
http://thegordian.blogspot.com
http://twitter.com/eikestepper
Previous Topic:[EMFStore] customizing date equality
Next Topic:[Teneo] Using char with non-default size causes problems
Goto Forum:
  


Current Time: Wed Jul 30 13:31:41 EDT 2025

Powered by FUDForum. Page generated in 0.04443 seconds
.:: Contact :: Home ::.

Powered by: FUDforum 3.0.2.
Copyright ©2001-2010 FUDforum Bulletin Board Software

Back to the top