| Re: [geomesa-dev] Question About Catalog Requirement in GeoMesa Cassandra DataStore |
That's not going to be easy. You'd need to re-write / modify lots of GeoMesa code to be able to read an existing Cassandra table. It would be pretty much the same as writing a new GeoTools datastore from scratch while trying to line it up with existing code. (Emilio may have some better ideas here.)
I think the quickest way to get a handle of things would be to run through the GeoMesa Cassandra quickstart to see what GeoMesa writes/expects as data in the actual tables.
There are a number of things going on:
First, GeoMesa will write the keys based on the selected indexing strategy. An existing table will not have that.
Second, GeoMesa will store the non-key columns serialized as Kryo as the value in C*.
As a quick way to frame it, GeoMesa can use Cassandra as a persistence layer. GeoMesa cannot use any arbitrary Cassandra table as input. (I know that is probably not what you want to hear, but hopefully it helps move things forward!)On Thu, Oct 3, 2024 at 1:43 PM Alessio Fabiani <alessio.fabiani@xxxxxxxxxxxxxxxxxxxxx> wrote:Another way, it is stored directly in Cassandra.Il gio 3 ott 2024, 19:29 James Hughes <jnhuva@xxxxxxxxx> ha scritto:Hi Alessio,Did you create the table using GeoMesa or some other method?
If you created them on your own, the data may not be written in a compatible format.Cheers,JimOn Thu, Oct 3, 2024 at 1:00 PM Alessio Fabiani via geomesa-dev <geomesa-dev@xxxxxxxxxxx> wrote:Dear all,
Dear Emilio,First of all, thank you for your response. I’m replying directly to the mailing list because, for some reason, I did not receive your email directly in my inbox. I had to check the Eclipse mailing list archive to see if there had been any replies to my initial questions.
Regarding the use case I mentioned, we need to access tables in Cassandra that reside at the root level, meaning they do not have any prefix associated with them. Could you please provide more clarification on how this can be handled in the current setup?
Additionally, I would like to ask for more details about your statement: "The catalog table is used to store the metadata about feature types, so we would need some alternative storage location if we removed it." Are you referring to the
Metadataclass that maintains the list of available tables in the catalog? If so, how would you suggest managing metadata for feature types without relying on this catalog table?Thank you again for your assistance, and I look forward to any further insights you can provide on these points.
On Tue, Oct 1, 2024 at 7:56 AM Alessio Fabiani <alessio.fabiani@xxxxxxxxxxxxxxxxxxxxx> wrote:Dear GeoMesa community,
First of all, thank you for your incredible work! I’m excited to be part of this community and appreciate the effort that goes into maintaining GeoMesa.
Recently, I’ve been experimenting with GeoServer 2.24.x and Cassandra. I successfully configured the DataStore and connected it to Cassandra using your plugin, which worked perfectly.
However, I noticed that the DataStore requires setting a catalog as a mandatory parameter, which prevents linking tables directly to the root keyspace. After a quick review of the code, it seems like making this parameter optional might not be too difficult.
Could you provide some insight into why the catalog is required? Are there any reasons or potential issues that would arise if this requirement were made optional? If this is something the community would find useful, I’d be happy to explore contributing a solution.
Thanks again for all the great work!
Best regards,
Alessio.--Regards,
Alessio Fabiani
==
GeoServer Professional Services from the experts!Visit http://bit.ly/gs-services-us for more information.
==
Ing. Alessio Fabiani@alfa7691
Founder/Technical Lead
GeoSolutions Group
phone: +39 0584 962313fax: +39 0584 1660272
mob: +39 331 6233686
https://www.geosolutionsgroup.com/
http://twitter.com/geosolutions_it
-------------------------------------------------------
Con riferimento alla normativa sul trattamento dei dati personali (Reg. UE 2016/679 - Regolamento generale sulla protezione dei dati “GDPR”), si precisa che ogni circostanza inerente alla presente email (il suo contenuto, gli eventuali allegati, etc.) è un dato la cui conoscenza è riservata al/i solo/i destinatario/i indicati dallo scrivente. Se il messaggio Le è giunto per errore, è tenuta/o a cancellarlo, ogni altra operazione è illecita. Le sarei comunque grato se potesse darmene notizia.
This email is intended only for the person or entity to which it is addressed and may contain information that is privileged, confidential or otherwise protected from disclosure. We remind that - as provided by European Regulation 2016/679 “GDPR” - copying, dissemination or use of this e-mail or the information herein by anyone other than the intended recipient is prohibited. If you have received this email by mistake, please notify us immediately by telephone or e-mail.--_______________________________________________Regards,
Alessio Fabiani
==
GeoServer Professional Services from the experts!Visit http://bit.ly/gs-services-us for more information.
==
Ing. Alessio Fabiani@alfa7691
Founder/Technical Lead
GeoSolutions Group
phone: +39 0584 962313fax: +39 0584 1660272
mob: +39 331 6233686
https://www.geosolutionsgroup.com/
http://twitter.com/geosolutions_it
-------------------------------------------------------
Con riferimento alla normativa sul trattamento dei dati personali (Reg. UE 2016/679 - Regolamento generale sulla protezione dei dati “GDPR”), si precisa che ogni circostanza inerente alla presente email (il suo contenuto, gli eventuali allegati, etc.) è un dato la cui conoscenza è riservata al/i solo/i destinatario/i indicati dallo scrivente. Se il messaggio Le è giunto per errore, è tenuta/o a cancellarlo, ogni altra operazione è illecita. Le sarei comunque grato se potesse darmene notizia.
This email is intended only for the person or entity to which it is addressed and may contain information that is privileged, confidential or otherwise protected from disclosure. We remind that - as provided by European Regulation 2016/679 “GDPR” - copying, dissemination or use of this e-mail or the information herein by anyone other than the intended recipient is prohibited. If you have received this email by mistake, please notify us immediately by telephone or e-mail.
geomesa-dev mailing list
geomesa-dev@xxxxxxxxxxx
To unsubscribe from this list, visit https://www.eclipse.org/mailman/listinfo/geomesa-dev
Regards,
Alessio Fabiani
==
GeoServer Professional Services from the experts!
Visit http://bit.ly/gs-services-us for more information.
==
Ing. Alessio Fabiani
@alfa7691
Founder/Technical Lead
GeoSolutions Group
phone: +39 0584 962313
fax: +39 0584 1660272
mob: +39 331 6233686
https://www.geosolutionsgroup.com/
http://twitter.com/geosolutions_it
-------------------------------------------------------