Re: [geomesa-users] Questions on filter method of dataframe

[Yifan Wang <yw2715@xxxxxxx>]

Hi,

Thank you for your help! I got two more questions on Geomesa DataStore.

1. How can I store persistent data via GeoMesa Lambda DataStore to Hbase?  (I noticed that when creating  Lambda DataStore, I have to set configurations for accumulo, 

does it mean I can only store persistent data to accumulo via Lambda DataStore?).And can I read data from Lambda DataStore kafka via Spark?

2. If I store data to Geomesa Kafka DataStore via Spark with Z-Index, will the index still be working when I read data via Structured Streaming and deserialize the SimpleFeature to DataFrame?

Best Regards,

Evan

On Mon, Oct 21, 2019 at 8:51 PM Emilio Lahr-Vivaz <elahrvivaz@xxxxxxxx> wrote:

Hello,

Once you load the dataframe from HBase, it will no longer use the z3 index. There are various options to create in-memory indices on an existing data frame - see https://www.geomesa.org/documentation/user/spark/sparksql.html#in-memory-indexing and https://www.geomesa.org/documentation/user/spark/sparksql.html#spatial-partitioning-and-faster-joins

Thanks,

Emilio

On 10/16/19 10:29 PM, Yifan Wang wrote:

Hi, 

Recently I came across a problem on filter method of dataframe, 

I am wondering that if I got a dataframe reading from Hbase via spark session,

and then built cache for the dataframe, after that I used filter method like st_within on the dataframe,

will the z3-index still be used or not? Thank you!

Best regards,

Evan

_______________________________________________
geomesa-users mailing list
geomesa-users@xxxxxxxxxxxxxxxx
To change your delivery options, retrieve your password, or unsubscribe from this list, visit
https://dev.locationtech.org/mailman/listinfo/geomesa-users

_______________________________________________
geomesa-users mailing list
geomesa-users@xxxxxxxxxxxxxxxx
To change your delivery options, retrieve your password, or unsubscribe from this list, visit
https://urldefense.proofpoint.com/v2/url?u=https-3A__dev.locationtech.org_mailman_listinfo_geomesa-2Dusers&d=DwICAg&c=slrrB7dE8n7gBJbeO0g-IQ&r=bFbOU0xECph47qaxajb1IA&m=7bEYFy3-Ww5btqcNx4qBwNu1dfFQCVZHWEWKYkYvofI&s=pju1vauN7PqE1V5ZoZARXNDZ1-J6NY0mHZ6VRaGr88o&e=