Skip to main content

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index] [List Home]
Re: [geomesa-users] Error while generating heatmap using Density process

Hi Sangeetha,

In the newly released 3.0 we've upgraded hbase client version to 1.4.12. Also, the hbase client jars are no longer bundled in a shaded jar, so you should be able to swap them out to your specific version in a geoserver instance without rebuilding the plugin.

Thanks,

Emilio

On 6/25/20 4:50 AM, Sangeetha S wrote:
Hi Emilio,

I haven't yet tried to change the HBase version and rebuild the plugin jar. However, I installed the newly released GeoMesa 2.4.1 and I hit the same error.

Thanks,
Sangeetha

On Sat, May 23, 2020 at 12:15 AM Emilio Lahr-Vivaz <elahrvivaz@xxxxxxxx> wrote:
Hi Sangeetha,

I hit the same error recently. I think something changed in a recent bug-fix version of HBase 1.4. For instance, it works with 1.4.4 but doesn't seem to work with 1.4.12. At this point, I'd recommend checking out the geomesa source code and modifying the pom.xml <hbase.version> to 1.4.12, then re-building the geomesa-hbase-gs-plugin shaded jar.

Thanks,

Emilio

On 5/22/20 10:18 AM, Sangeetha S wrote:
Hi Emilio,

Thanks a lot for the detailed steps. I followed the same, however there is an error while creating a datastore in the GeoServer. I have attached the error with this email. Could you please look at it?

Thanks,
Sangeetha

On Tue, May 19, 2020 at 8:14 PM Emilio Lahr-Vivaz <elahrvivaz@xxxxxxxx> wrote:
Hi Sangeetha,

I was able to run heatmaps ok. I did the following, starting with a fresh geoserver 2.15 with the wps plugin:

1. Install the geomesa-hbase-gs-plugin shaded jar from https://search.maven.org/remotecontent?filepath=org/locationtech/geomesa/geomesa-hbase-gs-plugin_2.11/2.4.0/geomesa-hbase-gs-plugin_2.11-2.4.0-shaded.jar into geoserver/WEB-INF/lib
2. Run the 'install-hadoop.sh' script from the binary distribution pointing at geoserver/WEB-INF/lib, after fixing the curl command in common-functions.sh to add an -L for handling maven redirects (see https://geomesa.atlassian.net/browse/GEOMESA-2768 for details)
3. Copied the wps jar from geomesa-hbase_2.11-2.4.0/dist/gs-plugins/geomesa-process-wps_2.11-2.4.0.jar into geoserver/WEB-INF/lib
4. Copied the hbase-site.xml into geoserver/WEB-INF/classes
5. Started geoserver and installed the 'heatmap' style from https://www.geomesa.org/documentation/tutorials/geomesa-examples-gdelt.html#heatmaps
6. Installed the geomesa-hbase-distributed-runtime jar into $HBASE_HOME/lib
7. Ingested the example-csv data bundled with the tools: ./geomesa-hbase ingest -c 240.test -C example-csv -s example-csv ../examples/ingest/csv/example.csv
8. Registered the store and layer in geoserver, displayed the layer preview, and appended '&styles=heatmap' to the URL

Hope that helps,

Emilio

On 5/15/20 1:32 AM, Sangeetha S wrote:
Hi Emilio,

I tried with both 2.15.5 and 2.16.0. I get the same error in both cases.

Thanks,
Sangeetha

On Thu, May 14, 2020 at 5:34 PM Emilio Lahr-Vivaz <elahrvivaz@xxxxxxxx> wrote:
Hello,

What version of GeoServer are you using? I believe it has to be 2.15[1]. If that's what you're using, I'll try to re-create the issue.

Thanks,

Emilio

[1]: https://www.geomesa.org/documentation/user/geoserver.html#geoserver-versions

On 5/14/20 3:13 AM, Sangeetha S wrote:
Hi Emilio,

In a newly installed GeoServer, I installed the WPS extension and then copied the geomesa-hbase-gs-plugin_2.11-2.4.0-shaded.jar and geomesa-process-wps_2.11-2.4.0.jar to WEB-INF/lib folder of GeoServer. However, the GeoServer does not start anymore.

Thanks,
Sangeetha



On Wed, May 13, 2020 at 4:01 PM Emilio Lahr-Vivaz <elahrvivaz@xxxxxxxx> wrote:
Hi Sangeetha,

It shouldn't be a problem to run on a different machine, as long as you have appropriate network connectivity to the cluster.

You can try using the geomesa shaded jar, which would replace the files in the geomesa-gs-plugin.tgz and all the hbase/hadoop jars:

https://search.maven.org/remotecontent?filepath=org/locationtech/geomesa/geomesa-hbase-gs-plugin_2.11/2.4.0/geomesa-hbase-gs-plugin_2.11-2.4.0-shaded.jar

So from a vanilla geoserver, you would install just that jar and the geomesa-process-wps jar.

Thanks,

Emilio

On 5/13/20 9:29 AM, Sangeetha S wrote:
Hi Emilio,

An update: The GeoServer does not start if I replace hbase-shaded-client with hbase-client. There are too many errors.
Could you please guide me on how to proceed?

One more question, the GeoServer runs on a different machine from where Hadoop, HBase and GeoMesa have been installed. Does that make a difference?

Thanks,
Sangeetha

On Tue, May 12, 2020 at 5:30 PM Sangeetha S <sanggeoceg@xxxxxxxxx> wrote:
Hi Emilio,

Thanks for your reply. I have added to the GeoServer all jars present in $GEOMESA_HBASE_HOME/dist/gs-plugins/geomesa-hbase-gs-plugin_2.11-2.4.0-install.tar.gz as well as the hbase-shaded-client-1.4.12.jar and htrace-core-1.3.0-incubating.jar.

I'll try replacing hbase-shaded-client with hbase-client and let you know how it goes.

Thanks,
Sangeetha

On Mon, May 11, 2020 at 7:23 PM Emilio Lahr-Vivaz <elahrvivaz@xxxxxxxx> wrote:
Hello,

I think the issue comes from using the hbase-shaded client jar. Could you try using the non-shaded hbase client jar, and/or provide the list of jars you've added to geoserver?

Thanks,

Emilio

On 5/11/20 4:17 AM, Sangeetha S wrote:
Dear GeoMesa devs and users,

I am trying to generate a heatmap of line strings stored in an HBase table using GeoMesa density process. HBase is running on top of Hadoop HDFS. I have created a HBase datastore and published the layer in the GeoServer. When I use the standard line style, I am able to make WMS requests. However, when I execute the geomesa density process, I get the error the following error:

java.lang.NoSuchMethodException: org.locationtech.geomesa.hbase.proto.GeoMesaProto$GeoMesaCoprocessorService.newStub(org.apache.hadoop.hbase.shaded.com.google.protobuf.RpcChannel)

The full error log is attached with this email. I have installed Hadoop 2.7.1, HBase 1.4.12 and GeoMesa 2.4.0.
Could you please help me in finding what is going wrong and how to fix it? Please let me know if you need further information.

Thanks,
Sangeetha.

_______________________________________________
geomesa-users mailing list
geomesa-users@xxxxxxxxxxx
To unsubscribe from this list, visit https://dev.eclipse.org/mailman/listinfo/geomesa-users

_______________________________________________
geomesa-users mailing list
geomesa-users@xxxxxxxxxxx
To unsubscribe from this list, visit https://dev.eclipse.org/mailman/listinfo/geomesa-users


--
Sangeetha Shankar.


--
Sangeetha Shankar.

_______________________________________________
geomesa-users mailing list
geomesa-users@xxxxxxxxxxx
To unsubscribe from this list, visit https://dev.eclipse.org/mailman/listinfo/geomesa-users

_______________________________________________
geomesa-users mailing list
geomesa-users@xxxxxxxxxxx
To unsubscribe from this list, visit https://dev.eclipse.org/mailman/listinfo/geomesa-users


--
Sangeetha Shankar.

_______________________________________________
geomesa-users mailing list
geomesa-users@xxxxxxxxxxx
To unsubscribe from this list, visit https://dev.eclipse.org/mailman/listinfo/geomesa-users

_______________________________________________
geomesa-users mailing list
geomesa-users@xxxxxxxxxxx
To unsubscribe from this list, visit https://dev.eclipse.org/mailman/listinfo/geomesa-users


--
Sangeetha Shankar.

_______________________________________________
geomesa-users mailing list
geomesa-users@xxxxxxxxxxx
To unsubscribe from this list, visit https://dev.eclipse.org/mailman/listinfo/geomesa-users

_______________________________________________
geomesa-users mailing list
geomesa-users@xxxxxxxxxxx
To unsubscribe from this list, visit https://dev.eclipse.org/mailman/listinfo/geomesa-users


--
Sangeetha Shankar.

_______________________________________________
geomesa-users mailing list
geomesa-users@xxxxxxxxxxx
To unsubscribe from this list, visit https://dev.eclipse.org/mailman/listinfo/geomesa-users

_______________________________________________
geomesa-users mailing list
geomesa-users@xxxxxxxxxxx
To unsubscribe from this list, visit https://dev.eclipse.org/mailman/listinfo/geomesa-users


--
Sangeetha Shankar.

_______________________________________________
geomesa-users mailing list
geomesa-users@xxxxxxxxxxx
To unsubscribe from this list, visit https://dev.eclipse.org/mailman/listinfo/geomesa-users


Back to the top