Skip to main content
[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index] [List Home]
Re: [geowave-dev] Unable to ingest data into HBase via CLI
We did in fact have an issue with the 0.9.4.1 build for the CDH HBase client that we discovered.  In 0.9.4.1 we inadvertently built the CDH library with class files from an apache build, but fixed that for our latest release by cleaning out the classes before building [1].  This should make things work for the 0.9.5 release (scheduled for tomorrow). However, there is a binary incompatibility in HTableDescriptor that we discovered that caused problems in 0.9.4.1 [2].
You can build the cloudera commandline tool jar from source by running from the root source directory (and if you want you can use properties -Dhbase.version, -Dhadoop.version, or -Daccumulo.version to ensure its using your particular version of cloudera).
mvn package -am -pl deploy -P geowave-tools-singlejar -Dtools.finalName=geowave-tools -P cloudera -DskipTests -Dfindbugs.skip

Let us know if you continue to have issues or further questions.

1) https://github.com/locationtech/geowave/blob/master/deploy/packaging/docker/build-src/build-geowave-vendor.sh#L38
2) https://github.com/apache/hbase/blob/master/hbase-client/src/main/java/org/apache/hadoop/hbase/HTableDescriptor.java#L435  vs https://github.com/cloudera/hbase/blob/trunk/src/main/java/org/apache/hadoop/hbase/HTableDescriptor.java#L457




On Thu, Aug 10, 2017 at 9:40 PM, Joel Folkerts <joel.folkerts@xxxxxxxxx> wrote:
 I am running CDH 5.10.1 on a 16 node cluster with GeoWave 0.9.4.1 installed on one of the nodes. I am unable to ingest data into HBase when following the documentation's example: http://locationtech.github.io/geowave/previous-versions/0.9.3/userguide.html#something-recognizable. 

I create the store:
# geowave config addstore -t hbase -z manager-02.spectre.works:2181,manager-03.spectre.works:2181,manager-04.spectre.works:2181 mystore


I create the index:
# geowave config addindex -t spatial myindex


I ingest the locally stored data: 
# geowave ingest localToGW /root/ingest mystore myindex -f geotools-vector


I receive the following output: 

10 Aug 20:32:18 WARN [util.NativeCodeLoader] - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Aug 10, 2017 8:32:19 PM org.geoserver.platform.GeoServerExtensions checkContext
WARNING: Extension lookup 'GeoServerResourceLoader', but ApplicationContext is unset.
Aug 10, 2017 8:32:19 PM org.geoserver.platform.GeoServerExtensions checkContext
WARNING: Extension lookup 'GeoServerResourceLoader', but ApplicationContext is unset.
Aug 10, 2017 8:32:19 PM org.geoserver.platform.GeoServerExtensions checkContext
WARNING: Extension lookup 'ExtensionFilter', but ApplicationContext is unset.
Aug 10, 2017 8:32:19 PM org.geoserver.platform.GeoServerExtensions checkContext
WARNING: Extension lookup 'ExtensionProvider', but ApplicationContext is unset.
Aug 10, 2017 8:32:19 PM org.geoserver.platform.GeoServerExtensions checkContext
WARNING: Extension lookup 'ExtensionFilter', but ApplicationContext is unset.
Aug 10, 2017 8:32:19 PM org.geoserver.platform.GeoServerExtensions checkContext
WARNING: Extension lookup 'GeoServerResourceLoader', but ApplicationContext is unset.
Aug 10, 2017 8:32:19 PM org.geoserver.platform.GeoServerExtensions checkContext
WARNING: Extension lookup 'GeoServerResourceLoader', but ApplicationContext is unset.
Aug 10, 2017 8:32:19 PM org.geoserver.platform.GeoServerExtensions checkContext
WARNING: Extension lookup 'ExtensionFilter', but ApplicationContext is unset.
Aug 10, 2017 8:32:19 PM org.geoserver.platform.GeoServerExtensions checkContext
WARNING: Extension lookup 'ExtensionProvider', but ApplicationContext is unset.
Aug 10, 2017 8:32:19 PM org.geoserver.platform.GeoServerExtensions checkContext
WARNING: Extension lookup 'ExtensionFilter', but ApplicationContext is unset.
Aug 10, 2017 8:32:20 PM org.geotools.image.ImageWorker <clinit>
INFO: Warp/affine reduction enabled: true


The documentation states: "After running the ingest command you should see the various index tables in you datastore."

However, there are no tables within HBase:

hbase(main):001:0> list
TABLE
0 row(s) in 0.2810 seconds


Oddly, I have been able to ingest into Accumulo but not HBase for some reason. I don't see any errors in either the ZooKeeper or HBase logs. For that matter, I am not seeing any activity that looks like it could be related to the HBase ingest. 

I believe I have all of the necessary RPMs installed:
yum list installed | grep geowave
geowave-0.9.4.1-cdh5-accumulo.noarch  0.9.4.1-201705052201        @geowave
geowave-0.9.4.1-cdh5-hbase.noarch     0.9.4.1-201705052201        @geowave
geowave-0.9.4.1-cdh5-jetty.noarch     0.9.4.1-201705052201        @geowave
geowave-0.9.4.1-cdh5-tools.noarch     0.9.4.1-201705052201        @geowave
geowave-0.9.4.1-core.noarch           0.9.4.1-201705052201        @geowave
geowave-0.9.4.1-docs.noarch           0.9.4.1-201705052201        @geowave
geowave-repo.noarch                   1.0-3                       installed


 Any help would be greatly appreciated!

-Joel

_______________________________________________
geowave-dev mailing list
geowave-dev@xxxxxxxxxxxxxxxx
To change your delivery options, retrieve your password, or unsubscribe from this list, visit
https://dev.locationtech.org/mailman/listinfo/geowave-dev


Back to the top