| Re: [geomesa-users] geomesa-users Digest, Vol 11, Issue 7 |
Hi Jim,I tried with the accumulo6 branch this time and got the following error.Failed to get multiscan result java.util.concurrent.ExecutionException: java.lang.IllegalArgumentException: Malformed attribute at org.apache.accumulo.tserver.TabletServer$ScanTask.get(TabletServer.java:759) at org.apache.accumulo.tserver.TabletServer$ThriftClientHandler.continueMultiScan(TabletServer.java:1422) at org.apache.accumulo.tserver.TabletServer$ThriftClientHandler.continueMultiScan(TabletServer.java:1408) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.accumulo.trace.instrument.thrift.TraceWrap$1.invoke(TraceWrap.java:63) at com.sun.proxy.$Proxy23.continueMultiScan(Unknown Source) at org.apache.accumulo.core.tabletserver.thrift.TabletClientService$Processor$continueMultiScan.getResult(TabletClientService.java:2276) at org.apache.accumulo.core.tabletserver.thrift.TabletClientService$Processor$continueMultiScan.getResult(TabletClientService.java:2260) at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39) at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39) at org.apache.accumulo.server.util.TServerUtils$TimedProcessor.process(TServerUtils.java:171) at org.apache.thrift.server.AbstractNonblockingServer$FrameBuffer.invoke(AbstractNonblockingServer.java:478) at org.apache.accumulo.server.util.TServerUtils$THsHaServer$Invocation.run(TServerUtils.java:231) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at org.apache.accumulo.trace.instrument.TraceRunnable.run(TraceRunnable.java:47) at org.apache.accumulo.core.util.LoggingRunnable.run(LoggingRunnable.java:34) at java.lang.Thread.run(Thread.java:745) Caused by: java.lang.IllegalArgumentException: Malformed attribute at org.locationtech.geomesa.utils.geotools.SimpleFeatureTypes$SpecParser.parse(SimpleFeatureTypes.scala:370) at org.locationtech.geomesa.utils.geotools.SimpleFeatureTypes$.parse(SimpleFeatureTypes.scala:374) at org.locationtech.geomesa.utils.geotools.SimpleFeatureTypes$.createType(SimpleFeatureTypes.scala:44) at org.locationtech.geomesa.core.iterators.SpatioTemporalIntersectingIterator.init(SpatioTemporalIntersectingIterator.scala:76) at org.apache.accumulo.core.iterators.IteratorUtil.loadIterators(IteratorUtil.java:246) at org.apache.accumulo.core.iterators.IteratorUtil.loadIterators(IteratorUtil.java:216) at org.apache.accumulo.core.iterators.IteratorUtil.loadIterators(IteratorUtil.java:194) at org.apache.accumulo.tserver.Tablet$ScanDataSource.createIterator(Tablet.java:1985) at org.apache.accumulo.tserver.Tablet$ScanDataSource.iterator(Tablet.java:1923) at org.apache.accumulo.core.iterators.system.SourceSwitchingIterator.seek(SourceSwitchingIterator.java:163) at org.apache.accumulo.tserver.Tablet.lookup(Tablet.java:1499) at org.apache.accumulo.tserver.Tablet.lookup(Tablet.java:1606) at org.apache.accumulo.tserver.TabletServer$ThriftClientHandler$LookupTask.run(TabletServer.java:1119) at org.apache.accumulo.trace.instrument.TraceRunnable.run(TraceRunnable.java:47) ... 5 moreThe only change from this branch to what I am compiling is@@ -47,7 +47,7 @@ <!-- environment-dependent versions --> <zookeeper.version>3.4.5</zookeeper.version> <accumulo.version>1.6.1</accumulo.version> - <hadoop.version>2.2.0</hadoop.version> + <hadoop.version>2.5.0-cdh5.3.0</hadoop.version> <scalding.version>0.11.2</scalding.version> <!-- logging properties @@ -958,6 +958,11 @@ </snapshots> </repository> <repository> + <id>cloudera</id> + <url>https://repository.cloudera.com/artifactory/cloudera-repos/</url> + </repository> + + <repository> <id>geotools</id> <url>http://download.osgeo.org/webdav/geotools</url> </repository> (END)ThanksManasOn Mon, Jan 12, 2015 at 12:00 PM, <geomesa-users-request@xxxxxxxxxxxxxxxx> wrote:Send geomesa-users mailing list submissions to
geomesa-users@xxxxxxxxxxxxxxxx
To subscribe or unsubscribe via the World Wide Web, visit
http://www.locationtech.org/mailman/listinfo/geomesa-users
or, via email, send a message with subject or body 'help' to
geomesa-users-request@xxxxxxxxxxxxxxxx
You can reach the person managing the list at
geomesa-users-owner@xxxxxxxxxxxxxxxx
When replying, please edit your Subject line so it is more specific
than "Re: Contents of geomesa-users digest..."
Today's Topics:
1. Re: Geomesa with Accumulo 1.6 (Manas Kar)
2. Re: Geomesa with Accumulo 1.6 (Jim Hughes)
----------------------------------------------------------------------
Message: 1
Date: Sun, 11 Jan 2015 20:22:46 -0500
From: Manas Kar <manasdebashiskar@xxxxxxxxx>
To: geomesa-users <geomesa-users@xxxxxxxxxxxxxxxx>
Subject: Re: [geomesa-users] Geomesa with Accumulo 1.6
Message-ID:
<CAEfGi76aBuy_BCYqE2SGVYqNu8SfpEMKmutw4VL_wAJLmSRaTQ@xxxxxxxxxxxxxx>
Content-Type: text/plain; charset="utf-8"
Hi Jim,
Can't thank you enough for your help. Here are my steps and results.
I tried running the quickstart tutorial which should create 1000 features
in an empty table.
My tutorial fails with the following error.
Java.util.concurrent.ExecutionException:
java.lang.NoClassDefFoundError: javax/media/jai/util/ImagingListener
Also the acc16_gs26 branch fails to build with
hadoop-version 2.5.0-cdh5.3.0(builds fine with hadoop2.2) with the
following error
[ERROR] import org.glassfish.grizzly.servlet.ServletContextImpl.
Only when I build it with hadoop 2.2 and later don't do a clean build the
build succeeds.
May be this branch is not fully supported but may be I am missing some
thing trivial.
Also the is the geoserver build needs to have the geomesa-assemble jars in
it's lib as well?
..Manas
On Fri, Jan 9, 2015 at 6:50 PM, Manas Kar <manasdebashiskar@xxxxxxxxx>
wrote:
> Hi Jim,
> Thanks for your elaborate instruction. It definitely took me further then
> where I was before.
>
> Now I can bring up my geosererver. BUT I don't see the "geomesa pannel" on
> the left as described in the document
> http://www.geomesa.org/2014/08/06/geomesa-ui/.
>
> I DO see the Accumulo data store in the stores section but when I apply
> the proper credentials it gets stuck saying
>
> 09 Jan 18:34:54 WARN [org.apache.accumulo.core.client.impl.ServerClient] -
> Failed to find an available server in the list of servers:
> [cloudera2ne:10011 (120000), cloudera3ne:10011 (120000), cloudera1ne:10011
> (120000)]
>
> NB: I tried both IP and FQDN with the same result.
>
> *Am I still missing some jars or any steps? *
>
> *My list is given below*
> #accumulo specific#
>
> - accumulo-trace.jar
> - accumulo-fate.jar
> - accumulo-core.jar
>
> #As per instruction replaced commons lang 2.1 with 2.4 and
> commons-configuration
>
> - commons-lang-2.4.jar
> - commons-configuration-1.6.jar
>
>
> #hadoop specific jars from my cloudera servers.
>
> - hadoop-auth-2.5.0-cdh5.3.0.jar
> - hadoop-common-2.5.0-cdh5.3.0.jar
> - hadoop-hdfs-2.5.0-cdh5.3.0.jar
> - hadoop-mapreduce-client-app-2.5.0-cdh5.3.0.jar
> - hadoop-mapreduce-client-common-2.5.0-cdh5.3.0.jar
> - hadoop-yarn-client-2.5.0-cdh5.3.0.jar
> - hadoop-mapreduce-client-shuffle-2.5.0-cdh5.3.0.jar
> - hadoop-mapreduce-client-jobclient-2.5.0-cdh5.3.0.jar
> - hadoop-mapreduce-client-core-2.5.0-cdh5.3.0.jar
> - hadoop-yarn-client.jar
> -
>
> *Question: It is the hadoop client for MR2. Do I need to use one for MR1
> instead?*
>
> #Thrift jar
>
> - libthrift-0.9.0.jar
>
>
> #xookeeper jar
>
> - zookeeper-3.4.5-cdh5.3.0.jar
>
>
> # plugin(the name says it is 1.5 but it is built with 1.6)
> geomesa-distributed-runtime-accumulo1.5-1.0.0-rc.3-SNAPSHOT.jar
> #wps jars
>
> - gs-web-wps-2.5.2.jar
> - gt-xsd-wps-11.2.jar
> - gt-process-geometry-11.2.jar
> - gs-wps-core-2.5.2.jar
> - serializer-2.7.1.jar
> - net.opengis.wps-11.2.jar
>
>
> Appreciate any help...
> Manas
>
> On Thu, Jan 8, 2015 at 3:53 PM, Manas Kar <manasdebashiskar@xxxxxxxxx>
> wrote:
>
>> Hi Experts,
>> I built my Geomesa with Accumulo 1.6 and hadoop.version = 2.5.0-cdh5.3.0
>>
>> It was bit convenient because my Cloudera instance provides Accumulo1.6.
>> I am now trying to set up Geoserver to show Accumulo Data.
>>
>> I am using Geoserver 2.5.2 (With WPS)
>> Accumulo1.6.
>> Geomesa(RC.3)
>>
>> I am seeing the following error after following the document.
>>
>> WARNING: Can't load a service for category "DataStoreFactorySpi". Cause
>> is "ServiceConfigurationError: org.geotools.data.DataStoreFactorySpi:
>> Provider org.locationtech.geomesa.core.data.AccumuloDataStoreFactory could
>> not be instantiated".
>> java.util.ServiceConfigurationError:
>> org.geotools.data.DataStoreFactorySpi: Provider
>> org.locationtech.geomesa.core.data.AccumuloDataStoreFactory could not be
>> instantiated
>> at java.util.ServiceLoader.fail(ServiceLoader.java:224)
>> at java.util.ServiceLoader.access$100(ServiceLoader.java:181)
>> at java.util.ServiceLoader$LazyIterator.next(ServiceLoader.java:377)
>> at java.util.ServiceLoader$1.next(ServiceLoader.java:445)
>> at org.geotools.factory.FactoryRegistry.register(FactoryRegistry.java:826)
>> at
>> org.geotools.factory.FactoryRegistry.scanForPlugins(FactoryRegistry.java:772)
>> .
>> .
>> .
>> Caused by: java.lang.NoClassDefFoundError: org/apache/hadoop/io/Writable
>>
>> What am I missing here? Please help.
>>
>> Thanks
>> Manas
>>
>>
>> On Thu, Jan 8, 2015 at 3:30 PM, Manas Kar <manasdebashiskar@xxxxxxxxx>
>> wrote:
>>
>>> Hi,
>>> I am trying to make my current Cloudera installation (CDH5.3 with
>>> Accumulo 1.6) work with Geomesa.
>>>
>>> I saw a help in the Archive suggesting not to use Cloudera provided
>>> Accumulo. I was wondering if I can take a different route of compiling
>>> Geomesa with Accumulo 1.6?
>>>
>>> Also Do I have to change the hadoop version to the Cloudera provided
>>> version?
>>>
>>> Than
>>>
>>
>>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://www.locationtech.org/mhonarc/lists/geomesa-users/attachments/20150111/cb063f2b/attachment.html>
------------------------------
Message: 2
Date: Mon, 12 Jan 2015 11:46:06 -0500
From: Jim Hughes <jnh5y@xxxxxxxx>
To: geomesa-users@xxxxxxxxxxxxxxxx
Subject: Re: [geomesa-users] Geomesa with Accumulo 1.6
Message-ID: <54B3FA4E.2060504@xxxxxxxx>
Content-Type: text/plain; charset="windows-1252"; Format="flowed"
Hi Manas,
No problem; I'm happy to help. Once we worked through this, perhaps we
can sort out a branch which supports CDH 5.3.0.
For the issue with the QuickStart, can you send along more of the stack
trace? Usually, the exception which causes the stack trace is the most
important line. In this case, we are required by licensing issues to
exclude cerain jai-core which is where this class lives. In order to
fix things, we'll need to think through the call stack and make a change
so that this class is not used.
From chatting with some of the other GeoMesa developers, it sounds like
accumulo6 might be a better branch for you to work with. Can you give
it quick try? I checked the two branches and 'accumulo6' does not have
any Glassfish dependencies, so that issue should go away.
I don't think that GeoServer needs the geomesa-assemble jars. The
GeoServer plugin jar contains the jars necessary to run one or two M/R
jobs from the GeoMesa GeoServer panel. (Again, I'd point out that the
GeoMesa panel is a nice-to-have feature.)
Thanks,
Jim
On 01/11/2015 08:22 PM, Manas Kar wrote:
> Hi Jim,
> Can't thank you enough for your help. Here are my steps and results.
>
> I tried running the quickstart tutorial which should create 1000
> features in an empty table.
>
> My tutorial fails with the following error.
> Java.util.concurrent.ExecutionException: java.lang.NoClassDefFoundError: javax/media/jai/util/ImagingListener
>
> Also the acc16_gs26 branch fails to build with
> hadoop-version 2.5.0-cdh5.3.0(builds fine with hadoop2.2) with the
> following error
> [ERROR] import org.glassfish.grizzly.servlet.ServletContextImpl.
>
> Only when I build it with hadoop 2.2 and later don't do a clean build
> the build succeeds.
> May be this branch is not fully supported but may be I am missing some
> thing trivial.
>
> Also the is the geoserver build needs to have the geomesa-assemble
> jars in it's lib as well?
>
> ..Manas
>
> On Fri, Jan 9, 2015 at 6:50 PM, Manas Kar <manasdebashiskar@xxxxxxxxx
> <mailto:manasdebashiskar@xxxxxxxxx>> wrote:
>
> Hi Jim,
> Thanks for your elaborate instruction. It definitely took me
> further then where I was before.
>
> Now I can bring up my geosererver. BUT I don't see the "geomesa
> pannel" on the left as described in the document
> http://www.geomesa.org/2014/08/06/geomesa-ui/.
>
> I DO see the Accumulo data store in the stores section but when I
> apply the proper credentials it gets stuck saying
>
> 09 Jan 18:34:54 WARN
> [org.apache.accumulo.core.client.impl.ServerClient] - Failed to
> find an available server in the list of servers:
> [cloudera2ne:10011 (120000), cloudera3ne:10011 (120000),
> cloudera1ne:10011 (120000)]
>
> NB: I tried both IP and FQDN with the same result.
>
> *Am I still missing some jars or any steps? *
>
> _My list is given below_
> #accumulo specific#
>
> * accumulo-trace.jar
> * accumulo-fate.jar
> * accumulo-core.jar
>
> #As per instruction replaced commons lang 2.1 with 2.4 and
> commons-configuration
>
> * commons-lang-2.4.jar
> * commons-configuration-1.6.jar
>
>
> #hadoop specific jars from my cloudera servers.
>
> * hadoop-auth-2.5.0-cdh5.3.0.jar
> * hadoop-common-2.5.0-cdh5.3.0.jar
> * hadoop-hdfs-2.5.0-cdh5.3.0.jar
> * hadoop-mapreduce-client-app-2.5.0-cdh5.3.0.jar
> * hadoop-mapreduce-client-common-2.5.0-cdh5.3.0.jar
> * hadoop-yarn-client-2.5.0-cdh5.3.0.jar
> * hadoop-mapreduce-client-shuffle-2.5.0-cdh5.3.0.jar
> * hadoop-mapreduce-client-jobclient-2.5.0-cdh5.3.0.jar
> * hadoop-mapreduce-client-core-2.5.0-cdh5.3.0.jar
> * hadoop-yarn-client.jar
> *
>
> *Question: It is the hadoop client for MR2. Do I need to use one
> for MR1 instead?*
>
> #Thrift jar
>
> * libthrift-0.9.0.jar
>
>
> #xookeeper jar
>
> * zookeeper-3.4.5-cdh5.3.0.jar
>
>
> # plugin(the name says it is 1.5 but it is built with 1.6)
> geomesa-distributed-runtime-accumulo1.5-1.0.0-rc.3-SNAPSHOT.jar
> #wps jars
>
> * gs-web-wps-2.5.2.jar
> * gt-xsd-wps-11.2.jar
> * gt-process-geometry-11.2.jar
> * gs-wps-core-2.5.2.jar
> * serializer-2.7.1.jar
> * net.opengis.wps-11.2.jar
>
>
> Appreciate any help...
> Manas
>
> On Thu, Jan 8, 2015 at 3:53 PM, Manas Kar
> <manasdebashiskar@xxxxxxxxx <mailto:manasdebashiskar@xxxxxxxxx>>
> wrote:
>
> Hi Experts,
> I built my Geomesa with Accumulo 1.6 and hadoop.version =
> 2.5.0-cdh5.3.0
>
> It was bit convenient because my Cloudera instance provides
> Accumulo1.6.
> I am now trying to set up Geoserver to show Accumulo Data.
>
> I am using Geoserver 2.5.2 (With WPS)
> Accumulo1.6.
> Geomesa(RC.3)
>
> I am seeing the following error after following the document.
>
> WARNING: Can't load a service for category
> "DataStoreFactorySpi". Cause is "ServiceConfigurationError:
> org.geotools.data.DataStoreFactorySpi: Provider
> org.locationtech.geomesa.core.data.AccumuloDataStoreFactory
> could not be instantiated".
> java.util.ServiceConfigurationError:
> org.geotools.data.DataStoreFactorySpi: Provider
> org.locationtech.geomesa.core.data.AccumuloDataStoreFactory
> could not be instantiated
> at java.util.ServiceLoader.fail(ServiceLoader.java:224)
> at java.util.ServiceLoader.access$100(ServiceLoader.java:181)
> at
> java.util.ServiceLoader$LazyIterator.next(ServiceLoader.java:377)
> at java.util.ServiceLoader$1.next(ServiceLoader.java:445)
> at
> org.geotools.factory.FactoryRegistry.register(FactoryRegistry.java:826)
> at
> org.geotools.factory.FactoryRegistry.scanForPlugins(FactoryRegistry.java:772)
> .
> .
> .
> Caused by: java.lang.NoClassDefFoundError:
> org/apache/hadoop/io/Writable
>
> What am I missing here? Please help.
>
> Thanks
> Manas
>
>
> On Thu, Jan 8, 2015 at 3:30 PM, Manas Kar
> <manasdebashiskar@xxxxxxxxx
> <mailto:manasdebashiskar@xxxxxxxxx>> wrote:
>
> Hi,
> I am trying to make my current Cloudera installation
> (CDH5.3 with Accumulo 1.6) work with Geomesa.
>
> I saw a help in the Archive suggesting not to use Cloudera
> provided Accumulo. I was wondering if I can take a
> different route of compiling Geomesa with Accumulo 1.6?
>
> Also Do I have to change the hadoop version to the
> Cloudera provided version?
>
> Than
>
>
>
>
>
>
> _______________________________________________
> geomesa-users mailing list
> geomesa-users@xxxxxxxxxxxxxxxx
> To change your delivery options, retrieve your password, or unsubscribe from this list, visit
> http://www.locationtech.org/mailman/listinfo/geomesa-users
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://www.locationtech.org/mhonarc/lists/geomesa-users/attachments/20150112/16f9b275/attachment.html>
------------------------------
_______________________________________________
geomesa-users mailing list
geomesa-users@xxxxxxxxxxxxxxxx
To change your delivery options, retrieve your password, or unsubscribe from this list, visit
http://www.locationtech.org/mailman/listinfo/geomesa-users
End of geomesa-users Digest, Vol 11, Issue 7
********************************************