[
Date Prev][
Date Next][
Thread Prev][
Thread Next][
Date Index][
Thread Index]
[
List Home]
|
Re: [geomesa-users] geomesa-accumulo - Ingesting files with command line without editing application.conf
|
Emilo:
Sorry I should have mentioned. I am running accumulo 1.9.3 and
geomesa 3.0.0.
Thanks for the quick response.
On 7/30/2020 3:42 PM, Emilio Lahr-Vivaz wrote:
Hello,
I don't think that the converter is the issue - are you possibly on
Accumulo 1.6? There appears to be an error checking the table
namespace, which I believe was only added in 1.7 (which is the minimum
supported version for GeoMesa). Otherwise, check your cluster logs,
there should be more details on the error there.
Thanks,
Emilio
On 7/30/20 3:06 PM, David Boyd wrote:
All:
I have a small issue. My geomesa-accumulo is managed by puppet.
So I can't edit
the baseline application.conf file in the ${GEOMESA_HOME}/conf dir.
I tried putting the converter definition and sft definition in files
and referencing them from the command line.
But either I have the syntax/format wrong or something else.
Here is my command I am running:
[root@dspcnode11 jwacdata]# geomesa-accumulo ingest -z dspcnode01 -u
xxxxx -p xxxxxxxxx -i dspc -c power -C tranlines.conf -f
tranlines.conf transmission_lines/Transmission_Lines.shp
INFO Creating schema 'transmission-lines'
ERROR org.apache.thrift.TApplicationException: Internal error
processing checkNamespaceClass
org.apache.accumulo.core.client.AccumuloException:
org.apache.thrift.TApplicationException: Internal error processing
checkNamespaceClass
at
org.apache.accumulo.core.client.impl.NamespaceOperationsImpl.testClassLoad(NamespaceOperationsImpl.java:268)
at
org.locationtech.geomesa.accumulo.data.AccumuloDataStore.preSchemaCreate(AccumuloDataStore.scala:166)
at
org.locationtech.geomesa.index.geotools.MetadataBackedDataStore.createSchema(MetadataBackedDataStore.scala:136)
at
org.locationtech.geomesa.index.geotools.MetadataBackedDataStore.createSchema(MetadataBackedDataStore.scala:40)
at
org.locationtech.geomesa.tools.ingest.AbstractConverterIngest.run(AbstractConverterIngest.scala:31)
at
org.locationtech.geomesa.tools.ingest.IngestCommand$$anonfun$execute$2.apply(IngestCommand.scala:106)
at
org.locationtech.geomesa.tools.ingest.IngestCommand$$anonfun$execute$2.apply(IngestCommand.scala:105)
at scala.Option.foreach(Option.scala:257)
at
org.locationtech.geomesa.tools.ingest.IngestCommand$class.execute(IngestCommand.scala:105)
at
org.locationtech.geomesa.accumulo.tools.ingest.AccumuloIngestCommand.execute(AccumuloIngestCommand.scala:24)
at
org.locationtech.geomesa.tools.Runner$class.main(Runner.scala:28)
at
org.locationtech.geomesa.accumulo.tools.AccumuloRunner$.main(AccumuloRunner.scala:19)
at
org.locationtech.geomesa.accumulo.tools.AccumuloRunner.main(AccumuloRunner.scala)
Caused by: org.apache.thrift.TApplicationException: Internal error
processing checkNamespaceClass
at
org.apache.thrift.TApplicationException.read(TApplicationException.java:111)
at
org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:79)
at
org.apache.accumulo.core.client.impl.thrift.ClientService$Client.recv_checkNamespaceClass(ClientService.java:1022)
at
org.apache.accumulo.core.client.impl.thrift.ClientService$Client.checkNamespaceClass(ClientService.java:1005)
at
org.apache.accumulo.core.client.impl.NamespaceOperationsImpl$4.execute(NamespaceOperationsImpl.java:252)
at
org.apache.accumulo.core.client.impl.NamespaceOperationsImpl$4.execute(NamespaceOperationsImpl.java:249)
at
org.apache.accumulo.core.client.impl.ServerClient.executeRaw(ServerClient.java:83)
at
org.apache.accumulo.core.client.impl.NamespaceOperationsImpl.testClassLoad(NamespaceOperationsImpl.java:249)
... 12 more
Here is the sft file content:
"transmission-lines" = {
attributes = [
{ name = "fid", type = "String", index = false }
{ name = "inferred", type = "String", index = true }
{ name = "naics_code", type = "String", index = true }
{ name = "naics_desc", type = "String", index = false }
{ name = "owner", type = "String", index = true }
{ name = "shape_length", type = "Double", index = false }
{ name = "source", type = "String", index = true }
{ name = "sourcedate", type = "Date", index = true }
{ name = "status", type = "String", index = true }
{ name = "sub_1", type = "String", index = true }
{ name = "sub_2", type = "String", index = true }
{ name = "type", type = "String", index = true }
{ name = "val_date", type = "Date", index = true }
{ name = "val_method", type = "String", index = true }
{ name = "volt_class", type = "String", index = true }
{ name = "voltage", type = "Double", index = true }
{ name = "geom", type = "LineString", index = true,
srid = 4326, default = true }
]
}
}
Here is the converter:
"transmission-shp" = {
type = "shp"
id-field = "$0"
fields = [
{ name = "inferred", transform =
"INFERRED" }
{ name = "naics_code", transform =
"NAICS_CODE" }
{ name = "naics_desc", transform =
"NAICS_DESC" }
{ name = "owner", transform = "OWNER" }
{ name = "shape_length", transform =
"SHAPE_Leng" }
{ name = "source", transform = "SOURCE" }
{ name = "sourcedate", transform =
"SOURCEDATE" }
{ name = "status", transform = "STATUS" }
{ name = "sub_1", transform = "SUB_1" }
{ name = "sub_2", transform = "SUB_2" }
{ name = "type", transform = "TYPE" }
{ name = "val_date", transform =
"VAL_DATE" }
{ name = "val_method", transform =
"VAL_METHOD" }
{ name = "volt_class", transform =
"VAL_CLASS" }
{ name = "voltage", transform =
"VOLTAGE" }
{ name = "geom", transform =
"multilinestring(the_geom)" }
]
}
_______________________________________________
geomesa-users mailing list
geomesa-users@xxxxxxxxxxx
To unsubscribe from this list, visit
https://dev.eclipse.org/mailman/listinfo/geomesa-users
--
========= mailto:dboyd@xxxxxxxxxxxxxxxxx ============
David W. Boyd
VP, Data Solutions
10432 Balls Ford, Suite 240
Manassas, VA 20109
office: +1-703-552-2862
cell: +1-703-402-7908
============== http://www.incadencecorp.com/ ============
ISO/IEC JTC1 SC42/WG2, editor ISO/IEC 20546, ISO/IEC 20547-1
Chair INCITS TG Big Data
Co-chair NIST Big Data Public Working Group Reference Architecture
First Robotic Mentor - FRC, FTC - www.iliterobotics.org
Board Member- USSTEM Foundation - www.usstem.org
The information contained in this message may be privileged
and/or confidential and protected from disclosure.
If the reader of this message is not the intended recipient
or an employee or agent responsible for delivering this message
to the intended recipient, you are hereby notified that any
dissemination, distribution or copying of this communication
is strictly prohibited. If you have received this communication
in error, please notify the sender immediately by replying to
this message and deleting the material from any computer.
