| [geomesa-users] Hortonworks/Geomesa distributed ingestion error. |
Hi all, I’m a new geomesa user, and have a question about running geomesa on hortonworks. I’ve just installed Geomesa 1.2.4 on our existing hortonworks HPD 2.4 cluster. That cluster is bundled with Accumulo 1.7+ and so far the installation has been smooth, so very happy to report Accumulo 1.7 support seems to work great so far. During the installation process, I also hooked up the Boundless geoserver tooling, then ran the geomesa ingestion demos, and I now have gdelt event file map displayed via geoserver in a layer preview window. So far, all good. Then I tried to ingest up some of my data I have resting in HDFS, and I’m getting an error. The details are: Using GEOMESA_HOME = /home/andrew/data/geo/geomesa-1.2.4/dist/tools/geomesa-tools-1.2.4 Creating schema gcam-schema Running ingestion in distributed mode Submitting job - please wait... Unable to parse '/hdp/apps/${hdp.version}/mapreduce/mapreduce.tar.gz#mr-framework' as a URI, check the setting for mapreduce.application.framework.path java.lang.IllegalArgumentException: Unable to parse '/hdp/apps/${hdp.version}/mapreduce/mapreduce.tar.gz#mr-framework' as a URI, check the setting for mapreduce.application.framework.path at org.apache.hadoop.mapreduce.JobSubmitter.addMRFrameworkToDistributedCache(JobSubmitter.java:443) at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:142) at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1290) at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1287) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657) at org.apache.hadoop.mapreduce.Job.submit(Job.java:1287) at org.locationtech.geomesa.tools.accumulo.ingest.AbstractIngestJob.run(AbstractIngestJob.scala:67) at org.locationtech.geomesa.tools.accumulo.ingest.ConverterIngest.runDistributedJob(ConverterIngest.scala:62) at org.locationtech.geomesa.tools.accumulo.ingest.AbstractIngest.runDistributed(AbstractIngest.scala:176) at org.locationtech.geomesa.tools.accumulo.ingest.AbstractIngest.run(AbstractIngest.scala:89) at org.locationtech.geomesa.tools.accumulo.commands.IngestCommand.execute(IngestCommand.scala:64) at org.locationtech.geomesa.tools.common.Runner$class.main(Runner.scala:26) at org.locationtech.geomesa.tools.accumulo.AccumuloRunner$.main(AccumuloRunner.scala:16) at org.locationtech.geomesa.tools.accumulo.AccumuloRunner.main(AccumuloRunner.scala) Caused by: java.net.URISyntaxException: Illegal character in path at index 11: /hdp/apps/${hdp.version}/mapreduce/mapreduce.tar.gz#mr-framework at java.net.URI$Parser.fail(URI.java:2848) at java.net.URI$Parser.checkChars(URI.java:3021) at java.net.URI$Parser.parseHierarchical(URI.java:3105) at java.net.URI$Parser.parse(URI.java:3063) at java.net.URI.<init>(URI.java:588) at org.apache.hadoop.mapreduce.JobSubmitter.addMRFrameworkToDistributedCache(JobSubmitter.java:441) ... 15 more [andrew@gzet loadscripts]$ It seems like a Hortonworks / Geomesa integration type error. The hortonworks’ ambari set environment variables are not available to Geomesa. Are there any viewpoints on how I should proceed? many thanks, Andrew Andrew J Morgan CEO, Bytesumo Limited E-mail: andrew@xxxxxxxxxxxx Bytesumo Limited - Registered Company in England and Wales 33 Brodrick Grove, London, SE2 0SR, UK. |