Eclipse Community Forums: Newcomers » export CLASSPATH=`$HADOOP_HOME/bin/hdfs classpath --glob` on eclipse pydev

Home » Newcomers » Newcomers » export CLASSPATH=`$HADOOP_HOME/bin/hdfs classpath --glob` on eclipse pydev(how to export classpath of hadoop library jars on eclipse pydev ide)

Show: Today's Messages :: Show Polls :: Message Navigator

export CLASSPATH=`$HADOOP_HOME/bin/hdfs classpath --glob` on eclipse pydev [message #1836077]

Sat, 19 December 2020 23:08

Joseph Hwang

Messages: 8
Registered: September 2013

Junior Member

Hello! I use eclipse pydev ide on CentOS 8 and try to control hadoop file system 3.3 with pyarrow python package. Before executing eclipse pydev, I have to export classpath like below to connect hadoop file system by using pyarrow

> export CLASSPATH=`$HADOOP_HOME/bin/hdfs classpath --glob`

And I can connect to hadoop file system with the pyarrow python codes.

from pyarrow import fs 
hdfs = fs.HadoopFileSystem('localhost', 9000)

As you see, exporting classpath has to be executed on the shell outside the eclipse pydev ide. But I want to know how to configure the exporting CLASSPATH on eclipse inside pydev menu. Kindly inform me how to export the classpath of hadoop file system inside the eclipse pydev menu, so I can configure the classpath without executing on the shell.
Best regards

Report message to a moderator

Re: export CLASSPATH=`$HADOOP_HOME/bin/hdfs classpath --glob` on eclipse pydev [message #1836085 is a reply to message #1836077]

Sun, 20 December 2020 06:47

Ed Merks

Messages: 31702
Registered: July 2009

Senior Member

It's probably best to look here for a place to ask:

https://www.pydev.org/

As guess, I imagine they use Launch Configurations so that you can use Run -> Run Configurations... and there the tabs will provide you control over t

Ed Merks
Professional Support: https://www.macromodeling.com/

Report message to a moderator

Previous Topic:	DOT Plugin Exception
Next Topic:	Database development and debug

Goto Forum:

-=] Back to Top [=-

[ Syndicate this forum (XML) ] [

]

Current Time: Tue Jan 19 23:01:38 GMT 2021

.:: Contact :: Home ::.

Breadcrumbs

Sign up to our Newsletter