Eclipse Community Forums: Newcomers » how to add jar libraries to eclipse pydev ide?

Help

Home

Home » Newcomers » Newcomers » how to add jar libraries to eclipse pydev ide?

Show: Today's Messages :: Show Polls :: Message Navigator

how to add jar libraries to eclipse pydev ide? [message #1838530]

Sun, 28 February 2021 01:11

Eclipse User

I use eclipse 2020-12 and try to make codes to integrate spark structured streaming and kafka. My reference site is here.
https://spark.apache.org/docs/latest/structured-streaming-kafka-integration.html
But I face the trouble with "Linking". The documents say

Quote:

Linking
For Scala/Java applications using SBT/Maven project definitions, link your application with the following artifact:

groupId = org.apache.spark
artifactId = spark-sql-kafka-0-10_2.12
version = 3.0.2
Please note that to use the headers functionality, your Kafka client version should be version 0.11.0.0 or up.

For Python applications, you need to add this above library and its dependencies when deploying your application. See the Deploying subsection below.

I use eclipse pydev so I want to add above library on eclipse pydev environment. In the eclipse pydev preferences I can add libraries on eclipse but I can not find the jars file option, but zip or egg file. How to add spark-sql-kafka-0-10_2.12 jar file on my pydev project? Your any reply will be thankful. Best regards

Report message to a moderator