Skip to main content
[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index] [List Home]
Re: [ptp-dev] Withdrawal from SimRel
Hi Greg,

It turns out that, while I have permission to edit and start a job, I don't have permission to actually fully run a job on openshift so I can't actually test.

I have written the script, based on CDT, that promotes a build from Jenkins saved artifacts for a specific build to the download server. You can run the promote-build* job which will prompt for parameters. Those parameters, defined in the Jenkinsfile, allow you essentially to select a source and destination for a build to promote. 

AFAICT there is little point in continuing to maintain compositeArtifacts/Contents files in your use case as you are only using them for milestones, but in the simrel you are pointing directly at the individual milestone build. So going forward I recommend you simply stop providing them and as such I have not written scripts to do anything with that.

I am now handing back to you with these next steps for you to do:

1) Review and approve the gerrit that adds the releng scripts to PTP: https://git.eclipse.org/r/#/c/146192/
2) Delete the promote-download job as it isn't needed (see not about composites above)
2) Add archive the artifacts post build step for ptp-build job of releng/org.eclipse.ptp.repo/target/repository/** - the remote-build and photran-build already do - you won't be able to promote a ptp-build until you do.
3) Try promoting a build for M1 to see if it works.

* the -a- got lost along the way, it makes it look like "promote-build" is equivalent to "remote-build", "ptp-build" and "photran-build" instead of being a different kind of job.

HTH,
Jonah


~~~
Jonah Graham
Kichwa Coders
www.kichwacoders.com


On Mon, 15 Jul 2019 at 17:58, Greg Watson <g.watson@xxxxxxxxxxxx> wrote:
Done for the *-build and *-verify jobs. Let me know if there are problems or you need to see any other jobs.

Thanks!
Greg

On Jul 15, 2019, at 2:39 PM, Jonah Graham <jonah@xxxxxxxxxxxxxxxx> wrote:

Can you add me, or even all users, extednded read permission so that I can see job config of all the other jobs?

Thanks, 
Jonah 

On Mon., Jul. 15, 2019, 14:37 Jonah Graham, <jonah@xxxxxxxxxxxxxxxx> wrote:
Thanks, the projects look good, so I'll try and get it ready for +3 this week, but I will let you know if you need to do one (hopefully) last manual release this time. 

Jonah 

On Mon., Jul. 15, 2019, 14:22 Greg Watson, <g.watson@xxxxxxxxxxxx> wrote:
Done. Let me know if you aren’t able to do something.

PTP is +3 BTW.

Greg

On Jul 15, 2019, at 12:53 PM, Jonah Graham <jonah@xxxxxxxxxxxxxxxx> wrote:

OK. Therefore, can you create two pipeline jobs, one called promote-a-build and one called promote-files-to-download. If I can edit them then I can run the builds and resolve the issues without further involvement.

I will add scripts/Jenkinsfiles/etc to https://git.eclipse.org/c/ptp/org.eclipse.ptp.git/tree/releng in a new directory called org.eclipse.ptp.jenkins.

Thanks
Jonah


~~~
Jonah Graham
Kichwa Coders
www.kichwacoders.com


On Mon, 15 Jul 2019 at 12:48, Greg Watson <g.watson@xxxxxxxxxxxx> wrote:
Is that possible? I can give you permission to edit the current jobs, but I’m not sure if it’s possible to give you permission to create new ones.

Greg

On Jul 15, 2019, at 12:40 PM, Jonah Graham <jonah@xxxxxxxxxxxxxxxx> wrote:

Hi Greg,

Can you give me permission to edit/run jobs & create two new ones.

Thanks,
Jonah
~~~
Jonah Graham
Kichwa Coders
www.kichwacoders.com


On Mon, 15 Jul 2019 at 12:19, Greg Watson <g.watson@xxxxxxxxxxxx> wrote:
Hi Jonah,

Thanks for offering to help with this. I don’t think there’s any way to give you access to the CI instance other than getting you committer status. I think I could give you permission to edit/run the current jobs or create new ones, if that would work for you. In any case I’d be happy to work with you to figure out how to fix the situation. Let me know what works best for you.

Regards,
Greg

On Jul 15, 2019, at 11:33 AM, Jonah Graham <jonah@xxxxxxxxxxxxxxxx> wrote:

Hi Greg,

The release system you are using is very similar to what CDT does. I have already automated that with jobs on CDT's CI backed by Jenkinsfiles and scripts in github:
"Promote a build" - this uploads a build to somewhere on download.eclipse.org
"Promote files to download" - this uploads arbitrary files to download.eclipse.org and is, so far, only used to update composite xml files.

I can do the same for PTP as it is very much in CDT's interest to have one of our dependent and consumer projects continue to release regularly. I can probably do it for M1 this week if you have time, but it may be best to do your M1 contribution as normal and get this working for M2 in 6 weeks. What is your +N for PTP?

However as I am not a committer on PTP so I can't create new jenkins jobs and/or test them, so if you are interested I can work with you on this. 

(As for the Foundations' contribution here, I don't think we can expect them to do individual project releng work - it would be nice if someone coordinated this kind of releng work across multiple projects, perhaps providing consistent Jenkinsfiles or similar for everyone to use. However I think at the moment that is a task no one want to takeover. This aspect of the conversation should be continued on cbi-dev.)

HTH,
Jonah


~~~
Jonah Graham
Kichwa Coders
www.kichwacoders.com


On Mon, 15 Jul 2019 at 10:54, Doug Schaefer <cdtdoug@xxxxxxxxx> wrote:
On Mon, Jul 15, 2019 at 10:36 AM Greg Watson <g.watson@xxxxxxxxxxxx> wrote:
That wouldn’t help PTP, however.

No, but it would help CDT :).

Jonah has done a masterful job of the CDT releng. Let's see what he can come up with for PTP.
 

Greg

On Jul 15, 2019, at 10:16 AM, Doug Schaefer <cdtdoug@xxxxxxxxx> wrote:

As another option, we have discussed moving org.eclipse.remote down the stack a bit. We could take it over in CDT since we are using it for remote launching and we never got around to creating an IDE commons project, and probably won't at this point.

Thoughts?
Doug.

On Mon, Jul 15, 2019 at 10:08 AM Jonah Graham <jonah@xxxxxxxxxxxxxxxx> wrote:
Hi Greg,

I too am curious, while you are discussing simrel, it seems you are really saying there won't be any future PTP relesases? Or is the problem just the simrel contribution? 

Can you point me at what the PTP release scripting/process is so I can consider whether I, or others, can automate it? 

Thanks 
Jonah 

On Mon., Jul. 15, 2019, 09:24 Greg Watson, <g.watson@xxxxxxxxxxxx> wrote:
Hi,

The Eclipse Foundation are planning to remove ssh access to the build server, something we’ve been using for the last 15 years for our release process. Since the Foundation does not provide any standard mechanism for managing project releases, individual projects have had to develop their own processes. The PTP release process, which has been entirely adequate until now, requires some manual commands in order to verify the repository is valid and make it available. Without ssh access, we will need to develop a completely new release process that is driven from scripts that are run via Jenkins jobs. Currently there are no resources available to do this, and the Foundation has not offered any assistance or indication that they are intending to provide a standard release mechanism for projects to use. As a consequence PTP will need to withdraw from the SimRel and remove the Eclipse IDE for Scientific Computing from the downloads page.  Unless I hear anything to the contrary, I plan to inform them of this at the end of the week.

Regards,
Greg
_______________________________________________
ptp-dev mailing list
ptp-dev@xxxxxxxxxxx
To change your delivery options, retrieve your password, or unsubscribe from this list, visit
https://www.eclipse.org/mailman/listinfo/ptp-dev
_______________________________________________
ptp-dev mailing list
ptp-dev@xxxxxxxxxxx
To change your delivery options, retrieve your password, or unsubscribe from this list, visit
https://www.eclipse.org/mailman/listinfo/ptp-dev
_______________________________________________
ptp-dev mailing list
ptp-dev@xxxxxxxxxxx
To change your delivery options, retrieve your password, or unsubscribe from this list, visit
https://www.eclipse.org/mailman/listinfo/ptp-dev

_______________________________________________
ptp-dev mailing list
ptp-dev@xxxxxxxxxxx
To change your delivery options, retrieve your password, or unsubscribe from this list, visit
https://www.eclipse.org/mailman/listinfo/ptp-dev
_______________________________________________
ptp-dev mailing list
ptp-dev@xxxxxxxxxxx
To change your delivery options, retrieve your password, or unsubscribe from this list, visit
https://www.eclipse.org/mailman/listinfo/ptp-dev
_______________________________________________
ptp-dev mailing list
ptp-dev@xxxxxxxxxxx
To change your delivery options, retrieve your password, or unsubscribe from this list, visit
https://www.eclipse.org/mailman/listinfo/ptp-dev

_______________________________________________
ptp-dev mailing list
ptp-dev@xxxxxxxxxxx
To change your delivery options, retrieve your password, or unsubscribe from this list, visit
https://www.eclipse.org/mailman/listinfo/ptp-dev
_______________________________________________
ptp-dev mailing list
ptp-dev@xxxxxxxxxxx
To change your delivery options, retrieve your password, or unsubscribe from this list, visit
https://www.eclipse.org/mailman/listinfo/ptp-dev

_______________________________________________
ptp-dev mailing list
ptp-dev@xxxxxxxxxxx
To change your delivery options, retrieve your password, or unsubscribe from this list, visit
https://www.eclipse.org/mailman/listinfo/ptp-dev
_______________________________________________
ptp-dev mailing list
ptp-dev@xxxxxxxxxxx
To change your delivery options, retrieve your password, or unsubscribe from this list, visit
https://www.eclipse.org/mailman/listinfo/ptp-dev

_______________________________________________
ptp-dev mailing list
ptp-dev@xxxxxxxxxxx
To change your delivery options, retrieve your password, or unsubscribe from this list, visit
https://www.eclipse.org/mailman/listinfo/ptp-dev
_______________________________________________
ptp-dev mailing list
ptp-dev@xxxxxxxxxxx
To change your delivery options, retrieve your password, or unsubscribe from this list, visit
https://www.eclipse.org/mailman/listinfo/ptp-dev

_______________________________________________
ptp-dev mailing list
ptp-dev@xxxxxxxxxxx
To change your delivery options, retrieve your password, or unsubscribe from this list, visit
https://www.eclipse.org/mailman/listinfo/ptp-dev

Back to the top