[
Date Prev][
Date Next][
Thread Prev][
Thread Next][
Date Index][
Thread Index]
[
List Home]
|
Re: [geclipse-dev] Transferring local input files during job submission - changes in jdl
|
Hi Mariusz,
> > InputSandbox = { <SOME-FILES> };
> > those files are uploaded from the local machine ... From there the CE
> > fetches the files, and the WN fetches them from the CE (a gLite
> > "optimization" ;-)
>
> So, as I understand input files workflow is:
> local machine -> CE -> WN
no, Pawel explained it already,
local machine <-> WMS <-> CE <-> WNs (WNs might communicate with WMS also)
there is no communication at all between local machine and CE or WNs
> Attribute InputSandbox says which files should be copied between
> local machine -> CE.
no, uploaded to WMS, CE is still not known at submission time!! (WNs even
less!)
> Because files on CE are stored in one folder (returned by
> getSandboxDestURI()),
that is a url on the WMS where the sandbox is stored
> so I think that whole this folder is copied
> between CE -> WN, right?
well, yes afterwards (WMS -> CE -> WN) but you don't have to care about
that
> If whole folder is copied, then entries to particular files, which I
> transferred to CE can be removed from JDL.
>
> But...
>
> > i think you can leave in the JDL all entries which are not relevant to
> > the current submission step, they shouldn't matter!
>
> you says entries to transfered local files shouldn't break job
> execution, so I will leave these entries and we will see what will
> happen :-)
>
> > myJobID = jobRegister( myJDL, delegationId )
> > getTransferProtocols()
> > getSandboxDestURI( myJobID, choosenProtocol )
> > [ Upload files here ]
> > jobStart( myJobID )
>
> Exactly!
you provide the JDL only once, so you don't have the chance to remove
anything from it! :-) And the JDL should be the one generated by the XSLT
transformation of the JSDL without any changes, that should be possible.
for the step: [ Upload files here ] you will be using a gridftp or https
connection to the WMS, so you also don't need the JDL here (but the names
of the files of course)
Cheers, Ariel
