| org.griphyn.cPlanner.transfer.SingleFTPerXFERJobRefiner
 org.griphyn.cPlanner.transfer.refiner.GRMS
| GRMS | | public class GRMS extends SingleFTPerXFERJobRefiner (Code) | | The refiner that is compatible with the GRMS system. In this the job
specification specifies what input and output file it needs. Hence in this
refiner, unlike the other refiners we do not add any transfer nodes explicitly,
just specify the appropriate urls and let the GRMS system do the magic of
transferring the files to and from the execution pools. It does not perform
any registration of the output files at present, and DOES NOT SUPPORT
RANDOM DIRECTORIES as directories on the remote side are handled by the
GRMS system.
Please Note that this has to be used in conjunction with the GRMSWriter.
author:
Karan Vahi
version:
$Revision: 50 $ |
| Method Summary | |
| public void | addInterSiteTXNodes(SubInfo job, Collection files)
Adds the inter pool transfer nodes that are required for transferring
the output files of the parents to the jobs execution site. | | public void | addJob(SubInfo job)
Add a new job to the workflow being refined. | | public void | addRelation(String parent, String child)
Adds a new relation to the workflow being refiner. | | public void | addRelation(String parent, String child, String site, boolean parentNew)
Adds a new relation to the workflow. | | public void | addStageInXFERNodes(SubInfo job, Collection files)
Adds the stage in transfer nodes which transfer the input files for a job,
from the location returned from the replica catalog to the job's execution
pool. | | public void | addStageOutXFERNodes(SubInfo job, Collection files, ReplicaCatalogBridge rcb)
Adds the stageout transfer nodes, that stage data to an output site
specified by the user.
Parameters:
job - SubInfo object corresponding to the node towhich the files are to be transferred to.
Parameters:
files - Collection of FileTransfer objects containing theinformation about source and destURL's.
Parameters:
rcb - bridge to the Replica Catalog. | | public void | addStageOutXFERNodes(SubInfo job, Collection files, ReplicaCatalogBridge rcb, boolean deletedLeaf)
For GRMS we do not need to add any push transfer nodes. | | public void | done()
Signals that the traversal of the workflow is done. | | public String | getDescription()
Returns a textual description of the transfer mode. |
| DESCRIPTION | | final public static String DESCRIPTION(Code) | | A short description of the transfer refinement.
|
| mLogMsg | | protected String mLogMsg(Code) | | The string holding the logging messages
|
| GRMS | | public GRMS(ADag dag, PegasusProperties properties, PlannerOptions options)(Code) | | The overloaded constructor.
Parameters:
dag - the workflow to which transfer nodes need to be added.
Parameters:
properties - the PegasusProperties object containing allthe properties required by Pegasus.
Parameters:
options - the options passed to the planner. |
| addInterSiteTXNodes | | public void addInterSiteTXNodes(SubInfo job, Collection files)(Code) | | Adds the inter pool transfer nodes that are required for transferring
the output files of the parents to the jobs execution site. They are not
supported in this case.
Parameters:
job - SubInfo object corresponding to the node towhich the files are to be transferred to.
Parameters:
files - Collection of FileTransfer objects containing theinformation about source and destURL's. |
| addJob | | public void addJob(SubInfo job)(Code) | | Add a new job to the workflow being refined.
Parameters:
job - the job to be added. |
| addRelation | | public void addRelation(String parent, String child)(Code) | | Adds a new relation to the workflow being refiner.
Parameters:
parent - the jobname of the parent node of the edge.
Parameters:
child - the jobname of the child node of the edge. |
| addRelation | | public void addRelation(String parent, String child, String site, boolean parentNew)(Code) | | Adds a new relation to the workflow. In the case when the parent is a
transfer job that is added, the parentNew should be set only the first
time a relation is added. For subsequent compute jobs that maybe
dependant on this, it needs to be set to false.
Parameters:
parent - the jobname of the parent node of the edge.
Parameters:
child - the jobname of the child node of the edge.
Parameters:
site - the execution pool where the transfer node is to be run.
Parameters:
parentNew - the parent node being added, is the new transfer joband is being called for the first time. |
| addStageInXFERNodes | | public void addStageInXFERNodes(SubInfo job, Collection files)(Code) | | Adds the stage in transfer nodes which transfer the input files for a job,
from the location returned from the replica catalog to the job's execution
pool. It creates a stagein job for each file to be transferred.
Parameters:
job - SubInfo object corresponding to the node towhich the files are to be transferred to.
Parameters:
files - Collection of FileTransfer objects containing theinformation about source and destURL's. |
| addStageOutXFERNodes | | public void addStageOutXFERNodes(SubInfo job, Collection files, ReplicaCatalogBridge rcb)(Code) | | Adds the stageout transfer nodes, that stage data to an output site
specified by the user.
Parameters:
job - SubInfo object corresponding to the node towhich the files are to be transferred to.
Parameters:
files - Collection of FileTransfer objects containing theinformation about source and destURL's.
Parameters:
rcb - bridge to the Replica Catalog. Used for creating registrationnodes in the workflow. |
| addStageOutXFERNodes | | public void addStageOutXFERNodes(SubInfo job, Collection files, ReplicaCatalogBridge rcb, boolean deletedLeaf)(Code) | | For GRMS we do not need to add any push transfer nodes. Instead we modify
the job description to specify the urls to where the materialized files
need to be pushed to.
It modifies the job input file list to point to urls of the files that are
to be used. The deletedLeaf flag is immaterial for this case.
Parameters:
job - SubInfo object corresponding to the node towhich the files are to be transferred to.
Parameters:
files - Collection of FileTransfer objects containing theinformation about source and destURL's.
Parameters:
rcb - bridge to the Replica Catalog. Used for creating registrationnodes in the workflow.
Parameters:
deletedLeaf - to specify whether the node is being added fora deleted node by the reduction engine or not.default: false |
| done | | public void done()(Code) | | Signals that the traversal of the workflow is done. This would allow
the transfer mechanisms to clean up any state that they might be keeping
that needs to be explicitly freed.
|
| getDescription | | public String getDescription()(Code) | | Returns a textual description of the transfer mode.
a short textual description |
|
|