| org.griphyn.cPlanner.transfer.Refiner
All known Subclasses: org.griphyn.cPlanner.transfer.AbstractRefiner,
| Refiner | | public interface Refiner extends org.griphyn.cPlanner.engine.Refiner(Code) | | The refiner interface, that determines the functions that need to be
implemented to add various types of transfer nodes to the workflow.
author:
Karan Vahi
author:
Gaurang Mehta
version:
$Revision: 243 $ |
| Field Summary | |
| final public static String | INTER_POOL_PREFIX
The prefix for the jobs which are added to transfer the files generated by
the parents of a job to the jobs execution pool. | | final public static String | REGISTER_PREFIX
The prefix for the jobs which register the newly materialized files in the
Replica Catalog. | | final public static String | STAGE_IN_PREFIX
The prefix for the jobs which are added to transfer the files to a job's
execution pool from the location returned from the replica mechanism. | | final public static String | STAGE_OUT_PREFIX
The prefix for the jobs which are added to transfer the files generated by
a job on an execution pool to the output pool. |
| Method Summary | |
| public void | addInterSiteTXNodes(SubInfo job, Collection files)
Adds the inter pool transfer nodes that are required for transferring
the output files of the parents to the jobs execution site. | | public void | addJob(SubInfo job)
Add a new job to the workflow being refined. | | public void | addRelation(String parent, String child)
Adds a new relation to the workflow being refiner. | | public void | addRelation(String parent, String child, String pool, boolean parentNew)
Adds a new relation to the workflow. | | public void | addStageInXFERNodes(SubInfo job, Collection files)
Adds the stage in transfer nodes which transfer the input files for a job,
from the location returned from the replica catalog to the job's execution
pool. | | public void | addStageOutXFERNodes(SubInfo job, Collection files, ReplicaCatalogBridge rcb)
Adds the stageout transfer nodes, that stage data to an output site
specified by the user.
Parameters:
job - SubInfo object corresponding to the node towhich the files are to be transferred to.
Parameters:
files - Collection of FileTransfer objects containing theinformation about source and destURL's.
Parameters:
rcb - bridge to the Replica Catalog. | | abstract public void | addStageOutXFERNodes(SubInfo job, Collection files, ReplicaCatalogBridge rcb, boolean deletedLeaf)
Adds the stageout transfer nodes, that stage data to an output site
specified by the user. | | public void | done()
Signals that the traversal of the workflow is done. | | public String | getDescription()
Returns a textual description of the transfer mode. | | public boolean | isSiteThirdParty(String site, int type)
Returns whether a Site is third party enabled or not. | | public void | loadImplementations(PegasusProperties properties, PlannerOptions options)
Loads the appropriate implementations that is required by this refinement
strategy for different types of transfer jobs. | | public boolean | runTPTOnRemoteSite(String site, int type)
Returns whether the third party transfers for a particular site are to
be run on the remote site or the submit host. |
| INTER_POOL_PREFIX | | final public static String INTER_POOL_PREFIX(Code) | | The prefix for the jobs which are added to transfer the files generated by
the parents of a job to the jobs execution pool. The new job's name is
INTER_POOL_PREFIX + nameofjob + _+ counter.
|
| REGISTER_PREFIX | | final public static String REGISTER_PREFIX(Code) | | The prefix for the jobs which register the newly materialized files in the
Replica Catalog. The job's name should be RC_REGISTER_PREFIX + nameofjob,
where nameofjob is the job that generates these materialized files.
|
| STAGE_IN_PREFIX | | final public static String STAGE_IN_PREFIX(Code) | | The prefix for the jobs which are added to transfer the files to a job's
execution pool from the location returned from the replica mechanism.
the new job's name is FROM_RC_PREFIX + nameofjob + _+ counter.
|
| STAGE_OUT_PREFIX | | final public static String STAGE_OUT_PREFIX(Code) | | The prefix for the jobs which are added to transfer the files generated by
a job on an execution pool to the output pool. The new job's name is
TO_RC_PREFIX + nameofjob + _+ counter.
|
| addInterSiteTXNodes | | public void addInterSiteTXNodes(SubInfo job, Collection files)(Code) | | Adds the inter pool transfer nodes that are required for transferring
the output files of the parents to the jobs execution site.
Parameters:
job - SubInfo object corresponding to the node towhich the files are to be transferred to.
Parameters:
files - Collection of FileTransfer objects containing theinformation about source and destURL's. |
| addJob | | public void addJob(SubInfo job)(Code) | | Add a new job to the workflow being refined.
Parameters:
job - the job to be added. |
| addRelation | | public void addRelation(String parent, String child)(Code) | | Adds a new relation to the workflow being refiner.
Parameters:
parent - the jobname of the parent node of the edge.
Parameters:
child - the jobname of the child node of the edge. |
| addRelation | | public void addRelation(String parent, String child, String pool, boolean parentNew)(Code) | | Adds a new relation to the workflow. In the case when the parent is a
transfer job that is added, the parentNew should be set only the first
time a relation is added. For subsequent compute jobs that maybe
dependant on this, it needs to be set to false.
Parameters:
parent - the jobname of the parent node of the edge.
Parameters:
child - the jobname of the child node of the edge.
Parameters:
pool - the execution pool where the transfer node is to be run.
Parameters:
parentNew - the parent node being added, is the new transfer joband is being called for the first time. |
| addStageInXFERNodes | | public void addStageInXFERNodes(SubInfo job, Collection files)(Code) | | Adds the stage in transfer nodes which transfer the input files for a job,
from the location returned from the replica catalog to the job's execution
pool.
Parameters:
job - SubInfo object corresponding to the node towhich the files are to be transferred to.
Parameters:
files - Collection of FileTransfer objects containing theinformation about source and destURL's. |
| addStageOutXFERNodes | | public void addStageOutXFERNodes(SubInfo job, Collection files, ReplicaCatalogBridge rcb)(Code) | | Adds the stageout transfer nodes, that stage data to an output site
specified by the user.
Parameters:
job - SubInfo object corresponding to the node towhich the files are to be transferred to.
Parameters:
files - Collection of FileTransfer objects containing theinformation about source and destURL's.
Parameters:
rcb - bridge to the Replica Catalog. Used for creating registrationnodes in the workflow. |
| addStageOutXFERNodes | | abstract public void addStageOutXFERNodes(SubInfo job, Collection files, ReplicaCatalogBridge rcb, boolean deletedLeaf)(Code) | | Adds the stageout transfer nodes, that stage data to an output site
specified by the user. It also adds the registration nodes to register
the data in the replica catalog if required.
Parameters:
job - SubInfo object corresponding to the node towhich the files are to be transferred to.
Parameters:
files - Collection of FileTransfer objects containing theinformation about source and destURL's.
Parameters:
rcb - bridge to the Replica Catalog. Used for creating registrationnodes in the workflow.
Parameters:
deletedLeaf - to specify whether the node is being added fora deleted node by the reduction engine or not.default: false |
| done | | public void done()(Code) | | Signals that the traversal of the workflow is done. This would allow
the transfer mechanisms to clean up any state that they might be keeping
that needs to be explicitly freed.
|
| getDescription | | public String getDescription()(Code) | | Returns a textual description of the transfer mode.
a short textual description |
| isSiteThirdParty | | public boolean isSiteThirdParty(String site, int type)(Code) | | Returns whether a Site is third party enabled or not.
Parameters:
site - the name of the site.
Parameters:
type - the type of transfer job for which the URL is being constructed.Should be one of the following:stage-instage-outinter-pool transfer true pool is third party enabledfalse pool is not third party enabled.
See Also: SubInfo.STAGE_IN_JOB
See Also: SubInfo.INTER_POOL_JOB
See Also: SubInfo.STAGE_OUT_JOB |
| runTPTOnRemoteSite | | public boolean runTPTOnRemoteSite(String site, int type)(Code) | | Returns whether the third party transfers for a particular site are to
be run on the remote site or the submit host.
Parameters:
site - the name of the site.
Parameters:
type - the type of transfer job for which the URL is being constructed.Should be one of the following:stage-instage-outinter-pool transfer true if the transfers are to be run on remote site, else false.
See Also: SubInfo.STAGE_IN_JOB
See Also: SubInfo.INTER_POOL_JOB
See Also: SubInfo.STAGE_OUT_JOB |
|
|