| org.griphyn.cPlanner.transfer.refiner.Default
 org.griphyn.cPlanner.transfer.refiner.Chain
| Chain | | public class Chain extends Default (Code) | | This transfer refiner builds upon the Default Refiner.
The defaul Refiner allows the transfer of multiple files in a single
condor job. However, it adds the stage in transfer nodes in parallel leading
to multiple invocation of the globus-url-copy at remote execution pools,
while running huge workflows.
This refiner, tries to circumvent this problem by chaining up the stagein jobs
instead of scheduling in parallel. This works best only when the top level
of the workflow requires stage in jobs. The correct way is that the traversal
needs to be done breath first in the TransferEngine.java.
author:
Karan Vahi
author:
Gaurang Mehta
version:
$Revision: 50 $ |
| Field Summary | |
| final public static String | DEFAULT_BUNDLE_FACTOR
The default bundling factor that identifies the number of transfer jobs
that are being created per execution pool for the workflow. | | final public static String | DESCRIPTION
A short description of the transfer refinement. | | protected PoolInfoProvider | mSCHandle
The handle to the Site Catalog. |
| Method Summary | |
| public void | addRelation(String parent, String child, String site, boolean parentNew)
Adds a new relation to the workflow. | | public void | done()
Prints out the bundles and chains that have been constructed. | | public String | getDescription()
Returns a textual description of the transfer mode. | | public int | getSiteBundleValue(String site, String key)
Determines the bundle factor for a particular site on the basis of the
key associcated with the underlying transfer transformation in the
transformation catalog. |
| DEFAULT_BUNDLE_FACTOR | | final public static String DEFAULT_BUNDLE_FACTOR(Code) | | The default bundling factor that identifies the number of transfer jobs
that are being created per execution pool for the workflow.
|
| DESCRIPTION | | final public static String DESCRIPTION(Code) | | A short description of the transfer refinement.
|
| mSCHandle | | protected PoolInfoProvider mSCHandle(Code) | | The handle to the Site Catalog. It is instantiated in this class.
|
| Chain | | public Chain(ADag dag, PegasusProperties properties, PlannerOptions options)(Code) | | The overloaded constructor.
Parameters:
dag - the workflow to which transfer nodes need to be added.
Parameters:
properties - the PegasusProperties object containing allthe properties required by Pegasus.
Parameters:
options - the options passed to the planner. |
| addRelation | | public void addRelation(String parent, String child, String site, boolean parentNew)(Code) | | Adds a new relation to the workflow. In the case when the parent is a
transfer job that is added, the parentNew should be set only the first
time a relation is added. For subsequent compute jobs that maybe
dependant on this, it needs to be set to false.
Parameters:
parent - the jobname of the parent node of the edge.
Parameters:
child - the jobname of the child node of the edge.
Parameters:
site - the execution site where the transfer node is to be run.
Parameters:
parentNew - the parent node being added, is the new transfer joband is being called for the first time. |
| done | | public void done()(Code) | | Prints out the bundles and chains that have been constructed.
|
| getDescription | | public String getDescription()(Code) | | Returns a textual description of the transfer mode.
a short textual description |
| getSiteBundleValue | | public int getSiteBundleValue(String site, String key)(Code) | | Determines the bundle factor for a particular site on the basis of the
key associcated with the underlying transfer transformation in the
transformation catalog. If none specified in transformation catalog then
one is picked up from the site catalog. If the key is not found in the
site catalog too , then the global default is returned.
Parameters:
site - the site at which the transfer job is being run.
Parameters:
key - the bundle key whose value needs to be searched. the bundle factor.
See Also: Chain.DEFAULT_BUNDLE_FACTOR |
| Methods inherited from org.griphyn.cPlanner.transfer.refiner.Default | public void addInterSiteTXNodes(SubInfo job, Collection files)(Code)(Java Doc)
public void addJob(SubInfo job)(Code)(Java Doc)
public void addRelation(String parent, String child)(Code)(Java Doc)
public void addRelation(String parent, String child, String site, boolean parentNew)(Code)(Java Doc)
public void addStageInXFERNodes(SubInfo job, Collection files)(Code)(Java Doc)
public void addStageOutXFERNodes(SubInfo job, Collection files, ReplicaCatalogBridge rcb)(Code)(Java Doc)
public void addStageOutXFERNodes(SubInfo job, Collection files, ReplicaCatalogBridge rcb, boolean deletedLeaf)(Code)(Java Doc)
protected void appendAttribute(StringBuffer xmlFeed, String key, String value)(Code)(Java Doc)
protected String constructFileKey(String lfn, String siteHandle)(Code)(Java Doc)
protected SubInfo createRegistrationJob(String regJobName, SubInfo job, Collection files, ReplicaCatalogBridge rcb)(Code)(Java Doc)
public void done()(Code)(Java Doc)
public String getDescription()(Code)(Java Doc)
protected void logRefinerAction(SubInfo computeJob, SubInfo txJob, Collection files, String type)(Code)(Java Doc)
|
|
|