Ends up creating a cleanup dag that deletes the remote directories that
were created by the create dir jobs. The cleanup dag is generated in a
sub directory from the main directory containing the submit files of the
dag. The dag consists of independant jobs, with each job responsible for
deleting directory for a execution pool. The current way of generating the
dag is tied to the fact, that the directories in which a job are executed
is tied to the pool not the job itself.
author: Karan Vahi version: $Revision: 428 $ See Also:CreateDirectory
CLEANUP_DAG_PREFIX The prefix that is attached to the name of the dag for which the
cleanup Dag is being generated, to generate the name of the cleanup
Dag.
RemoveDirectory(ADag concDag, PegasusProperties properties) The overloaded constructor that sets the dag for which we have to
generated the cleanup dag for.
getCreateDirSites(ADag dag) Retrieves the sites for which the create dir jobs need to be created.
It returns all the sites where the compute jobs have been scheduled.
Parameters: dag - the workflow for which the sites have to be computed.
Field Detail
CLEANUP_DAG_PREFIX
final public static String CLEANUP_DAG_PREFIX(Code)
The prefix that is attached to the name of the dag for which the
cleanup Dag is being generated, to generate the name of the cleanup
Dag.
The overloaded constructor that sets the dag for which we have to
generated the cleanup dag for.
Parameters: concDag - the concrete dag for which cleanup is reqd. Parameters: properties - the PegasusProperties to be used.
Generates a cleanup DAG for the dag associated with the class. Creates a
cleanup node per remote pool. It looks at the ADAG, to determine the
sites at which the jobs in the dag have been scheduled.
the cleanup DAG. See Also:org.griphyn.cPlanner.classes.ADag.getExecutionSites
Generates a cleanup DAG for the dag object passed. Creates a cleanup
node per remote pool. It looks at the ADAG, to determine the sites at
which the jobs in the dag have been scheduled.
Parameters: dag - the dag for which cleanup dag needs to be generated. the cleanup DAG. See Also:org.griphyn.cPlanner.classes.ADag.getExecutionSites
getCompleteTranformationName
public static String getCompleteTranformationName()(Code)
A convenience method to return the complete transformation name being
used to construct jobs in this class.
the complete transformation name
Retrieves the sites for which the create dir jobs need to be created.
It returns all the sites where the compute jobs have been scheduled.
Parameters: dag - the workflow for which the sites have to be computed. a Set containing a list of siteID's of the sites where thedag has to be run.
Fields inherited from org.griphyn.cPlanner.engine.Engine