org.griphyn.cPlanner.partitioner |
|
Java Source File Name | Type | Comment |
Bag.java | Interface | An interface to define a BAG of objects. |
BFS.java | Class | This does a modified breadth first search of the graph to identify the levels. |
Callback.java | Interface | This interface defines the callback calls from the partitioners. |
ClustererCallback.java | Class | A Callback implementation that passes the partitions detected during the
partitioning of the worflow to a Clusterer for clustering. |
DAXWriter.java | Class | The abstract class that identifies the interface for writing out a dax
corresponding to a partition. |
GraphNode.java | Class | Data class that allows us to construct information about the nodes
in the abstract graph. |
Horizontal.java | Class | Horizontal based partitioning scheme, that allows the user to configure the
number of partitions per transformation name per level.
To set the size of the partition per transformation, the following properties
need to be set
pegasus.partitioner.horizontal.collapse.[txName]
pegasus.partitioner.horizontal.bundle.[txName]
The bundle value designates the number of partitions per transformation per level.
The collapse values designates the number of nodes in a partitioning referring
to a particular transformation. |
Label.java | Class | This partitioner partitions the DAX into smaller partitions as specified by
the labels associated with the jobs. |
LabelBag.java | Class | A bag implementation that just holds a particular value for the label key. |
MultipleLook.java | Class | This class ends up writing a partitioned dax, that corresponds to one
partition as defined by the Partitioner. |
One2One.java | Class | This partitioning technique considers each of the job in the dax as a
separate partition. |
Partition.java | Class | This is an abstract container for a partition in the graph. |
Partitioner.java | Class | The abstract class that lays out the api to do the partitioning of the dax
into smaller daxes. |
PartitionerFactory.java | Class | A Factory class to load the right type of partitioner at runtime, as
specified by the Properties. |
PartitionerFactoryException.java | Class | Class to notify of failures while instantiating Partitioner implementations. |
PDAXWriter.java | Class | It writes out the partition graph in xml form. |
SingleLook.java | Class | This class ends up writing a partitioned dax, that corresponds to one
partition as defined by the Partitioner. |
Topological.java | Class | Does a topological sort on the Partition. |
WriterCallback.java | Class | This callback writes out a DAX file for each of the partitions,
and also writes out a PDAX file that captures the relations
between the partitions. |