org.apache.sysml.runtime.matrix

Class DataGenMR

java.lang.Object

org.apache.sysml.runtime.matrix.DataGenMR

public class DataGenMR
extends Object

Rand MapReduce job which creates random objects.

Method Summary

Modifier and Type	Method and Description
static JobReturn	runJob(MRJobInstruction inst, String[] dataGenInstructions, String instructionsInMapper, String aggInstructionsInReducer, String otherInstructionsInReducer, int numReducers, int replication, byte[] resultIndexes, String dimsUnknownFilePrefix, String[] outputs, OutputInfo[] outputInfos) Starts a Rand MapReduce job which will produce one or more random objects.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Method Detail

runJob

public static JobReturn runJob(MRJobInstruction inst,
                               String[] dataGenInstructions,
                               String instructionsInMapper,
                               String aggInstructionsInReducer,
                               String otherInstructionsInReducer,
                               int numReducers,
                               int replication,
                               byte[] resultIndexes,
                               String dimsUnknownFilePrefix,
                               String[] outputs,
                               OutputInfo[] outputInfos)
                        throws Exception

Starts a Rand MapReduce job which will produce one or more random objects.

Parameters:

inst - MR job instruction

dataGenInstructions - array of data gen instructions

instructionsInMapper - instructions in mapper

aggInstructionsInReducer - aggregate instructions in reducer

otherInstructionsInReducer - other instructions in reducer

numReducers - number of reducers

replication - file replication

resultIndexes - result indexes for each random object

dimsUnknownFilePrefix - file path prefix when dimensions unknown

outputs - output file for each random object

outputInfos - output information for each random object

Returns:

matrix characteristics for each random object

Throws:

Exception - if Exception occurs