public class DataGenMR extends Object
Rand MapReduce job which creates random objects.
Modifier and Type | Method and Description |
---|---|
static JobReturn |
runJob(MRJobInstruction inst,
String[] dataGenInstructions,
String instructionsInMapper,
String aggInstructionsInReducer,
String otherInstructionsInReducer,
int numReducers,
int replication,
byte[] resultIndexes,
String dimsUnknownFilePrefix,
String[] outputs,
OutputInfo[] outputInfos)
Starts a Rand MapReduce job which will produce one or more random objects.
|
public static JobReturn runJob(MRJobInstruction inst, String[] dataGenInstructions, String instructionsInMapper, String aggInstructionsInReducer, String otherInstructionsInReducer, int numReducers, int replication, byte[] resultIndexes, String dimsUnknownFilePrefix, String[] outputs, OutputInfo[] outputInfos) throws Exception
Starts a Rand MapReduce job which will produce one or more random objects.
inst
- MR job instructiondataGenInstructions
- array of data gen instructionsinstructionsInMapper
- instructions in mapperaggInstructionsInReducer
- aggregate instructions in reducerotherInstructionsInReducer
- other instructions in reducernumReducers
- number of reducersreplication
- file replicationresultIndexes
- result indexes for each random objectdimsUnknownFilePrefix
- file path prefix when dimensions unknownoutputs
- output file for each random objectoutputInfos
- output information for each random objectException
- if Exception occursCopyright © 2017 The Apache Software Foundation. All rights reserved.