org.apache.sysml.runtime.matrix

Class GMR

java.lang.Object

org.apache.sysml.runtime.matrix.GMR

public class GMR
extends Object

Method Summary

Modifier and Type

Method and Description

static JobReturn

runJob(MRJobInstruction inst, String[] inputs, InputInfo[] inputInfos, long[] rlens, long[] clens, int[] brlens, int[] bclens, boolean[] partitioned, org.apache.sysml.runtime.controlprogram.ParForProgramBlock.PDataPartitionFormat[] pformats, int[] psizes, String recordReaderInstruction, String instructionsInMapper, String aggInstructionsInReducer, String otherInstructionsInReducer, int numReducers, int replication, boolean jvmReuse, byte[] resultIndexes, String dimsUnknownFilePrefix, String[] outputs, OutputInfo[] outputInfos) Execute job.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Method Detail

runJob

public static JobReturn runJob(MRJobInstruction inst,
                               String[] inputs,
                               InputInfo[] inputInfos,
                               long[] rlens,
                               long[] clens,
                               int[] brlens,
                               int[] bclens,
                               boolean[] partitioned,
                               org.apache.sysml.runtime.controlprogram.ParForProgramBlock.PDataPartitionFormat[] pformats,
                               int[] psizes,
                               String recordReaderInstruction,
                               String instructionsInMapper,
                               String aggInstructionsInReducer,
                               String otherInstructionsInReducer,
                               int numReducers,
                               int replication,
                               boolean jvmReuse,
                               byte[] resultIndexes,
                               String dimsUnknownFilePrefix,
                               String[] outputs,
                               OutputInfo[] outputInfos)
                        throws Exception

Execute job.

Parameters:

inst - MR job instruction

inputs - input matrices, the inputs are indexed by 0, 1, 2, .. based on the position in this string

inputInfos - the input format information for the input matrices

rlens - array of number of rows

clens - array of number of columns

brlens - array of number of rows in block

bclens - array of number of columns in block

partitioned - boolean array of partitioned status

pformats - array of data partition formats

psizes - does nothing

recordReaderInstruction - record reader instruction

instructionsInMapper - in Mapper, the set of unary operations that need to be performed on each input matrix

aggInstructionsInReducer - in Reducer, right after sorting, the set of aggreagte operations that need to be performed on each input matrix

otherInstructionsInReducer - the mixed operations that need to be performed on matrices after the aggregate operations

numReducers - the number of reducers

replication - the replication factor for the output

jvmReuse - if true, reuse JVM

resultIndexes - the indexes of the result matrices that needs to be outputted

dimsUnknownFilePrefix - file path prefix when dimensions unknown

outputs - the names for the output directories, one for each result index

outputInfos - output format information for the output matrices

Returns:

job return object

Throws:

Exception - if Exception occurs