Package | Description |
---|---|
org.apache.sysml.api.mlcontext |
Modifier and Type | Method and Description |
---|---|
FrameMetadata |
Frame.getFrameMetadata()
Obtain the frame metadata
|
FrameMetadata |
BinaryBlockFrame.getFrameMetadata()
Obtain the SystemML binary-block frame metadata
|
Modifier and Type | Method and Description |
---|---|
static org.apache.sysml.runtime.controlprogram.caching.FrameObject |
MLContextConversionUtil.binaryBlocksToFrameObject(String variableName,
org.apache.spark.api.java.JavaPairRDD<Long,FrameBlock> binaryBlocks,
FrameMetadata frameMetadata)
Convert a
JavaPairRDD<Long, FrameBlock> to a FrameObject . |
static org.apache.spark.api.java.JavaPairRDD<Long,FrameBlock> |
MLContextConversionUtil.dataFrameToFrameBinaryBlocks(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> dataFrame,
FrameMetadata frameMetadata)
Convert a
DataFrame to a JavaPairRDD<Long, FrameBlock>
binary-block frame. |
static org.apache.sysml.runtime.controlprogram.caching.FrameObject |
MLContextConversionUtil.dataFrameToFrameObject(String variableName,
org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> dataFrame,
FrameMetadata frameMetadata)
Convert a
DataFrame to a FrameObject . |
static void |
MLContextConversionUtil.determineFrameFormatIfNeeded(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> dataFrame,
FrameMetadata frameMetadata)
If the FrameFormat of the DataFrame has not been explicitly specified,
attempt to determine the proper FrameFormat.
|
static org.apache.sysml.runtime.controlprogram.caching.FrameObject |
MLContextConversionUtil.frameBlockToFrameObject(String variableName,
FrameBlock frameBlock,
FrameMetadata frameMetadata)
Convert a
FrameBlock to a FrameObject . |
static boolean |
MLContextConversionUtil.isDataFrameWithIDColumn(FrameMetadata frameMetadata)
Return whether or not the DataFrame has an ID column.
|
static org.apache.sysml.runtime.controlprogram.caching.FrameObject |
MLContextConversionUtil.javaRDDStringCSVToFrameObject(String variableName,
org.apache.spark.api.java.JavaRDD<String> javaRDD,
FrameMetadata frameMetadata)
Convert a
JavaRDD<String> in CSV format to a FrameObject |
static org.apache.sysml.runtime.controlprogram.caching.FrameObject |
MLContextConversionUtil.javaRDDStringIJVToFrameObject(String variableName,
org.apache.spark.api.java.JavaRDD<String> javaRDD,
FrameMetadata frameMetadata)
Convert a
JavaRDD<String> in IJV format to a FrameObject
. |
static org.apache.sysml.runtime.controlprogram.caching.FrameObject |
MLContextConversionUtil.rddStringCSVToFrameObject(String variableName,
org.apache.spark.rdd.RDD<String> rdd,
FrameMetadata frameMetadata)
Convert a
RDD<String> in CSV format to a FrameObject |
static org.apache.sysml.runtime.controlprogram.caching.FrameObject |
MLContextConversionUtil.rddStringIJVToFrameObject(String variableName,
org.apache.spark.rdd.RDD<String> rdd,
FrameMetadata frameMetadata)
Convert a
RDD<String> in IJV format to a FrameObject . |
void |
BinaryBlockFrame.setFrameMetadata(FrameMetadata frameMetadata)
Set the SystemML binary-block frame metadata
|
Constructor and Description |
---|
BinaryBlockFrame(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> dataFrame,
FrameMetadata frameMetadata)
Convert a Spark DataFrame to a SystemML binary-block representation.
|
BinaryBlockFrame(org.apache.spark.api.java.JavaPairRDD<Long,FrameBlock> binaryBlocks,
FrameMetadata frameMetadata)
Create a BinaryBlockFrame, specifying the SystemML binary-block frame and
its metadata.
|
Copyright © 2017 The Apache Software Foundation. All rights reserved.