Package org.rumbledb.runtime.functions.input

Class DeltaTableFunctionIterator

java.lang.Object

org.rumbledb.runtime.plan.RuntimePlan<Item>

org.rumbledb.runtime.plan.ItemRuntimePlan

org.rumbledb.runtime.functions.input.DeltaTableFunctionIterator

All Implemented Interfaces:

Serializable, DataFrameRuntimePlan<Item>

public class DeltaTableFunctionIterator
extends ItemRuntimePlan
implements DataFrameRuntimePlan<Item>

See Also:

• Serialized Form

Field Summary

Fields inherited from class org.rumbledb.runtime.plan.RuntimePlan

staticContext

Constructor Summary

Constructors

Constructor	Description
DeltaTableFunctionIterator(List<ItemRuntimePlan> arguments, RuntimeStaticContext staticContext)

Method Summary

Modifier and Type	Method	Description
HomogeneousItemDataFrame	createNativeDataFrame(DynamicContext context)	Builds the DataFrame for one evaluation.
static HomogeneousItemDataFrame	postProcess(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> dataFrame, String collectionName)

Methods inherited from class org.rumbledb.runtime.plan.ItemRuntimePlan

getChild, getChildren, getStaticType, getVariableDependencies, isSparkJobNeeded, print

Methods inherited from class org.rumbledb.runtime.plan.RuntimePlan

getConfiguration, getCursor, getDataFrame, getMetadata, getRDD, getRuntimeStaticContext, materialize, materializeAtMost, materializeAtMostOne, materializeExactlyOne, materializeFirstOrNull

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Details

DeltaTableFunctionIterator

public DeltaTableFunctionIterator(List<ItemRuntimePlan> arguments,
 RuntimeStaticContext staticContext)

Method Details

createNativeDataFrame

public HomogeneousItemDataFrame createNativeDataFrame(DynamicContext context)

Description copied from interface: DataFrameRuntimePlan

Builds the DataFrame for one evaluation.

Specified by:

createNativeDataFrame in interface DataFrameRuntimePlan<Item>

Parameters:

context - the dynamic context for that evaluation

Returns:

the resulting DataFrame

postProcess

public static HomogeneousItemDataFrame postProcess(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> dataFrame,
 String collectionName)