Package org.rumbledb.runtime.functions.input

Class RepartitionFunctionIterator

java.lang.Object

org.rumbledb.runtime.RuntimeIterator

org.rumbledb.runtime.HybridRuntimeIterator

org.rumbledb.runtime.functions.input.RepartitionFunctionIterator

All Implemented Interfaces:

com.esotericsoftware.kryo.KryoSerializable, Serializable, RuntimeIteratorInterface

public class RepartitionFunctionIterator
extends HybridRuntimeIterator

See Also:

• Serialized Form

Field Summary

Fields inherited from class org.rumbledb.runtime.HybridRuntimeIterator

result

Fields inherited from class org.rumbledb.runtime.RuntimeIterator

children, currentDynamicContextForLocalExecution, FLOW_EXCEPTION_MESSAGE, hasNext, isOpen, isSequential, isUpdating, staticContext, staticURI

Constructor Summary

Constructors

Constructor	Description
RepartitionFunctionIterator(List<RuntimeIterator> inputIterators, RuntimeStaticContext staticContext)

Method Summary

Modifier and Type	Method	Description
protected void	closeLocal()
NativeClauseContext	generateNativeQuery(NativeClauseContext nativeClauseContext)	This function generate (if possible) a native spark-sql query that maps the inner working of the iterator
JSoundDataFrame	getDataFrame(DynamicContext context)
org.apache.spark.api.java.JavaRDD<Item>	getRDDAux(DynamicContext dynamicContext)
protected boolean	hasNextLocal()
boolean	implementsDataFrames()
Item	nextLocal()
void	openLocal()
protected void	resetLocal()

Methods inherited from class org.rumbledb.runtime.HybridRuntimeIterator

close, collectRDDwithLimit, dataFrameToRDDOfItems, fallbackToRDDIfDFNotImplemented, getRDD, hasNext, implementsLocal, implementsRDD, materialize, materializeAtMostOneItemOrNull, materializeExactlyOneItem, materializeFirstItemOrNull, materializeNFirstItems, next, open, reset

Methods inherited from class org.rumbledb.runtime.RuntimeIterator

bindToVariableInDynamicContext, canProduceDataFrame, deepCopy, getConfiguration, getEffectiveBooleanValue, getEffectiveBooleanValueOrCheckPosition, getHighestExecutionMode, getMetadata, getOrCreateDataFrame, getPendingUpdateList, getStaticType, getVariableDependencies, isDataFrame, isLocal, isOpen, isRDD, isRDDOrDataFrame, isSequential, isSparkJobNeeded, isUpdating, materialize, materializeAtMostOneItemOrDefault, print, printToStandardError, read, setStaticContext, write

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Details

RepartitionFunctionIterator

public RepartitionFunctionIterator(List<RuntimeIterator> inputIterators,
 RuntimeStaticContext staticContext)

Method Details

openLocal

public void openLocal()

Specified by:

openLocal in class HybridRuntimeIterator

hasNextLocal

protected boolean hasNextLocal()

Specified by:

hasNextLocal in class HybridRuntimeIterator

nextLocal

public Item nextLocal()

Specified by:

nextLocal in class HybridRuntimeIterator

resetLocal

protected void resetLocal()

Specified by:

resetLocal in class HybridRuntimeIterator

closeLocal

protected void closeLocal()

Specified by:

closeLocal in class HybridRuntimeIterator

getRDDAux

public org.apache.spark.api.java.JavaRDD<Item> getRDDAux(DynamicContext dynamicContext)

Specified by:

getRDDAux in class HybridRuntimeIterator

implementsDataFrames

public boolean implementsDataFrames()

Overrides:

implementsDataFrames in class HybridRuntimeIterator

generateNativeQuery

public NativeClauseContext generateNativeQuery(NativeClauseContext nativeClauseContext)

Description copied from class: RuntimeIterator

This function generate (if possible) a native spark-sql query that maps the inner working of the iterator

Overrides:

generateNativeQuery in class RuntimeIterator

Parameters:

nativeClauseContext - context information to generate the native query

Returns:

a native clause context with the spark-sql native query to get an equivalent result of the iterator, or [NativeClauseContext.NoNativeQuery] if it is not possible

getDataFrame

public JSoundDataFrame getDataFrame(DynamicContext context)

Overrides:

getDataFrame in class RuntimeIterator