Package org.rumbledb.runtime.typing

Class TreatIterator

java.lang.Object

org.rumbledb.runtime.RuntimeIterator

org.rumbledb.runtime.HybridRuntimeIterator

org.rumbledb.runtime.typing.TreatIterator

All Implemented Interfaces:

com.esotericsoftware.kryo.KryoSerializable, Serializable, RuntimeIteratorInterface

public class TreatIterator
extends HybridRuntimeIterator

See Also:

• Serialized Form

Field Summary

Fields inherited from class org.rumbledb.runtime.HybridRuntimeIterator

result

Fields inherited from class org.rumbledb.runtime.RuntimeIterator

children, currentDynamicContextForLocalExecution, FLOW_EXCEPTION_MESSAGE, hasNext, isOpen, isSequential, isUpdating, staticContext, staticURI

Constructor Summary

Constructors

Constructor	Description
TreatIterator(RuntimeIterator iterator, SequenceType sequenceType, boolean isUpdating, ErrorCode errorCode, RuntimeStaticContext staticContext)
TreatIterator(RuntimeIterator iterator, SequenceType sequenceType, ErrorCode errorCode, RuntimeStaticContext staticContext)

Method Summary

Modifier and Type	Method	Description
void	closeLocal()
static JSoundDataFrame	convertToDataFrame(org.apache.spark.api.java.JavaRDD<?> rdd, ItemType itemType)	Converts a homogeneous RDD of atomic values to a DataFrame
NativeClauseContext	generateNativeQuery(NativeClauseContext nativeClauseContext)	This function generate (if possible) a native spark-sql query that maps the inner working of the iterator
JSoundDataFrame	getDataFrame(DynamicContext dynamicContext)
static ItemType	getItemType(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> df)
PendingUpdateList	getPendingUpdateList(DynamicContext context)
org.apache.spark.api.java.JavaRDD<Item>	getRDDAux(DynamicContext dynamicContext)
boolean	hasNextLocal()
protected boolean	implementsDataFrames()
Item	nextLocal()
void	openLocal()
void	resetLocal()

Methods inherited from class org.rumbledb.runtime.HybridRuntimeIterator

close, dataFrameToRDDOfItems, fallbackToRDDIfDFNotImplemented, getRDD, hasNext, implementsLocal, implementsRDD, materialize, materializeAtMostOneItemOrNull, materializeExactlyOneItem, materializeFirstItemOrNull, materializeNFirstItems, next, open, reset

Methods inherited from class org.rumbledb.runtime.RuntimeIterator

bindToVariableInDynamicContext, canProduceDataFrame, deepCopy, getConfiguration, getEffectiveBooleanValue, getEffectiveBooleanValueOrCheckPosition, getHighestExecutionMode, getMetadata, getOrCreateDataFrame, getStaticType, getVariableDependencies, isDataFrame, isLocal, isOpen, isRDD, isRDDOrDataFrame, isSequential, isSparkJobNeeded, isUpdating, materialize, materializeAtMostOneItemOrDefault, print, printToStandardError, read, setStaticContext, write

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Details

TreatIterator

public TreatIterator(RuntimeIterator iterator,
 SequenceType sequenceType,
 boolean isUpdating,
 ErrorCode errorCode,
 RuntimeStaticContext staticContext)

TreatIterator

public TreatIterator(RuntimeIterator iterator,
 SequenceType sequenceType,
 ErrorCode errorCode,
 RuntimeStaticContext staticContext)

Method Details

hasNextLocal

public boolean hasNextLocal()

Specified by:

hasNextLocal in class HybridRuntimeIterator

resetLocal

public void resetLocal()

Specified by:

resetLocal in class HybridRuntimeIterator

closeLocal

public void closeLocal()

Specified by:

closeLocal in class HybridRuntimeIterator

openLocal

public void openLocal()

Specified by:

openLocal in class HybridRuntimeIterator

nextLocal

public Item nextLocal()

Specified by:

nextLocal in class HybridRuntimeIterator

getRDDAux

public org.apache.spark.api.java.JavaRDD<Item> getRDDAux(DynamicContext dynamicContext)

Specified by:

getRDDAux in class HybridRuntimeIterator

implementsDataFrames

protected boolean implementsDataFrames()

Overrides:

implementsDataFrames in class HybridRuntimeIterator

getItemType

public static ItemType getItemType(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> df)

getDataFrame

public JSoundDataFrame getDataFrame(DynamicContext dynamicContext)

Overrides:

getDataFrame in class RuntimeIterator

getPendingUpdateList

public PendingUpdateList getPendingUpdateList(DynamicContext context)

Overrides:

getPendingUpdateList in class RuntimeIterator

convertToDataFrame

public static JSoundDataFrame convertToDataFrame(org.apache.spark.api.java.JavaRDD<?> rdd,
 ItemType itemType)

Converts a homogeneous RDD of atomic values to a DataFrame

Parameters:

rdd - the RDD containing the atomic values.

itemType - the dynamic type of these values.

Returns:

generateNativeQuery

public NativeClauseContext generateNativeQuery(NativeClauseContext nativeClauseContext)

Description copied from class: RuntimeIterator

This function generate (if possible) a native spark-sql query that maps the inner working of the iterator

Overrides:

generateNativeQuery in class RuntimeIterator

Parameters:

nativeClauseContext - context information to generate the native query

Returns:

a native clause context with the spark-sql native query to get an equivalent result of the iterator, or [NativeClauseContext.NoNativeQuery] if it is not possible