Package org.rumbledb.runtime

Class RDDRuntimeIterator

java.lang.Object

org.rumbledb.runtime.RuntimeIterator

org.rumbledb.runtime.HybridRuntimeIterator

org.rumbledb.runtime.RDDRuntimeIterator

All Implemented Interfaces:

com.esotericsoftware.kryo.KryoSerializable, Serializable, RuntimeIteratorInterface

Direct Known Subclasses:

DataFrameRuntimeIterator, UnparsedTextLinesFunctionIterator, XmlFilesFunctionIterator

public abstract class RDDRuntimeIterator
extends HybridRuntimeIterator

See Also:

• Serialized Form

Field Summary

Fields inherited from class org.rumbledb.runtime.HybridRuntimeIterator

result

Fields inherited from class org.rumbledb.runtime.RuntimeIterator

children, currentDynamicContextForLocalExecution, FLOW_EXCEPTION_MESSAGE, hasNext, isOpen, isSequential, isUpdating, staticContext, staticURI

Constructor Summary

Constructors

Modifier	Constructor	Description
protected	RDDRuntimeIterator(List<RuntimeIterator> children, RuntimeStaticContext staticContext)

Method Summary

Modifier and Type	Method	Description
protected void	closeLocal()
protected org.apache.spark.api.java.JavaRDD<Item>	getRDDAux(DynamicContext context)
protected boolean	hasNextLocal()
protected boolean	implementsLocal()
protected boolean	implementsRDD()
protected Item	nextLocal()
protected void	openLocal()
protected void	resetLocal()

Methods inherited from class org.rumbledb.runtime.HybridRuntimeIterator

close, collectRDDwithLimit, dataFrameToRDDOfItems, fallbackToRDDIfDFNotImplemented, getRDD, hasNext, implementsDataFrames, materialize, materializeAtMostOneItemOrNull, materializeExactlyOneItem, materializeFirstItemOrNull, materializeNFirstItems, next, open, reset

Methods inherited from class org.rumbledb.runtime.RuntimeIterator

bindToVariableInDynamicContext, canProduceDataFrame, deepCopy, generateNativeQuery, getConfiguration, getDataFrame, getEffectiveBooleanValue, getEffectiveBooleanValueOrCheckPosition, getHighestExecutionMode, getMetadata, getOrCreateDataFrame, getPendingUpdateList, getStaticType, getVariableDependencies, isDataFrame, isLocal, isOpen, isRDD, isRDDOrDataFrame, isSequential, isSparkJobNeeded, isUpdating, materialize, materializeAtMostOneItemOrDefault, print, printToStandardError, read, setStaticContext, write

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Details

RDDRuntimeIterator

protected RDDRuntimeIterator(List<RuntimeIterator> children,
 RuntimeStaticContext staticContext)

Method Details

getRDDAux

protected org.apache.spark.api.java.JavaRDD<Item> getRDDAux(DynamicContext context)

Specified by:

getRDDAux in class HybridRuntimeIterator

implementsLocal

protected boolean implementsLocal()

Overrides:

implementsLocal in class HybridRuntimeIterator

implementsRDD

protected boolean implementsRDD()

Overrides:

implementsRDD in class HybridRuntimeIterator

openLocal

protected void openLocal()

Specified by:

openLocal in class HybridRuntimeIterator

closeLocal

protected void closeLocal()

Specified by:

closeLocal in class HybridRuntimeIterator

resetLocal

protected void resetLocal()

Specified by:

resetLocal in class HybridRuntimeIterator

hasNextLocal

protected boolean hasNextLocal()

Specified by:

hasNextLocal in class HybridRuntimeIterator

nextLocal

protected Item nextLocal()

Specified by:

nextLocal in class HybridRuntimeIterator