Package org.rumbledb.runtime

Class HybridRuntimeIterator

java.lang.Object

org.rumbledb.runtime.RuntimeIterator

org.rumbledb.runtime.HybridRuntimeIterator

All Implemented Interfaces:

com.esotericsoftware.kryo.KryoSerializable, Serializable, RuntimeIteratorInterface

Direct Known Subclasses:

AppendExpressionIterator, ArrayAppendFunctionIterator, ArrayDescendantFunctionIterator, ArrayFilterFunctionIterator, ArrayFlattenFunctionIterator, ArrayFoldLeftFunctionIterator, ArrayFoldRightFunctionIterator, ArrayForEachFunctionIterator, ArrayForEachPairFunctionIterator, ArrayFunctionCallIterator, ArrayGetFunctionIterator, ArrayHeadFunctionIterator, ArrayInsertBeforeFunctionIterator, ArrayJoinFunctionIterator, ArrayLookupIterator, ArrayMembersFunctionIterator, ArrayPutFunctionIterator, ArrayRemoveFunctionIterator, ArrayReverseFunctionIterator, ArraySortFunctionIterator, ArraySubarrayFunctionIterator, ArrayTailFunctionIterator, ArrayUnboxingIterator, BuiltinFunctionItemCallIterator, CommaExpressionIterator, ConstantRDDRuntimeIterator, CreateCollectionIterator, DataFunctionIterator, DeleteExpressionIterator, DeleteIndexFromCollectionIterator, DeleteSearchFromCollectionIterator, DistinctValuesFunctionIterator, DropColumnsIterator, DynamicFunctionCallIterator, EditCollectionIterator, ExitStatementIterator, FunctionItemCallIterator, IfRuntimeIterator, IndexOfFunctionIterator, InsertBeforeFunctionIterator, InsertExpressionIterator, InsertIndexIntoCollectionIterator, InsertSearchIntoCollectionIterator, JsonLinesFunctionIterator, MapFindFunctionIterator, MapForEachFunctionIterator, MapFunctionCallIterator, MapGetFunctionIterator, MapKeysFunctionIterator, MapRemoveFunctionIterator, ObjectDescendantFunctionIterator, ObjectKeysFunctionIterator, ObjectLookupIterator, ObjectProjectFunctionIterator, ObjectRemoveKeysFunctionIterator, ObjectValuesFunctionIterator, OneOrMoreIterator, ParallelizeFunctionIterator, PostfixLookupIterator, PredicateIterator, ProgramIterator, RangeOperationIterator, RDDRuntimeIterator, RemoveFunctionIterator, RenameExpressionIterator, RepartitionFunctionIterator, ReplaceExpressionIterator, ReturnClauseSparkIterator, ReverseFunctionIterator, SimpleMapExpressionIterator, SlashExprIterator, StatementsWithExprIterator, StaticUserDefinedFunctionCallIterator, SubsequenceFunctionIterator, SwitchRuntimeIterator, TailFunctionIterator, TransformExpressionIterator, TreatIterator, TruncateCollectionIterator, TypePromotionIterator, TypeswitchRuntimeIterator, UnorderedFunctionIterator, ValidateTypeIterator, VariableReferenceIterator

public abstract class HybridRuntimeIterator
extends RuntimeIterator

See Also:

• Serialized Form

Field Summary

Fields

Modifier and Type	Field	Description
protected List<Item>	result

Fields inherited from class org.rumbledb.runtime.RuntimeIterator

children, currentDynamicContextForLocalExecution, FLOW_EXCEPTION_MESSAGE, hasNext, isOpen, isSequential, isUpdating, staticContext, staticURI

Constructor Summary

Constructors

Modifier	Constructor	Description
protected	HybridRuntimeIterator(List<RuntimeIterator> children, RuntimeStaticContext staticContext)

Method Summary

Modifier and Type	Method	Description
void	close()
protected abstract void	closeLocal()
static List<Item>	collectRDDwithLimit(org.apache.spark.api.java.JavaRDD<Item> rdd, RumbleRuntimeConfiguration configuration, ExceptionMetadata metadata)
static org.apache.spark.api.java.JavaRDD<Item>	dataFrameToRDDOfItems(JSoundDataFrame df, ExceptionMetadata metadata)
protected void	fallbackToRDDIfDFNotImplemented(ExecutionMode executionMode)
org.apache.spark.api.java.JavaRDD<Item>	getRDD(DynamicContext context)
protected abstract org.apache.spark.api.java.JavaRDD<Item>	getRDDAux(DynamicContext context)
boolean	hasNext()
protected abstract boolean	hasNextLocal()
protected boolean	implementsDataFrames()
protected boolean	implementsLocal()
protected boolean	implementsRDD()
void	materialize(DynamicContext context, List<Item> result)	Materialize the items of the iterator into the result list.
Item	materializeAtMostOneItemOrNull(DynamicContext context)
Item	materializeExactlyOneItem(DynamicContext context)
Item	materializeFirstItemOrNull(DynamicContext context)
void	materializeNFirstItems(DynamicContext context, List<Item> result, int n)
Item	next()
protected abstract Item	nextLocal()
void	open(DynamicContext context)
protected abstract void	openLocal()
void	reset(DynamicContext context)
protected abstract void	resetLocal()

Methods inherited from class org.rumbledb.runtime.RuntimeIterator

bindToVariableInDynamicContext, canProduceDataFrame, deepCopy, generateNativeQuery, getConfiguration, getDataFrame, getEffectiveBooleanValue, getEffectiveBooleanValueOrCheckPosition, getHighestExecutionMode, getMetadata, getOrCreateDataFrame, getPendingUpdateList, getRuntimeStaticContext, getStaticType, getVariableDependencies, isDataFrame, isLocal, isOpen, isRDD, isRDDOrDataFrame, isSequential, isSparkJobNeeded, isUpdating, materialize, materializeAtMostOneItemOrDefault, print, printToStandardError, read, setStaticContext, write

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Details

result

protected List<Item> result

Constructor Details

HybridRuntimeIterator

protected HybridRuntimeIterator(List<RuntimeIterator> children,
 RuntimeStaticContext staticContext)

Method Details

implementsDataFrames

protected boolean implementsDataFrames()

implementsLocal

protected boolean implementsLocal()

implementsRDD

protected boolean implementsRDD()

fallbackToRDDIfDFNotImplemented

protected void fallbackToRDDIfDFNotImplemented(ExecutionMode executionMode)

open

public void open(DynamicContext context)

Specified by:

open in interface RuntimeIteratorInterface

Overrides:

open in class RuntimeIterator

reset

public void reset(DynamicContext context)

Specified by:

reset in interface RuntimeIteratorInterface

Overrides:

reset in class RuntimeIterator

close

public void close()

Specified by:

close in interface RuntimeIteratorInterface

Overrides:

close in class RuntimeIterator

hasNext

public boolean hasNext()

Specified by:

hasNext in interface RuntimeIteratorInterface

Overrides:

hasNext in class RuntimeIterator

next

public Item next()

Specified by:

next in interface RuntimeIteratorInterface

Specified by:

next in class RuntimeIterator

getRDD

public org.apache.spark.api.java.JavaRDD<Item> getRDD(DynamicContext context)

Overrides:

getRDD in class RuntimeIterator

dataFrameToRDDOfItems

public static org.apache.spark.api.java.JavaRDD<Item> dataFrameToRDDOfItems(JSoundDataFrame df,
 ExceptionMetadata metadata)

collectRDDwithLimit

public static List<Item> collectRDDwithLimit(org.apache.spark.api.java.JavaRDD<Item> rdd,
 RumbleRuntimeConfiguration configuration,
 ExceptionMetadata metadata)

materialize

public void materialize(DynamicContext context,
 List<Item> result)

Description copied from class: RuntimeIterator

Materialize the items of the iterator into the result list.

Overrides:

materialize in class RuntimeIterator

Parameters:

context - the dynamic context

result - the list to materialize the items into. The list is cleared before the materialization.

materializeNFirstItems

public void materializeNFirstItems(DynamicContext context,
 List<Item> result,
 int n)

Overrides:

materializeNFirstItems in class RuntimeIterator

materializeFirstItemOrNull

public Item materializeFirstItemOrNull(DynamicContext context)

Overrides:

materializeFirstItemOrNull in class RuntimeIterator

materializeExactlyOneItem

public Item materializeExactlyOneItem(DynamicContext context)
                               throws NoItemException,
MoreThanOneItemException

Overrides:

materializeExactlyOneItem in class RuntimeIterator

Throws:

NoItemException

MoreThanOneItemException

materializeAtMostOneItemOrNull

public Item materializeAtMostOneItemOrNull(DynamicContext context)
                                    throws MoreThanOneItemException

Overrides:

materializeAtMostOneItemOrNull in class RuntimeIterator

Throws:

MoreThanOneItemException

getRDDAux

protected abstract org.apache.spark.api.java.JavaRDD<Item> getRDDAux(DynamicContext context)

openLocal

protected abstract void openLocal()

closeLocal

protected abstract void closeLocal()

resetLocal

protected abstract void resetLocal()

hasNextLocal

protected abstract boolean hasNextLocal()

nextLocal

protected abstract Item nextLocal()