Package org.rumbledb.runtime.functions.input

Class ParallelizeFunctionIterator

java.lang.Object

org.rumbledb.runtime.RuntimeIterator

org.rumbledb.runtime.HybridRuntimeIterator

org.rumbledb.runtime.functions.input.ParallelizeFunctionIterator

All Implemented Interfaces:

com.esotericsoftware.kryo.KryoSerializable, Serializable, RuntimeIteratorInterface

public class ParallelizeFunctionIterator
extends HybridRuntimeIterator

See Also:

• Serialized Form

Field Summary

Fields inherited from class org.rumbledb.runtime.HybridRuntimeIterator

result

Fields inherited from class org.rumbledb.runtime.RuntimeIterator

children, currentDynamicContextForLocalExecution, FLOW_EXCEPTION_MESSAGE, hasNext, isOpen, isSequential, isUpdating, staticContext, staticURI

Constructor Summary

Constructors

Constructor	Description
ParallelizeFunctionIterator(List<RuntimeIterator> parameters, RuntimeStaticContext staticContext)

Method Summary

Modifier and Type	Method	Description
protected void	closeLocal()
protected Item	getNumberOfPartitions(DynamicContext context)
org.apache.spark.api.java.JavaRDD<Item>	getRDDAux(DynamicContext context)
protected boolean	hasNextLocal()
protected Item	nextLocal()
protected void	openLocal()
protected void	resetLocal()

Methods inherited from class org.rumbledb.runtime.HybridRuntimeIterator

close, dataFrameToRDDOfItems, fallbackToRDDIfDFNotImplemented, getRDD, hasNext, implementsDataFrames, implementsLocal, implementsRDD, materialize, materializeAtMostOneItemOrNull, materializeExactlyOneItem, materializeFirstItemOrNull, materializeNFirstItems, next, open, reset

Methods inherited from class org.rumbledb.runtime.RuntimeIterator

bindToVariableInDynamicContext, canProduceDataFrame, deepCopy, generateNativeQuery, getConfiguration, getDataFrame, getEffectiveBooleanValue, getEffectiveBooleanValueOrCheckPosition, getHighestExecutionMode, getMetadata, getOrCreateDataFrame, getPendingUpdateList, getStaticType, getVariableDependencies, isDataFrame, isLocal, isOpen, isRDD, isRDDOrDataFrame, isSequential, isSparkJobNeeded, isUpdating, materialize, materializeAtMostOneItemOrDefault, print, printToStandardError, read, setStaticContext, write

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Details

ParallelizeFunctionIterator

public ParallelizeFunctionIterator(List<RuntimeIterator> parameters,
 RuntimeStaticContext staticContext)

Method Details

getRDDAux

public org.apache.spark.api.java.JavaRDD<Item> getRDDAux(DynamicContext context)

Specified by:

getRDDAux in class HybridRuntimeIterator

getNumberOfPartitions

protected Item getNumberOfPartitions(DynamicContext context)

openLocal

protected void openLocal()

Specified by:

openLocal in class HybridRuntimeIterator

closeLocal

protected void closeLocal()

Specified by:

closeLocal in class HybridRuntimeIterator

resetLocal

protected void resetLocal()

Specified by:

resetLocal in class HybridRuntimeIterator

hasNextLocal

protected boolean hasNextLocal()

Specified by:

hasNextLocal in class HybridRuntimeIterator

nextLocal

protected Item nextLocal()

Specified by:

nextLocal in class HybridRuntimeIterator