pyflink.datastream.connectors.file_system.FileSplitAssignerProvider

class FileSplitAssignerProvider(j_file_split_assigner)

Factory for FileSplitAssigner which is responsible for deciding what split should be processed next by which node. It determines split processing order and locality.

Methods

locality_aware_split_assigner()

A FileSplitAssigner that assigns to each host preferably splits that are local, before assigning splits that are not local.