Ctrl+K
Logo image Logo image

Site Navigation

  • API Reference
  • Examples

Site Navigation

  • API Reference
  • Examples

Section Navigation

  • PyFlink Table
  • PyFlink DataStream
    • StreamExecutionEnvironment
    • DataStream
    • Functions
    • State
    • Timer
    • Window
    • Checkpoint
    • Side Outputs
    • Connectors
    • Formats
  • PyFlink Common

pyflink.datastream.connectors.file_system.BucketAssigner#

class BucketAssigner(j_bucket_assigner)[source]#

A BucketAssigner is used with a file sink to determine the bucket each incoming element should be put into.

The StreamingFileSink can be writing to many buckets at a time, and it is responsible for managing a set of active buckets. Whenever a new element arrives it will ask the BucketAssigner for the bucket the element should fall in. The BucketAssigner can, for example, determine buckets based on system time.

Methods

base_path_bucket_assigner()

Creates a BucketAssigner that does not perform any bucketing of files.

date_time_bucket_assigner([format_str, ...])

Creates a BucketAssigner that assigns to buckets based on current system time.

get_java_object()

previous

pyflink.datastream.connectors.file_system.FileSource

next

pyflink.datastream.connectors.file_system.RollingPolicy

On this page
  • BucketAssigner
Show Source

Created using Sphinx 5.3.0.