Ctrl+K
Logo image Logo image

Site Navigation

  • API Reference
  • Examples

Site Navigation

  • API Reference
  • Examples

Section Navigation

  • PyFlink Table
  • PyFlink DataStream
    • StreamExecutionEnvironment
    • DataStream
    • Functions
    • State
    • Timer
    • Window
    • Checkpoint
    • Side Outputs
    • Connectors
    • Formats
  • PyFlink Common

pyflink.datastream.connectors.file_system.StreamingFileSink#

class StreamingFileSink(j_obj)[source]#

Sink that emits its input elements to FileSystem files within buckets. This is integrated with the checkpointing mechanism to provide exactly once semantics.

When creating the sink a basePath must be specified. The base directory contains one directory for every bucket. The bucket directories themselves contain several part files, with at least one for each parallel subtask of the sink which is writing data to that bucket. These part files contain the actual output data.

Methods

for_bulk_format(base_path, writer_factory)

for_row_format(base_path, encoder)

get_java_function()

previous

pyflink.datastream.connectors.file_system.FileSink

next

pyflink.datastream.connectors.number_seq.NumberSequenceSource

On this page
  • StreamingFileSink
Show Source

Created using Sphinx 5.3.0.