Ctrl+K
Logo image Logo image

Site Navigation

  • API Reference
  • Examples

Site Navigation

  • API Reference
  • Examples

Section Navigation

  • PyFlink Table
  • PyFlink DataStream
    • StreamExecutionEnvironment
    • DataStream
    • Functions
    • State
    • Timer
    • Window
    • Checkpoint
    • Side Outputs
    • Connectors
    • Formats
  • PyFlink Common

pyflink.datastream.formats.csv.CsvBulkWriters#

class CsvBulkWriters[source]#

CsvBulkWriter is for building BulkWriterFactory to write Rows with a predefined CSV schema to partitioned files in a bulk fashion.

Example:

>>> schema = CsvSchema.builder() \
...     .add_number_column('id', number_type=DataTypes.INT()) \
...     .add_string_column('name') \
...     .add_array_column('list', ',', element_type=DataTypes.STRING()) \
...     .set_column_separator('|') \
...     .build()
>>> sink = FileSink.for_bulk_format(
...     OUTPUT_DIR, CsvBulkWriters.for_schema(schema)).build()
>>> ds.sink_to(sink)

New in version 1.16.0.

Methods

for_schema(schema)

Creates a BulkWriterFactory for writing records to files in CSV format.

previous

pyflink.datastream.formats.csv.CsvReaderFormat

next

pyflink.datastream.formats.csv.CsvRowDeserializationSchema

On this page
  • CsvBulkWriters
Show Source

Created using Sphinx 5.3.0.