flow php

UNIFIED DATA PROCESSING FRAMEWORK

composer require flow-php/etl ^0.10.0

Changelog

elephant
extract

Extracts

Read from various data sources.

arrow
transform

Transforms

Shape and optimize for your needs.

arrow
load

Loads

Store and secure in one of many available data sinks.

DSL Functions


DSL stands for Domain Specific Language. In the case of Flow, the DSL is used to define simple functions that can be used to transform data. Most of those functions are initializing a new instance of a class under the hood since Flow is fully object-oriented. Please look at the examples below to get a better understanding of how to use the DSL functions.

EXTRACTOR


/**
 * @param Path|string $path
 * @param array<string> $columns - list of columns to read from parquet file - @deprecated use `withColumns` method instead
 * @param Options $options - @deprecated use `withOptions` method instead
 * @param ByteOrder $byte_order - @deprecated use `withByteOrder` method instead
 * @param null|int $offset - @deprecated use `withOffset` method instead
 */
from_parquet(Path|string $path, array $columns, Options $options, ByteOrder $byte_order, ?int $offset) : ParquetExtractor

LOADER


/**
 * @param Path|string $path
 * @param null|Options $options - @deprecated use `withOptions` method instead
 * @param Compressions $compressions - @deprecated use `withCompressions` method instead
 * @param null|Schema $schema - @deprecated use `withSchema` method instead
 */
to_parquet(Path|string $path, ?Options $options, Compressions $compressions, ?Schema $schema) : ParquetLoader

Contributors

Join us on GitHub external resource
scroll back to top