UNIFIED DATA PROCESSING FRAMEWORK

composer require flow-php/etl ~0.26.1

Changelog Release Cycle

Extracts

Read from various data sources.

Transforms

Shape and optimize for your needs.

Loads

Store and secure in one of many available data sinks.

DSL

Definition

View

data_frame(Config|ConfigBuilder|null $config) : Flow

Usage Examples

Example: Data frame - Data reading

<?php

declare(strict_types=1);

use function Flow\ETL\DSL\{data_frame, from_array, from_data_frame, lit, ref, to_stream};

require __DIR__ . '/vendor/autoload.php';

data_frame()
    ->read(
        from_data_frame(
            data_frame()
                ->read(from_array(
                    [
                        ['id' => 1],
                        ['id' => 2],
                        ['id' => 3],
                        ['id' => 4],
                        ['id' => 5],
                    ]
                ))
                ->withEntry('timestamp', ref('id')->multiply(lit(10000)))
        )
    )
    ->collect()
    ->write(to_stream(__DIR__ . '/output.txt', truncate: false))
    ->run();

Example: Data frame - Data writing

<?php

declare(strict_types=1);

use function Flow\ETL\Adapter\CSV\{from_csv, to_csv};
use function Flow\ETL\DSL\{data_frame, overwrite, to_stream};

require __DIR__ . '/vendor/autoload.php';

data_frame()
    ->read(from_csv(__DIR__ . '/input/file.csv'))
    ->saveMode(overwrite())
    ->write(to_csv(__DIR__ . '/output/file.csv'))
    ->collect()
    ->write(to_stream(__DIR__ . '/output.txt', truncate: false))
    ->run();

data_frame()
    ->read(from_csv(__DIR__ . '/output/file.csv'))
    ->saveMode(overwrite())
    ->drop('name')
    ->write(to_csv(__DIR__ . '/output/file.csv'))
    ->collect()
    ->write(to_stream(__DIR__ . '/output.txt', truncate: false))
    ->run();

Adapters

Libraries

Bridges

Contributors

Join us on GitHub