UNIFIED DATA PROCESSING FRAMEWORK

composer require flow-php/etl ~0.25.0

Changelog Release Cycle

Extracts

Read from various data sources.

Transforms

Shape and optimize for your needs.

Loads

Store and secure in one of many available data sinks.

DSL

Definition

View

from_rows(Rows $rows) : RowsExtractor

Usage Examples

Example: Data frame - Data reading

<?php

declare(strict_types=1);

use function Flow\ETL\DSL\{data_frame, from_array, from_data_frame, lit, ref, to_stream};

require __DIR__ . '/vendor/autoload.php';

data_frame()
    ->read(
        from_data_frame(
            data_frame()
                ->read(from_array(
                    [
                        ['id' => 1],
                        ['id' => 2],
                        ['id' => 3],
                        ['id' => 4],
                        ['id' => 5],
                    ]
                ))
                ->withEntry('timestamp', ref('id')->multiply(lit(10000)))
        )
    )
    ->collect()
    ->write(to_stream(__DIR__ . '/output.txt', truncate: false))
    ->run();

Example: Data frame - Data writing

<?php

declare(strict_types=1);

use function Flow\ETL\Adapter\CSV\{from_csv, to_csv};
use function Flow\ETL\DSL\{data_frame, overwrite, to_stream};

require __DIR__ . '/vendor/autoload.php';

data_frame()
    ->read(from_csv(__DIR__ . '/input/file.csv'))
    ->saveMode(overwrite())
    ->write(to_csv(__DIR__ . '/output/file.csv'))
    ->collect()
    ->write(to_stream(__DIR__ . '/output.txt', truncate: false))
    ->run();

data_frame()
    ->read(from_csv(__DIR__ . '/output/file.csv'))
    ->saveMode(overwrite())
    ->drop('name')
    ->write(to_csv(__DIR__ . '/output/file.csv'))
    ->collect()
    ->write(to_stream(__DIR__ . '/output.txt', truncate: false))
    ->run();

Adapters

Libraries

Bridges

Contributors

Join us on GitHub