UNIFIED DATA PROCESSING FRAMEWORK

composer require flow-php/etl ^0.10.0

Changelog

Extracts

Read from various data sources.

Transforms

Shape and optimize for your needs.

Loads

Store and secure in one of many available data sinks.

Modules

Definition

source

data_frame(Config|ConfigBuilder|null $config) : Flow

Usage Examples

Example: Data frame - Data frame

<?php

declare(strict_types=1);

use function Flow\ETL\DSL\{array_entry, array_expand, data_frame, from_rows, int_entry, ref, row, rows, to_stream};

data_frame()
    ->read(
        from_rows(
            rows(
                row(int_entry('id', 1), array_entry('array', ['a' => 1, 'b' => 2, 'c' => 3])),
            )
        )
    )
    ->withEntry('expanded', array_expand(ref('array')))
    ->write(to_stream(__DIR__ . '/output.txt', truncate: false))
    ->run();

Example: Data frame - Overwrite

<?php

declare(strict_types=1);

use function Flow\ETL\Adapter\CSV\{from_csv, to_csv};
use function Flow\ETL\DSL\{data_frame, overwrite, to_stream};

require __DIR__ . '/../../../autoload.php';

data_frame()
    ->read(from_csv(__DIR__ . '/input/file.csv'))
    ->saveMode(overwrite())
    ->write(to_csv(__DIR__ . '/output/file.csv'))
    ->collect()
    ->write(to_stream(__DIR__ . '/output.txt', truncate: false))
    ->run();

data_frame()
    ->read(from_csv(__DIR__ . '/output/file.csv'))
    ->saveMode(overwrite())
    ->drop('name')
    ->write(to_csv(__DIR__ . '/output/file.csv'))
    ->collect()
    ->write(to_stream(__DIR__ . '/output.txt', truncate: false))
    ->run();

Contributors

Join us on GitHub