flow php

UNIFIED DATA PROCESSING FRAMEWORK

composer require flow-php/etl ^0.10.0

Changelog

elephant
extract

Extracts

Read from various data sources.

arrow
transform

Transforms

Shape and optimize for your needs.

arrow
load

Loads

Store and secure in one of many available data sinks.


Definition


/**
 * Used to read from a JSON lines https://jsonlines.org/ formatted file.
 *
 * @param Path|string $path - string is internally turned into stream
 */
from_json_lines(Path|string $path) : JsonLinesExtractor

Usage Examples


Example: Data reading - Jsonl

<?php

declare(strict_types=1);

use function Flow\ETL\Adapter\JSON\from_json_lines;
use function Flow\ETL\DSL\{bool_schema, data_frame, int_schema, schema, str_schema, to_stream};

require __DIR__ . '/vendor/autoload.php';

$schema = schema(
    int_schema('id'),
    str_schema('name'),
    str_schema('email'),
    bool_schema('active'),
);

data_frame()
    ->read(
        from_json_lines(__DIR__ . '/input/dataset.jsonl')
            ->withSchema($schema)
    )
    ->collect()
    ->write(to_stream(__DIR__ . '/output.txt', truncate: false))
    ->run();

Contributors

Join us on GitHub external resource
scroll back to top