UNIFIED DATA PROCESSING FRAMEWORK

composer require flow-php/etl ^0.10.0

Changelog

Extracts

Read from various data sources.

Transforms

Shape and optimize for your needs.

Loads

Store and secure in one of many available data sinks.

Modules

Core
CSV
Doctrine
Elastic Search
Google Sheet
Chart.js
JSON
Meili Search
Parquet
Text
XML
Filesystem
Azure Filesystem
Azure SDK

Definition

source

from_path_partitions(Path|string $path) : PathPartitionsExtractor

Usage Examples

Example: Partitioning - Path partitions

<?php

declare(strict_types=1);

use function Flow\ETL\DSL\{data_frame, from_path_partitions, ref, to_stream};

require __DIR__ . '/../../../autoload.php';

data_frame()
    ->read(from_path_partitions(__DIR__ . '/input/color=*/sku=*/*.csv'))
    ->withEntry('path', ref('path')->strReplace(__DIR__, '/__ABSOLUTE_PATH__'))
    ->collect()
    ->write(to_stream(__DIR__ . '/output.txt', truncate: false))
    ->run();

Contributors

Join us on GitHub