Flow PHP

DataPageHeaderV2

New page format allowing reading levels without decompressing the data Repetition and definition levels are uncompressed The remaining section containing the data is compressed if is_compressed is true.

Properties

$_TSPEC  : mixed
$definition_levels_byte_length  : int
Length of the definition levels.
$encoding  : int
Encoding used for data in this page *.
$is_compressed  : bool
Whether the values are compressed.
$isValidate  : mixed
$num_nulls  : int
Number of NULL values, in this data page.
$num_rows  : int
Number of rows in this data page. Every page must begin at a row boundary (repetition_level = 0): rows must **not** be split across page boundaries when using V2 data pages.
$num_values  : int
Number of values, including NULLs, in this data page. *.
$repetition_levels_byte_length  : int
Length of the repetition levels.
$statistics  : Statistics
Optional statistics for the data in this page *.

Methods

__construct()  : mixed
getName()  : mixed
read()  : mixed
write()  : mixed

Properties

$_TSPEC

public static mixed $_TSPEC = [1 => ['var' => 'num_values', 'isRequired' => true, 'type' => \Thrift\Type\TType::I32], 2 => ['var' => 'num_nulls', 'isRequired' => true, 'type' => \Thrift\Type\TType::I32], 3 => ['var' => 'num_rows', 'isRequired' => true, 'type' => \Thrift\Type\TType::I32], 4 => ['var' => 'encoding', 'isRequired' => true, 'type' => \Thrift\Type\TType::I32, 'class' => '\Flow\Parquet\Thrift\Encoding'], 5 => ['var' => 'definition_levels_byte_length', 'isRequired' => true, 'type' => \Thrift\Type\TType::I32], 6 => ['var' => 'repetition_levels_byte_length', 'isRequired' => true, 'type' => \Thrift\Type\TType::I32], 7 => ['var' => 'is_compressed', 'isRequired' => false, 'type' => \Thrift\Type\TType::BOOL], 8 => ['var' => 'statistics', 'isRequired' => false, 'type' => \Thrift\Type\TType::STRUCT, 'class' => '\Flow\Parquet\Thrift\Statistics']]

$definition_levels_byte_length

Length of the definition levels.

public int $definition_levels_byte_length

$is_compressed

Whether the values are compressed.

public bool $is_compressed = true

Which means the section of the page between definition_levels_byte_length + repetition_levels_byte_length + 1 and compressed_page_size (included) is compressed with the compression_codec. If missing it is considered compressed.

$num_nulls

Number of NULL values, in this data page.

public int $num_nulls

Number of non-null = num_values - num_nulls which is also the number of values in the data section *.

$num_rows

Number of rows in this data page. Every page must begin at a row boundary (repetition_level = 0): rows must **not** be split across page boundaries when using V2 data pages.

public int $num_rows

$num_values

Number of values, including NULLs, in this data page. *.

public int $num_values

$repetition_levels_byte_length

Length of the repetition levels.

public int $repetition_levels_byte_length

Methods

__construct()

public __construct([mixed $vals = null ]) : mixed
Parameters
$vals : mixed = null

write()

public write(mixed $output) : mixed
Parameters
$output : mixed

        
On this page

Search results