DataPageHeaderV2
New page format allowing reading levels without decompressing the data Repetition and definition levels are uncompressed The remaining section containing the data is compressed if is_compressed is true.
Properties
- $_TSPEC : mixed
- $definition_levels_byte_length : int
- Length of the definition levels.
- $encoding : int
- Encoding used for data in this page *.
- $is_compressed : bool
- Whether the values are compressed.
- $isValidate : mixed
- $num_nulls : int
- Number of NULL values, in this data page.
- $num_rows : int
- Number of rows in this data page. Every page must begin at a row boundary (repetition_level = 0): rows must **not** be split across page boundaries when using V2 data pages.
- $num_values : int
- Number of values, including NULLs, in this data page. *.
- $repetition_levels_byte_length : int
- Length of the repetition levels.
- $statistics : Statistics
- Optional statistics for the data in this page *.
Methods
- __construct() : mixed
- getName() : mixed
- read() : mixed
- write() : mixed
Properties
$_TSPEC
public
static mixed
$_TSPEC
= [1 => ['var' => 'num_values', 'isRequired' => true, 'type' => \Thrift\Type\TType::I32], 2 => ['var' => 'num_nulls', 'isRequired' => true, 'type' => \Thrift\Type\TType::I32], 3 => ['var' => 'num_rows', 'isRequired' => true, 'type' => \Thrift\Type\TType::I32], 4 => ['var' => 'encoding', 'isRequired' => true, 'type' => \Thrift\Type\TType::I32, 'class' => '\Flow\Parquet\Thrift\Encoding'], 5 => ['var' => 'definition_levels_byte_length', 'isRequired' => true, 'type' => \Thrift\Type\TType::I32], 6 => ['var' => 'repetition_levels_byte_length', 'isRequired' => true, 'type' => \Thrift\Type\TType::I32], 7 => ['var' => 'is_compressed', 'isRequired' => false, 'type' => \Thrift\Type\TType::BOOL], 8 => ['var' => 'statistics', 'isRequired' => false, 'type' => \Thrift\Type\TType::STRUCT, 'class' => '\Flow\Parquet\Thrift\Statistics']]
$definition_levels_byte_length
Length of the definition levels.
public
int
$definition_levels_byte_length
$encoding
Encoding used for data in this page *.
public
int
$encoding
$is_compressed
Whether the values are compressed.
public
bool
$is_compressed
= true
Which means the section of the page between definition_levels_byte_length + repetition_levels_byte_length + 1 and compressed_page_size (included) is compressed with the compression_codec. If missing it is considered compressed.
$isValidate
public
static mixed
$isValidate
= false
$num_nulls
Number of NULL values, in this data page.
public
int
$num_nulls
Number of non-null = num_values - num_nulls which is also the number of values in the data section *.
$num_rows
Number of rows in this data page. Every page must begin at a row boundary (repetition_level = 0): rows must **not** be split across page boundaries when using V2 data pages.
public
int
$num_rows
$num_values
Number of values, including NULLs, in this data page. *.
public
int
$num_values
$repetition_levels_byte_length
Length of the repetition levels.
public
int
$repetition_levels_byte_length
$statistics
Optional statistics for the data in this page *.
public
Statistics
$statistics
Methods
__construct()
public
__construct([mixed $vals = null ]) : mixed
Parameters
- $vals : mixed = null
getName()
public
getName() : mixed
read()
public
read(mixed $input) : mixed
Parameters
- $input : mixed
write()
public
write(mixed $output) : mixed
Parameters
- $output : mixed