A row group is a horizontal slice of a columnar file’s rows, stored as one column chunk per column, each contiguous in the file. A column chunk is divided into data pages, the unit of encoding and compression. The file’s metadata (its schema, and the position, size, encoding and statistics of every chunk) is written in a footer after the data, so that the file can be written in one pass and read from its end.
Quantitative Finance · Begrippenlijst
Wat is Row group, column chunk, data page?
Ook bekend als: row group · column chunk · data page