Todos os livros

Profissional

Apps Sobre Coach Entrar Começar a ler

Quantitative Finance · Glossário

O que é Out-of-core processing, streaming execution?

Também chamado de: out-of-core processing · streaming execution

Definition 10.5 Research, Data and Risk Platforms · Capítulo 10 — Dataframes

Out-of-core processing computes a result over data larger than memory by reading it in pieces from storage. Streaming execution is the engine-level form of it: the plan’s operators pass batches to one another as they are produced, so that a scan, a filter and an aggregation hold one batch at a time, while operators that need all of their input (a global sort, some joins) buffer it.

Ler no capítulo →