Todos los libros

Profesional

Apps Acerca de Coach Iniciar sesión Empezar a leer

Quantitative Finance · Glosario

¿Qué es Out-of-core processing, streaming execution?

También llamado: out-of-core processing · streaming execution

Definition 10.5 Research, Data and Risk Platforms · Capítulo 10 — Dataframes

Out-of-core processing computes a result over data larger than memory by reading it in pieces from storage. Streaming execution is the engine-level form of it: the plan’s operators pass batches to one another as they are produced, so that a scan, a filter and an aggregation hold one batch at a time, while operators that need all of their input (a global sort, some joins) buffer it.

Leer en el capítulo →