Dataset View
DatasetView
Composite façade that fans out output operations to two independent backends:
CSVView — streaming‑first CSV (owns buffering + canonical sort/rewrite).
ParquetView — streaming‑first Parquet (keeps its own buffers + final write).
Public surface
print — final snapshot writer (CSV + Parquet).
appendCardinality — streaming append of per‑generation cardinalities (FUN/VAR).
replaceTopBatch — streaming update of top‑solutions blocks (TOP).
closeStreams — finalize and write sorted/merged artifacts for both backends.
Path helpers
CSV path helpers are delegated to CSVView and preserve the original naming scheme.
Parquet helpers are provided here for logging/UX convenience and mirror CSV layouts.
All merged artifacts are emitted under
/CSV/
and/Parquet/
subfolders.
Functions
Stream one cardinality event into both CSV and Parquet backends.
Finalize both backends:
Mirrors the CSV FINAL table location under /Parquet/
.
Mirrors the CSV INFO table location under /Parquet/
.
Replace a batch of top solutions blocks (per K) in both CSV and Parquet backends.
Generic Parquet table writer for Final tables.