Streaming 500M rows into Apache Arrow in 2.3 seconds

## Streaming 500 million rows into Apache Arrow in 2.3 seconds

## Streaming 500 million rows into Apache Arrow in 2.3 seconds We built a naive parallel reader to see how fast QuestDB's new QWP protocol can stream query results into Arrow, compared it against ClickHouse and TimescaleDB, and stripped out three measurement artifacts before the numbers meant anything. Most database benchmarks measure how fast a query engine can compute an answer. This one measures how fast the database can hand you the rows once it has them. That's egress, and it matters because of what people do with the data next. Feeding a model, running a dataframe pipeline, backfilling…

Читать полностью →

Источник: HN: movies/streaming

Подключаюсь к источникам…

30 главных источников
о мире ИИ

Автоматический перевод, курирование и красивая подача главных статей об искусственном интеллекте.

0
статей
0
источников
9
разделов