August 2024 Update

This month has 144 commits from 45 authors. Below are some of the highlights.

Core Library

• Add IPAddress Presto type.

• Add support for copying a vector to a new memory pool. #10647

• Add support for Wave metrics.

• Add support for byte input stream backed by a file. #10717

• Add near zero-copy import & export for Arrow BinaryView/Utf8View formats. #9726

• Add support for custom join bridges. #10626

• Add support for row-level streaming build in the window operator. #9025

• Fix some joins to preserve probe order. #10651, #10832

• Fix row vectors export to Arrow. #10703

• Fix memory arbitration/reclaim in single-threaded execution. #10600

• Fix filter evaluation for missing fields in a file. #10777

• Fix a race condition in query memory abort process. #10826

• Fix common sub-expression. #10837

Presto Functions

• Add support for WEEK_OF_WEEK_YEAR to date_format() function.

• Add support for UNKNOWN type in map_concat() function.

• Add support for complex types in array_except(), array_intersect(), and arrays_overlap().

• Fix json_array_* functions to return NULL for malformed inputs.

• Fix NaN comparison in approx_percentile(). #10710

• Fix array_join() for TIMESTAMP inputs. #10881

Spark Functions

• Add empty2null(), slice() scalar functions.

• Add mode() aggregate function.

• Add support for UNKNOWN type in hash() function.

• Add support for regex delimiter and limit argument in split() function.

• Fix collect_set() output. #10737

Hive Connector

• Add support for column names to include space character.

• Fix Parquet RowGroup filtering for MAP and ARRAY types. #10510

• Fix reading legacy array and map types in parquet. #9728, #10753

Performance and Correctness

• Add support for Spark query runner. #10357

• Add Query Trace Writers and Readers. #10774

• Optimize remaining filter to not eagerly materialize multi-referenced fields. #10645

• Optimize cross joins for single record build side. #10726

Build System

• Add support for Clang15.

Credits

 3  Amit Dutta - Meta
 5  Bikramjeet Vig - Meta
 5  Chengcheng Jin - Intel
 3  Christian Zentgraf - IBM
 7  Daniel Hunte - Meta
 4  Deepak Majeti - IBM
 4  Hongze Zhang - Intel
 1  Huameng (Michael) Jiang - Meta
 1  Jacob Khaliqi - Meta
 4  Jacob Wujciak-Jens - Voltron Data
 6  Jia Ke - Intel
14  Jialiang Tan
 8  Jimmy Lu - Meta
 2  Joe Abraham - IBM
 1  Karthikeyan Natarajan - Nvidia
 7  Ke Wang - Meta
 1  Kevin Wilfong - Meta
 5  Krishna Pai - Meta
 1  Masha Basmanova - Meta
 1  Muhammad Faisal - Meta
 1  Orri Erling - Meta
11  Pedro Eugenio Rocha Pedreira - Meta
 2  Pramod Satya - IBM
 2  Satadru Pan - Meta
 1  Serge Druzkin - Meta
 1  Sergey Pershin - Meta
 1  Stan Ionascu - Meta
 1  Urvish Desai - ByteDance
 4  Wei He - Meta
 3  Yang Zhang - Alibaba Inc
 2  Zuyu ZHANG
 2  duanmeng - Tencent
 1  gaoyangxiaozhu
 1  hitarth
 1  kevincmchen
 1  lingbin
 1  mohsaka
 2  rexan
 6  Rui Mo - Intel
 1  snadukudy
12  xiaoxmeng - Meta
 2  yan ma - Intel
 1  yingsu00
 1  zhaokuo
 1  Zhen Li - Microsoft