June 2023 Update

Core Library

• Add MarkDistinct operator.

• Add TopNRowNumber operator.

• Add support for aggregations over sorted inputs: SELECT agg(x, ORDER BY y) FROM t.

• Add join expression support to Nested Loop join.

• Add serialization support for TableScanNode and TableWriteNode.

• Add INTERVAL YEAR TO MONTH type.

• Add basic support for writing bucketed tables.

• Add support for UNKNOWN type to UnsafeRow serializer.

Presto Functions

• Add lead() and lag() window functions.

• Add set_agg() and set_union() aggregate functions.

• Add rand() alias for random() function.

• Add array_trim() function.

• Add flatten() function.

• Add kurtosis() and skewness() functions.

• Add map_from_entries() function.

• Add json_extract() function.

• Add sum_data_size_for_stats aggregation() function.

• Add 3-argument version of min_by() and max_by() aggregate functions.

• Add :func:`concat`(array(E), E) function.

• Add support for inputs of type DECIMAL to round() function.

• Add support for inputs of type REAL in least() and greatest() functions.

• Add support for inputs of type TIMESTAMP in min_by() and max_by() aggregate functions.

• Add support for inputs of type VARCHAR in histogram() aggregate function.

• Add support for input maps with VARCHAR keys in map_union_sum() aggregate function.

• Add support for inputs of type UNKNOWN to map_union() aggregate function.

• Fix date_diff() function to allow case insensitive units.

• Optimize json_array_length() and json_array_contains() functions using SIMD.

Spark Functions

• Add bin() function.

• Add last_day() function.

• Add overlay() function.

• Add bit_count() and bit_get() functions.

• Add bloom_filter_agg() aggregate function.

Performance and Correctness

• Enable switch and dereference expressions in Fuzzer.

Credits

Aditi Pandit, Amit Dutta, Ariel Ji, Arpit Porwal, Austin Dickey, Bikramjeet Vig, Chengcheng Jin, Daniel Munoz, Darren Fu, David Vu, Deepak Majeti, Ge Gao, Genevieve (Genna) Helsel, Huameng Jiang, Ivan Sadikov, Jalpreet Singh Nanda (:imjalpreet), Jia Ke, Jialiang Tan, Jiayan Wei, Jimmy Lu, Karteek Murthy Samba Murthy, Karteekmurthys, Ke, Kevin Wilfong, Krishna Pai, Laith Sakka, Lingfeng Zhang, Masha Basmanova, Nick Terrell, Open Source Bot, Orri Erling, Patrick Sullivan, Paul Amonson, Pedro Eugenio Rocha Pedreira, Pramod, Richard Barnes, Sanjiban Sengupta, Serge Druzkin, Sergey Pershin, Shiyu Gan, Wei He, Yang Zhang, Zac, duanmeng, joey.ljy, rui-mo, usurai, wanweiqiangintel, xiaoxmeng, xiyu.zk, yangchuan, yingsu00, zhli1142015