July 2023 Update

Documentation

• Add I/O Optimizations and the TpchBenchmark article.

• Add array_sort lambda function blog post.

• Add documentation for the new CompactRow row-wise serialization format.

• Expand documentation for aggregate functions with variable-width accumulators.

Core Library

• Add support for aggregations over distinct inputs: SELECT sum(distinct a).

• Add TableWriteMerge operator. #5546

• Add CompactRow row-wise serialization format to optimize shuffle for Presto-on-Spark.

• Convert DATE to logical type backed by INTEGER physical type.

• Enhance Aggregate and Window functions APIs to provide access to configuration properties.

• Add support for compressing spill data. #5544

Presto Functions

• Add array_sort_desc(), array_union functions.

• Add array_sort() lambda function.

• Add cauchy_cdf(), chi_squared_cdf(), f_cdf(), inverse_beta_cdf() function.

• Add levenshtein_distance() function.

• Add 2-arg versions of min() and max() aggregate functions.

• Add multimap_agg() aggregate function.

• Add entropy() aggregate function.

• Add support for BOOLEAN comparison argument to min_by() and max_by().

• Add support for IGNORE NULLs to Window value functions.

• Optimize map_agg() function for inputs with many duplicate keys.

• Optimize array_agg(), map_agg(), set_agg(), min(), max() for abandon-partial-aggregation use case.

• Optimize json_extract(), json_extract_scalar(), json_size() using SIMD.

Spark Functions

• Add acos(), cosh(), hypot(), left(), log1p(), lpad(), rpad(), sinh(), translate() functions.

• Fix return type of size() function.

• Fix intermediate type of first() and last() functions.

Hive Connector

• Add support for Tencent Cloud Object Storage. #5619

• Add support for reading from Google Cloud Storage. #5069

Performance and Correctness

• Optimize round-robin exchange. #5651

• Optimize try_cast expression for the case when many rows fail the cast.

Credits

Aditi Pandit, Amit Dutta, Arpit Porwal, Austin Dickey, Bikramjeet Vig, Chad Austin, Chen Zhang, Chengcheng Jin, Christian Clauss, Christian Zentgraf, Deepak Majeti, Eric Liu, GOPU-Krishna-S, Ge Gao, Gufan Yin, Harsha Rastogi, Iosif Spulber, Jacob Wujciak-Jens, Jialiang Tan, Jiayan Wei, Jimmy Lu, Jin Chengcheng, John Elliott, Kapil Sharma, Karteekmurthys, Ke, Kevin Wilfong, Konstantin Tsoy, Krishna Pai, Laith Sakka, Logan Wendholt, Ma-Jian1, Masha Basmanova, Orri Erling, PHILO-HE, Paul Amonson, Pedro Pedreira, Pramod, Pranjal Shankhdhar, Sandino Flores, Srikrishna Gopu, Srinivas S T, Taras Galkovskyi, Tiziano Carotti, Wei He, Xiaoxuan Meng, Yang Zhang, Ying, Zac, Zhaolong Zhu, Zhongjun Jin, duanmeng, joey.ljy, kayagokalp, mayan, mohsaka, rrando901, rui-mo, wypb, xiaodou, xiaoxmeng, yangchuan, yanmin, zhejiangxiaomai, 陈旭