August 2022 Update

Documentation

• Add website for Velox.

• Add documentation for Window functions.

• Add documentation for combinations() and array_sort() Presto functions.

Core Library

• Add support for Right Semi Join.

• Add basic Window operator.

• Add support for spilling order by.

• Add support for zero-copy vector view.

• Add support for DECIMAL addition and subtraction functions.

• Add support for casting one DECIMAL to another DECIMAL with different precision and scale.

• Add support for DECIMAL sum aggregation.

• Improve spilling by avoiding redundant computations, better test coverage.

• Resolve to vector functions over simple functions when their signatures match.

Substrait Extension

• Add support for ROW, ARRAY, and MAP types.

Arrow Extension

• Add support for dictionary encoding.

• Improve support for ARRAY and MAP types.

Presto Functions

• Add transform_keys() and transform_values() functions.

• Add array_sum() function.

• Add max_data_size_for_stats() aggregate function that is used for computing statistics.

• Add is_json_scalar(), json_array_length(), json_array_contains() functions.

• Add support for TIMESTAMP WITH TIME ZONE in date_trunc() function.

• Add support for parsing month string (prefix “Jan” or the full name “January”) in parse_datetime() function.

• Update min(), max() aggregate functions to use the same type for input, intermediate, and final results.

• Update sum() aggregate function to check for integer overflow.

• Optimize eq(), neq(), lt(), gt(), lte(), gte() functions using SIMD.

Hive Connector

• Add support for FLOAT, DOUBLE, and STRING types to native Parquet reader.

• Add support for dictionary encoded INTEGER columns to native Parquet reader.

• Add GZIP and Snappy compression support to native Parquet reader.

• Add support for DATE type in ORC reader.

Performance and Correctness

• Add q9, q15, q16 to TPC-H benchmark.

• Optimize memory allocation by specializing vector readers based on the arguments. #1956

• Add benchmark for vector view.

• Publish microbenchmark results to conbench.

Debugging Experience

• Add BaseVector::toString(bool) API to print all layers of encodings.

Credits

Aditi Pandit, Barson, Behnam Robatmili, Bikramjeet Vig, Chad Austin, Connor Devlin, Daniel Munoz, Deepak Majeti, Ge Gao, Huameng Jiang, James Wyles, Jialiang Tan, Jimmy Lu, Jonathan Keane, Karteek Murthy Samba Murthy, Katie Mancini, Kimberly Yang, Kk Pulla, Krishna Pai, Laith Sakka, Masha Basmanova, Michael Shang, Orri Erling, Orvid King, Parvez Shaikh, Paul Saab, Pedro Eugenio Rocha Pedreira, Pramod, Pyre Bot Jr, Raúl Cumplido, Serge Druzkin, Sergey Pershin, Shiyu Gan, Shrikrishna (Shri) Khare, Taras Boiko, Victor Zverovich, Wei He, Wei Zheng, Xiaoxuan Meng, Yuan Chao Chou, Zhenyuan Zhao, erdembilegt.j, jiyu.cy, leoluan2009, muniao, tanjialiang, usurai, yingsu00, 学东栾.