June 2024 Update¶
This month has 261 commits from 58 authors. Below are some of the highlights.
Documentation¶
Document Timestamp and Timezone Management.
Core Library¶
Presto Functions¶
Add
regexp_split()
,regexp_replace()
,to_milliseconds()
,from_iso8601_timestamp()
,json_array_get()
,map_remove_null_values()
,array_cum_sum()
,normalize()
,inverse_normal_cdf()
,lpad()
,rpad()
,fail()
,map_top_n_keys()
functions.Add support for TS_WITH_TZ +/- INTERVAL function.
Add support for INTERVAL input to
year()
,month()
,hour()
,minute()
,second()
,millisecond()
, comparison functions.Add support for CAST(TIMESTAMP WITH TIMEZONE AS VARCHAR).
Add support for CAST(DATE AS TIMESTAMP WITH TIMEZONE).
Add support for CAST(TIMESTAMP WITH TIMEZONE AS DATE).
Add support for trailing spaces in CAST(VARCHAR as DATE).
Add support for negative array index, single-quoted keys, paths without leading “$” JsonPath argument in JSON functions such as
json_extract()
.Add support for DECIMAL in
modulus()
function.Add support for DATETIME unit ‘week’ in
date_add()
anddate_diff()
functions.Add support for TIMESTAMP input in
to_iso8601()
function.Add support for variable pattern and replacement in
regexp_replace()
function.Add support for INTERVAL and TIMESTAMP WITH TIMEZONE to between function.
Fix parsing of ‘March’ and ‘MARCH’ input in
date_parse()
function.Add support for complex types to
distinct_from()
,array_distinct()
,histogram()
functions.Add support for VARBINARY to
concat()
,from_base64()
,substr()
functions.Add support for REAL, DECIMAL to
truncate()
function.Add support for
from_unixtime(unixtime, hours, minutes)()
function.Add support for TIMESTAMP WITH TIME ZONE input to
least()
,greatest()
,minus()
functions.Add support for BOOLEAN input to
approx_most_frequent()
function.Fix
json_array_contains()
for NaN, Infinity, -Infinity arguments. #10023Fix
min()
,max()
handling for NaN, Infinity, -Infinity arguments. #9931
Spark Functions¶
Add
log()
function.Add support for DECIMAL input to
greatest()
andleast()
functions.Add support for complex types to
equalto()
andequalnullsafe()
functions.Add support for FLOAT and DOUBLE types to
mod()
function.Fix
in()
for NaN inputs.
Hive Connector¶
Add “cache.no_retention” session config to allow a query not retain data in the AsyncDataCache and skip SSD Cache.
Add retry for S3 filesystem.
Add support for ORC file-format Reader.
Performance and Correctness¶
Build System¶
Add support for Centos9 Stream + GCC12.
Update fbos deps to v2024.05.20.00.
Credits¶
56 Masha Basmanova <mbasmanova@meta.com>
20 Kevin Wilfong <kevinwilfong@meta.com>
17 Jimmy Lu <jimmylu@meta.com>
16 xiaoxmeng <xiaoxmeng@fb.com>
13 Deepak Majeti <deepak.majeti@ibm.com>
9 Pedro Eugenio Rocha Pedreira <pedroerp@meta.com>
11 Zac Wen <zacw@meta.com>
8 Bikramjeet Vig <bikramjeet@meta.com>
7 Ke <ke.404notfound@gmail.com>
7 Wei He <weihe@meta.com>
6 Jialiang Tan <jacob.jialiang.tan@gmail.com>
6 wypb <wyphao.2007@163.com>
5 Jacob Wujciak-Jens <jacob@wujciak.de>
5 PHILO-HE <feilong.he@intel.com>
5 zhli1142015 <zhli@microsoft.com>
4 Kevin Wilfong <kevinwilfong@fb.com>
4 Orri Erling <oerling@fb.com>
4 duanmeng <macduan@tencent.com>
4 yanngyoung <cindyyyang@tencent.com>
3 Jia Ke <ke.a.jia@intel.com>
3 Krishna Pai <kpai@fb.com>
3 Pramod <pramod@ahana.io>
3 Sandino Flores <sandino.flores.moreno@intel.com>
3 lingbin <lingbinlb@gmail.com>
3 mwish <maplewish117@gmail.com>
2 Andrii Rosa <andriirosa@fb.com>
2 Christian Zentgraf <kitgocz@gmail.com>
2 rui-mo <rui.mo@intel.com>
2 wypb <wjameswu@tencent.com>
1 Amit Dutta <adutta@meta.com>
1 Andrii Rosa <andriirosa@meta.com>
1 Ankita Victor <anvicto@microsoft.com>
1 Athmaja N <Athmaja.N@ibm.com>
1 Daniel Hunte <danielhunte@meta.com>
1 Daniel Jonathan Hunte <danielhunte@meta.com>
1 Deepashree Gandhi <deegandh@in.ibm.com>
1 Huameng (Michael) Jiang <huamengjiang@meta.com>
1 Jacob Khaliqi <jacobkhaliqi@gmail.com>
1 Jialiang Tan <jtan6@meta.com>
1 Kunal Kataria <kunalkataria@meta.com>
1 NEUpanning <emmning@163.com>
1 Pranjal Shankhdhar <pranjalssh@meta.com>
1 Pratik Joseph Dabre <pdabre12@gmail.com>
1 Reetika Agrawal <reetika.agrawal@ibm.com>
1 Yoav Helfman <ifdef@meta.com>
1 Zhenyuan Zhao <zzhao@meta.com>
1 aditi-pandit <Aditi.Pandit@ibm.com>
1 chenweiguo.vc <chenweiguo.vc@bytedance.com>
1 deepthydavis <deepthy.davis@ibm.com>
1 gaoyangxiaozhu <gyycoder@gmail.com>
1 joey.ljy <joey.ljy@alibaba-inc.com>
1 liangyongyuan <liangyongyuan@xiaomi.com>
1 lingbin <lingbin.lb@alibaba-inc.com>
1 rexan <rexan@apache.org>
1 soumyaduriseti <soumyaduriseti@ibm.com>
1 wjameswu <wjameswu@tencent.com>
1 yan ma <yan.ma@intel.com>
1 yangshijie.2024 <yangshijie.2024@bytedance.com>