Release 3.0.5
Dear community members, the Apache Doris 3.0.5 version was officially released on Apr 28, 2025.
Quick Download: https://doris.apache.org/download/
GitHub Release: https://github.com/apache/doris/releases
New Features
Lakehouse
- Added Catalog/Database/Table quantity monitoring metrics to FE Metrics (#47891)
- MaxCompute Catalog now supports Timestamp type (#48768)
Query Execution
- Added URL processing functions:
top_level_domain
,first_significant_subdomain
,cut_to_first_significant_subdomain
(#42488) - Added
year_of_week
function with Trino-compatible implementation (#48870) percentile_array
function now supports Float and Double data types (#48094)
Storage-Compute Separation
- Added compute group renaming support (#46221)
Improvements
Storage
- Accelerated Compaction task generation to improve performance (#49547)
- Stream Load now supports compressed JSON file ingestion (#49044)
- Enhanced error messages for various ingestion scenarios (#48436 #47721 #47804 #48638 #48344 #49287 #48009)
- Added multiple metrics for Routine Load (#49045 #48764)
- Optimized Routine Load scheduling algorithm to prevent single job failure from affecting overall scheduling (#47847)
- Added Routine Load system table (#49284)
- Improved query performance for Merge-On-Write (MOW) tables under high-frequency ingestion (#48968)
- Enhanced Profile information display for Key Range queries (#48191)
Compute-Storage Decoupled
- Fixed multiple File Cache stability and performance issues (#48786 #48623 #48687 #49050 #48318)
- Improved validation logic for Storage Vault creation (#48073 #48369)
Lakehouse
- Optimized BE Scanner closure logic for Trino Connector Catalog to accelerate memory release (#47857)
- ClickHouse JDBC Catalog now auto-adapts to different driver versions (#46026)
Asynchronous Materialized Views
- Enhanced planning performance for transparent rewrite (#48782)
- Optimized
tvf mv_infos
performance (#47415) - Disabled catalog metadata refresh during external table-based MV construction to reduce memory usage (#48767)
Query Optimizer
- Improved statistics collection performance for key columns and partition columns (#46534)
- Query result aliases now strictly match user input (#47093)
- Enhanced column pruning after common subexpression extraction in aggregation operators (#46627)
- Improved error messages for function binding failures and unsupported subqueries (#47919 #47985)
Semi-structured Data Management
json_object
function now supports complex type parameters (#47779)- Added support for writing UInt128 to IPv6 type (#48802)
- Enabled inverted index support for ARRAY fields in VARIANT type (#47688 #48117)
Security
- Improved Ranger authorization performance (#49352)
Others
- Optimized JVM Metrics interface performance (#49380)
Bug Fixes
Storage
- Fixed data correctness issues in several edge cases (#48056 #48399 #48400 #48748 #48775 #48867 #49165 #49193 #49350 #49710 #49825)
- Fixed untimely cleanup of completed transactions (#49564)
- Changed JSONB default value to
{}
for partial column updates (#49066) - Fixed delete bitmap update lock release issue in Storage-Compute Separation model (#47766)
- Fixed data loss in Stream Load on ARM architecture (#49666)
- Fixed missing error URL return for data quality issues in Insert Into Select (#49687)
- Fixed error URL reporting for multi-table Routine Load data quality issues (#49130)
- Fixed incorrect results when using Insert Into Values during Schema Change (#49338)
- Fixed core dump caused by tablet commit info reporting (#48732)
- Added Azure China region support for S3 Load (#48642)
- Fixed "get image failed" error in K8s environment (#49072)
- Reduced CPU consumption in dynamic partition scheduling (#48577)
- Fixed column exception after materialized view renaming (#48328)
- Fixed memory and file cache leakage after failed Schema Change (#48426)
- Fixed base compaction failure for tables with empty partitions (#49062)
- Fixed data correctness issues in complex type modifications (#49452)
- Fixed core dump in cold compaction (#48329)
- Fixed cumulative point stagnation with delete operations (#47282)
- Fixed memory insufficiency in large-scale full compaction (#48958)
Compute-Storage Decoupled
- Fixed file cache cleanup failure in K8s environment (#49199)
- Fixed FE CPU spike caused by read-write locks during high-frequency ingestion (#48564)
Lakehouse
Data Lakes
- Fixed BE core dump during concurrent writes to Hive/Iceberg tables (#49842)
- Fixed write failures to Hive/Iceberg tables on AWS S3 (#47162)
- Fixed incorrect Iceberg Position Deletion reads (#47977)
- Added Tencent Cloud COS support for Iceberg table creation (#49885)
- Fixed Kerberos authentication for Paimon data on HDFS (#47192)
- Fixed memory leak in Hudi Jni Scanner (#48955)
- Fixed multi-partition list reading in MaxCompute Catalog (#48325)
JDBC
- Fixed NPE when fetching row count from JDBC Catalog (#49442)
- Fixed OceanBase Oracle mode connection test (#49442)
- Fixed column type length inconsistency in concurrent JDBC Catalog access (#48541)
- Fixed Classloader leak in JDBC Catalog BE (#46912)
- Fixed connection thread leak in PostgreSQL JDBC Catalog (#49568)
Export
- Fixed EXPORT job stuck in EXPORTING state (#47974)
- Disabled OUTFILE auto-retry to prevent duplicate files (#48095)
Others
- Fixed NPE when executing TVF queries via FE WebUI (#49213)
- Fixed Hadoop Libhdfs thread local null pointer exception (#48280)
- Fixed "Filesystem already closed" error in FE Hadoop access (#48351)
- Fixed Catalog comment persistence issue (#46946)
- Fixed Parquet complex type reading errors (#47734)
Asynchronous Materialized Views
- Fixed slow MV construction in extreme scenarios (#48074)
- Fixed nested MV transparent rewrite failure (#48222)
Query Optimizer
- Fixed constant folding calculation errors (#49225 #47966 #49416 #49087 #49033 #49061 #48895 #48957 #47288 #48641 #49413 #48783)
- Fixed unexpected errors with ORDER BY in nested window functions (#48492)
Query Execution
- Fixed pipeline task scheduling deadlocks/performance issues (#49976 #49007)
- Fixed memory corruption on FE connection failure (#48370 #48313)
- Fixed memory corruption with lambda and array functions (#49140)
- Fixed BE core caused by null string-to-JSONB conversion (#49810)
- Standardized undefined behaviors in
parse_url
(#49149) - Fixed
array_overlap
null handling (#49403) - Fixed case conversion errors for non-ASCII characters (#49763)
- Fixed BE core in
percentile
function (#48563) - Fixed multiple memory corruption issues (#48288 #49737 #48018 #47964)
- Fixed incorrect SET operator results (#48001)
- Reduced default Arrow Flight thread pool size to prevent FD exhaustion (#48530)
- Fixed window function memory corruption (#48458)
Semi-structured Data Management
- Fixed chunked Stream Load JSON import (#48474)
- Enhanced JSONB format validation (#48731)
- Fixed crash with large STRUCT fields (#49552)
- Extended VARCHAR length support in complex types (#48025)
- Fixed
array_avg
crash with specific parameters (#48691) - Fixed
ColumnObject::pop_back
crash in VARIANT type (#48935 #48978) - Disabled index building on VARIANT type (#49844)
- Disabled inverted index v1 format for VARIANT type (#49890)
- Fixed multi-layer CAST errors in VARIANT type (#47954)
- Optimized inverted index metadata lookup for VARIANT with many subcolumns (#48153)
- Reduced VARIANT schema memory consumption in Storage-Compute Separation mode (#47629 #48463)
- Fixed PreparedStatement ID overflow (#48116)
- Fixed row storage with DELETE operations (#49609)
Inverted Index
- Fixed ARRAY type null bitmap handling (#48052)
- Fixed Date/Datetimev1 Bloomfilter comparison (#47005)
- Fixed UTF-8 4-byte character truncation (#48792)
- Fixed index loss after immediate column addition (#48547)
- Fixed empty data handling in ARRAY inverted index (#48264)
- Improved FE metadata upgrade compatibility (#49283)
- Fixed
match_phrase_prefix
cache error (#46517) - Fixed file cache cleanup after compaction (#49738)
Security
- Removed Select_Priv check for DELETE operations (#49239)
- Prevented non-root users from modifying root privileges (#48752)
- Fixed intermittent LDAP PartialResultException (#47858)