khazana — your personal signal terminal khazana — your personal signal terminal
No. 311 eng-blog gh-rel-duckdb 75

DuckDB v1.5.2 Bugfix Release

This is a bug fix release for various issues discovered after we released v1.5.1 What's Changed Backport various race condition fixes to v1.4 by @Mytherin in #20804 bump ref to azure for v1.4.4 (rebuild) by @benfleis in #20888 Internal #7584: AsOf Simple Joins by @hawkfish in…

data-science data-strategy tech

7 min read open original ↗

This is a bug fix release for various issues discovered after we released v1.5.1 What's Changed Backport various race condition fixes to v1.4 by @Mytherin in #20804 bump ref to azure for v1.4.4 (rebuild) by @benfleis in #20888 Internal #7584: AsOf Simple Joins by @hawkfish in #21090 Do not write ccache to github cache for v1.4-andium by @smvv in #21109 Disable extension caching for v1.4 to free github cache space by @smvv in #21150 Disable save_cache for v1.4-andium by @smvv in #21167 Backport #19232: allow * Not similar to 'pattern' by @Dtenwolde in #21177 backport zstd PR to 1.4 by @artjomPlaunov in #21178 Fix unbounded row group growth for indexed tables on repeated load+insert cycles by @abramk in #21316 Backport #21271 by @artjomPlaunov in #21326 [lance] Add for v1.4-andium by @carlopi in #21410 add lance for v1.4 by @samansmink in #21113 Correctly detect overflows when decoding integers from storage by @Mytherin in #21482 Correctly revert dictionary size when reverting string appends by @Mytherin in #21489 Add descriptions for vortex and lance by @carlopi in #21500 Fixup Write bytes are counted as BYTES_WRITTEN by @carlopi in #21501 Fix memory leak when reusing PreparedStatement (#21089) by @wzharies in #21104 Make some MultiStatements and PRAGMAs Transactional by @yan-alex in #21171 Reduce concurrent thread count in test by @Mytherin in #21511 Fixing integer overflow in list_resize by @hannes in #21515 Fix #21512: correctly render empty results in .mode json by @Mytherin in #21517 Fix parsing test path to skip by @jeewonhh in #21495 Add setting for limiting the number of threads launched concurrently in the test runner (max_test_threads) by @Mytherin in #21520 Unify adding suffixes to path in Path:: AddSuffixToPath - fix temp directory split bug by @Mytherin in #21527 Correctly deal with negative values in GetPosixVersionTag, and fix constant NULL struct scans after recent fix by @Mytherin in #21549 Fix missing extension static libs in Windows MinGW bundle by @mlafeldt in #21559 PEG grammar fixes: Update extension and allow numeric struct keys by @Dtenwolde in #21331 [v1.5-variegata] Fix #21514: ASOF join empty right by @Pieczasz in #21553 Fix data path in test/sql/copy/parquet/parquet_no_stats.test by @jeewonhh in #21561 TopNWindowElimination Column Binding Fix by @d-justen in #21564 lance: bump lance-duckdb to 4d9ecab by @Xuanwo in #21572 Bump Julia to v1.5.0 by @taniabogatsch in #21588 Bump Julia to v1.4.4 on v1.4-andium by @taniabogatsch in #21589 Simplify the way we determine which row groups to checkpoint during checkpoints by @Mytherin in #21574 Fix for CSV reader buffer-boundary value read by @Mytherin in #21577 CLI: Avoid division by zero when formatting a large result with a non-wide shell by @Mytherin in #21591 Backport __EMSCRIPTEN__ fix by @Mytherin in #21581 Fix missing SetSizeAndFinalize in BIGNUM Add for zero result case by @pdet in #21465 Segfault due to unchecked malloc/realloc, proposed fix to #21593 by @wasade in #21594 Reduce arg_min_max_n heap preallocation by @feichai0017 in #21467 Fixed an issue where the describe statement did not work correctly in markdown output mode(ISSUE:#21579) by @ArNine in #21611 fix unpivot serialization by @Maxxen in #21595 Windows shell: enable VT100 processing on startup by @staticlibs in #21615 Make PEG Parser use strict mode in CI by @Dtenwolde in #21590 Fix #21623: flatten input chunk in TopNHeap::CheckBoundaryValues by @Mytherin in #21629 Issue #21592: Window Self-Join Framing by @hawkfish in #21628 Bump Julia to v1.5.1 by @taniabogatsch in #21637 Merge v1.4-andium into v1.5-variegata by @Mytherin in #21639 Bump storage version to v1.5.2 by @taniabogatsch in #21638 bump delta and unity_catalog ext refs in v1.5-variegata by @benfleis in #21640 Fix cancellation order between pipelines and tasks in CancelTasks by @carlopi in #21642 Fix shell completion enter handling by @atulagrwl in #21552 fix(adbc): err use after free by @gishor in #21605 Fix some Parquet fuzzer issues by @lnkuiper in #21635 Re-organize WAL replay slightly, and correctly deal with empty checkpoint WAL files in WAL recovery by @Mytherin in #21645 Warn instead of error when trying to persist geometry columns with CRS in old storage format by @Maxxen in #21649 Avoid throwing an error when failing to bind views in duckdb_columns by @Mytherin in #21658 Infer timestamps with timezone in read_json_auto by @leo-altertable in #21660 Windows: remove prefix from canonical paths by @staticlibs in #21652 CLI: Add .help shortcuts by @carlopi in #21662 Internal #8553: Window TopN Except by @hawkfish in #21671 Fix issue with struct filter on missing structs by @Mytherin in #21676 Internal #7568: ASOF SEMI Test by @hawkfish in #21683 Fix type check in st_crs by @Maxxen in #21688 Disable regular updates for geometry by @Maxxen in #21641 Fix stoi crash in Arrow format string parsing for w: and +w: types by @yharby in #21692 Test runner: Support replacement without dollar ({i} instead of ${i}) in loop iterators by @Mytherin in #21708 Internal #8657: IEJoin Filter Sides by @hawkfish in #21721 Add missing test for delta byte array by @ccfelius in #21714 Fix variant shredding consistency issue by @Tishj in #21715 TopNWindowElimination fixes by @d-justen in #21663 Ignore NULL/__HIVE_DEFAULT_PARTITION__ when detecting types by @lnkuiper in #21731 fix path test warnings by @benfleis in #21711 Allow SET DEFAULT / DROP DEFAULT for tables that have dependencies by @Mytherin in #21729 Add clickbench by @c-herrewijn in #21730 Fix prepared temp-table INSERT invalidation after DROP by @wordhardqi in #21712 Allow join filter pushdown through integral up/down casts by @lnkuiper in #21743 Allow join filter pushdown for NOP collations by @lnkuiper in #21742 counting fix by @artjomPlaunov in #21733 [Variant] Re-add the removed variant_legacy_encoding setting by @Tishj in #21710 Fix update plans when deserializing if type no longer supports regular updates by @Maxxen in #21718 Re-instantiate dependencies of tables for ALTER TABLE ... DROP COLUMN and ALTER TABLE .. SET DEFAULT by @Mytherin in #21752 Use correct error message for name conflicts between table and views by @JelteF in #21760 Bump spatial by @taniabogatsch in #21781 PEG parser strict mode: followup fixes and improvements by @Dtenwolde in #21709 Fix DELETE RETURNING for rows inserted in the same transaction by @rustyconover in #21541 Disable bloom filter pushdown through casts by @lnkuiper in #21792 Bugfixes by @lnkuiper in #21793 Bump test utils by @taniabogatsch in #21795 Expose HIDDEN as an ATTACH option by @utay in #21764 Fix TopN window elimination with external CTE refs by @feichai0017 in #21686 Issue #21682: TopN Window Sets by @hawkfish in #21775 Add support for reading geometry type to the C-API by @Maxxen in #21763 Fix ADBC data race by @dentiny in #21800 Fix Arrow REE INT64 run_ends using wrong template parameter by @rustyconover in #21847 Fix integer overflow crash in list repeat function by @rustyconover in #21873 [minor] Fix CreateViewInfo::Copy() not copying names by @LucaSoato in #21819 Fix case-sensitive default database check allowing detach of default database by @rustyconover in #21863 Fix geometry TextWriter corrupting coordinates in scientific notation by @rustyconover in #21893 Issue #21820: TopN Window Projections by @hawkfish in #21902 Bump Postgres, MySQL and SQLite by @staticlibs in #21899 AddToBeRescheduled: Avoid UB in assigning vs move by @carlopi in #21912 vacuum_rebuild_indexes threshold setting by @artjomPlaunov in #21769 Fix CSV process over buffer out-of-bound access by @dentiny in #21840 Fix is_histogram_other_bin handle null by @dentiny in #21841 Merge v1.4-andium into v1.5-variegata by @Mytherin in #21919 Fix in-place update to look only at updated columns by @jeewonhh in #21922 Issue #21905: AGO Overflow Check by @hawkfish in #21936 Fix common subplan optimizer bug by @kryonix in #21932 Issue #21907: Invalid Window Macros by @hawkfish in #21929 [ART] Fix information loss on index build cast by @taniabogatsch in #21815 Improve geometry WKT parsing and add geometry to test_all_types v2 by @taniabogatsch in #21805 Run ArrowConverter::ToArrowSchema in a transaction by @evertlammerts in #21927 Fix invalid memory access when CSV columns less than expected by @dentiny in #21822 Use BLOB, not VARCHAR for row group pruning by @lnkuiper in #21946 Add HTTPUtil::CloseClient(...) with trivial no-op implementation, and base_url field to HTTPClient by @carlopi in #21924 Fix incorrect results when using try within if by @jankramer in #21943 lance: bump lance-duckdb to 1b4ef68 by @Xuanwo in #21944 Fix Arrow union type_ids buffer ignoring chunk_offset by @rustyconover in #21848 Make parser override work with parser extensions by @Dtenwolde in #21761 [Dev] Bump the merge_vcpkg_deps script to bump the baseline of the registry by @Tishj in #21950 Bump httpfs to include recent fixes, also adding new no-op setting by @carlopi in #21949 Parquet writer: allow partial variant shredding in Parquet, instead of bailing out when a single struct field does not match by @Mytherin in #21959 Bump Postgres by @staticlibs in #21958 bump iceberg by @Tmonster in #21967 [Parquet][VARIANT] Add support for Snowflake-produced shredded VARIANT Parquet files by @Tishj in #21814 Make Oids start at 20k to avoid unintended collisions by @JelteF in #20979 Unlock transaction lock during fallback WAL write by @Mytherin in #21969 bump avro hash by @Tishj in #21974 Shred unsigned types in VARIANT when writing to Parquet by @Mytherin in #21973 Fix "make clangd" by @JelteF in #21981 MERGE INTO - no need to extract logical get, we already know where it is by @Mytherin in #21984 Attempt to fix invalid memory access by @dentiny in #21985 Json function should be set CanThrow by @tianjq16 in #21972 bump azure and delta for v1.5.2 by @benfleis in #21979 Bumping DuckLake by @pdet in #21989 Bump httpfs, now with implemented httpfs_connection_caching (opt-in) by @carlopi in #21982 Revert "Run ArrowConverter::ToArrowSchema in a transaction" by @evertlammerts in #22007 Full Changelog: v1.5.1...v1.5.2