Commit Graph

72347 Commits

Author SHA1 Message Date
fredwang 005475b739 Merge 'dog-cnch-dev-fix-left-any-join' into 'cnch-dev'
fix(optimizer@m-5266967197): ban left any join to inner

See merge request: !24508
2024-10-08 06:49:40 +00:00
fredwang bb9ec5eeed fix compile errors 2024-10-08 14:45:28 +08:00
fredwang 4390fa54fe fix compile error 2024-10-08 02:40:52 +00:00
fredwang 91dc237459 Merge 'lf-cnch-dev' into 'cnch-dev'
feat(clickhousech@m-4692072591): add lasformation client

See merge request: !24228
# Conflicts:
#	build_bin_tob.sh
#	src/CMakeLists.txt
#	src/ExternalCatalog/CMakeLists.txt
#	src/ExternalCatalog/HiveExternalCatalog.cpp
#	src/Storages/Hive/CnchHiveSettings.h
#	src/Storages/Hive/DirectoryLister.cpp
2024-10-08 02:31:20 +00:00
fredwang 57e1dc4a70 Merge 'fix_expand_distinct_cnchdev' into 'cnch-dev'
fix(optimizer@m-5158780031): MultipleDistinctAggregationToExpandAggregate process normal agg with multiple arguments cnch-dev

See merge request: !24404
# Conflicts:
#	src/Interpreters/executeQuery.cpp
2024-10-08 02:17:56 +00:00
fredwang 874ef7aa5e Merge 'fix_optimize_read_in_order_with_enable_sorting_property_cnchdev' into 'cnch-dev'
fix(optimizer@m-5260420737): fix sorting_property when optimizer_in_order = 0

See merge request: !24478
2024-10-08 02:16:25 +00:00
fredwang addcb5ddb4 Merge 'cnch_dev_fix_gin_ub' into 'cnch-dev'
fix(clickhousech@m-5260405054): Fix ub in gin store factory

See merge request: !24461
2024-10-08 02:16:06 +00:00
fredwang c41b238490 Merge branch 'cherry-pick-eab18ceb-4' into 'cnch-dev'
fix(clickhousech@m-5251516614): Fix toDatetime64ornull with Time Type cnch dev

See merge request dp/ClickHouse!24439
2024-10-08 02:15:34 +00:00
fredwang 17a9cfe9ed Merge 'fix/cnch-2-partwriter_bitengine_fix' into 'cnch-dev'
fix(clickhousech@m-14417475): BitEngine schema change in part-writer

See merge request: !24457
# Conflicts:
#	src/Storages/StorageCloudMergeTree.cpp
#	tests/queries/4_cnch_stateless/20012_test_bitengine_preattach_partition.reference
#	tests/queries/4_cnch_stateless/20012_test_bitengine_preattach_partition.sql
2024-10-08 02:14:20 +00:00
fredwang e652822e0d Merge branch 'max.chenxi/dev' into 'cnch-dev'
fix(clickhousech@m-3000508658): fix for asan build

See merge request dp/ClickHouse!24466
2024-10-08 02:06:10 +00:00
fredwang 50d4589991 Merge 'optimizer_fully_support_subquery' into 'cnch-dev'
feat(clickhousech@m-5165217262): refine subquery

See merge request: !24343
# Conflicts:
#	src/Interpreters/InterpreterCreateQuery.cpp
#	src/Statistics/SubqueryHelper.cpp
2024-10-08 02:05:42 +00:00
fredwang a2f104c10c Merge 'dev_shared_uncompressed_cache' into 'cnch-dev'
feat(clickhousech@m-5165158853):  Add sharded uncompress cache

See merge request: !24443
# Conflicts:
#	programs/server/Server.cpp
2024-10-08 02:04:04 +00:00
fredwang cb6e38545a Merge branch 'fix-profile' into 'cnch-dev'
fix(clickhousech@m-4970049069): fix query with profile

See merge request dp/ClickHouse!24437
2024-10-08 02:00:13 +00:00
fredwang 0da5ba8cf9 Merge 'add_map_check_cnchdev' into 'cnch-dev'
fix(optimizer@m-4281348766): optimizer add allow_map_access_without_key check cnch-dev

See merge request: !24370
2024-10-08 01:59:57 +00:00
fredwang 2493c821ac Merge 'cnch_dev_multiple_table_query_forwarding' into 'cnch-dev'
fix(clickhousech@m-4711068146): support query forwarding for multiple tables select

See merge request: !24219
2024-10-08 01:58:49 +00:00
fredwang 410eb53016 Merge 'remove_use_test' into 'cnch-dev'
feat(clickhousech@m-5165832635): remove use test avoid conflict

See merge request: !24379
# Conflicts:
#	tests/queries/4_cnch_stateless/11000_2_udf_check_format.sql
#	tests/queries/4_cnch_stateless/11000_alias_and_recursive_udf.sql
#	tests/queries/4_cnch_stateless/11000_lambda_udf_1.sql
#	tests/queries/4_cnch_stateless/11000_lambda_udf_2.sql
#	tests/queries/4_cnch_stateless/11000_python_udf_10_expression.sql
#	tests/queries/4_cnch_stateless/11000_python_udf_11_limit_by.sql
#	tests/queries/4_cnch_stateless/11000_python_udf_12_join_distinct.sql
#	tests/queries/4_cnch_stateless/11000_python_udf_13_check_update.sql
#	tests/queries/4_cnch_stateless/11000_python_udf_4.sql
#	tests/queries/4_cnch_stateless/11000_python_udf_5_uint.sql
#	tests/queries/4_cnch_stateless/11000_python_udf_6_int.sql
#	tests/queries/4_cnch_stateless/11000_python_udf_7_float.sql
#	tests/queries/4_cnch_stateless/11000_python_udf_8_datetime.sql
#	tests/queries/4_cnch_stateless/11000_python_udf_9_string.sql
#	tests/queries/4_cnch_stateless/11000_show_udf.sql
#	tests/queries/4_cnch_stateless/11000_udf_fixedString.sql
#	tests/queries/4_cnch_stateless/11000_udf_nullable.sql
#	tests/queries/4_cnch_stateless/20000_test_bitengine_cluster_by_clause.sql
#	tests/queries/4_cnch_stateless/20001_test_bitengine_buckets_encode.sql
#	tests/queries/4_cnch_stateless/20002_test_bitengine_buckets_encode_2.sql
#	tests/queries/4_cnch_stateless/20003_test_bitengine_buckets_encode_3.sql
#	tests/queries/4_cnch_stateless/20004_bitengine_constraint.sql
#	tests/queries/4_cnch_stateless/20005_bitengine_insert_select.sql
#	tests/queries/4_cnch_stateless/20007_test_bitmap_or.sql
#	tests/queries/4_cnch_stateless/20008_insert_bitengine_with_multiple_splits.sql
#	tests/queries/4_cnch_stateless/20009_test_encode_decode_performance.sql
#	tests/queries/4_cnch_stateless/20010_test_dict_cache_update.sql
#	tests/queries/4_cnch_stateless/20011_parallel_load_dict_and_cache.sql
#	tests/queries/4_cnch_stateless/20012_test_bitengine_preattach_partition.sql
#	tests/queries/4_cnch_stateless/20013_test_drop_memoy_dict_cache.sql
#	tests/queries/4_cnch_stateless/40022_topn_filtering_opt.sql
#	tests/queries/4_cnch_stateless/66000_gis_type.sql
#	tests/queries/4_cnch_stateless/udf/11000_alias_and_recursive_udf.sql
#	tests/queries/4_cnch_stateless/udf/11000_lambda_udf_1.sql
#	tests/queries/4_cnch_stateless/udf/11000_python_udf_10_expression.sql
#	tests/queries/4_cnch_stateless/udf/11000_python_udf_11_limit_by.sql
#	tests/queries/4_cnch_stateless/udf/11000_python_udf_12_join_distinct.sql
#	tests/queries/4_cnch_stateless/udf/11000_python_udf_13_check_update.sql
#	tests/queries/4_cnch_stateless/udf/11000_python_udf_4.sql
#	tests/queries/4_cnch_stateless/udf/11000_python_udf_5_uint.sql
#	tests/queries/4_cnch_stateless/udf/11000_python_udf_6_int.sql
#	tests/queries/4_cnch_stateless/udf/11000_python_udf_7_float.sql
#	tests/queries/4_cnch_stateless/udf/11000_python_udf_8_datetime.sql
#	tests/queries/4_cnch_stateless/udf/11000_python_udf_9_string.sql
#	tests/queries/4_cnch_stateless/udf/11000_udf_nullable.sql
2024-10-08 01:58:29 +00:00
fredwang 00c44a6ca9 fix git submodule url 2024-10-08 01:48:21 +00:00
fredwang 64c989a55f Merge branch 'fky@cnch-dev@feat@dm-metrics' into 'cnch-dev'
feat(clickhousech@m-4970022768): add TR metrics in Daemon Manager.

See merge request dp/ClickHouse!23976
# Conflicts:
#	src/DaemonManager/DaemonJobTxnGC.cpp
#	src/DaemonManager/DaemonManager.cpp
2024-10-08 01:35:18 +00:00
fredwang 22b9a6bff4 Merge 'fix/cnch-2-bitengine_not_find_table' into 'cnch-dev'
fix(clickhousech@m-4724003525): BitEngine fix not-found-table issue when writing dict table on Server

See merge request: !24393
# Conflicts:
#	src/Interpreters/InterpreterInsertQuery.cpp
#	src/Storages/BitEngine/BitEngineDictionaryManager.cpp
#	src/Storages/BitEngine/BitEngineHelper.cpp
#	src/Storages/BitEngine/BitEngineHelper.h
#	src/Storages/StorageDictCloudMergeTree.cpp
#	tests/queries/4_cnch_stateless/20003_test_bitengine_buckets_encode_3.reference
#	tests/queries/4_cnch_stateless/20003_test_bitengine_buckets_encode_3.sql
2024-10-08 01:19:19 +00:00
fredwang 29ab390e04 Merge 'cherry-pick-mr-24041-1' into 'cnch-dev'
fix(clickhousech@m-4969080058):fix labelled metric export

See merge request: !24368
2024-10-08 01:15:38 +00:00
fredwang bdf0527d35 Merge 'fky@cnch-dev@feat@phase-two-gc-parlog' into 'cnch-dev'
feat(clickhousech@m-3030780003): add phase-two GC to system.server_part_log

See merge request: !23161
2024-10-08 01:15:20 +00:00
fredwang 5d6a0c9975 Merge 'remove_duplicate_query_log_record' into 'cnch-dev'
fix(clickhousech@m-5165162487):remove segment 0 record in server

See merge request: !24358
2024-10-08 01:15:06 +00:00
fredwang 4a8b540139 Merge 'ctas_opt' into 'cnch-dev'
fix(clickhousech@m-4789676157): enable optimizer in ctas by default

See merge request: !23563
2024-10-08 01:14:51 +00:00
fredwang 3d5d9ff5e4 Merge 'cnch_dev_unique_table_merge_support_preload' into 'cnch-dev'
fix(clickhousech@m-4872244233): cnch dev [cp] fix unique table preload after merge

See merge request: !24372
2024-10-08 01:14:31 +00:00
fredwang d71a360f5b Merge 'temp_file_fix' into 'cnch-dev'
fix(clickhousech@m-10180677): rename dup TemporaryFileStream

See merge request: !24373
2024-10-08 01:14:13 +00:00
fredwang 77b2f5fb59 Merge branch 'fix-set-sensitive' into 'cnch-dev'
fix(clickhousech@m-5161178137): add new SET_SENSITIVE permission

See merge request dp/ClickHouse!24319
2024-10-08 01:13:58 +00:00
fredwang 9e6bad938f Merge branch 'fix-sensitive-permission' into 'cnch-dev'
fix(clickhousech@m-17322645): move sensitive sqls into optional field, to avoid compatibility issue when…

See merge request dp/ClickHouse!24221
2024-10-08 01:13:42 +00:00
fredwang b2987fa402 Merge branch 'cnch_gz_fix' into 'cnch-dev'
fix(clickhousech@m-5141737531): optimize get last modification time of partitions

See merge request dp/ClickHouse!24353
2024-10-08 01:13:21 +00:00
Wei Wang 7a3a26cf24
Merge pull request #1886 from ByConity/cp-1007
Cp 1007
2024-10-08 08:50:32 +08:00
fredwang d0960bfca5 fix ci 2024-10-07 18:35:19 +08:00
fredwang 88166b79da fix compile errors 2024-10-07 17:11:01 +08:00
fredwang ab71e550f9 Revert "Merge 'cp_encryption' into 'cnch-dev'"
This reverts commit 1b5c85418e.
2024-10-07 16:22:48 +08:00
fredwang 98846a30d3 Revert "Merge 'cp_hms_token' into 'cnch-dev'"
This reverts commit 5b1afb856e.
2024-10-07 16:13:48 +08:00
fredwang 25c3514e45 Merge 'fix_add_any_cnchdev' into 'cnch-dev'
fix(optimizer@m-4675050005): substitute Select Item To Any Function cnch-dev

See merge request: !24348
2024-10-07 07:43:34 +00:00
fredwang 79e82c5e94 Merge 'cp_paimon' into 'cnch-dev'
feat(clickhousech@m-4670741761): Support paimon (8, cp cnch-dev)

See merge request: !24334
# Conflicts:
#	build_bin.sh
#	contrib/java-extensions
2024-10-07 07:43:16 +00:00
fredwang bd67948875 Merge 'fix_compatible-bug4cnch-dev' into 'cnch-dev'
fix(clickhousech@m-4789419711): compatible bug about dedup stage 2.0

See merge request: !24160
# Conflicts:
#	src/MergeTreeCommon/MergeTreeMetaBase.cpp
#	src/MergeTreeCommon/MergeTreeMetaBase.h
#	src/Storages/MergeTree/CloudMergeTreeBlockOutputStream.h
#	src/Transaction/ICnchTransaction.h
2024-10-07 07:42:30 +00:00
fredwang b122d23ace Merge branch 'fix-mysql-datetime-type-format-dev' into 'cnch-dev'
fix(clickhousech@m-4789458129): Change datetime behavior of mysql protocol dev

See merge request dp/ClickHouse!24231
2024-10-07 07:40:15 +00:00
fredwang 2442e0feb9 Merge 'fix_outerjoin_nullable_cnchdev' into 'cnch-dev'
fix(optimizer@m-4671122533): make join input nullable cnch-dev

See merge request: !22806
2024-10-07 07:39:59 +00:00
fredwang 908487ce54 Merge branch 'fix_format_factory_for_cnchKafka' into 'cnch-dev'
fix(clickhousech@m-4670739530): minor fix ALTER & take effect of the settings from format factory for CnchKafka

See merge request dp/ClickHouse!22564
2024-10-07 07:39:03 +00:00
fredwang e7d7c712f6 Merge 'rename' into 'cnch-dev'
fix(clickhousech@m-5165713913): rename is all

See merge request: !24293
2024-10-07 07:37:46 +00:00
fredwang 7c1c18403a Merge branch 'jiashuo_fix-thread-pool-exception' into 'cnch-dev'
fix(clickhousech@m-5165672531): disk cache preload pool shutdown when exception

See merge request dp/ClickHouse!24220
# Conflicts:
#	src/Disks/DiskByteS3.cpp
#	src/Disks/HDFS/DiskByteHDFS.cpp
#	src/IO/WriteSettings.h
#	src/Storages/MergeTree/IMergeTreeDataPart.h
#	src/Storages/MergeTree/MergeTreeCNCHDataDumper.cpp
#	src/Storages/MergeTree/MergeTreeDataPartCNCH.cpp
2024-10-07 07:35:38 +00:00
fredwang 1b5c85418e Merge 'cp_encryption' into 'cnch-dev'
feat(clickhousech@m-4210016642): Support parquet encryption(cp cnch-dev)

See merge request: !24260
2024-10-07 07:29:36 +00:00
fredwang 1857d5c57f Merge branch 'cherry-pick-b343668c-2' into 'cnch-dev'
fix(clickhousech@m-4874775195): cnch dev [cp] fix multi if for lc

See merge request dp/ClickHouse!24265
2024-10-07 07:27:06 +00:00
fredwang 1cb0a66e7b Merge 'cherry-pick-commit-225ee66b-2' into 'cnch-dev'
fix(clickhousech@m-5165104694): skip compare exchange_port for server topo.

See merge request: !24274
2024-10-07 07:26:49 +00:00
fredwang 49059e5d25 Merge 'fix_optimizer_sample_cnchdev' into 'cnch-dev'
fix(optimizer@m-4770421276): fix sample cnch-dev

See merge request: !24215
2024-10-07 07:26:31 +00:00
fredwang 44f5fa7904 Merge 'support_jsonb_datatype' into 'cnch-dev'
feat(clickhousech@m-4811809757):implement jsonb datatype

See merge request: !23593
# Conflicts:
#	src/Core/Types.h
#	src/DataTypes/DataTypeFactory.cpp
#	src/DataTypes/DataTypeFactory.h
#	src/DataTypes/IDataType.h
2024-10-07 07:26:13 +00:00
fredwang 0ad322c89e Merge 'queue_new' into 'cnch-dev'
fix(clickhousech@m-4770401674): use event queue to loop scheduling, handle corner case for task retrying on restarted workers

See merge request: !24096
# Conflicts:
#	src/Interpreters/DistributedStages/PlanSegmentManagerRpcService.cpp
2024-10-07 07:24:30 +00:00
fredwang c5603aaff1 Merge 'cp_paimon' into 'cnch-dev'
fix(clickhousech@m-4670741761): Paimon fix time offset and fix paimon share filter across different queries and enhance push down(cp cnch-dev)

See merge request: !24226
# Conflicts:
#	build_bin.sh
#	contrib/java-extensions
2024-10-07 07:21:29 +00:00
fredwang ed0c2f7a67 Merge '547/fix_insert_values_metric' into 'cnch-dev'
fix(clickhousech@m-5165709139): fix insert values metrics not accurate

See merge request: !24244
2024-10-07 07:07:56 +00:00
fredwang d91c4f13a4 Merge 'revert_inner_join_associate_in_cnchdev' into 'cnch-dev'
fix(optimizer@m-5034995163): revert innerJoinAssociate getPattern

See merge request: !24232
2024-10-07 07:06:56 +00:00