Commit Graph

7449 Commits

Author SHA1 Message Date
fredwang e621df4dc5 Merge 'fix/cnch-2-bitengine_server_decode_fix' into 'cnch-dev'
fix(clickhousech@m-4675484022): fix wrong database name in loadDictsForCnchServer

See merge request: !22947
2024-09-03 06:58:26 +00:00
fredwang d5a868d9cd Merge branch 'fix/fix_mark_distinct_optimization' into 'cnch-dev'
fix(optimizer@m-4674753509): MultipleDistinctAggregationToMarkDistinct supports count distinct with multi columns cnch-dev

See merge request dp/ClickHouse!22913
2024-09-03 06:57:19 +00:00
fredwang 5d2dfa93e4 Merge 'zema/cnch-dev-delayLoadDataParts' into 'cnch-dev'
fix(clickhousech@m-4420282579): delay loadDataParts in sendResources

See merge request: !22681
# Conflicts:
#	src/CloudServices/CnchWorkerClient.cpp
#	src/CloudServices/CnchWorkerServiceImpl.cpp
#	src/CloudServices/CnchWorkerServiceImpl.h
#	src/Storages/StorageCloudMergeTree.cpp
2024-09-03 06:56:39 +00:00
fredwang aae68b6066 Merge 'feat/push_order_by_desc_to_table_scan2' into 'cnch-dev'
feat(optimizer@m-4670772522): add limit transform for partial sorting even no need finish sorting

See merge request: !22914
# Conflicts:
#	src/QueryPlan/SortingStep.cpp
2024-09-03 06:53:31 +00:00
fredwang cd5c9e2411 Merge 'explain_ignore_format_cnchdev' into 'cnch-dev'
fix(optimizer@m-4675314011): explain metadata output OutputDescriptions

See merge request: !22919
2024-09-03 06:52:51 +00:00
fredwang e677b25520 Merge branch 'cch_cnch-dev-hasTokens' into 'cnch-dev'
feat(clickhousech@m-4674646055):  add hasTokens function and standard tokenizer for inverted index

See merge request dp/ClickHouse!22867
# Conflicts:
#	src/Storages/MergeTree/MergeTreeDataSelectExecutor.cpp
#	src/Storages/MergeTree/MergeTreeIndices.h
2024-09-03 06:52:34 +00:00
fredwang ac9f194851 Merge 'feat/push_order_by_desc_to_table_scan2' into 'cnch-dev'
feat(optimizer@m-4670772522): push order by desc into table scan cnch-dev

See merge request: !22882
2024-09-03 06:46:43 +00:00
fredwang 7a724dea24 Merge branch 'zema/adb-minorFix' into 'cnch-dev'
fix(clickhousech@m-4655931866): minor fix for msyql compatibility

See merge request dp/ClickHouse!22687
2024-09-03 02:54:15 +00:00
fredwang 8c59bca949 Merge 'fix_logical_optimizer_alias_cnchdev' into 'cnch-dev'
fix(clickhousech@m-4505531776): Disable logical expression optimizer for expression with aliases. #47451

See merge request: !22847
2024-09-03 02:53:04 +00:00
fredwang ff6840fc6b Merge 'dog-cnch-dev-fix-multi-distinct' into 'cnch-dev'
fix(optimizer@m-4670748330): fix multi distinct property

See merge request: !22848
2024-09-03 02:49:50 +00:00
fredwang 0e95478fdf Merge 'dog-cnch-dev-fix-ci' into 'cnch-dev'
fix(optimizer@m-4549369693): cherry-pick 2 fixes from ce-dev

See merge request: !22808
2024-09-03 02:49:18 +00:00
fredwang 84554ad9d2 Merge 'fix/fix_share_common_plan_for_join_cnch_dev' into 'cnch-dev'
fix(optimizer@m-4655932058): fix share common plan node for join cnch-dev

See merge request: !22719
2024-09-03 02:49:03 +00:00
fredwang 25dfa95a6b Merge branch 'zema/cnch-dev-fixMergeMutation' into 'cnch-dev'
fix(clickhousech@m-4549346716): minor fixes for merge mutation

See merge request dp/ClickHouse!22661
2024-09-03 02:48:49 +00:00
fredwang 5d7c2c7bfd Merge 'planner_join_use_nulls_cnchdev' into 'cnch-dev'
fix(optimizer@m-4548822622): QueryAnalyzer process join_use_nulls

See merge request: !22732
2024-09-03 02:48:34 +00:00
fredwang 3eae5a3b6f Merge 'support_view_grant_check_in_cnch' into 'cnch-dev'
feat(optimizer@m-3987302752): support view grant check

See merge request: !22729
2024-09-03 02:45:22 +00:00
fredwang bd4c816490 Merge 'fix/fix_makeSetsForIndex_sub_columns_cnch_dev' into 'cnch-dev'
fix(optimizer@m-4548778590): fix makeSetsForIndex don't support subcolumns cnch-dev

See merge request: !22677
2024-09-03 02:44:44 +00:00
fredwang 2d1eb489d9 Merge branch 'pudu-poc' into 'cnch-dev'
fix(clickhousech@m-4656101775): add settings to not return nullable array

See merge request dp/ClickHouse!22715
2024-09-02 06:18:36 +00:00
fredwang 84c956a8b7 Merge 'dog-cnch-dev-sync-code' into 'cnch-dev'
feat(optimizer@m-3012466272): sync code from ce-dev

See merge request: !22274
# Conflicts:
#	src/Functions/invalidateStatsCache.cpp
#	src/Statistics/BucketBoundsImpl.cpp
#	src/Statistics/SubqueryHelper.cpp
#	tests/queries/4_cnch_stateless_no_tenant/45008_type_list_for_optimizer.sql
2024-09-02 06:18:18 +00:00
fredwang e312ffa19f Merge 'json_function_name_alias' into 'cnch-dev'
feat(clickhousech@m-3011087571):add alias for json function

See merge request: !22014
# Conflicts:
#	tests/queries/0_stateless/01889_sql_json_functions.reference
#	tests/queries/0_stateless/01889_sql_json_functions.sql
2024-09-02 06:14:16 +00:00
fredwang ead2e8d647 Merge 'prepared_array_type_cnchdev' into 'cnch-dev'
fix(optimizer@m-4655303703): prepared statement support array type

See merge request: !22696
2024-09-02 06:11:29 +00:00
fredwang 647bbc76a9 Merge branch 'rename_info_schema_table_type' into 'cnch-dev'
fix(clickhousech@m-4505469713): fix incorrect value for the table_type column in information_schema.tables

See merge request dp/ClickHouse!22644
2024-09-02 06:09:38 +00:00
fredwang 8bc1cc0692 Merge '4656096097_cnch-dev' into 'cnch-dev'
fix(optimizer@m-4656096097): make MultipleDistinctAggregationToExpandAggregate skip unsupported case

See merge request: !22673
2024-09-02 06:09:13 +00:00
fredwang 3ee7ef7623 Merge branch 'ide-adapt-quoted-alias-only' into 'cnch-dev'
feat(clickhousech@m-4505469713): Support single quoted identifier as alias for MYSQL IDE

See merge request dp/ClickHouse!22434
2024-08-30 05:52:16 +00:00
fredwang eca19c83b9 Merge 'fix_rewrite_like_cnchdev' into 'cnch-dev'
fix(optimizer@m-4505507062): fix rewrite like

See merge request: !22459
2024-08-30 05:51:41 +00:00
fredwang 1b96842f7b Merge 'prepared_statement_catalog_cnchdev' into 'cnch-dev'
feat(optimizer@m-3010175307):prepared statement catalog

See merge request: !22606
2024-08-30 05:51:23 +00:00
fredwang 2ea472bea3 Merge 'cherry-pick-mr-22414' into 'cnch-2.2'
fix(clickhousech@m-4345257817): insert_select_with_profiles

See merge request: !22414
2024-08-30 05:46:55 +00:00
fredwang 9c25ee84f2 Merge 'fix_abtest_cnchdev' into 'cnch-dev'
fix(optimizer@m-4533434583): fix settings ab test

See merge request: !22450
# Conflicts:
#	src/Interpreters/executeQuery.cpp
2024-08-30 05:43:36 +00:00
fredwang 49ce776559 Merge branch 'cnch_dev_handle_large_kv' into 'cnch-dev'
feat(clickhousech@m-4209342798): catalog support large KV

See merge request dp/ClickHouse!22351
# Conflicts:
#	ci_scripts/config/users.xml
2024-08-30 05:42:08 +00:00
fredwang 273675f29e Merge branch 'fix_date_out_of_range' into 'cnch-dev'
fix(clickhousech@m-4503623503): fix DateTime Overflow Behavior

See merge request dp/ClickHouse!22304
# Conflicts:
#	src/Formats/FormatFactory.cpp
2024-08-30 03:40:33 +00:00
fredwang 1d7c369a83 Merge '4616856596_cnch-dev' into 'cnch-dev'
fix(optimizer@m-4616856596): fix MultipleDistinctAggregationToExpandAggregate bugs

See merge request: !22536
2024-08-30 03:39:27 +00:00
fredwang 82a49973f4 Merge 'zema/cnch-dev-fixBytesOnDisk' into 'cnch-dev'
fix(clickhousech@m-4616855063): fix bytes_on_disk for CNCH part

See merge request: !22495
# Conflicts:
#	src/Storages/MergeTree/MergeTreeDataPartCNCH.h
2024-08-30 03:38:02 +00:00
fredwang 8522663244 Merge branch 'zema/cnch-dev-CnchPartsDeleteRows' into 'cnch-dev'
feat(clickhousech@m-3030898703): add delete_rows in system.cnch_parts

See merge request dp/ClickHouse!22388
2024-08-30 03:36:46 +00:00
fredwang 828de74a44 Merge branch 'rovoke-if' into 'cnch-dev'
fix(clickhousech@m-17322645): Implement REVOKE IF EXISTS for RBAC

See merge request dp/ClickHouse!22470
2024-08-30 03:14:49 +00:00
fredwang bd4b6cad6d Merge branch 'lta@ETL_perf_optimize4cnch-dev' into 'cnch-dev'
feat(clickhousech@m-3012442647): optimize ETL perf for unique table

See merge request dp/ClickHouse!21744
# Conflicts:
#	src/CloudServices/CnchDataWriter.cpp
#	src/CloudServices/CnchWorkerClient.cpp
#	src/Core/Settings.h
#	src/MergeTreeCommon/MergeTreeMetaBase.cpp
#	src/MergeTreeCommon/MergeTreeMetaBase.h
#	src/Protos/cnch_worker_rpc.proto
#	src/Storages/BitEngineEncodePartitionHelper.cpp
#	src/Storages/MergeTree/CloudMergeTreeBlockOutputStream.h
#	src/Transaction/Actions/InsertAction.cpp
#	src/Transaction/Actions/InsertAction.h
#	src/Transaction/CnchWorkerTransaction.cpp
2024-08-29 05:36:32 +00:00
fredwang 0e1d65f003 Merge 'cnch_dev_partial_upsert_using_update_set_gwmh' into 'cnch-dev'
feat(clickhousech@m-3000709386): unique table partial update using update set

See merge request: !22432
# Conflicts:
#	src/Core/Settings.h
2024-08-29 04:31:12 +00:00
fredwang 3e1594222f Merge pull request #1724 from ByConity/fix-http-compress-1
Fix error due to output buffer not finalized correctly
2024-08-26 07:19:51 +00:00
fredwang c48c9eccbf skip the intermediate result cache 2024-07-31 10:12:33 +00:00
fredwang 0ccf19f8e9 Merge 'youzhiyuan_test_ci' into 'cnch-dev'
feat(clickhousech@m-4344711347): Bucket Shuffle

See merge request: !22463
# Conflicts:
#	src/Interpreters/DistributedStages/PlanSegmentSplitter.cpp
#	src/Optimizer/Property/PropertyDeriver.cpp
#	src/Optimizer/Rewriter/BitEngineInfoDeriver.cpp
2024-07-30 10:14:19 +00:00
fredwang e0c6ff0ebb Merge 'prepared_rbac_multitenant_cnchdev' into 'cnch-dev'
fix(optimizer@m-4505019564): Prepared statement support RBAC and multi-tenant

See merge request: !22320
# Conflicts:
#	src/Parsers/ASTIdentifier.cpp
#	src/Parsers/formatTenantDatabaseName.cpp
2024-07-30 08:40:19 +00:00
fredwang afd4cc1625 Merge 'push_union' into 'cnch-dev'
feat(optimizer@m-3766296612): push union through join/projection/agg

See merge request: !22377
2024-07-30 08:39:11 +00:00
fredwang ee0451f5a3 Merge 'feat/fix_cte_buffer' into 'cnch-dev'
fix(optimizer@m-4171913691): add buffer for all cte exists in join build cnch-dev

See merge request: #22342
# Conflicts:
#	src/Optimizer/PlanOptimizer.cpp
#	src/QueryPlan/AggregatingStep.cpp
2024-07-30 08:27:06 +00:00
fredwang 482eb3b18e Merge 'cnch_dev_fix_partial_part_columns' into 'cnch-dev'
fix(clickhousech@m-3878506001): [cp] cnch dev fix partial part columns

See merge request: #22215
# Conflicts:
#	src/Storages/MergeTree/MergeTreeDataPartCNCH.cpp
2024-07-30 08:24:46 +00:00
fredwang 06c9c7eb43 Merge 'feat/share_common_plan_node_cnch' into 'cnch-dev'
feat(optimizer@m-3000649598): cherry-pick share common plan node

See merge request: https://code.byted.org/dp/ClickHouse/merge_requests/20384
# Conflicts:
#	src/Optimizer/PlanOptimizer.cpp
#	src/Optimizer/Property/PropertyMatcher.cpp
#	src/Optimizer/Rewriter/UnifyNullableType.cpp
#	src/Optimizer/Rule/Rewrite/PushDownLimitRules.cpp
#	src/Optimizer/Rule/Rewrite/PushDownLimitRules.h
#	src/Optimizer/Signature/PlanNormalizer.cpp
#	src/Optimizer/Signature/PlanNormalizer.h
#	src/Optimizer/Signature/PlanSignature.cpp
#	src/Optimizer/Signature/PlanSignature.h
#	src/Optimizer/Signature/StepNormalizer.cpp
#	src/QueryPlan/CTEInfo.cpp
#	tests/optimizers/tpcds/explains/tpcds100/q1.explain
#	tests/optimizers/tpcds/explains/tpcds100/q11.explain
#	tests/optimizers/tpcds/explains/tpcds100/q13.explain
#	tests/optimizers/tpcds/explains/tpcds100/q24.explain
#	tests/optimizers/tpcds/explains/tpcds100/q4.explain
#	tests/optimizers/tpcds/explains/tpcds1000/q1.explain
#	tests/optimizers/tpcds/explains/tpcds1000/q11.explain
#	tests/optimizers/tpcds/explains/tpcds1000/q13.explain
#	tests/optimizers/tpcds/explains/tpcds1000/q24.explain
#	tests/optimizers/tpcds/explains/tpcds1000/q4.explain
#	tests/optimizers/tpcds/explains/tpcds1000_not_show_stats/q1.explain
#	tests/optimizers/tpcds/explains/tpcds1000_not_show_stats/q11.explain
#	tests/optimizers/tpcds/explains/tpcds1000_not_show_stats/q13.explain
#	tests/optimizers/tpcds/explains/tpcds1000_not_show_stats/q24.explain
#	tests/optimizers/tpcds/explains/tpcds1000_not_show_stats/q4.explain
#	tests/optimizers/tpcds/explains/tpcds1000_sample/q1.explain
#	tests/optimizers/tpcds/explains/tpcds1000_sample/q11.explain
#	tests/optimizers/tpcds/explains/tpcds1000_sample/q13.explain
#	tests/optimizers/tpcds/explains/tpcds1000_sample/q24.explain
#	tests/optimizers/tpcds/explains/tpcds1000_sample/q4.explain
#	tests/queries/4_cnch_stateless_no_tenant/48025_remove_redundant_union.reference
2024-07-30 08:02:43 +00:00
fredwang 657659a3f9 Merge branch 'ide-adapt-fix-host' into 'cnch-dev'
feat(clickhousech@m-3179138697): Set host to empty for cnch_user_priv and cnch_db_priv

See merge request dp/ClickHouse!22279
2024-07-30 07:21:48 +00:00
fredwang 38ea9600f5 Merge 'fix_support_input_order_info_for_not_null_in_cnch' into 'cnch-dev'
fix(optimizer@m-4171933193): Support indexed reads for non-null columns with 'ASC NULLS LAST' ordering.

See merge request: #22337
2024-07-30 07:21:19 +00:00
fredwang f938e0a094 Merge 'lta@fix_bitmap_bug4cnch-dev' into 'cnch-dev'
fix(clickhousech@m-4450311187): delete bitmap corner case bug

See merge request: #22352
2024-07-30 07:21:09 +00:00
fredwang 83de851519 Merge 'inter_cache_cnch_mr' into 'cnch-dev'
feat(clickhousech@m-10412969): implement result cache for partial aggregation

See merge request: #22175
# Conflicts:
#	src/Core/Settings.h
#	src/MergeTreeCommon/MergeTreeMetaBase.h
#	src/Optimizer/Signature/PlanNormalizer.cpp
#	src/Optimizer/Signature/PlanNormalizer.h
#	src/Optimizer/Signature/PlanSignature.cpp
#	src/Optimizer/Signature/PlanSignature.h
#	src/Optimizer/Signature/StepNormalizer.cpp
#	src/Processors/Pipe.cpp
#	src/Storages/MergeTree/MergeTreeBaseSelectProcessor.cpp
#	src/Storages/SelectQueryInfo.h
2024-07-30 07:12:58 +00:00
fredwang 87bcffe895 Merge branch 'cnch_dev_recycle_sessions' into 'cnch-dev'
refactor(clickhousech@m-4420222051): optimize recycle outdated sessions/cnch_sessions

See merge request dp/ClickHouse!22184
2024-07-30 06:57:38 +00:00
fredwang 2ee883c661 Merge branch 'cnch_dev_unique_table_auto_repair' into 'cnch-dev'
feat(clickhousech@m-3047891595): unique table auto repair

See merge request dp/ClickHouse!22004
2024-07-30 06:51:52 +00:00
fredwang cf3d65aefc Merge branch 'fix_password_leak' into 'cnch-dev'
fix(clickhousech@m-3015427407): Fix password leak

See merge request dp/ClickHouse!20915
# Conflicts:
#	src/Parsers/ASTFunction.cpp
#	src/Parsers/ASTFunction.h
#	tests/integration/test_postgresql_database_engine/test.py
2024-07-30 06:50:49 +00:00
fredwang 9df2e8dee7 Merge 'binding_rbac_multitenant_cnchdev' into 'cnch-dev'
fix(optimizer@m-3460292615): binding support RBAC and multi-tenant

See merge request: #22272
# Conflicts:
#	src/Access/AccessType.h
#	src/Access/ContextAccess.cpp
2024-07-30 06:39:43 +00:00
fredwang f083e96921 Merge 'fix/fix_unify_join_outputs_for_cte' into 'cnch-dev'
fix(optimizer@m-4450336776): fix UnifyJoinOutputs for cte cnch-dev

See merge request: #22285
2024-07-30 06:26:07 +00:00
fredwang e1e10d4d37 Merge branch 'cherry-pick-288b9671' into 'cnch-dev'
feat(clickhousech@m-3857639077): [cp] cache common data types for DataTypeFactory::get

See merge request dp/ClickHouse!21455
# Conflicts:
#	tests/queries/0_ce_problematic_stateless/10061_zookeeper_test_uniquekey_backgroud_executor.sql
2024-07-30 06:25:49 +00:00
fredwang 3035c1f9e7 Merge 'cherry-pick-df4fa613-2' into 'cnch-dev'
fix(optimizer@m-4420727003): fix distinct same column

See merge request: #22208
2024-07-30 06:25:12 +00:00
fredwang 5dbe3471c2 Merge branch 'ide-adapt' into 'cnch-dev'
feat(clickhousech@m-3179138697): Support IDEs and BIs

See merge request dp/ClickHouse!21118
# Conflicts:
#	src/Interpreters/DistributedStages/PlanSegmentManagerRpcService.cpp
#	src/Parsers/ParserAlterQuery.cpp
#	src/Server/MySQLHandler.cpp
2024-07-30 06:24:05 +00:00
fredwang 2ca35b1643 update ci reference 2024-07-30 04:24:29 +00:00
fredwang 14d76c12fa Merge branch 'hybrid_allocation' into 'cnch-dev'
feat(clickhousech@m-4209967307): Implement hybrid part allocation in CNCH 2.0

See merge request dp/ClickHouse!22169
# Conflicts:
#	src/CloudServices/CnchServerResource.cpp
#	src/CloudServices/CnchServerResource.h
#	src/Storages/MergeTree/MergeTreeDataSelectExecutor.cpp
2024-07-29 09:30:34 +00:00
fredwang 511c96297c Merge 'prune_create_table' into 'cnch-dev'
feat(clickhousech@m-4309579234): prune send resource

See merge request: #22021
# Conflicts:
#	src/CloudServices/CnchServerResource.cpp
#	src/CloudServices/CnchWorkerClient.cpp
2024-07-29 09:19:11 +00:00
fredwang 51fca75a10 Merge 'cherry-pick-6e60cb0c' into 'cnch-dev'
fix(clickhousech@m-4086549751): Fix IfNull and Case Type Mismatch dev

See merge request: #22210
2024-07-29 09:12:24 +00:00
fredwang d11f068f7c Merge branch 'current_db' into 'cnch-dev'
feat(clickhousech@m-3265377520): currentDatabase() now returns DB name without tenant id, and add currentDatabase(0) to return with tenant id

See merge request dp/ClickHouse!22032
# Conflicts:
#	tests/queries/4_cnch_stateless/20000_test_bitengine_cluster_by_clause.sql
#	tests/queries/4_cnch_stateless/20001_test_bitengine_buckets_encode.sql
#	tests/queries/4_cnch_stateless/20001_test_bitengine_encode.sql
#	tests/queries/4_cnch_stateless/20002_test_bitengine_buckets_encode_2.sql
#	tests/queries/4_cnch_stateless/20003_test_bitengine_buckets_encode_3.sql
#	tests/queries/4_cnch_stateless/20005_bitengine_insert_select.sql
#	tests/queries/4_cnch_stateless/20007_test_bitmap_or.sql
#	tests/queries/4_cnch_stateless/20009_test_encode_decode_performance.sql
#	tests/queries/4_cnch_stateless/20010_test_dict_cache_update.sql
#	tests/queries/4_cnch_stateless/20011_parallel_load_dict_and_cache.sql
#	tests/queries/4_cnch_stateless/20012_test_bitengine_preattach_partition.sql
#	tests/queries/4_cnch_stateless/20013_test_drop_memoy_dict_cache.sql
#	tests/queries/4_cnch_stateless/50013_parts_info_with_drop_table.sql
2024-07-29 09:07:13 +00:00
fredwang d5a67cceda Merge 'dog-cnch-dev-cp-fix' into 'cnch-dev'
fix(optimizer@m-3086390001): fix UUID and create stats ast format, expand statistics to current

See merge request: #22151
# Conflicts:
#	src/Statistics/StatisticsCollector.cpp
2024-07-29 08:20:28 +00:00
fredwang e3aa08a014 Merge 'cnch_dev_support_aeolus_check' into 'cnch-dev'
feat(clickhousech@m-4420261054): session level table access control for Aeolus

See merge request: #22177
# Conflicts:
#	src/Interpreters/Context.h
2024-07-29 08:19:08 +00:00
fredwang 78139a2978 Merge branch 'cnch_dev_limit_memory_usage_in_vertical_merge' into 'cnch-dev'
feat(clickhousech@m-4420290609): [cp] cnch dev limit memory usage in vertical merge

See merge request dp/ClickHouse!21834
# Conflicts:
#	src/DataStreams/ColumnGathererStream.cpp
#	src/DataStreams/ColumnGathererStream.h
#	src/Storages/MergeTree/MergeTreeSequentialSource.cpp
#	src/Storages/MergeTree/MergeTreeSequentialSource.h
#	src/WorkerTasks/MergeTreeDataMerger.cpp
2024-07-29 08:16:09 +00:00
fredwang dc0d59066a Merge branch 'fix_number' into 'cnch-dev'
fix(clickhousech@m-3986713216): fix multi arguments integral

See merge request dp/ClickHouse!21904
2024-07-29 07:58:36 +00:00
fredwang eacd3c8828 Merge 'fix_decimal_tostring_cnchdev1' into 'cnch-dev'
fix(optimizer@m-4310259718): fix decimal to string for DataTypeAggregateFunction

See merge request: #22143
2024-07-29 07:57:40 +00:00
fredwang 543e3734b5 Merge 'over' into 'cnch-dev'
fix(clickhousech@m-4344717826): Add test case to protect oversize distributed_max_parallel_size in mpp mode

See merge request: #22148
2024-07-26 10:06:20 +00:00
fredwang 749251d7ed Merge branch 'fix-array' into 'cnch-dev'
fix(clickhousech@m-4345272739): fix array func core dump

See merge request dp/ClickHouse!22121
2024-07-26 10:06:01 +00:00
fredwang 17048da8a7 Merge branch 'mysql_having_clause_enhancement-cnch-dev' into 'cnch-dev'
feat(clickhousech@m-4209994537): mysql having clause enhancement cnch dev

See merge request dp/ClickHouse!22110
# Conflicts:
#	src/Analyzers/QueryRewriter.cpp
2024-07-26 10:03:01 +00:00
fredwang ee10e0059f Merge branch 'fix_ctas_fk' into 'cnch-dev'
fix(clickhousech@m-4052814572): Fix CTAS FK

See merge request dp/ClickHouse!22095
2024-07-26 10:01:53 +00:00
fredwang e421e00088 Merge 'fix_ddl_dev' into 'cnch-dev'
fix(clickhousech@m-4171894685): Fix MySQL DDL and Comments Dev

See merge request: #22048
2024-07-26 09:58:55 +00:00
fredwang 84db7c184b Merge branch 'cherry-pick-f9c127e2' into 'cnch-dev'
fix(clickhousech@m-4086549751): fix if type mismatch dev

See merge request dp/ClickHouse!22075
2024-07-26 09:58:37 +00:00
fredwang 12c3d8149c Merge 'lc_test_case' into 'cnch-dev'
feat(clickhousech@m-13866469): cp some test case for lc

See merge request: #22087
# Conflicts:
#	tests/queries/0_ce_problematic_stateless/01049_join_low_card_bug_long.sql
#	tests/queries/0_ce_problematic_stateless/01510_format_regexp_raw_low_cardinality.sh
#	tests/queries/0_ce_problematic_stateless/01549_low_cardinality_materialized_view.reference
#	tests/queries/0_ce_problematic_stateless/10063_zookeeper_test_uniquekey_unique_low_cardinality_type.sql
#	tests/queries/0_ce_problematic_stateless/10101_low_cardinality_runtime_filter.sql
#	tests/queries/4_cnch_stateless/00688_low_cardinality_syntax.reference
#	tests/queries/4_cnch_stateless/00688_low_cardinality_syntax.sql
#	tests/queries/4_cnch_stateless/00717_low_cardinality_distributed_group_by.sql
#	tests/queries/4_cnch_stateless/00800_low_cardinality_distributed_insert.reference
#	tests/queries/4_cnch_stateless/00800_low_cardinality_join.reference
#	tests/queries/4_cnch_stateless/00800_low_cardinality_join.sql
#	tests/queries/4_cnch_stateless/01049_join_low_card_crash.reference
#	tests/queries/4_cnch_stateless/01049_join_low_card_crash.sql
#	tests/queries/4_cnch_stateless/01262_low_cardinality_remove.reference
#	tests/queries/4_cnch_stateless/01262_low_cardinality_remove.sql
#	tests/queries/4_cnch_stateless/01353_low_cardinality_join_types.reference
#	tests/queries/4_cnch_stateless/01353_low_cardinality_join_types.sql
#	tests/queries/4_cnch_stateless/01396_low_cardinality_fixed_string_default.reference
#	tests/queries/4_cnch_stateless/01396_low_cardinality_fixed_string_default.sql
#	tests/queries/4_cnch_stateless/01414_low_cardinality_nullable.reference
#	tests/queries/4_cnch_stateless/01414_low_cardinality_nullable.sql
#	tests/queries/4_cnch_stateless/02012_low_cardinality_uuid_with_extremes.reference
#	tests/queries/4_cnch_stateless/02012_low_cardinality_uuid_with_extremes.sql
#	tests/queries/7_clickhouse_sql_problematic/00800_low_cardinality_join.reference
#	tests/queries/7_clickhouse_sql_problematic/00800_low_cardinality_join.sql
#	tests/queries/7_unstable_clickhouse_sql/00800_low_cardinality_join.reference
#	tests/queries/7_unstable_clickhouse_sql/00800_low_cardinality_join.sql
2024-07-26 09:58:07 +00:00
fredwang 0e8028740f Merge branch 'cherry-pick-57cebd67' into 'cnch-dev'
fix(clickhousech@m-3986741193): Fix string engine dev

See merge request dp/ClickHouse!21701
2024-07-26 09:35:25 +00:00
fredwang 340cbb6f77 Merge branch 'fix_enum' into 'cnch-dev'
fix(clickhousech@m-4310260265): fix comparison for enum under mysql dialect

See merge request dp/ClickHouse!22043
2024-07-26 09:35:05 +00:00
fredwang 0e69670f67 Merge 'lta@fix_detach_attach_bucket_bug4cnch-dev' into 'cnch-dev'
fix(clickhousech@m-3047891595): detach bug with BUCKET command

See merge request: #21982
2024-07-26 09:34:49 +00:00
fredwang 972a6c245c Merge 'support_input_order_info_for_not_null_in_cnch' into 'cnch-dev'
feat(optimizer@m-4171933193): Support indexed reads for non-null columns with 'ASC NULLS LAST' ordering.

See merge request: #22005
2024-07-26 09:34:07 +00:00
fredwang ff190678d4 Merge 'fix/fix_rf_cnch_dev' into 'cnch-dev'
fix(optimizer@m-3878478043): fix runtime filter in partition filter cnch-dev

See merge request: #21887
2024-07-26 09:33:49 +00:00
fredwang f588b86aee Merge 'zema/cnch-dev-fixTruncatePartitions' into 'cnch-dev'
fix(clickhousech@m-4087835740): fix truncate partitions

See merge request: #21986
2024-07-26 09:33:32 +00:00
fredwang cd9046c50b Merge branch 'fix-arraypush' into 'cnch-dev'
fix(clickhousech@m-4210021191): arraypush support nullable array

See merge request dp/ClickHouse!21918
# Conflicts:
#	tests/queries/0_ce_problematic_stateless/00498_array_functions_concat_slice_push_pop.reference
#	tests/queries/0_ce_problematic_stateless/00498_array_functions_concat_slice_push_pop.sql
2024-07-26 09:33:06 +00:00
fredwang dea198a528 Merge 'fix/fix_in_subquery_in_prewhere_cnch_dev' into 'cnch-dev'
fix(optimizer@m-4209948786): support in subquery in prewhere for optimizer cnch-dev

See merge request: #21968
2024-07-26 09:30:13 +00:00
fredwang 24b6fd8144 Merge 'cherry-pick-121edc4a' into 'cnch-dev'
fix(clickhousech@m-3348304164): [cp cnch-dev] add ci-cases for multiple-nested types

See merge request: https://code.byted.org/dp/ClickHouse/merge_requests/21924
2024-07-26 09:29:10 +00:00
fredwang 9ad37d83b9 Merge branch 'double-quoted-string' into 'cnch-dev'
feat(clickhousech@m-4172484611): supported double quoted string

See merge request dp/ClickHouse!21746
# Conflicts:
#	src/Common/ThreadFuzzer.cpp
2024-07-24 06:12:41 +00:00
fredwang c9698821dd Merge branch 'zema/cnch-dev-fixUpdateJoin' into 'cnch-dev'
fix(clickhousech@m-4087816164): fix UPDATE JOIN

See merge request dp/ClickHouse!21909
2024-07-24 06:04:31 +00:00
fredwang bc20bc21aa Merge branch 'fix_lc_full_in' into 'cnch-dev'
fix(clickhousech@m-15276865): 【CP】fix core for full lc using in function

See merge request dp/ClickHouse!21890
2024-07-24 06:03:46 +00:00
fredwang 767b7ef3c7 Merge 'fix-ingest-partition-target-parts-cnch-dev' into 'cnch-dev'
fix(clickhousech@m-4171894664): fix dup keys for ingest partition

See merge request: https://code.byted.org/dp/ClickHouse/merge_requests/21883
2024-07-24 06:02:51 +00:00
fredwang 4db78a9889 fix hive ci test 2024-07-24 04:43:58 +00:00
fredwang 6154fe631f Merge 'support-hive-mod' into 'cnch-dev'
feat(clickhousech@m-4189371115): Support hive mod

See merge request: https://code.byted.org/dp/ClickHouse/merge_requests/21882
# Conflicts:
#	tests/queries/4_cnch_external_table/60014_hive_bucket_table.sql
2024-07-24 02:47:20 +00:00
fredwang db4252d47e Merge branch 'implicit_primary_key' into 'cnch-dev'
feat(clickhousech@m-4171948177): Decompose UUID

See merge request dp/ClickHouse!21621
2024-07-24 02:40:14 +00:00
fredwang 43779144e1 Merge 'query_lineage_cnchdev' into 'cnch-dev'
feat(optimizer@m-3011106861): SQL lineage info

See merge request: https://code.byted.org/dp/ClickHouse/merge_requests/21805
2024-07-24 02:39:47 +00:00
fredwang d1a3bcd5af Merge branch 'cnch_grace_right_and_full_join' into 'cnch-dev'
feat(clickhousech@m-4052824594): [cnch]grace join support right & full join

See merge request dp/ClickHouse!21700
2024-07-24 02:39:28 +00:00
fredwang e021d2e4ed Merge branch 'jiacheng.sun-fix-convert-tz-segfault' into 'cnch-dev'
fix(clickhousech@m-14362905): Add check for nullptr in const columns

See merge request dp/ClickHouse!21597
2024-07-24 02:38:07 +00:00
fredwang acf8bae9a4 Merge branch 'cnch_fix_end_of_spill_join_read_when_joinblk_split' into 'cnch-dev'
fix(clickhousech@m-3404807508): [cnch]fix ending of spill join read in join block split case

See merge request dp/ClickHouse!21592
2024-07-24 02:37:44 +00:00
fredwang 011748e0d2 Merge branch 'jiacheng.sun-add-bitwise-and-or' into 'cnch-dev'
feat(clickhousech@m-14362905): Add bitwise operators &,|,<<,>>,^

See merge request dp/ClickHouse!21345
2024-07-24 02:37:23 +00:00
fredwang 27565fc1bc Merge branch 'jiacheng.sun-extend-group-concat-syntax' into 'cnch-dev'
feat(clickhousech@m-14362905): Add support for multiple columns and implicit String conversion to group_concat

See merge request dp/ClickHouse!21565
2024-07-24 02:37:03 +00:00
fredwang 789cea64af Merge 'zema/cnch-dev-truncatePartition' into 'cnch-dev'
feat(clickhousech@m-3106204787): TRUNCATE TABLE PARTITION

See merge request: https://code.byted.org/dp/ClickHouse/merge_requests/21391
# Conflicts:
#	src/Storages/StorageCnchMergeTree.cpp
2024-07-24 02:36:28 +00:00
fredwang 662c4ffe79 Merge 'show_grant_partial_revoke_fix' into 'cnch-dev'
fix(clickhousech@m-3594234201): Fix SHOW GRANTS when partial revokes are used

See merge request: https://code.byted.org/dp/ClickHouse/merge_requests/21090
2024-07-24 02:35:09 +00:00
fredwang 7d3981c7ba Merge branch 'jiacheng.sun-grant-show-databases-information-schema' into 'cnch-dev'
fix(clickhousech@m-3179138697): Add default grant for SHOW DATABASES ON information_schema.*

See merge request dp/ClickHouse!21225
2024-07-24 02:30:40 +00:00
fredwang 38e04f3fe0 Merge branch 'jiacheng.sun-add-is-ipv4-alias' into 'cnch-dev'
fix(clickhousech@m-14362905): Add IS_IPV4 mysql alias

See merge request dp/ClickHouse!21105
# Conflicts:
#	tests/queries/4_cnch_stateless/00725_ipv4_ipv6_domains.reference
#	tests/queries/4_cnch_stateless/00725_ipv4_ipv6_domains.sql
2024-07-22 08:06:06 +00:00
fredwang e930368f87 Merge 'jiacheng.sun-add-locale-to-mysql-format' into 'cnch-dev'
feat(clickhousech@m-14362905): Add locale to mysql FORMAT

See merge request: https://code.byted.org/dp/ClickHouse/merge_requests/21107
2024-07-22 08:01:09 +00:00
fredwang a3ad06b6ed Merge branch 'jiacheng.sun-add-binary-keyword' into 'cnch-dev'
feat(clickhousech@m-14362905): Add BINARY cast keyword

See merge request dp/ClickHouse!21104
2024-07-22 08:00:41 +00:00
fredwang 9fcf286c77 Merge branch 'jiacheng.sun-add-uuid-alias' into 'cnch-dev'
fix(clickhousech@m-14362905): Add UUID mysql alias

See merge request dp/ClickHouse!21106
2024-07-22 07:58:26 +00:00
fredwang 8fb13d815e Merge 'm_cte' into 'cnch-dev'
fix(clickhousech@m-3347651074): considering multiple cte input in bsp mode

See merge request: https://code.byted.org/dp/ClickHouse/merge_requests/21055
2024-07-22 07:56:30 +00:00
fredwang 8167be0c4a fix TTL in mysql ddl 2024-07-17 20:59:45 +00:00
fredwang 9beb987424 Merge branch 'mysql_fix' into 'cnch-dev'
feat(clickhousech@m-3106204787): support ctas and extend ddl

See merge request dp/ClickHouse!21052
# Conflicts:
#	tests/queries/4_cnch_stateless/60000_mysql_ddl_create.sql
2024-07-17 19:28:34 +00:00
fredwang dbf8e80e28 Merge 'fix_symbol_cnchdev' into 'cnch-dev'
fix(optimizer@m-3857664023): fix SymbolAllocator

See merge request: https://code.byted.org/dp/ClickHouse/merge_requests/21784
2024-07-17 17:34:15 +00:00
fredwang 0a7ba424ee Merge branch 'parquet-native-cnch' into 'cnch-dev'
feat(clickhousech@m-4087850669): cherry-pick parquet native reader

See merge request dp/ClickHouse!21704
# Conflicts:
#	programs/server/Server.cpp
#	src/Common/ProfileEvents.cpp
#	src/Core/Settings.h
#	src/Formats/FormatSettings.h
#	tests/queries/4_cnch_external_table/00019_join_case_enable_optimzier_use_part_schedule.sql.disabled
#	tests/queries/4_cnch_external_table/00022_join_case_enable_optimzier_use_row_group_schedule.sql.disabled
#	tests/queries/4_cnch_external_table/00024_sum_case_enable_optimzier_use_row_group_schedule.sql.disabled
2024-07-17 17:31:45 +00:00
fredwang 9311642dbf Merge branch 'fix-ttl' into 'cnch-dev'
fix(clickhousech@m-3782202099): ttl throw error early under mysql dialect

See merge request dp/ClickHouse!21672
# Conflicts:
#	tests/queries/4_cnch_stateless/60000_mysql_ddl_create.sql
2024-07-17 17:14:24 +00:00
fredwang 0154c8ebc5 Merge 'rw2' into 'cnch-dev'
fix(clickhousech@m-3798350118):Filter shuffle data by prefix may read extra wrong files

See merge request: https://code.byted.org/dp/ClickHouse/merge_requests/21764
2024-07-17 17:13:14 +00:00
fredwang a7f5791653 Merge 'allow_with_totals_after_union_agg_join-cnch-dev' into 'cnch-dev'
fix(clickhousech@m-3892780786): fix 40096 unstable result cnch dev

See merge request: https://code.byted.org/dp/ClickHouse/merge_requests/21772
2024-07-15 05:44:20 +00:00
fredwang 4deae74c14 skip two tests following cnch-dev 2024-07-12 09:51:22 +00:00
fredwang 76cd5b9592 Merge branch 'trivial_count_ci_test_cnch_dev' into 'cnch-dev'
fix(optimizer@m-3030898703): fix trivial count optimize

See merge request dp/ClickHouse!21726
# Conflicts:
#	src/Optimizer/PlanOptimizer.cpp
2024-07-12 05:52:27 +00:00
fredwang 85300670e8 Merge 'scale-cnch' into 'cnch-dev'
fix(clickhousech@m-3158828611): plansegment scala cnch-dev

See merge request: https://code.byted.org/dp/ClickHouse/merge_requests/21566
# Conflicts:
#	src/Interpreters/DistributedStages/PlanSegmentSplitter.cpp
2024-07-12 05:48:19 +00:00
fredwang a235c69fc2 Merge branch 'allow_with_totals_after_union_agg_join-cnch-dev' into 'cnch-dev'
fix(clickhousech@m-3892780786): allow with totals after union agg join cnch dev

See merge request dp/ClickHouse!21698
2024-07-12 05:46:24 +00:00
fredwang 7c4afafc73 Merge 'feat/cnch-2-integer_in_bitmap' into 'cnch-dev'
feat(clickhousech@m-4051966615): select query supports integer in bitmap

See merge request: https://code.byted.org/dp/ClickHouse/merge_requests/21682
2024-07-12 05:43:03 +00:00
fredwang a80bcf0ea2 Merge branch 'add_bit_engine_tag_id_pushdown_for_optimizier_cnch-dev' into 'cnch-dev'
fix(clickhousech@m-3001121811): add bit engine tag id pushdown for optimizier cnch dev

See merge request dp/ClickHouse!21696
2024-07-12 05:41:04 +00:00
fredwang 2864eefc13 Merge 'cherry-pick-db633703' into 'cnch-dev'
fix(clickhousech@m-3987297181): fix ser/deser/orderby for lc fallback

See merge request: https://code.byted.org/dp/ClickHouse/merge_requests/21667
# Conflicts:
#	tests/queries/4_cnch_stateless/00800_low_cardinality_full_state.reference
#	tests/queries/4_cnch_stateless/00800_low_cardinality_full_state.sql
2024-07-12 04:02:58 +00:00
fredwang b6afeecc3c Merge 'cherry-pick-e63978a2-2' into 'cnch-dev'
fix(clickhousech@m-4008474081): fix bitmap index after alter

See merge request: https://code.byted.org/dp/ClickHouse/merge_requests/21653
2024-07-12 04:00:56 +00:00
fredwang 7cbea2abeb Merge branch 'jiacheng.sun-add-information-schema-engines-table' into 'cnch-dev'
feat(clickhousech@m-3179138697): Add information_schema engines, files, profiling

See merge request dp/ClickHouse!21618
2024-07-12 04:00:04 +00:00
fredwang 3cb6abb5db Merge 'fix_not_not_in_cnch' into 'cnch-dev'
fix(optimizer@m-3987325191): convert not(not(id)) to toBool(id)

See merge request: https://code.byted.org/dp/ClickHouse/merge_requests/21643
2024-07-12 03:59:32 +00:00
fredwang 7a13e0b6f1 Merge branch 'zema/cnch-dev-addBackTrivialCount' into 'cnch-dev'
fix(clickhousech@m-3030898703): add back trivial count

See merge request dp/ClickHouse!21456
2024-07-12 03:41:53 +00:00
fredwang eb47ebbbe6 Merge branch 'feat-sensitive-permissions-dev' into 'cnch-dev'
feat(clickhousech@m-17322645): RBAC Sensitive Permissions

See merge request dp/ClickHouse!20380
# Conflicts:
#	programs/server/config.xml
#	src/Catalog/MetastoreProxy.h
2024-07-11 08:55:11 +00:00
fredwang c20b2ec6af Merge branch 'support_sum_if_to_count_if' into 'cnch-dev'
feat(optimizer@m-3000771409): support sum if to count if

See merge request dp/ClickHouse!21339
2024-07-11 08:41:39 +00:00
fredwang 2f178e0e60 Merge branch 'cnch_dev_map_function_aligen_adb' into 'cnch-dev'
feat(clickhousech@m-3644560524): add map function alias for adb

See merge request dp/ClickHouse!21110
2024-07-11 08:40:46 +00:00
fredwang 9f8c6c62eb Merge branch 'tenanted_mutation_view' into 'cnch-dev'
feat(clickhousech@m-3179141704): support tenanted mutation system table

See merge request dp/ClickHouse!21517
2024-07-11 08:38:04 +00:00
fredwang 3e292b168f use striped db name for system.cnch_detached_parts 2024-07-05 02:28:44 +00:00
fredwang 32803067d1 separate s3 with/without tenant tests 2024-07-05 02:28:44 +00:00
fredwang 5e42f19ac0 update ci to set tenant_id
* add skip list
* fix test cases
2024-07-05 02:27:51 +00:00
skyoct 3bf360f96e fix tests 2024-06-28 02:50:43 +00:00
skyoct f36c20fcd8 fix tests cnch_detached_parts 2024-06-28 01:53:54 +00:00
skyoct 4227ab3993 fix tests 2024-06-27 12:08:49 +00:00
skyoct 6d5ffc6888 fix tests 2024-06-27 10:03:14 +00:00
skyoct 1a1eb4c055 fix tests 2024-06-26 14:06:46 +00:00
skyoct 5ca1e18c5a add cnch_detached_parts test case 2024-06-19 05:23:54 +00:00
fanqi1909 a67b9929dd fix unit test 40057_ansi_nullify_grouping.sql failure 2024-06-13 10:34:54 +08:00
fredwang a87bf6e46f Merge branch 'rbac-system-cnch-tables' into 'cnch-dev'
feat(clickhousech@m-3798701528): add rbac check for system cnch tables

See merge request dp/ClickHouse!21374
2024-06-10 11:12:24 +08:00
fanqi1909 cdb88a84a8 Merge 'fky@cnch-dev@ci@fix-partition-prune' into 'cnch-dev'
fix(clickhousech@m-3782162120): fix 48040_optimizer_partition_prune

See merge request: https://code.byted.org/dp/ClickHouse/merge_requests/21438

# Conflicts:
#	tests/queries/4_cnch_stateless/48040_optimizer_partition_prune.reference
2024-05-13 17:32:06 +08:00
fanqi1909 b2ce4e2a1d Merge branch 'zema/cnch-dev-partitionLevelTTL' into 'cnch-dev'
feat(clickhousech@m-3652516602): store ttl info to kv and execute partition gc by ttl

See merge request dp/ClickHouse!20899
2024-05-13 17:29:51 +08:00
fanqi1909 f6272a03b2 Merge branch 'lta@feat_dedup_detach_attach_support_bucket4cnch-dev' into 'cnch-dev'
feat(clickhousech@m-3047891595-2): repair/detach/attach commands support bucket

See merge request dp/ClickHouse!20494
2024-05-13 17:29:51 +08:00
fanqi1909 b6e69fbf70 Merge 'cnch_dev_unique_table_support_system_log' into 'cnch-dev'
feat(clickhousech@m-3047891595): unique table support system log

See merge request: https://code.byted.org/dp/ClickHouse/merge_requests/20683
 Conflicts:
	.codebase/ci_scripts/cnch_config/1_single_server/config/server.xml
	.codebase/ci_scripts/cnch_config/1_single_server/config/worker0.xml
	.codebase/ci_scripts/cnch_config/1_single_server/config/worker1.xml
	.codebase/ci_scripts/cnch_config/2_backward_compability/config/server.xml
	.codebase/ci_scripts/cnch_config/2_backward_compability/config/worker1.xml
	.codebase/ci_scripts/cnch_config/3_multiple_server/config/server0.xml
	.codebase/ci_scripts/cnch_config/3_multiple_server/config/server1.xml
	.codebase/ci_scripts/cnch_config/3_multiple_server/config/worker0.xml
	.codebase/ci_scripts/cnch_config/3_multiple_server/config/worker1.xml
	deploy/template/byconity-worker.xml
	docker/CI/multi-servers/server.yml
	docker/CI/s3/server.yml
	docker/docker-compose/byconity-multiworkers-cluster/server.yml
	docker/docker-compose/byconity-simple-cluster/server.yml
	docker/docker-compose/byconity-simple-cluster/worker.yml
	programs/server/cnch-server.xml
2024-05-13 17:29:50 +08:00
fanqi1909 cfecb8a52b Merge branch 'fix_rm_redundant_distinct_cnchdev' into 'cnch-dev'
fix(optimizer@m-3645281049): fix rm redundant distinct

See merge request dp/ClickHouse!21322
# Conflicts:
#	tests/queries/4_cnch_stateless_no_tenant/46010_explain_with_settings.reference
#	tests/queries/4_cnch_stateless_no_tenant/46010_explain_with_settings.sql
2024-05-13 17:29:50 +08:00
fanqi1909 32f060d92c Merge 'fix/fix_offloading_with_query_plan' into 'cnch-dev'
fix(optimizer@m-3695172707): fix offloading_with_query_plan don't set shuffle_with_order cnch-dev

See merge request: https://code.byted.org/dp/ClickHouse/merge_requests/21269
# Conflicts:
#	src/Optimizer/Cascades/CascadesOptimizer.cpp
2024-05-13 17:29:50 +08:00
fanqi1909 1e91ed5e77 Merge 'rename_fix_dev' into 'cnch-dev'
fix(clickhousech@m-3594234201): cp fix from ClickHouse/ClickHouse#40906

See merge request: https://code.byted.org/dp/ClickHouse/merge_requests/21501
2024-05-08 11:16:31 +08:00
fanqi1909 52df9695a4 Merge 'cherry-pick-8eb88b4f' into 'cnch-dev'
fix(clickhousech@m-3856683587): Mysql Default Text Case Roll Back dev

See merge request: https://code.byted.org/dp/ClickHouse/merge_requests/21461
2024-05-08 09:27:41 +08:00
fanqi1909 b8bfaff543 Merge 'fky@cnch-dev@ci@fix-partition-prune' into 'cnch-dev'
fix(clickhousech@m-3782162120): fix 48040_optimizer_partition_prune

See merge request: https://code.byted.org/dp/ClickHouse/merge_requests/21438
 Conflicts:
	tests/queries/4_cnch_stateless/48040_optimizer_partition_prune.reference
	tests/queries/4_cnch_stateless/48040_optimizer_partition_prune.sql
2024-05-07 18:28:02 +08:00
fanqi1909 ac227c2476 Merge branch 'final_sample_cnchdev' into 'cnch-dev'
fix(optimizer@m-15069680): optimizer support final sample

See merge request dp/ClickHouse!21333
2024-05-07 10:54:32 +08:00
fanqi1909 72b8c06179 Merge branch 'cnch-auto-spill' into 'cnch-dev'
feat(clickhousech@m-3766345642): [Cnch] adaptive spill

See merge request dp/ClickHouse!21308
# Conflicts:
#	src/Core/Settings.h
#	src/Interpreters/InterpreterPerfectShard.cpp
2024-05-07 10:53:38 +08:00
fanqi1909 70361814ba Merge 'tenant_access_cnch_tables' into 'cnch-dev'
feat(clickhousech@m-3672768086): support tenant separation for accessing cnch table

See merge request: !21195
2024-05-06 18:02:43 +08:00
fanqi1909 7d0a6c8ecd Merge 'cherry-pick-5961fbe3' into 'cnch-dev'
fix(clickhousech@m-3671827753): [cp] Make sure cluster_status set to 0 after modify cluster by

See merge request: https://code.byted.org/dp/ClickHouse/merge_requests/21257
2024-05-03 17:25:06 +08:00
fanqi1909 b9930a3e2d Merge 'feat/cnch-2-parquet_bitmap' into 'cnch-dev'
feat(clickhousech@m-3460336453): support BitMap64 type with Parquet format

See merge request: https://code.byted.org/dp/ClickHouse/merge_requests/21184
2024-05-03 13:58:01 +08:00
fanqi1909 acd1018d2c Merge branch 'fix-daemon-manager-clean-undo-buffer' into 'cnch-dev'
fix(clickhousech@m-3671907062): Fix cleanUndoBuffers logic for DaemonJobTxnGC to let it works well with write_undo_buffer_new_key

See merge request dp/ClickHouse!21185
2024-04-30 20:24:04 +08:00
fanqi1909 321c50008c Merge branch 'jiacheng.sun-fix-ansi-information-schema-partitions' into 'cnch-dev'
fix(clickhousech@m-3179138697): Fix information_schema partitions

See merge request dp/ClickHouse!21013
2024-04-30 14:57:13 +08:00
fanqi1909 bed101e0e9 Merge branch 'fix_toDateOrNull_core-cnch-dev' into 'cnch-dev'
fix(clickhousech@m-3651696533): fix toDateOrNull core cnch dev

See merge request dp/ClickHouse!21160
2024-04-30 14:56:43 +08:00
fanqi1909 b5c43d3f6c Merge 'fix/cte_broadcast_cnch_dev' into 'cnch-dev'
fix(optimizer@m-3310530537): fix cte property explore with broadcast cnch-dev

See merge request: https://code.byted.org/dp/ClickHouse/merge_requests/21114
2024-04-30 14:55:45 +08:00
fanqi1909 fdd7102b44 Merge branch 'fix-period' into 'cnch-dev'
fix(clickhousech@m-3672735570): refactor period_add and period_diff

See merge request dp/ClickHouse!21180
2024-04-30 14:55:14 +08:00
fanqi1909 3b071b386c Merge '3595066568_cnch-dev' into 'cnch-dev'
fix(clickhousech@m-3595066568): fix arrayjoin performance slow with optimizer

See merge request: https://code.byted.org/dp/ClickHouse/merge_requests/21080
2024-04-30 10:42:31 +08:00
fanqi1909 89ad213119 Merge branch 'reduceS3API' into 'cnch-dev'
fix(clickhousech@m-3156347174): Reduce S3 API invoke in merge process

See merge request dp/ClickHouse!20632
# Conflicts:
#	src/Storages/MergeTree/MergeTreeCNCHDataDumper.cpp
2024-04-29 14:55:22 +08:00
fanqi1909 4655e1e88f Merge branch 'zema/cnch-dev-mysqlDialectType' into 'cnch-dev'
fix(clickhousech@m-3106204787): add setting storage_dialect_type and use it for key expressions

See merge request dp/ClickHouse!21078
2024-04-29 14:31:37 +08:00
fanqi1909 d2a7e418d1 Merge branch 'memory_statistics_merge' into 'cnch-dev'
feat(clickhousech@m-16145968): 【CP】plansegment memory statistics merge(disable in bsp mode)

See merge request dp/ClickHouse!20709
# Conflicts:
#	src/Core/Settings.h
#	src/Interpreters/Context.h
2024-04-26 18:10:04 +08:00
fanqi1909 da4d92aea6 Merge branch 'cch-cnch_dev-ingest-with-bucket' into 'cnch-dev'
feat(clickhousech@m-3348298112): Ingest with bucket

See merge request dp/ClickHouse!20774
# Conflicts:
#	docker/CI/docker-compose-s3.yml
#	docker/CI/docker-compose-single.yml
#	docker/CI/docker-compose.yml
#	docker/CI/multi-servers/cnch-config.yml
#	docker/CI/multi-servers/daemon-manager.yml
#	docker/CI/multi-servers/server.yml
#	docker/CI/multi-servers/tso.yml
#	docker/CI/multi-servers/worker.yml
#	docker/CI/s3/daemon-manager.yml
#	docker/CI/s3/docker-compose-patch.yml
#	docker/CI/s3/server.yml
#	docker/CI/s3/tso.yml
#	docker/CI/s3/worker.yml
#	docker/CI/single-server/cnch-config.yml
#	docker/CI/single-server/daemon-manager.yml
#	docker/CI/single-server/tso.yml
#	docker/docker-compose/byconity-multi-cluster/resource-manager.yml
#	docker/docker-compose/byconity-multiworkers-cluster/resource-manager.yml
#	docker/docker-compose/byconity-simple-cluster/resource-manager.yml
#	docker/docker-compose/byconity-simple-cluster/server.yml
#	docker/docker-compose/byconity-simple-cluster/worker.yml
#	src/Storages/IngestColumnCnch/IngestColumnCnch.cpp
2024-04-26 17:35:32 +08:00
fanqi1909 047711963c Merge branch 'read_tuple_as_json_object' into 'cnch-dev'
feat(clickhousech@m-3412038072):read named tuple from json

See merge request dp/ClickHouse!20952
2024-04-26 16:09:15 +08:00
fanqi1909 21bda3cd0c Merge 'cherry-pick-d1b0ed54-2' into 'cnch-dev'
fix(optimizer@m-3000537417): fix bitmap index not pushed down

See merge request: https://code.byted.org/dp/ClickHouse/merge_requests/20993
2024-04-26 15:15:02 +08:00
fanqi1909 d7cf8b66c1 Merge 'dog-cnch-ce-override-histogram' into 'cnch-dev'
fix(optimizer@m-3459430016): delete legacy histogram when re-collect stats without histogram

See merge request: https://code.byted.org/dp/ClickHouse/merge_requests/20997
2024-04-26 15:14:32 +08:00
fanqi1909 b16b15c932 Merge branch 'fix_explain_error_info_cnchdev' into 'cnch-dev'
fix(optimizer@m-3348274178): fix explain error info

See merge request dp/ClickHouse!20923
# Conflicts:
#	tests/queries/0_ce_problematic_stateless/01076_predicate_optimizer_with_view.sql
2024-04-25 10:10:10 +08:00
fanqi1909 d96417ed2e Merge 'fix/fix_pushdown_projection_symbol_mapping_cnch_dev' into 'cnch-dev'
fix(optimizer@m-3000935223): fix pushdown projection symbol mapping cnch-dev

See merge request: https://code.byted.org/dp/ClickHouse/merge_requests/20897
2024-04-24 14:37:46 +08:00
fanqi1909 f3a55cf065 Merge '3348191561_cnch-dev' into 'cnch-dev'
fix(optimizer@m-3348191561): Implement CrossJoinToUnion rule

See merge request: https://code.byted.org/dp/ClickHouse/merge_requests/20809
2024-04-24 14:37:36 +08:00
fanqi1909 b3af37f902 Merge branch 'fix-too-deep-recursion-cnch-dev' into 'cnch-dev'
fix(clickhousech@m-3047443070): fix too deep recursion cnch dev

See merge request dp/ClickHouse!20810
2024-04-24 14:36:29 +08:00
jenrryyou 33c669cb08 fix(byconity@m-3359728725): Fix bug with LowCardinality in short-curcuit function evaluation Closes #1301 2024-04-22 11:39:55 +08:00
Dao e6e411adfa Merge 'fix/runtime_filter_typed_date_core_dump_cnch_dev' into 'cnch-dev'
fix(optimizer@m-3347557629): fix runtime filter core dump in runtime for date type date cnch-dev

See merge request: https://code.byted.org/dp/ClickHouse/merge_requests/20835
2024-04-12 10:22:22 +08:00
Dao 23db37814d Merge branch 'fix-dual' into 'cnch-dev'
fix(clickhousech@m-3348198742): support mysql dual table

See merge request dp/ClickHouse!20811
2024-04-11 16:20:18 +08:00
Dao 484ff57e5c Merge branch 'zema/cnch-dev-updateJoin' into 'cnch-dev'
feat(clickhousech@m-3106204787): UPDATE JOIN

See merge request dp/ClickHouse!20684
2024-04-11 16:20:07 +08:00
Dao a1e959f1c2 Merge 'fix_bitmap_index_check_in_cnchdev' into 'cnch-dev'
fix(optimizer@m-3348236068): Fix bitmap index check

See merge request: https://code.byted.org/dp/ClickHouse/merge_requests/20786
2024-04-11 14:21:19 +08:00
Dao 12bb05be9c Merge branch 'cnch-join-block-split' into 'cnch-dev'
feat(clickhousech@m-3404807508): [CNCH] memory control on joined block

See merge request dp/ClickHouse!20820
# Conflicts:
#	src/Interpreters/HashJoin.cpp
2024-04-11 11:08:04 +08:00
Dao 6cff7215ba Merge branch 'add_fastprevauc_cnch' into 'cnch-dev'
feat(clickhousech@m-3347623183): add udaf fastPrevAuc2 to handle the miduim results for fastAuc2

See merge request dp/ClickHouse!20731
2024-04-09 13:33:30 +08:00
Dao f1d3ac44be Merge branch 'jiacheng.sun-add-replace-dml' into 'cnch-dev'
feat(clickhousech@m-3178381607): Add parser logic for REPLACE INTO

See merge request dp/ClickHouse!20726
2024-04-09 13:33:24 +08:00
Dao d64da1317e Merge branch 'fix_distinct_to_groupby_cnchdev' into 'cnch-dev'
fix(optimizer@m-16951867): fix distinct to agg

See merge request dp/ClickHouse!20714
2024-04-09 13:32:21 +08:00
Dao 549b502985 Merge 'lta@support_unique_table_append_mode4cnch_dev' into 'cnch-dev'
feat(clickhousech@m-3346761095): unique table support append mode

See merge request: https://code.byted.org/dp/ClickHouse/merge_requests/20653
# Conflicts:
#	src/MergeTreeCommon/MergeTreeMetaBase.cpp
#	src/MergeTreeCommon/MergeTreeMetaBase.h
#	src/Storages/StorageCnchMergeTree.cpp
2024-04-08 18:16:57 +08:00
Dao e2de5b9492 Merge branch 'jiacheng.sun-fix-mysql-rand' into 'cnch-dev'
fix(clickhousech@m-14362905): Redirect rand to randCanonical in mysql mode

See merge request dp/ClickHouse!20696
2024-04-08 16:02:14 +08:00
Dao f1252fe2d3 Merge branch 'mysql_fix' into 'cnch-dev'
fix(clickhousech@m-3347641016): enhancement for MySQL DDL and DQL patch 2

See merge request dp/ClickHouse!20725
2024-04-08 15:56:23 +08:00
Dao 853843f37b Merge 'fix-receiver-metrics-new' into 'cnch-dev'
fix(clickhousech@m-3000919937): fix receiver metrics

See merge request: https://code.byted.org/dp/ClickHouse/merge_requests/18926
2024-04-08 13:54:58 +08:00
Dao 00220fbc62 Merge 'mysql_fix' into 'cnch-dev'
fix(clickhousech@m-3347641016): enhancement for MySQL DDL and DQL

See merge request: https://code.byted.org/dp/ClickHouse/merge_requests/20620
2024-04-04 16:25:31 +08:00
Dao a35ab7f60b Merge 'not_do_constant_folding_for_complex_literals_cnch-dev' into 'cnch-dev'
fix(clickhousech@m-3284084166): not do constant folding for complex literals cnch dev

See merge request: https://code.byted.org/dp/ClickHouse/merge_requests/20688
2024-04-04 16:23:54 +08:00
Dao bcc11f8880 Merge 'wrong_num' into 'cnch-dev'
fix(clickhousech@m-3298014142): fix the wrong logic when parallel size is worker number + 1

See merge request: https://code.byted.org/dp/ClickHouse/merge_requests/20544
2024-04-04 10:25:52 +08:00
Dao 75d624affd Merge branch 'refactor_sql_binding_cnchdev' into 'cnch-dev'
fix(optimizer@m-3179121605): Refactor sql binding

See merge request dp/ClickHouse!20636
2024-04-04 10:24:02 +08:00
Dao 3f8293a1e7 Merge branch 'disable_bsp_shuffle_reduce_locality_enabled' into 'cnch-dev'
fix(clickhousech@m-3347651074): disable bsp_shuffle_reduce_locality_enabled for now

See merge request dp/ClickHouse!20689
2024-04-04 10:19:35 +08:00
Dao d1ac659261 Merge 'cherry-pick-comment' into 'cnch-dev'
fix(clickhousech@m-3284060938): refactor move comment from storage to astcreate[cp]

See merge request: https://code.byted.org/dp/ClickHouse/merge_requests/20617
2024-04-03 17:19:04 +08:00
Dao dcdb9e7684 Merge branch 'cnch_dev_part_prefetcher_support_map' into 'cnch-dev'
fix(clickhousech@m-3260182100): part prefetcher support map Closes #1410

See merge request dp/ClickHouse!20426
2024-04-03 17:19:04 +08:00
Dao 19abdd5313 Merge branch '3265473722_cnch_dev' into 'cnch-dev'
fix(optimizer@m-3265473722):fix predicate pushdown ineffective bug

See merge request dp/ClickHouse!20514
2024-04-03 14:45:56 +08:00
Dao 5ec5a22c0c Merge 'fix_mv_same_target_table' into 'cnch-dev'
fix(clickhousech@m-17441741): fix serveral mv with same target table insert in worker side report error

See merge request: https://code.byted.org/dp/ClickHouse/merge_requests/20432
# Conflicts:
#	src/Storages/StorageCnchMergeTree.cpp
#	tests/queries/4_cnch_stateless_no_tenant/50010_direct_insert.sh
2024-04-02 14:43:11 +08:00
Dao 8869f1c51a Merge branch 'cnch_jit_improve' into 'cnch-dev'
feat(clickhousech@m-3323403556): cnch jit improve

See merge request dp/ClickHouse!20347
2024-04-02 10:35:54 +08:00
Dao 9aabba8f73 Merge branch 'handle-data-overflow' into 'cnch-dev'
feat(clickhousech@m-3057426540): Handle data overflow

See merge request dp/ClickHouse!20182
2024-04-02 10:29:42 +08:00
Dao 6f6cd6da06 Merge branch 'cnch_2.0_JSONExtract_support_map' into 'cnch-dev'
feat(clickhousech@m-16873951): cnch dev JSONExtract support map type

See merge request dp/ClickHouse!17798
2024-04-01 13:36:58 +08:00
Dao 5e4be58904 Merge branch 'distributed_output' into 'cnch-dev'
feat(clickhousech@m-3001165347): support distributed outfile in worker

See merge request dp/ClickHouse!20342
# Conflicts:
#	src/Analyzers/QueryAnalyzer.cpp
#	src/Core/Settings.h
#	src/Interpreters/InterpreterExplainQuery.cpp
#	src/Interpreters/InterpreterFactory.cpp
#	src/QueryPlan/GraphvizPrinter.cpp
2024-03-28 15:15:41 +08:00
Dao fc6c43eaae Merge branch 'cnch_dev_str_to_map_support_nullable_string' into 'cnch-dev'
feat(clickhousech@m-3260147567): cnch-dev str_to_map support nullable string

See merge request dp/ClickHouse!19618
2024-03-27 17:39:21 +08:00
Dao c66b4e685c fix: fix unstable test 2024-03-27 17:36:45 +08:00
Dao 688c4e026b Merge 'feat/cnch-2.0-spark_hash_align' into 'cnch-dev'
feat(clickhousech@m-3011597342): add function sparkHashSimple to align with Spark

See merge request: https://code.byted.org/dp/ClickHouse/merge_requests/19889
2024-03-27 14:36:56 +08:00
Dao 5157bf15ee Merge branch 'city-hash-64' into 'cnch-dev'
feat(clickhousech@m-3086277560): Merge branch 'exchange_nullable_mr' into 'cnch-dev'

See merge request dp/ClickHouse!20298
2024-03-27 14:36:56 +08:00
Dao 7152ac9eb3 Merge 'cnch_dev_dedup_cancel_and_refinement' into 'cnch-dev'
feat(clickhousech@m-17312186): Support dedup cancel and refinement

See merge request: https://code.byted.org/dp/ClickHouse/merge_requests/19541
# Conflicts:
#	src/CloudServices/CnchWorkerServiceImpl.cpp
#	src/CloudServices/CnchWorkerServiceImpl.h
2024-03-26 18:40:39 +08:00
Dao Minh Thuc ef3e521c30
Merge pull request #1485 from ByConity/cherry-pick
style: fix comment string.
2024-03-26 18:33:01 +08:00
Dao 4651e9e0dc Merge 'fix/fix_tests_explain' into 'cnch-dev'
fix(optimizer@m-3105120106): fix explain cost for tests

See merge request: https://code.byted.org/dp/ClickHouse/merge_requests/20479
2024-03-26 15:28:25 +08:00
Dao 8911a0300a Merge branch 'fix_toInt_inf' into 'cnch-dev'
fix(clickhousech@m-3001047433): Fixed Unexpected Integer conversion

See merge request dp/ClickHouse!20445
2024-03-26 15:08:59 +08:00