wbtiger
/
ByConity
mirror of https://github.com/ByConity/ByConity
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
72,347 Commits 116 Branches 33 Tags 417 MiB
Commit Graph

7449 Commits

Author SHA1 Message Date
fredwang 9fcf286c77 Merge branch 'jiacheng.sun-add-uuid-alias' into 'cnch-dev' 
fix(clickhousech@m-14362905): Add UUID mysql alias

See merge request dp/ClickHouse!21106
 2024-07-22 07:58:26 +00:00
fredwang 8fb13d815e Merge 'm_cte' into 'cnch-dev' 
fix(clickhousech@m-3347651074): considering multiple cte input in bsp mode

See merge request: https://code.byted.org/dp/ClickHouse/merge_requests/21055
 2024-07-22 07:56:30 +00:00
fredwang 8167be0c4a fix TTL in mysql ddl 2024-07-17 20:59:45 +00:00
fredwang 9beb987424 Merge branch 'mysql_fix' into 'cnch-dev' 
feat(clickhousech@m-3106204787): support ctas and extend ddl

See merge request dp/ClickHouse!21052
# Conflicts:
#	tests/queries/4_cnch_stateless/60000_mysql_ddl_create.sql
 2024-07-17 19:28:34 +00:00
fredwang dbf8e80e28 Merge 'fix_symbol_cnchdev' into 'cnch-dev' 
fix(optimizer@m-3857664023): fix SymbolAllocator

See merge request: https://code.byted.org/dp/ClickHouse/merge_requests/21784
 2024-07-17 17:34:15 +00:00
fredwang 0a7ba424ee Merge branch 'parquet-native-cnch' into 'cnch-dev' 
feat(clickhousech@m-4087850669): cherry-pick parquet native reader

See merge request dp/ClickHouse!21704
# Conflicts:
#	programs/server/Server.cpp
#	src/Common/ProfileEvents.cpp
#	src/Core/Settings.h
#	src/Formats/FormatSettings.h
#	tests/queries/4_cnch_external_table/00019_join_case_enable_optimzier_use_part_schedule.sql.disabled
#	tests/queries/4_cnch_external_table/00022_join_case_enable_optimzier_use_row_group_schedule.sql.disabled
#	tests/queries/4_cnch_external_table/00024_sum_case_enable_optimzier_use_row_group_schedule.sql.disabled
 2024-07-17 17:31:45 +00:00
fredwang 9311642dbf Merge branch 'fix-ttl' into 'cnch-dev' 
fix(clickhousech@m-3782202099): ttl throw error early under mysql dialect

See merge request dp/ClickHouse!21672
# Conflicts:
#	tests/queries/4_cnch_stateless/60000_mysql_ddl_create.sql
 2024-07-17 17:14:24 +00:00
fredwang 0154c8ebc5 Merge 'rw2' into 'cnch-dev' 
fix(clickhousech@m-3798350118):Filter shuffle data by prefix may read extra wrong files

See merge request: https://code.byted.org/dp/ClickHouse/merge_requests/21764
 2024-07-17 17:13:14 +00:00
fredwang a7f5791653 Merge 'allow_with_totals_after_union_agg_join-cnch-dev' into 'cnch-dev' 
fix(clickhousech@m-3892780786): fix 40096 unstable result cnch dev

See merge request: https://code.byted.org/dp/ClickHouse/merge_requests/21772
 2024-07-15 05:44:20 +00:00
fredwang 4deae74c14 skip two tests following cnch-dev 2024-07-12 09:51:22 +00:00
fredwang 76cd5b9592 Merge branch 'trivial_count_ci_test_cnch_dev' into 'cnch-dev' 
fix(optimizer@m-3030898703): fix trivial count optimize

See merge request dp/ClickHouse!21726
# Conflicts:
#	src/Optimizer/PlanOptimizer.cpp
 2024-07-12 05:52:27 +00:00
fredwang 85300670e8 Merge 'scale-cnch' into 'cnch-dev' 
fix(clickhousech@m-3158828611): plansegment scala cnch-dev

See merge request: https://code.byted.org/dp/ClickHouse/merge_requests/21566
# Conflicts:
#	src/Interpreters/DistributedStages/PlanSegmentSplitter.cpp
 2024-07-12 05:48:19 +00:00
fredwang a235c69fc2 Merge branch 'allow_with_totals_after_union_agg_join-cnch-dev' into 'cnch-dev' 
fix(clickhousech@m-3892780786): allow with totals after union agg join cnch dev

See merge request dp/ClickHouse!21698
 2024-07-12 05:46:24 +00:00
fredwang 7c4afafc73 Merge 'feat/cnch-2-integer_in_bitmap' into 'cnch-dev' 
feat(clickhousech@m-4051966615): select query supports integer in bitmap

See merge request: https://code.byted.org/dp/ClickHouse/merge_requests/21682
 2024-07-12 05:43:03 +00:00
fredwang a80bcf0ea2 Merge branch 'add_bit_engine_tag_id_pushdown_for_optimizier_cnch-dev' into 'cnch-dev' 
fix(clickhousech@m-3001121811): add bit engine tag id pushdown for optimizier cnch dev

See merge request dp/ClickHouse!21696
 2024-07-12 05:41:04 +00:00
fredwang 2864eefc13 Merge 'cherry-pick-db633703' into 'cnch-dev' 
fix(clickhousech@m-3987297181): fix ser/deser/orderby for lc fallback

See merge request: https://code.byted.org/dp/ClickHouse/merge_requests/21667
# Conflicts:
#	tests/queries/4_cnch_stateless/00800_low_cardinality_full_state.reference
#	tests/queries/4_cnch_stateless/00800_low_cardinality_full_state.sql
 2024-07-12 04:02:58 +00:00
fredwang b6afeecc3c Merge 'cherry-pick-e63978a2-2' into 'cnch-dev' 
fix(clickhousech@m-4008474081): fix bitmap index after alter

See merge request: https://code.byted.org/dp/ClickHouse/merge_requests/21653
 2024-07-12 04:00:56 +00:00
fredwang 7cbea2abeb Merge branch 'jiacheng.sun-add-information-schema-engines-table' into 'cnch-dev' 
feat(clickhousech@m-3179138697): Add information_schema engines, files, profiling

See merge request dp/ClickHouse!21618
 2024-07-12 04:00:04 +00:00
fredwang 3cb6abb5db Merge 'fix_not_not_in_cnch' into 'cnch-dev' 
fix(optimizer@m-3987325191): convert not(not(id)) to toBool(id)

See merge request: https://code.byted.org/dp/ClickHouse/merge_requests/21643
 2024-07-12 03:59:32 +00:00
fredwang 7a13e0b6f1 Merge branch 'zema/cnch-dev-addBackTrivialCount' into 'cnch-dev' 
fix(clickhousech@m-3030898703): add back trivial count

See merge request dp/ClickHouse!21456
 2024-07-12 03:41:53 +00:00
fredwang eb47ebbbe6 Merge branch 'feat-sensitive-permissions-dev' into 'cnch-dev' 
feat(clickhousech@m-17322645): RBAC Sensitive Permissions

See merge request dp/ClickHouse!20380
# Conflicts:
#	programs/server/config.xml
#	src/Catalog/MetastoreProxy.h
 2024-07-11 08:55:11 +00:00
fredwang c20b2ec6af Merge branch 'support_sum_if_to_count_if' into 'cnch-dev' 
feat(optimizer@m-3000771409): support sum if to count if

See merge request dp/ClickHouse!21339
 2024-07-11 08:41:39 +00:00
fredwang 2f178e0e60 Merge branch 'cnch_dev_map_function_aligen_adb' into 'cnch-dev' 
feat(clickhousech@m-3644560524): add map function alias for adb

See merge request dp/ClickHouse!21110
 2024-07-11 08:40:46 +00:00
fredwang 9f8c6c62eb Merge branch 'tenanted_mutation_view' into 'cnch-dev' 
feat(clickhousech@m-3179141704): support tenanted mutation system table

See merge request dp/ClickHouse!21517
 2024-07-11 08:38:04 +00:00
fredwang 3e292b168f use striped db name for system.cnch_detached_parts 2024-07-05 02:28:44 +00:00
fredwang 32803067d1 separate s3 with/without tenant tests 2024-07-05 02:28:44 +00:00
fredwang 5e42f19ac0 update ci to set tenant_id 
* add skip list
* fix test cases
 2024-07-05 02:27:51 +00:00
skyoct 3bf360f96e fix tests 2024-06-28 02:50:43 +00:00
skyoct f36c20fcd8 fix tests cnch_detached_parts 2024-06-28 01:53:54 +00:00
skyoct 4227ab3993 fix tests 2024-06-27 12:08:49 +00:00
skyoct 6d5ffc6888 fix tests 2024-06-27 10:03:14 +00:00
skyoct 1a1eb4c055 fix tests 2024-06-26 14:06:46 +00:00
skyoct 5ca1e18c5a add cnch_detached_parts test case 2024-06-19 05:23:54 +00:00
fanqi1909 a67b9929dd fix unit test 40057_ansi_nullify_grouping.sql failure 2024-06-13 10:34:54 +08:00
fredwang a87bf6e46f Merge branch 'rbac-system-cnch-tables' into 'cnch-dev' 
feat(clickhousech@m-3798701528): add rbac check for system cnch tables

See merge request dp/ClickHouse!21374
 2024-06-10 11:12:24 +08:00
fanqi1909 cdb88a84a8 Merge 'fky@cnch-dev@ci@fix-partition-prune' into 'cnch-dev' 
fix(clickhousech@m-3782162120): fix 48040_optimizer_partition_prune

See merge request: https://code.byted.org/dp/ClickHouse/merge_requests/21438

# Conflicts:
#	tests/queries/4_cnch_stateless/48040_optimizer_partition_prune.reference
 2024-05-13 17:32:06 +08:00
fanqi1909 b2ce4e2a1d Merge branch 'zema/cnch-dev-partitionLevelTTL' into 'cnch-dev' 
feat(clickhousech@m-3652516602): store ttl info to kv and execute partition gc by ttl

See merge request dp/ClickHouse!20899
 2024-05-13 17:29:51 +08:00
fanqi1909 f6272a03b2 Merge branch 'lta@feat_dedup_detach_attach_support_bucket4cnch-dev' into 'cnch-dev' 
feat(clickhousech@m-3047891595-2): repair/detach/attach commands support bucket

See merge request dp/ClickHouse!20494
 2024-05-13 17:29:51 +08:00
fanqi1909 b6e69fbf70 Merge 'cnch_dev_unique_table_support_system_log' into 'cnch-dev' 
feat(clickhousech@m-3047891595): unique table support system log

See merge request: https://code.byted.org/dp/ClickHouse/merge_requests/20683
 Conflicts:
	.codebase/ci_scripts/cnch_config/1_single_server/config/server.xml
	.codebase/ci_scripts/cnch_config/1_single_server/config/worker0.xml
	.codebase/ci_scripts/cnch_config/1_single_server/config/worker1.xml
	.codebase/ci_scripts/cnch_config/2_backward_compability/config/server.xml
	.codebase/ci_scripts/cnch_config/2_backward_compability/config/worker1.xml
	.codebase/ci_scripts/cnch_config/3_multiple_server/config/server0.xml
	.codebase/ci_scripts/cnch_config/3_multiple_server/config/server1.xml
	.codebase/ci_scripts/cnch_config/3_multiple_server/config/worker0.xml
	.codebase/ci_scripts/cnch_config/3_multiple_server/config/worker1.xml
	deploy/template/byconity-worker.xml
	docker/CI/multi-servers/server.yml
	docker/CI/s3/server.yml
	docker/docker-compose/byconity-multiworkers-cluster/server.yml
	docker/docker-compose/byconity-simple-cluster/server.yml
	docker/docker-compose/byconity-simple-cluster/worker.yml
	programs/server/cnch-server.xml
 2024-05-13 17:29:50 +08:00
fanqi1909 cfecb8a52b Merge branch 'fix_rm_redundant_distinct_cnchdev' into 'cnch-dev' 
fix(optimizer@m-3645281049): fix rm redundant distinct

See merge request dp/ClickHouse!21322
# Conflicts:
#	tests/queries/4_cnch_stateless_no_tenant/46010_explain_with_settings.reference
#	tests/queries/4_cnch_stateless_no_tenant/46010_explain_with_settings.sql
 2024-05-13 17:29:50 +08:00
fanqi1909 32f060d92c Merge 'fix/fix_offloading_with_query_plan' into 'cnch-dev' 
fix(optimizer@m-3695172707): fix offloading_with_query_plan don't set shuffle_with_order cnch-dev

See merge request: https://code.byted.org/dp/ClickHouse/merge_requests/21269
# Conflicts:
#	src/Optimizer/Cascades/CascadesOptimizer.cpp
 2024-05-13 17:29:50 +08:00
fanqi1909 1e91ed5e77 Merge 'rename_fix_dev' into 'cnch-dev' 
fix(clickhousech@m-3594234201): cp fix from ClickHouse/ClickHouse#40906

See merge request: https://code.byted.org/dp/ClickHouse/merge_requests/21501
 2024-05-08 11:16:31 +08:00
fanqi1909 52df9695a4 Merge 'cherry-pick-8eb88b4f' into 'cnch-dev' 
fix(clickhousech@m-3856683587): Mysql Default Text Case Roll Back dev

See merge request: https://code.byted.org/dp/ClickHouse/merge_requests/21461
 2024-05-08 09:27:41 +08:00
fanqi1909 b8bfaff543 Merge 'fky@cnch-dev@ci@fix-partition-prune' into 'cnch-dev' 
fix(clickhousech@m-3782162120): fix 48040_optimizer_partition_prune

See merge request: https://code.byted.org/dp/ClickHouse/merge_requests/21438
 Conflicts:
	tests/queries/4_cnch_stateless/48040_optimizer_partition_prune.reference
	tests/queries/4_cnch_stateless/48040_optimizer_partition_prune.sql
 2024-05-07 18:28:02 +08:00
fanqi1909 ac227c2476 Merge branch 'final_sample_cnchdev' into 'cnch-dev' 
fix(optimizer@m-15069680): optimizer support final sample

See merge request dp/ClickHouse!21333
 2024-05-07 10:54:32 +08:00
fanqi1909 72b8c06179 Merge branch 'cnch-auto-spill' into 'cnch-dev' 
feat(clickhousech@m-3766345642): [Cnch] adaptive spill

See merge request dp/ClickHouse!21308
# Conflicts:
#	src/Core/Settings.h
#	src/Interpreters/InterpreterPerfectShard.cpp
 2024-05-07 10:53:38 +08:00
fanqi1909 70361814ba Merge 'tenant_access_cnch_tables' into 'cnch-dev' 
feat(clickhousech@m-3672768086): support tenant separation for accessing cnch table

See merge request: !21195
 2024-05-06 18:02:43 +08:00
fanqi1909 7d0a6c8ecd Merge 'cherry-pick-5961fbe3' into 'cnch-dev' 
fix(clickhousech@m-3671827753): [cp] Make sure cluster_status set to 0 after modify cluster by

See merge request: https://code.byted.org/dp/ClickHouse/merge_requests/21257
 2024-05-03 17:25:06 +08:00
fanqi1909 b9930a3e2d Merge 'feat/cnch-2-parquet_bitmap' into 'cnch-dev' 
feat(clickhousech@m-3460336453): support BitMap64 type with Parquet format

See merge request: https://code.byted.org/dp/ClickHouse/merge_requests/21184
 2024-05-03 13:58:01 +08:00
fanqi1909 acd1018d2c Merge branch 'fix-daemon-manager-clean-undo-buffer' into 'cnch-dev' 
fix(clickhousech@m-3671907062): Fix cleanUndoBuffers logic for DaemonJobTxnGC to let it works well with write_undo_buffer_new_key

See merge request dp/ClickHouse!21185
 2024-04-30 20:24:04 +08:00
fanqi1909 321c50008c Merge branch 'jiacheng.sun-fix-ansi-information-schema-partitions' into 'cnch-dev' 
fix(clickhousech@m-3179138697): Fix information_schema partitions

See merge request dp/ClickHouse!21013
 2024-04-30 14:57:13 +08:00
fanqi1909 bed101e0e9 Merge branch 'fix_toDateOrNull_core-cnch-dev' into 'cnch-dev' 
fix(clickhousech@m-3651696533): fix toDateOrNull core cnch dev

See merge request dp/ClickHouse!21160
 2024-04-30 14:56:43 +08:00
fanqi1909 b5c43d3f6c Merge 'fix/cte_broadcast_cnch_dev' into 'cnch-dev' 
fix(optimizer@m-3310530537): fix cte property explore with broadcast cnch-dev

See merge request: https://code.byted.org/dp/ClickHouse/merge_requests/21114
 2024-04-30 14:55:45 +08:00
fanqi1909 fdd7102b44 Merge branch 'fix-period' into 'cnch-dev' 
fix(clickhousech@m-3672735570): refactor period_add and period_diff

See merge request dp/ClickHouse!21180
 2024-04-30 14:55:14 +08:00
fanqi1909 3b071b386c Merge '3595066568_cnch-dev' into 'cnch-dev' 
fix(clickhousech@m-3595066568): fix arrayjoin performance slow with optimizer

See merge request: https://code.byted.org/dp/ClickHouse/merge_requests/21080
 2024-04-30 10:42:31 +08:00
fanqi1909 89ad213119 Merge branch 'reduceS3API' into 'cnch-dev' 
fix(clickhousech@m-3156347174): Reduce S3 API invoke in merge process

See merge request dp/ClickHouse!20632
# Conflicts:
#	src/Storages/MergeTree/MergeTreeCNCHDataDumper.cpp
 2024-04-29 14:55:22 +08:00
fanqi1909 4655e1e88f Merge branch 'zema/cnch-dev-mysqlDialectType' into 'cnch-dev' 
fix(clickhousech@m-3106204787): add setting storage_dialect_type and use it for key expressions

See merge request dp/ClickHouse!21078
 2024-04-29 14:31:37 +08:00
fanqi1909 d2a7e418d1 Merge branch 'memory_statistics_merge' into 'cnch-dev' 
feat(clickhousech@m-16145968): 【CP】plansegment memory statistics merge（disable in bsp mode）

See merge request dp/ClickHouse!20709
# Conflicts:
#	src/Core/Settings.h
#	src/Interpreters/Context.h
 2024-04-26 18:10:04 +08:00
fanqi1909 da4d92aea6 Merge branch 'cch-cnch_dev-ingest-with-bucket' into 'cnch-dev' 
feat(clickhousech@m-3348298112): Ingest with bucket

See merge request dp/ClickHouse!20774
# Conflicts:
#	docker/CI/docker-compose-s3.yml
#	docker/CI/docker-compose-single.yml
#	docker/CI/docker-compose.yml
#	docker/CI/multi-servers/cnch-config.yml
#	docker/CI/multi-servers/daemon-manager.yml
#	docker/CI/multi-servers/server.yml
#	docker/CI/multi-servers/tso.yml
#	docker/CI/multi-servers/worker.yml
#	docker/CI/s3/daemon-manager.yml
#	docker/CI/s3/docker-compose-patch.yml
#	docker/CI/s3/server.yml
#	docker/CI/s3/tso.yml
#	docker/CI/s3/worker.yml
#	docker/CI/single-server/cnch-config.yml
#	docker/CI/single-server/daemon-manager.yml
#	docker/CI/single-server/tso.yml
#	docker/docker-compose/byconity-multi-cluster/resource-manager.yml
#	docker/docker-compose/byconity-multiworkers-cluster/resource-manager.yml
#	docker/docker-compose/byconity-simple-cluster/resource-manager.yml
#	docker/docker-compose/byconity-simple-cluster/server.yml
#	docker/docker-compose/byconity-simple-cluster/worker.yml
#	src/Storages/IngestColumnCnch/IngestColumnCnch.cpp
 2024-04-26 17:35:32 +08:00
fanqi1909 047711963c Merge branch 'read_tuple_as_json_object' into 'cnch-dev' 
feat(clickhousech@m-3412038072):read named tuple from json

See merge request dp/ClickHouse!20952
 2024-04-26 16:09:15 +08:00
fanqi1909 21bda3cd0c Merge 'cherry-pick-d1b0ed54-2' into 'cnch-dev' 
fix(optimizer@m-3000537417): fix bitmap index not pushed down

See merge request: https://code.byted.org/dp/ClickHouse/merge_requests/20993
 2024-04-26 15:15:02 +08:00
fanqi1909 d7cf8b66c1 Merge 'dog-cnch-ce-override-histogram' into 'cnch-dev' 
fix(optimizer@m-3459430016): delete legacy histogram when re-collect stats without histogram

See merge request: https://code.byted.org/dp/ClickHouse/merge_requests/20997
 2024-04-26 15:14:32 +08:00
fanqi1909 b16b15c932 Merge branch 'fix_explain_error_info_cnchdev' into 'cnch-dev' 
fix(optimizer@m-3348274178): fix explain error info

See merge request dp/ClickHouse!20923
# Conflicts:
#	tests/queries/0_ce_problematic_stateless/01076_predicate_optimizer_with_view.sql
 2024-04-25 10:10:10 +08:00
fanqi1909 d96417ed2e Merge 'fix/fix_pushdown_projection_symbol_mapping_cnch_dev' into 'cnch-dev' 
fix(optimizer@m-3000935223): fix pushdown projection symbol mapping cnch-dev

See merge request: https://code.byted.org/dp/ClickHouse/merge_requests/20897
 2024-04-24 14:37:46 +08:00
fanqi1909 f3a55cf065 Merge '3348191561_cnch-dev' into 'cnch-dev' 
fix(optimizer@m-3348191561): Implement CrossJoinToUnion rule

See merge request: https://code.byted.org/dp/ClickHouse/merge_requests/20809
 2024-04-24 14:37:36 +08:00
fanqi1909 b3af37f902 Merge branch 'fix-too-deep-recursion-cnch-dev' into 'cnch-dev' 
fix(clickhousech@m-3047443070): fix too deep recursion cnch dev

See merge request dp/ClickHouse!20810
 2024-04-24 14:36:29 +08:00
jenrryyou 33c669cb08 fix(byconity@m-3359728725): Fix bug with LowCardinality in short-curcuit function evaluation Closes #1301 2024-04-22 11:39:55 +08:00
Dao e6e411adfa Merge 'fix/runtime_filter_typed_date_core_dump_cnch_dev' into 'cnch-dev' 
fix(optimizer@m-3347557629): fix runtime filter core dump in runtime for date type date cnch-dev

See merge request: https://code.byted.org/dp/ClickHouse/merge_requests/20835
 2024-04-12 10:22:22 +08:00
Dao 23db37814d Merge branch 'fix-dual' into 'cnch-dev' 
fix(clickhousech@m-3348198742): support mysql dual table

See merge request dp/ClickHouse!20811
 2024-04-11 16:20:18 +08:00
Dao 484ff57e5c Merge branch 'zema/cnch-dev-updateJoin' into 'cnch-dev' 
feat(clickhousech@m-3106204787): UPDATE JOIN

See merge request dp/ClickHouse!20684
 2024-04-11 16:20:07 +08:00
Dao a1e959f1c2 Merge 'fix_bitmap_index_check_in_cnchdev' into 'cnch-dev' 
fix(optimizer@m-3348236068): Fix bitmap index check

See merge request: https://code.byted.org/dp/ClickHouse/merge_requests/20786
 2024-04-11 14:21:19 +08:00
Dao 12bb05be9c Merge branch 'cnch-join-block-split' into 'cnch-dev' 
feat(clickhousech@m-3404807508): [CNCH] memory control on joined block

See merge request dp/ClickHouse!20820
# Conflicts:
#	src/Interpreters/HashJoin.cpp
 2024-04-11 11:08:04 +08:00
Dao 6cff7215ba Merge branch 'add_fastprevauc_cnch' into 'cnch-dev' 
feat(clickhousech@m-3347623183): add udaf fastPrevAuc2 to handle the miduim results for fastAuc2

See merge request dp/ClickHouse!20731
 2024-04-09 13:33:30 +08:00
Dao f1d3ac44be Merge branch 'jiacheng.sun-add-replace-dml' into 'cnch-dev' 
feat(clickhousech@m-3178381607): Add parser logic for REPLACE INTO

See merge request dp/ClickHouse!20726
 2024-04-09 13:33:24 +08:00
Dao d64da1317e Merge branch 'fix_distinct_to_groupby_cnchdev' into 'cnch-dev' 
fix(optimizer@m-16951867): fix distinct to agg

See merge request dp/ClickHouse!20714
 2024-04-09 13:32:21 +08:00
Dao 549b502985 Merge 'lta@support_unique_table_append_mode4cnch_dev' into 'cnch-dev' 
feat(clickhousech@m-3346761095): unique table support append mode

See merge request: https://code.byted.org/dp/ClickHouse/merge_requests/20653
# Conflicts:
#	src/MergeTreeCommon/MergeTreeMetaBase.cpp
#	src/MergeTreeCommon/MergeTreeMetaBase.h
#	src/Storages/StorageCnchMergeTree.cpp
 2024-04-08 18:16:57 +08:00
Dao e2de5b9492 Merge branch 'jiacheng.sun-fix-mysql-rand' into 'cnch-dev' 
fix(clickhousech@m-14362905): Redirect rand to randCanonical in mysql mode

See merge request dp/ClickHouse!20696
 2024-04-08 16:02:14 +08:00
Dao f1252fe2d3 Merge branch 'mysql_fix' into 'cnch-dev' 
fix(clickhousech@m-3347641016): enhancement for MySQL DDL and DQL patch 2

See merge request dp/ClickHouse!20725
 2024-04-08 15:56:23 +08:00
Dao 853843f37b Merge 'fix-receiver-metrics-new' into 'cnch-dev' 
fix(clickhousech@m-3000919937): fix receiver metrics

See merge request: https://code.byted.org/dp/ClickHouse/merge_requests/18926
 2024-04-08 13:54:58 +08:00
Dao 00220fbc62 Merge 'mysql_fix' into 'cnch-dev' 
fix(clickhousech@m-3347641016): enhancement for MySQL DDL and DQL

See merge request: https://code.byted.org/dp/ClickHouse/merge_requests/20620
 2024-04-04 16:25:31 +08:00
Dao a35ab7f60b Merge 'not_do_constant_folding_for_complex_literals_cnch-dev' into 'cnch-dev' 
fix(clickhousech@m-3284084166): not do constant folding for complex literals cnch dev

See merge request: https://code.byted.org/dp/ClickHouse/merge_requests/20688
 2024-04-04 16:23:54 +08:00
Dao bcc11f8880 Merge 'wrong_num' into 'cnch-dev' 
fix(clickhousech@m-3298014142): fix the wrong logic when parallel size is worker number + 1

See merge request: https://code.byted.org/dp/ClickHouse/merge_requests/20544
 2024-04-04 10:25:52 +08:00
Dao 75d624affd Merge branch 'refactor_sql_binding_cnchdev' into 'cnch-dev' 
fix(optimizer@m-3179121605): Refactor sql binding

See merge request dp/ClickHouse!20636
 2024-04-04 10:24:02 +08:00
Dao 3f8293a1e7 Merge branch 'disable_bsp_shuffle_reduce_locality_enabled' into 'cnch-dev' 
fix(clickhousech@m-3347651074): disable bsp_shuffle_reduce_locality_enabled for now

See merge request dp/ClickHouse!20689
 2024-04-04 10:19:35 +08:00
Dao d1ac659261 Merge 'cherry-pick-comment' into 'cnch-dev' 
fix(clickhousech@m-3284060938): refactor move comment from storage to astcreate[cp]

See merge request: https://code.byted.org/dp/ClickHouse/merge_requests/20617
 2024-04-03 17:19:04 +08:00
Dao dcdb9e7684 Merge branch 'cnch_dev_part_prefetcher_support_map' into 'cnch-dev' 
fix(clickhousech@m-3260182100): part prefetcher support map Closes #1410

See merge request dp/ClickHouse!20426
 2024-04-03 17:19:04 +08:00
Dao 19abdd5313 Merge branch '3265473722_cnch_dev' into 'cnch-dev' 
fix(optimizer@m-3265473722):fix predicate pushdown ineffective bug

See merge request dp/ClickHouse!20514
 2024-04-03 14:45:56 +08:00
Dao 5ec5a22c0c Merge 'fix_mv_same_target_table' into 'cnch-dev' 
fix(clickhousech@m-17441741): fix serveral mv with same target table insert in worker side report error

See merge request: https://code.byted.org/dp/ClickHouse/merge_requests/20432
# Conflicts:
#	src/Storages/StorageCnchMergeTree.cpp
#	tests/queries/4_cnch_stateless_no_tenant/50010_direct_insert.sh
 2024-04-02 14:43:11 +08:00
Dao 8869f1c51a Merge branch 'cnch_jit_improve' into 'cnch-dev' 
feat(clickhousech@m-3323403556): cnch jit improve

See merge request dp/ClickHouse!20347
 2024-04-02 10:35:54 +08:00
Dao 9aabba8f73 Merge branch 'handle-data-overflow' into 'cnch-dev' 
feat(clickhousech@m-3057426540): Handle data overflow

See merge request dp/ClickHouse!20182
 2024-04-02 10:29:42 +08:00
Dao 6f6cd6da06 Merge branch 'cnch_2.0_JSONExtract_support_map' into 'cnch-dev' 
feat(clickhousech@m-16873951): cnch dev JSONExtract support map type

See merge request dp/ClickHouse!17798
 2024-04-01 13:36:58 +08:00
Dao 5e4be58904 Merge branch 'distributed_output' into 'cnch-dev' 
feat(clickhousech@m-3001165347): support distributed outfile in worker

See merge request dp/ClickHouse!20342
# Conflicts:
#	src/Analyzers/QueryAnalyzer.cpp
#	src/Core/Settings.h
#	src/Interpreters/InterpreterExplainQuery.cpp
#	src/Interpreters/InterpreterFactory.cpp
#	src/QueryPlan/GraphvizPrinter.cpp
 2024-03-28 15:15:41 +08:00
Dao fc6c43eaae Merge branch 'cnch_dev_str_to_map_support_nullable_string' into 'cnch-dev' 
feat(clickhousech@m-3260147567): cnch-dev str_to_map support nullable string

See merge request dp/ClickHouse!19618
 2024-03-27 17:39:21 +08:00
Dao c66b4e685c fix: fix unstable test 2024-03-27 17:36:45 +08:00
Dao 688c4e026b Merge 'feat/cnch-2.0-spark_hash_align' into 'cnch-dev' 
feat(clickhousech@m-3011597342): add function sparkHashSimple to align with Spark

See merge request: https://code.byted.org/dp/ClickHouse/merge_requests/19889
 2024-03-27 14:36:56 +08:00
Dao 5157bf15ee Merge branch 'city-hash-64' into 'cnch-dev' 
feat(clickhousech@m-3086277560): Merge branch 'exchange_nullable_mr' into 'cnch-dev'

See merge request dp/ClickHouse!20298
 2024-03-27 14:36:56 +08:00
Dao 7152ac9eb3 Merge 'cnch_dev_dedup_cancel_and_refinement' into 'cnch-dev' 
feat(clickhousech@m-17312186): Support dedup cancel and refinement

See merge request: https://code.byted.org/dp/ClickHouse/merge_requests/19541
# Conflicts:
#	src/CloudServices/CnchWorkerServiceImpl.cpp
#	src/CloudServices/CnchWorkerServiceImpl.h
 2024-03-26 18:40:39 +08:00
Dao Minh Thuc ef3e521c30
Merge pull request #1485 from ByConity/cherry-pick 
style: fix comment string.
 2024-03-26 18:33:01 +08:00
Dao 4651e9e0dc Merge 'fix/fix_tests_explain' into 'cnch-dev' 
fix(optimizer@m-3105120106): fix explain cost for tests

See merge request: https://code.byted.org/dp/ClickHouse/merge_requests/20479
 2024-03-26 15:28:25 +08:00
Dao 8911a0300a Merge branch 'fix_toInt_inf' into 'cnch-dev' 
fix(clickhousech@m-3001047433): Fixed Unexpected Integer conversion

See merge request dp/ClickHouse!20445
 2024-03-26 15:08:59 +08:00
Dao 7458d0f92e Merge branch 'cnch-insert-select-mr2' into 'cnch-dev' 
fix(clickhousech@m-3032975684): fix insert select can not parallel on non-unique table

See merge request dp/ClickHouse!20294
# Conflicts:
#	src/Core/Settings.h
 2024-03-26 15:08:08 +08:00
Dao 1f1adc2f9b Merge '3010071514_cnch_dev' into 'cnch-dev' 
feat(optimizer@m-3010071514): Support rewrite multiple-distinct aggregation to expand aggregate

See merge request: https://code.byted.org/dp/ClickHouse/merge_requests/20409
 2024-03-26 12:03:32 +08:00
Dao a4501cb016 Merge 'optimize_explain_cnchdev' into 'cnch-dev' 
fix(optimizer@m-3009798505): optimize explain info

See merge request: https://code.byted.org/dp/ClickHouse/merge_requests/20425
 2024-03-26 12:03:16 +08:00
Dao b5c7bf66c2 Merge branch 'fix_alter_test' into 'cnch-dev' 
fix(clickhousech@m-3158805678): Change alter test name

See merge request dp/ClickHouse!20203
 2024-03-26 12:02:38 +08:00
Dao eddf1d332e Merge branch 'mysql-ddl-latest' into 'cnch-dev' 
feat(clickhousech@m-3000222376): make columns nullable by default under mysql

See merge request dp/ClickHouse!19668
 2024-03-26 12:02:12 +08:00
Dao 01cdcf718b Merge 'cherry-pick-fetch-data-part-by-buckets' into 'cnch-dev' 
feat(clickhousech@m-3104314165): [cp] Dedup worker only get wanted bucket numbers' parts

See merge request: https://code.byted.org/dp/ClickHouse/merge_requests/20354
# Conflicts:
#	src/CloudServices/CnchServerClient.cpp
 2024-03-22 14:45:29 +08:00
Dao 10cc673516 Merge 'fix_async_mv_create_cnch_dev' into 'cnch-dev' 
fix(clickhousech@m-3015468153): remove validate during create , fix view rewrite , remove sync mv path

See merge request: https://code.byted.org/dp/ClickHouse/merge_requests/20328
# Conflicts:
#	src/DaemonManager/TargetServerCalculator.cpp
 2024-03-22 14:37:04 +08:00
Dao 9d2665c73e Merge 'fix/fix_column_pruning_with_nested_cte_ce_dev_cnch_dev' into 'cnch-dev' 
fix(optimizer@m-3012454190): fix column pruning for nested cte cnch-dev

See merge request: https://code.byted.org/dp/ClickHouse/merge_requests/20282
 2024-03-22 14:37:03 +08:00
Dao ec8f128bad Merge 'tostring_fix' into 'cnch-dev' 
fix(clickhousech@m-3018479783): Allow extra argument for toString

See merge request: https://code.byted.org/dp/ClickHouse/merge_requests/20280
 2024-03-22 14:37:03 +08:00
Dao a4875f44b3 Merge branch 'feat/semi_join_cnch_cp' into 'cnch-dev' 
feat(optimizer@m-3000649598): cherry-pick semi / anti  join support  in optimizer && adjust join order

See merge request dp/ClickHouse!19206
    # Conflicts:
    #	src/Analyzers/ExprAnalyzer.cpp
    #	src/Analyzers/QueryAnalyzer.cpp
    #	src/Analyzers/function_utils.cpp
    #	src/Optimizer/CardinalityEstimate/FilterEstimator.cpp
    #	src/Optimizer/CardinalityEstimate/JoinEstimator.cpp
    #	src/Optimizer/ExpressionDeterminism.cpp
    #	src/Optimizer/Property/PropertyMatcher.cpp
    #	src/Optimizer/Rewriter/BitEngineInfoDeriver.cpp
    #	src/Optimizer/Rewriter/RemoveApply.cpp
    #	src/Optimizer/Rule/Rules.cpp
    #	src/Optimizer/Rule/Transformation/MagicSetForAggregation.cpp
    #	src/Optimizer/Rule/Transformation/MagicSetPushDown.cpp
    #	src/Optimizer/Rule/Transformation/MagicSetPushDown.h
    #	src/QueryPlan/QueryPlanner.cpp
    #	tests/optimizers/tpcds/sql/create_table.sql
    #	tests/optimizers/tpch/sql/create_table.sql
 2024-03-22 11:36:57 +08:00
Dao 211f3ce677 Merge 'dao_cherry_pick' into 'cnch-dev' 
feat(clickhousech@m-16690828): apply where filter for cnch tables/columns tables to accelerate query speed

See merge request: https://code.byted.org/dp/ClickHouse/merge_requests/19985
# Conflicts:
#	src/Catalog/MetastoreProxy.cpp
#	src/Catalog/MetastoreProxy.h
#	src/Storages/System/StorageSystemCnchTables.cpp
 2024-03-21 19:10:39 +08:00
Dao ad96be10a4 Merge 'fix-table-definition-hash' into 'cnch-dev' 
fix(clickhousech@m-3033025866): Fix table_definition_hash and make it backward compatible

See merge request: https://code.byted.org/dp/ClickHouse/merge_requests/20163
# Conflicts:
#	src/MergeTreeCommon/assignCnchParts.cpp
#	src/Storages/MergeTree/CnchAttachProcessor.cpp
 2024-03-21 16:57:41 +08:00
Dao af20dc6d57 Merge 'remove_assumeNotNull_cnchdev' into 'cnch-dev' 
feat(optimizer@m-3012508396): fix remove redundant assumeNotNull

See merge request: https://code.byted.org/dp/ClickHouse/merge_requests/20155
 2024-03-21 16:57:40 +08:00
Dao e13bd9333a Merge 'fix_QueryAnalyzer_process_asterisk_fail_for_INSERT_query-cnch-dev' into 'cnch-dev' 
fix(clickhousech@m-3011570740): fix QueryAnalyzer process asterisk fail for INSERT query cnch dev

See merge request: https://code.byted.org/dp/ClickHouse/merge_requests/20137
 2024-03-21 16:57:40 +08:00
Dao 5396995f1e Merge 'cp-file-prune' into 'cnch-dev' 
fix(clickhousech@m-3047469692): Supports parquet native filter pushdown

See merge request: https://code.byted.org/dp/ClickHouse/merge_requests/20145
# Conflicts:
#	src/Core/Settings.h
#	src/Storages/Hive/HiveFile/HiveParquetFile.cpp
 2024-03-21 16:57:40 +08:00
Dao 75b9fd0270 Merge 'fix_share_common_expression_with_rf_cnch-dev' into 'cnch-dev' 
fix(clickhousech@m-3011587410): fix share common expression with rf cnch dev

See merge request: https://code.byted.org/dp/ClickHouse/merge_requests/20099
 2024-03-21 14:44:03 +08:00
Dao f263446ee6 Merge 'fix-gc-commit-time-cnch-dev' into 'cnch-dev' 
fix(clickhousech@m-3030754042): fix assert failure in part gc thread

See merge request: https://code.byted.org/dp/ClickHouse/merge_requests/20140
 2024-03-21 14:44:03 +08:00
Dao 805ee97274 Merge 'send-progress' into 'cnch-dev' 
feat(clickhousech@m-17104648): send progress in optimizer mode

See merge request: https://code.byted.org/dp/ClickHouse/merge_requests/19287
 2024-03-21 14:43:56 +08:00
Dao 717dde8eae Merge 'fix_combineDisjuncts_process_single_term-cnch-dev' into 'cnch-dev' 
fix(clickhousech@m-3012349519): fix combineDisjuncts process single term cnch dev

See merge request: https://code.byted.org/dp/ClickHouse/merge_requests/20131
 2024-03-21 10:56:03 +08:00
Dao db36550d0f Merge branch 'mv_push_filter_into_storage_cnchdev' into 'cnch-dev' 
fix(optimizer@m-3005181379): move pushFilterIntoStorage into IStorage

See merge request dp/ClickHouse!20066
# Conflicts:
#	src/MergeTreeCommon/MergeTreeMetaBase.cpp
#	src/MergeTreeCommon/MergeTreeMetaBase.h
 2024-03-19 19:24:15 +08:00
Dao 0f6cf5d2d6 Merge 'fix/fix_mv_match_cnch_dev' into 'cnch-dev' 
fix(clickhousech@m-3011612585): fix materialized view rewrite for unqiue table & view

See merge request: https://code.byted.org/dp/ClickHouse/merge_requests/20068
 2024-03-19 17:20:35 +08:00
Dao 6551c9bfc8 Merge 'cp_600712607489cefbf245dad56c6459ab248fb6ea' into 'cnch-dev' 
fix(clickhousech@m-16627925):add setting for return type of groupArray compatibility[cp]

See merge request: https://code.byted.org/dp/ClickHouse/merge_requests/20026
 2024-03-19 17:16:19 +08:00
Dao 2faaa4d2f6 Merge 'jiacheng.sun-add-aggregate-function-orderby' into 'cnch-dev' 
feat(clickhousech@m-14362905): Add aggregate function combinator OrderBy

See merge request: https://code.byted.org/dp/ClickHouse/merge_requests/19672
 2024-03-19 14:03:33 +08:00
Dao f87fd827d1 Merge branch 'jiacheng.sun-fix-union-table-header' into 'cnch-dev' 
fix(clickhousech@m-3011037279): fix union table header

See merge request dp/ClickHouse!19540
 2024-03-19 13:36:07 +08:00
Dao d686ff8117 Merge branch 'fix_datetime' into 'cnch-dev' 
fix(clickhousech@m-3000858675): enable single character of M-D hⓂ️s under mysql dialect

See merge request dp/ClickHouse!19459
 2024-03-19 13:36:07 +08:00
Dao 7f85aaca72 Merge branch 'rf' into 'cnch-dev' 
fix(clickhousech@m-16450238): enable runtime filter in bsp mode

See merge request dp/ClickHouse!19972
 2024-03-19 10:54:34 +08:00
Dao dcc5361616 Merge branch '3001048881_cnch_dev' into 'cnch-dev' 
fix(clickhousech@m-3001048881): add enable_add_projection_to_pruning setting

See merge request dp/ClickHouse!19605
# Conflicts:
#	src/Optimizer/Rewriter/ColumnPruning.cpp
#	tests/queries/4_cnch_stateless/48026_injective_in_property.reference
 2024-03-19 10:29:18 +08:00
Dao b304b7af52 Merge branch 'dog-cnch-ce-fix-outer-using' into 'cnch-dev' 
fix(optimizer@m-17553588): use better error msg for ANSI banning using in outer join

See merge request dp/ClickHouse!19991
 2024-03-18 16:21:37 +08:00
Dao d8d4360a4a Merge branch 'set-retry-enable-by-default' into 'cnch-dev' 
feat(clickhousech@m-3012490495): enable retry by default

See merge request dp/ClickHouse!19977
 2024-03-18 16:18:29 +08:00
Dao 2ef7420392 Merge branch '3011510549_cnch_dev' into 'cnch-dev' 
fix(clickhousech@m-3011510549): force UnifyNullableVisitor visit all plan nodes

See merge request dp/ClickHouse!19774
 2024-03-18 16:18:28 +08:00
Dao 37187b1039 Merge branch 'sql-cnch-dev' into 'cnch-dev' 
fix(clickhousech@m-3012494971): Commented out 4 SQL statements

See merge request dp/ClickHouse!19971
 2024-03-18 16:18:28 +08:00
Dao f879b39af1 Merge branch 'no_need_gather_in_insert_select_2' into 'cnch-dev' 
fix(optimizer@m-3010162633): no need gather in insert select

See merge request dp/ClickHouse!19692
 2024-03-18 13:32:34 +08:00
Dao cb4f33c4ae Merge branch 'zema/cnch-dev-minorUpdates' into 'cnch-dev' 
fix(clickhousech@m-16328206): minor updates for cnch

See merge request dp/ClickHouse!19789
# Conflicts:
#	src/Parsers/ASTCreateWorkerGroupQuery.cpp
 2024-03-18 13:32:34 +08:00
Dao 11850ac3a7 Merge branch 'cte_test' into 'cnch-dev' 
fix(clickhousech@m-3011768987): support shared cte in bsp mode

See merge request dp/ClickHouse!19808
 2024-03-18 11:37:06 +08:00
Dao 436596ec74 Merge branch 'fix_time_core' into 'cnch-dev' 
fix(clickhousech@m-3011856729): Fix time core

See merge request dp/ClickHouse!19905
 2024-03-14 16:53:29 +08:00
Dao 65d7849ee2 Merge branch 'fix-elementarray-map' into 'cnch-dev' 
fix(clickhousech@m-3011579754): Fix arrayElement for map column under MySQL

See merge request dp/ClickHouse!19913
 2024-03-14 14:23:52 +08:00
Dao 2ede4aedd3 Merge branch 'fix-overwrite-partition-view-rewrite' into 'cnch-dev' 
fix(clickhousech@m-3011858710): Fix TableFinishStep overwrite partition when there is view rewrite

See merge request dp/ClickHouse!19919
 2024-03-14 14:23:38 +08:00
Dao 7e14f09d10 Merge branch 'fix/materialized_view_rewrite_sync_mv' into 'cnch-dev' 
fix(clickhousech@m-3009810881): fix materialized view rewrite for sync materialized view

See merge request dp/ClickHouse!19719
# Conflicts:
#	src/Optimizer/Rewriter/MaterializedViewRewriter.cpp
#	src/Storages/StorageMaterializedView.cpp
 2024-03-14 14:21:01 +08:00
Dao f631d39bcd Merge branch 'fix-array-remove' into 'cnch-dev' 
feat(clickhousech@m-3000280096): fix array_remove and reverse function

See merge request dp/ClickHouse!19838
 2024-03-14 13:35:49 +08:00
Dao 5811655783 Merge branch 'fix_nullable_lc_convert_to_nullable' into 'cnch-dev' 
fix(optimizer@m-3010141722): fix_nullable_lc_convert_to_nullable

See merge request dp/ClickHouse!19649
 2024-03-14 09:47:21 +08:00
Dao c72ed891eb Merge branch 'dog-cnch-ce-fix-tealimit' into 'cnch-dev' 
fix(optimizer@m-3011859204): fix tealimit for ANSI

See merge request dp/ClickHouse!19850
 2024-03-13 18:23:35 +08:00
Dao 1514345dae Merge branch 'pick_read_json_as_string' into 'cnch-dev' 
fix(clickhousech@m-3011463128): pick input_format_json_read_objects_as_strings setting for compatibility

See merge request dp/ClickHouse!19799
# Conflicts:
#	src/Core/Settings.h
 2024-03-13 18:23:35 +08:00
Dao 7c56fffd35 Merge branch 'rewrite_filter_window_cnchdev' into 'cnch-dev' 
feat(optimizer@m-3011504871): rewrite filter window as sorting limit

See merge request dp/ClickHouse!19824
 2024-03-13 18:23:35 +08:00
Dao b6ecb29776 Merge branch 'fix_regexp' into 'cnch-dev' 
fix(clickhousech@m-3011944189): fix regexp and enable nullable column for char func

See merge request dp/ClickHouse!19825
 2024-03-13 15:34:02 +08:00
Dao 1032f1ec3b Merge branch 'fix_division_by_zero' into 'cnch-dev' 
fix(clickhousech@m-3011528029): Refactor division by zero and enable for mysql

See merge request dp/ClickHouse!19766
 2024-03-13 15:27:44 +08:00
Dao 517ec342a8 Merge branch 'cnch_fix_ci' into 'cnch-dev' 
fix(clickhousech@m-3011604666): Fixed LM unstable ci test

See merge request dp/ClickHouse!19718
 2024-03-13 13:37:36 +08:00
Dao cc6244896b Merge branch 'fix-alter_rename' into 'cnch-dev' 
fix(clickhousech@m-3011073672): Fix Alter Rename with DB Name

See merge request dp/ClickHouse!19713
 2024-03-13 13:37:36 +08:00
Dao 17bf0dcf66 Merge branch 'dialect_type' into 'cnch-dev' 
fix(clickhousech@m-3010848076): enable implicit type convert and case insensitive by default under mysql dialect

See merge request dp/ClickHouse!19482
 2024-03-12 19:39:27 +08:00
Dao bd086b1381 Merge branch 'fix/materialized_view_rewrite_order_by_key' into 'cnch-dev' 
fix(clickhousech@m-3009810881): fix materialized view rewrite for order by columns unstable tests

See merge request dp/ClickHouse!19785
 2024-03-12 17:37:21 +08:00
Dao 414654bc7d Merge branch 'fix/materialized_view_rewrite_order_by_key' into 'cnch-dev' 
fix(clickhousech@m-3009810881): fix materialized view rewrite for order by columns

See merge request dp/ClickHouse!19725
 2024-03-12 13:48:27 +08:00
Dao 10baaa6d5c Merge branch 'grace-hash-join-rehash-fix-cnch' into 'cnch-dev' 
fix(clickhousech@m-3001140632): fix bug when grace hash join rehash

See merge request dp/ClickHouse!19661
 2024-03-12 13:44:09 +08:00
Dao cc2e0411c1 Merge branch 'supportOutFileToDir' into 'cnch-dev' 
feat(clickhousech@m-3001107627): [To cnch-dev] Support outfile into directory

See merge request dp/ClickHouse!19462
# Conflicts:
#	src/IO/OutfileCommon.cpp
 2024-03-12 10:50:50 +08:00
Dao 340c9a70e0 Merge branch 'cnch_dev_fix_core_create_table_as' into 'cnch-dev' 
fix(clickhousech@m-3010170028): fix core create table as using unique key

See merge request dp/ClickHouse!19667
 2024-03-12 10:46:22 +08:00
Dao d8ea8cf306 Merge branch 'mv_async_multiple_table' into 'cnch-dev' 
feat(clickhousech@m-16264517):  materialized view support async refresh mode with multiple joins

See merge request dp/ClickHouse!17885
    # Conflicts:
    #	src/Catalog/Catalog.cpp
    #	src/Catalog/MetastoreProxy.h
    #	src/CloudServices/CnchServerClient.cpp
    #	src/Interpreters/DistributedStages/PlanSegmentManagerRpcService.cpp
    #	src/Interpreters/InterpreterInsertQuery.cpp
    #	src/Optimizer/MaterializedView/MaterializeViewChecker.cpp
    #	src/Optimizer/MaterializedView/MaterializeViewChecker.h
    #	src/Optimizer/Rewriter/MaterializedViewRewriter.cpp
    #	src/Optimizer/Rule/Rewrite/InlineProjections.cpp
    #	src/Optimizer/domain.cpp
    #	src/Parsers/ASTInsertQuery.h
    #	src/Parsers/ParserCreateQuery.cpp
    #	src/Protos/DataModelHelpers.cpp
    #	src/ResourceGroup/IResourceGroupManager.cpp
    #	src/Storages/BitEngineEncodePartitionHelper.cpp
    #	src/Storages/Hive/HivePartition.cpp
    #	src/Storages/MergeTree/CloudMergeTreeBlockOutputStream.cpp
    #	src/Storages/MergeTree/CloudMergeTreeBlockOutputStream.h
    #	src/Storages/StorageCnchMergeTree.cpp
    #	src/Storages/StorageCnchMergeTree.h
    #	src/Storages/StorageMaterializedView.cpp
    #	src/Storages/System/StorageSystemCnchPartsInfoLocal.cpp
    #	src/Transaction/ICnchTransaction.h
    #	tests/queries/4_cnch_stateless_no_tenant/48011_mv_match_rewrite_optimizer.sql
    #	tests/queries/4_cnch_stateless_no_tenant/50010_direct_insert.reference
    #	tests/queries/4_cnch_stateless_no_tenant/50010_direct_insert.sh
 2024-03-11 18:06:32 +08:00
Dao 16db1a5f9a Merge branch 'adb-ddl-alter-rebase' into 'cnch-dev' 
feat(clickhousech@m-3000222376): Add Support for MySQL DDL

See merge request dp/ClickHouse!19627
# Conflicts:
#	src/Interpreters/InterpreterFactory.cpp
 2024-03-08 14:43:02 +08:00
Dao 19ca430de3 Merge branch 'mysql-array-final' into 'cnch-dev' 
feat(clickhousech@m-3000280096): Support MySQL Array Functions (FINAL)

See merge request dp/ClickHouse!19628
# Conflicts:
#	src/Functions/array/arrayElement.cpp
 2024-03-08 14:35:17 +08:00
Dao d49d954659 Merge branch 'cnch_dev_fix_diskcache_right_mark_in_same_block' into 'cnch-dev' 
fix(clickhousech@m-3010951071): [cp] cnch dev fix disk cache total segments in single compressed block

See merge request dp/ClickHouse!19602
 2024-03-08 10:46:54 +08:00
Dao 91afb842c0 Merge branch 'fky@cnch-dev@ci@fix-jobs-concurrency' into 'cnch-dev' 
fix(clickhousech@m-3011054454): fix jobs concurrency

See merge request dp/ClickHouse!19569
# Conflicts:
#	.codebase/pipelines/ci.yaml
#	tests/queries/skip_list.json
 2024-03-08 10:45:04 +08:00
Dao 3a177f2002 Merge branch 'cnchdev_fix_sorting_proto' into 'cnch-dev' 
fix(optimizer@m-3000647987): fix SortingStep proto

See merge request dp/ClickHouse!19624
 2024-03-08 10:34:28 +08:00
Dao Minh Thuc 023ca3cd21
Merge pull request #1292 from ByConity/cherry-pick1 
feat: Prepared Statement
 2024-03-07 21:08:29 +08:00
Dao a08037f299 Merge branch 'prepared_statement_cnchdev' into 'cnch-dev' 
feat(optimizer@m-3000647987): Prepared Statement

See merge request dp/ClickHouse!19511
 2024-03-07 18:03:38 +08:00
Dao 4fee1ca95e fix: mysql integration test 2024-03-07 17:17:42 +08:00
Dao 6c2a0e99f3 Merge branch 'fky@cnch-ce-merge@ci@mysql' into 'cnch-dev' 
ci(clickhousech@m-17456259): support test environment for materialized mysql.

See merge request dp/ClickHouse!18328
 2024-03-07 15:42:13 +08:00
Dao d0a11969e9 Merge branch 'support_object_type_in_json_func' into 'cnch-dev' 
feat(clickhousech@m-3000280096):json functions support Object(JSON)

See merge request dp/ClickHouse!19308
# Conflicts:
#	tests/queries/0_ce_problematic_stateless/01889_sql_json_functions.reference
#	tests/queries/0_ce_problematic_stateless/01889_sql_json_functions.sql
 2024-03-07 14:14:02 +08:00
Dao 066a0ac033 Merge branch 'zema/cnch-dev-mysqlAllowNullableTTLType' into 'cnch-dev' 
feat(clickhousech@m-3000280132): support nullable date type for TTL

See merge request dp/ClickHouse!19472
 2024-03-06 16:49:33 +08:00
Dao 27b933b870 Merge branch 'number_matters' into 'cnch-dev' 
fix(clickhousech@m-3009842771): respect parallel index of map task while registring brpc receivers

See merge request dp/ClickHouse!19542
 2024-03-06 14:56:47 +08:00
Dao Minh Thuc 0fd4c96445
Merge pull request #1269 from ByConity/cherry-pick1 
fix: "X.Y.Z" format column query support in multi-tenant enviornment
 2024-03-05 17:32:24 +08:00
Dao d3aab053b4 test: testing remote function to community clickhouse 2024-03-05 16:53:37 +08:00
Dao def66c55fb Merge branch 'fix_ci' into 'cnch-dev' 
feat(clickhousech@m-3000613267): fix ci

See merge request dp/ClickHouse!19578
# Conflicts:
#	tests/queries/4_cnch_stateless/48026_injective_in_property.reference
 2024-03-05 15:37:23 +08:00
Dao 09a45ed660 Merge branch 'tenant_opt_dottedcol' into 'cnch-dev' 
fix(clickhousech@m-3010311700):  "X.Y.Z" format column query support in multi-tenant enviornment

See merge request dp/ClickHouse!19517
# Conflicts:
#	src/Parsers/formatTenantDatabaseName.cpp
 2024-03-05 13:40:37 +08:00
Dao c2e4e8f1ca Merge branch 'attribution_analysis_upgrade' into 'cnch-dev' 
feat(clickhousech@m-12626005): upgrade aggregate function attributionAnalysis

See merge request dp/ClickHouse!19395
 2024-03-05 13:40:37 +08:00
Dao a9bf18fefa Merge branch 'tuple_prop_2.0' into 'cnch-dev' 
feat(clickhousech@m-3000613267): change injective check

See merge request dp/ClickHouse!19390
 2024-03-05 13:40:31 +08:00
Dao Minh Thuc 688b83bd7c
Merge pull request #1264 from ByConity/dao_add_nightly_external_test 
feat: add nightly integration test
 2024-03-04 22:22:32 +08:00
Dao 965d72813d feat: add nightly integration test 2024-03-04 18:19:46 +08:00
Dao 985d356232 Merge branch '3005422636_cnch_dev' into 'cnch-dev' 
fix(optimizer@m-3005422636): make union input/output stream nullable data type consistent

See merge request dp/ClickHouse!19513
 2024-03-04 17:30:15 +08:00
Dao 975863ae7f Merge branch 'cnch_dev_gz_system' into 'cnch-dev' 
feat(clickhousech@m-3000561362): optimize query system tables/databases when tenant is set

See merge request dp/ClickHouse!19095
# Conflicts:
#	tests/queries/4_cnch_stateless/01161_information_schema.reference
 2024-03-04 14:32:05 +08:00
Dao 935852d85d Merge branch 'zema/cnch-dev-cpQueryBasicMutationInfo' into 'cnch-dev' 
feat(clickhousech@m-3000935786): [cp] allow to get basic mutation info without accessing MergeMutateThread

See merge request dp/ClickHouse!19331
 2024-03-04 13:42:18 +08:00
Dao a44aefec8f Merge branch 'zema/cnch-dev-fixDropPartitionWhere' into 'cnch-dev' 
fix(clickhousech@m-3010134014): throw exception when DROP PARTITION WHERE contains no partition key

See merge request dp/ClickHouse!19461
 2024-03-04 10:43:57 +08:00
Dao 10cd54b142 Merge branch 'fix_dump_issues_cnchdev' into 'cnch-dev' 
fix(optimizer@m-3000801032): fix workload dump issues

See merge request dp/ClickHouse!19455
 2024-02-26 16:45:45 +08:00
Dao 1cf8f4693a Merge branch 'cnch_dev_mysql_insert_into_throw' into 'cnch-dev' 
feat(clickhousech@m-3000280132): finish insert into throw setting

See merge request dp/ClickHouse!19376
 2024-02-23 16:31:32 +08:00
Dao 22ea95e9c2 Merge branch 'support_ast_in_domain_translator_cnch' into 'cnch-dev' 
feat(optimizer@m-16964266): support ast ptr in domain translator

See merge request dp/ClickHouse!19419
 2024-02-23 14:37:42 +08:00
Dao b530fd76b6 Merge branch 'fix_mutation_assert' into 'cnch-dev' 
fix(clickhousech@m-15668541):  fix mutation conflict

See merge request dp/ClickHouse!19310
# Conflicts:
#	src/Core/Settings.h
 2024-02-23 11:30:17 +08:00
Dao 341cbf5402 Merge branch 'fix_adddate' into 'cnch-dev' 
fix(clickhousech@m-3000990961): fix adddate for implicit type convert

See merge request dp/ClickHouse!19407
 2024-02-22 15:45:39 +08:00
Dao 4321d47170 Merge branch '3000820420_cnch_dev' into 'cnch-dev' 
fix(optimizer@m-3000820420): SingleDistinctAggregationToGroupBy support multiple input arguments

See merge request dp/ClickHouse!19403
 2024-02-22 15:44:28 +08:00
Dao 87291ed7f9 Merge branch 'optimizer-handle-non-deterministic-function-better-cnch-dev' into 'cnch-dev' 
fix(clickhousech@m-3001200917): optimizer handle non deterministic function better cnch dev

See merge request dp/ClickHouse!19379
# Conflicts:
#	src/Analyzers/QueryAnalyzer.cpp
#	src/QueryPlan/QueryPlanner.cpp
#	src/QueryPlan/TranslationMap.cpp
 2024-02-22 14:26:38 +08:00
Dao fdcebfb0f8 Merge branch 'fix_over20' into 'cnch-dev' 
fix(clickhousech@m-3000856904): fix parse datetime best effort more than 20 fractional digits

See merge request dp/ClickHouse!19361
 2024-02-21 19:08:29 +08:00
Dao 577fe977b9 Merge branch 'cnch-mysql-sync-1' into 'cnch-dev' 
feat(clickhousech@m-3000223500): MySQL BI compatibility improvements

See merge request dp/ClickHouse!18954
 # Conflicts:
 #	docs/en/operations/settings/settings.md
 #	docs/en/operations/system-tables/part_log.md
 #	docs/en/sql-reference/statements/show.md
 #	src/Core/Settings.h
 #	tests/queries/0_ce_problematic_stateless/01114_database_atomic.reference
 #	tests/queries/0_ce_problematic_stateless/01114_database_atomic.sh
 #	tests/queries/0_ce_problematic_stateless/01834_alias_columns_laziness_filimonov.reference
 #	tests/queries/0_ce_problematic_stateless/01834_alias_columns_laziness_filimonov.sh
 #	tests/queries/4_cnch_stateless/01161_information_schema.reference
 2024-02-21 19:08:13 +08:00
Dao 6a15fcc174 Merge branch 'date_overflow_adapt' into 'cnch-dev' 
feat(clickhousech@m-3000280096): Handle overflow date under MySQL dialect

See merge request dp/ClickHouse!19103
# Conflicts:
#	src/Common/ErrorCodes.cpp
 2024-02-21 14:33:54 +08:00
Dao 9e9bb55e66 Merge branch 'cnch-agg-spill-too-many-files' into 'cnch-dev' 
fix(clickhousech@m-16629230): fix external agg spills too many small files

See merge request dp/ClickHouse!19293
# Conflicts:
#	tests/queries/0_ce_problematic_stateless/01231_distributed_aggregation_memory_efficient_mix_levels.sql
 2024-02-20 19:38:35 +08:00
Dao 222326213e Merge branch 'fky@cnch-dev@fix@dedup_active_tables' into 'cnch-dev' 
fix(clickhousech@m-3000697893): dedup active tables when query cnch_parts_info.

See merge request dp/ClickHouse!19298
 2024-02-20 15:58:33 +08:00
Dao 354c545931 Merge branch 'support_more_output_type_dev' into 'cnch-dev' 
fix(clickhousech@m-17402374): support more output type dev

See merge request dp/ClickHouse!19010
# Conflicts:
#	src/Core/Settings.h
#	src/Interpreters/Context.cpp
#	src/Processors/Formats/Impl/ORCBlockInputFormat.cpp
#	src/Processors/Formats/Impl/ORCBlockInputFormat.h
#	src/Storages/Hive/HiveFile/HiveORCFile.cpp
 2024-02-20 14:26:04 +08:00
Dao 186311e5e1 Merge branch 'fix-time-diff' into 'cnch-dev' 
fix(clickhousech@m-3000884848): Fix timediff function under mysql mode

See merge request dp/ClickHouse!19279
 2024-02-20 14:18:26 +08:00
Dao Minh Thuc 79eabe0e6a
Merge pull request #1098 from blueskygzhz/ddl_check 
disable String to Array(XXX) CAST  at ddl modify column Scenario
 2024-02-19 10:28:40 +08:00
blueskygzhz c73ffa15ed add more test cases 2024-02-18 16:20:36 +08:00
blueskygzhz ca948cb686 add debug 2024-02-18 15:12:54 +08:00
blueskygzhz 1f018ce8cf add error case 2024-02-18 14:20:37 +08:00
blueskygzhz 808147f02b add test cases 2024-02-18 10:27:06 +08:00
Dao a92b78caca Merge branch 'pick-fusionMerge-cnch-dev' into 'cnch-dev' 
feat(clickhousech@m-3005428041): pick fusionMerge cnch dev

See merge request dp/ClickHouse!19269
 # Conflicts:
 #	src/Analyzers/QueryRewriter.cpp
 #	src/Interpreters/trySetVirtualWarehouse.cpp
 2024-02-08 15:26:29 +08:00
Dao 748a1e1ba7 Merge branch 'cherry-pick-853e8717-2' into 'cnch-dev' 
fix(clickhousech@m-15221885): fix quantileTDigestWithSSize

See merge request dp/ClickHouse!19264
 2024-02-08 15:22:59 +08:00
Dao dd657247bf Merge branch 'dialect_type_not_set_join_use_nulls_cnch-dev' into 'cnch-dev' 
fix(clickhousech@m-3001103382): dialect type not set join use nulls cnch dev

See merge request dp/ClickHouse!19122
 2024-02-08 15:22:59 +08:00
Dao dde7551cd7 ci: fix 50010_direct_insert 2024-02-08 15:22:59 +08:00
Dao 5463fb7041 Merge branch 'jiacheng.sun-refactor-sec-time' into 'cnch-dev' 
fix(clickhousech@m-3000280004): Add additional precision to sec time conversions

See merge request dp/ClickHouse!19144
 2024-02-08 10:36:39 +08:00
Dao 5f7d437767 Merge branch 'jiacheng.sun-fix-mysql-rlike-cnch' into 'cnch-dev' 
fix(clickhousech@m-14496110): Fix mysql function RLIKE

See merge request dp/ClickHouse!19091
 2024-02-08 10:36:27 +08:00
Dao 3836d11c78 Merge branch 'zema/cnch-dev-fixCIOptimizeQuery' into 'cnch-dev' 
fix(clickhousech@m-3001029266): fix 10120_optimize_query

See merge request dp/ClickHouse!19050
 2024-02-08 10:35:54 +08:00
Dao 1ac65776e2 Merge branch 'feat-detach-table-error-code' into 'cnch-dev' 
feat(clickhousech@m-3005189430): Add TABLE_IS_DETACHED error code and message

See merge request dp/ClickHouse!19233
# Conflicts:
#	src/Interpreters/DatabaseCatalog.cpp
 2024-02-07 20:21:35 +08:00
Dao e4fe3e0151 Merge branch 'boke' into 'cnch-dev' 
feat(clickhousech@m-17601052): Boke requirements

See merge request dp/ClickHouse!18570
# Conflicts:
#	src/Analyzers/QueryAnalyzer.cpp
#	src/Interpreters/DistributedStages/PlanSegmentManagerRpcService.cpp
#	tests/queries/0_ce_problematic_stateless/01677_bit_float.sql
 2024-02-07 16:28:17 +08:00
Dao afb6363948 Merge branch '3001200837_cnch_dev' into 'cnch-dev' 
feat(optimizer@m-3001200837): fix ReadStorageRowCountStep bug

See merge request dp/ClickHouse!19148
 2024-02-07 16:28:17 +08:00
Dao 9652c1a0e5 Merge branch 'add_enbale_skip_index' into 'cnch-dev' 
feat(clickhousech@m-12937808): enhance skip index

See merge request dp/ClickHouse!19069
# Conflicts:
#	src/Core/Settings.h
 2024-02-07 16:28:17 +08:00
Dao 0d204d9e45 test: improve 50010_direct_insert test 2024-02-07 14:57:42 +08:00
Dao 813624af12 Merge branch 'feat/optimizer_distributed_aggregation_memory_efficient_cnch_dev' into 'cnch-dev' 
feat(optimizer@m-3000763312): support distributed_aggregation_memory_efficient in optimizer cnch-dev

See merge request dp/ClickHouse!19124
 # Conflicts:
 #	src/Optimizer/Rule/Rewrite/PushAggThroughJoinRules.cpp
 #	src/Optimizer/Rule/Rewrite/PushPartialStepThroughExchangeRules.cpp
 #	src/QueryPlan/GraphvizPrinter.cpp
 2024-02-06 22:24:26 +08:00
Dao d88be4590c Merge branch 'jiacheng.sun-fix-mysql-timestamp-diff' into 'cnch-dev' 
fix(clickhousech@m-3000280004): fix mysql timestamp_diff

See merge request dp/ClickHouse!18439
 # Conflicts:
 #	src/Functions/dateDiff.cpp
 2024-02-06 22:24:14 +08:00
Dao af93b5167e Merge branch 'real' into 'cnch-dev' 
fix(clickhousech@m-3000945388): set real parallel size for plan segment

See merge request dp/ClickHouse!19034
 2024-02-06 14:09:45 +08:00
Dao 6d55fe5814 Merge branch 'cnchdev_fix_ci_baiyang.cby' into 'cnch-dev' 
fix(clickhousech@m-3001169037): fix 10054_mv_refresh.sql

See merge request dp/ClickHouse!19106
 2024-02-06 12:03:09 +08:00
Dao fc2299c275 Merge branch 'fix/local_runtime_filter_core' into 'cnch-dev' 
fix(optimizer@m-3001161008): fix local runtime filter core dump

See merge request dp/ClickHouse!19098
 2024-02-05 16:38:52 +08:00
Dao 32afd5bd98 Merge branch 'cnch-mysql-sync-jan25' into 'cnch-dev' 
feat(clickhousech@m-3000223500): MySQL BI compatibility improvements

See merge request dp/ClickHouse!18912
 2024-02-02 17:45:36 +08:00
Dao 951b75a5c6 Merge branch 'dog-cnch-ce-implicit-columns' into 'cnch-dev' 
feat(optimizer@m-15948935): statistics support implicit columns

See merge request dp/ClickHouse!19019
# Conflicts:
#	src/Catalog/MetastoreProxy.h
#	src/Core/Settings.h
#	src/Statistics/CatalogAdaptor.cpp
#	src/Statistics/CatalogAdaptorCnch.cpp
 2024-02-02 14:01:43 +08:00
Dao 6b0540475a Merge branch 'jiacheng.sun-fix-mysql-from-base64' into 'cnch-dev' 
fix(clickhousech@m-3000280004): fix mysql FROM_BASE64

See merge request dp/ClickHouse!18506
 2024-02-02 13:47:30 +08:00
Dao 7f4f722ab7 Merge branch 'jiacheng.sun-fix-mysql-unix-timestamp' into 'cnch-dev' 
fix(clickhousech@m-3000280004): fix mysql unix_timestamp

See merge request dp/ClickHouse!18501
 2024-02-02 13:47:30 +08:00
Dao c390368688 Merge branch 'jiacheng.sun-add-signed-integer-support-to-bitwise-op' into 'cnch-dev' 
fix(clickhousech@m-3000280004): Allow BIT_AND and similar bitwise aggregation functions to operate on signed integers

See merge request dp/ClickHouse!18522
 2024-02-02 13:47:30 +08:00
Dao Minh Thuc 49f1d50b73
Merge pull request #1133 from ByConity/cherry-pick3 
Daily cherry-pick from internal
 2024-02-02 13:46:25 +08:00
Dao 312ab6510d fix CI 2024-02-02 11:05:35 +08:00
Dao d140a1dba6 Merge branch 'fky@cnch-dev@fix@parts-info' into 'cnch-dev' 
fix(clickhousech@m-3000975442): improve parts_info's accuracy for unique table.

See merge request dp/ClickHouse!18973
 2024-02-01 22:56:15 +08:00
Dao 32d0597dc2 Merge branch 'cherry-pick-4eda2477' into 'cnch-dev' 
fix(optimizer@m-3000864511): fix RemoveRedundantSort with filling step

See merge request dp/ClickHouse!18892
 2024-02-01 22:51:05 +08:00
Dao e77c84986d Merge branch 'wuwen-case-insensitive-cnch' into 'cnch-dev' 
feat(clickhousech@m-16525748): MySQL Case Insensitive for CNCH

See merge request dp/ClickHouse!17762
# Conflicts:
#	src/Core/SettingsEnums.cpp
#	src/Core/SettingsEnums.h
#	src/Parsers/ASTQueryWithTableAndOutput.h
 2024-01-31 20:11:06 +08:00
Dao 4bfea6e863 Merge branch 'cnch-mysql-sync' into 'cnch-dev' 
feat(clickhousech@m-3000223500): MySQL BI compatibility improvements

See merge request dp/ClickHouse!18833
# Conflicts:
#	docker/CI/s3/server.yml
#	docker/docker-compose/byconity-simple-cluster/server.yml
#	docker/docker-compose/byconity-simple-cluster/worker.yml
#	programs/server/config.xml
#	src/Common/ErrorCodes.cpp
#	src/Server/MySQLHandler.cpp
 2024-01-31 20:08:17 +08:00
Dao 9428b9baeb Merge branch 'jiacheng.sun-fix-mysql-convert-tz-cnch' into 'cnch-dev' 
fix(clickhousech@m-3000280004): fix convert_tz to follow mysql

See merge request dp/ClickHouse!18617
 2024-01-31 18:15:43 +08:00
Dao b1f909276c Merge branch 'cnch-mysql-jsonmerge' into 'cnch-mysql-sync' 
Cnch mysql jsonmerge

See merge request dp/ClickHouse!18895
# Conflicts:
#	docs/en/sql-reference/functions/json-functions.md
#	src/Common/ErrorCodes.cpp
 2024-01-31 18:15:43 +08:00
Dao 56ef8a4d5b Merge branch 'cnch_dev_fix_non_default_enum' into 'cnch-dev' 
fix(clickhousech@m-3000581850): cnch dev fix non-standard default enum

See merge request dp/ClickHouse!18824
# Conflicts:
#	src/DataTypes/IDataType.cpp
 2024-01-31 17:28:26 +08:00
Dao 6f4b912758 Merge branch 'wuwen-add-bi-ddl' into 'cnch-dev' 
feat(clickhousech@m-3000223371): supoort schema cnch

See merge request dp/ClickHouse!18753
 2024-01-31 10:20:21 +08:00
Dao ab461fd224 Fix S3 CI 2024-01-30 17:03:37 +08:00
Dao 25bca53e9c Merge branch 'lm-cnch-ce-merge3' into 'cnch-dev' 
feat(clickhousech@m-17342812): merge-tree multi-stages reader

See merge request dp/ClickHouse!17778
# Conflicts:
#	tests/queries/0_ce_problematic_stateless/01786_explain_merge_tree.reference
 2024-01-30 14:03:19 +08:00
Dao 040aa53196 Merge branch 'jiacheng.sun-add-information-schema-cnch' into 'cnch-dev' 
feat(clickhousech@m-3000223371): add information schema

See merge request dp/ClickHouse!18538
 2024-01-30 11:08:54 +08:00
Dao d8fd3f71e2 fix CI 2024-01-29 15:45:07 +08:00
Dao 17b7823752 Merge branch 'remove_duplicate_predicate_in_cnchdev' into 'cnch-dev' 
feat(optimizer@m-3000287018): remove duplicate or predicate

See merge request dp/ClickHouse!18807
 2024-01-26 14:03:48 +08:00
Dao e271dc5a87 Merge branch 'fix/cnch_ce_optimier_cp' into 'cnch-dev' 
fix(optimizer@m-3000649598): fix UnifyNullableType don't handle cte

See merge request dp/ClickHouse!18773
 2024-01-26 14:03:35 +08:00
Dao 96b45132b2 Merge branch 'branch_3000662004' into 'cnch-dev' 
fix(optimizer@m-3000662004): set enable_optimizer default true, set enable_auto_query_forwarding default true

See merge request dp/ClickHouse!18673
# Conflicts:
#	.codebase/pipelines/ci.yaml
#	tests/queries/4_cnch_external_table/11008_no_ip_port_dictionary.sql
 2024-01-26 12:01:24 +08:00
Dao Minh Thuc de5bd273f9
Daily cherry-pick from internal (#1099) 
* Merge branch 'support_json_type' into 'cnch-ce-merge'

feat(clickhousech@m-13539135):support json type

See merge request dp/ClickHouse!15288
# Conflicts:
#	src/Analyzers/QueryRewriter.cpp
#	src/Catalog/Catalog.cpp
#	src/Catalog/Catalog.h
#	src/CloudServices/CnchServerServiceImpl.cpp
#	src/CloudServices/CnchWorkerResource.cpp
#	src/CloudServices/CnchWorkerServiceImpl.cpp
#	src/Common/config.h.in
#	src/DataStreams/ReadDictInputStream.cpp
#	src/Interpreters/ClusterProxy/SelectStreamFactory.cpp
#	src/Interpreters/DatabaseCatalog.cpp
#	src/Interpreters/TreeRewriter.cpp
#	src/MergeTreeCommon/MergeTreeMetaBase.h
#	src/Protos/DataModelHelpers.cpp
#	src/Protos/cnch_worker_rpc.proto
#	src/QueryPlan/PlanSegmentSourceStep.cpp
#	src/QueryPlan/TableScanStep.cpp
#	src/Storages/BitEngine/BitEngineHelper.cpp
#	src/Storages/BitEngineEncodePartitionHelper.cpp
#	src/Storages/MergeTree/MergeTreeSequentialSource.cpp
#	src/Storages/StorageCnchMergeTree.cpp
#	src/Storages/StorageCnchMergeTree.h
#	src/WorkerTasks/MergeTreeDataMerger.cpp
#	tests/queries/0_ce_problematic_stateless/01756_optimize_skip_unused_shards_rewrite_in.sql
 2024-01-26 10:38:39 +08:00
Dao c18331be5b Merge branch 'fix_grouping_set_no_merging' into 'cnch-ce-merge' 
fix(optimizer@m-3000478482): Fix grouping set no merging

See merge request dp/ClickHouse!18545
 2024-01-25 16:01:42 +08:00
Dao cc54625c9e Merge branch 'fix_not_grouping_key_eror-cnch-ce' into 'cnch-ce-merge' 
fix(clickhousech@m-3000541547): fix not grouping key error

See merge request dp/ClickHouse!18700
# Conflicts:
#	src/Analyzers/QueryRewriter.cpp
 2024-01-25 16:01:42 +08:00
Dao 47b065df4c Merge branch 'cnch_2.0_fix_get_map_keys_called_multi_times' into 'cnch-dev' 
fix(clickhousech@m-3000543045): fix getMapKeys called multi times

See merge request dp/ClickHouse!18730
 2024-01-25 14:27:46 +08:00
Dao e93ba59a04 Merge branch 'cnch-20-fix-tealimit' into 'cnch-ce-merge' 
fix(clickhousech@m-3000117435): try fix tealimit order by

See merge request dp/ClickHouse!18679
 2024-01-25 11:24:27 +08:00
Dao d270233116 Merge branch 'supportS3SeekCur' into 'cnch-ce-merge' 
feat(clickhousech@m-3000650351): ReadBufferFromS3 Support SEEK_CUR mode

See merge request dp/ClickHouse!18652
 2024-01-25 11:22:54 +08:00
Dao 2f17637d10 Merge branch 'cnch_2.0_fix_ci' into 'cnch-ce-merge' 
fix(clickhousech@m-3000659546): fix unstable testcase 10120

See merge request dp/ClickHouse!18651
# Conflicts:
#	tests/queries/4_cnch_stateless/10120_optimize_query.sql
 2024-01-24 17:41:14 +08:00
Dao 822b0658c6 Merge branch 'pick_into_cnch2.0' into 'cnch-ce-merge' 
feat(clickhousech@m-9746747): support aggregated funciton funnelPathSplit

See merge request dp/ClickHouse!18639
 2024-01-24 17:40:12 +08:00
Dao 23c1e921fa Merge branch 'refine_topn_filtering-cnch-ce' into 'cnch-ce-merge' 
feat(clickhousech@m-14514654): refine topn filtering

See merge request dp/ClickHouse!17682
# Conflicts:
#	src/Optimizer/QueryUseOptimizerChecker.cpp
 2024-01-24 16:23:31 +08:00
Dao 44950af350 diable test 00032_server_vw 2024-01-24 16:21:46 +08:00
Dao 2f71da5763 Merge branch 'cherry-pick-rewrite-unknown-left-join-identifier-cnch-ce' into 'cnch-ce-merge' 
fix(clickhousech@m-15095003): cherry pick rewrite unknown left join identifier

See merge request dp/ClickHouse!18664
 2024-01-24 14:17:18 +08:00
Dao 80c521204f Merge branch 'fix_cnch_hive_alter_server_vw_2.0' into 'cnch-ce-merge' 
fix(clickhousech@m-16503124): fix cnchhive alter cnch_server_vw

See merge request dp/ClickHouse!18486
 2024-01-24 14:13:46 +08:00
Dao 5902a6ee38 Merge branch 'cnch_ce_merge-gwmh-pick-funcs' into 'cnch-ce-merge' 
fix(clickhousech@m-3000278706): pick funcs/fixs

See merge request dp/ClickHouse!18628
 2024-01-24 14:12:36 +08:00
Dao d5700b20af Merge branch 'youzhiyuan_refine_plansegment_ser_deser_cnch_2_0' into 'cnch-ce-merge' 
feat(clickhousech@m-16351141): improve executing PlanSemgent performace

See merge request dp/ClickHouse!18642
# Conflicts:
#	src/Interpreters/Context.h
#	src/Interpreters/DistributedStages/PlanSegmentExecutor.cpp
#	src/Interpreters/DistributedStages/PlanSegmentManagerRpcService.cpp
#	src/Interpreters/DistributedStages/executePlanSegment.cpp
#	src/Interpreters/InterpreterExplainQuery.cpp
#	src/Interpreters/SegmentScheduler.cpp
 2024-01-24 11:14:28 +08:00
Dao a590540601 Merge branch 'cherry-pick-664f658c' into 'cnch-ce-merge' 
fix(clickhousech@m-17355229): Fix StartOfInterval Monotonic

See merge request dp/ClickHouse!18574
 2024-01-22 16:55:33 +08:00
Dao e952d40877 Merge branch 'cherry-pick-c2da51de' into 'cnch-ce-merge' 
fix(clickhousech@m-16417022): Fix ParseDatetime Coredump

See merge request dp/ClickHouse!18577
 2024-01-22 16:55:33 +08:00
Dao 1ae0e4b8f6 Merge branch 'cherry-pick-1.4-wj' into 'cnch-ce-merge' 
fix(clickhousech@m-16749121): Use MultiWrite for writeUndoBuffer & add flinkFieldHash fnv1aHash

See merge request dp/ClickHouse!18636
 2024-01-22 16:55:33 +08:00
Dao 8c4c2f7536 Merge branch 'cnch_2.0_map_community_compatible' into 'cnch-ce-merge' 
feat(clickhousech@m-12613915): compatible Byte map (KV) with community map

See merge request dp/ClickHouse!16367
# Conflicts:
#	src/Columns/ColumnByteMap.cpp
#	src/Columns/ColumnByteMap.h
#	src/Common/FieldVisitorWriteBinary.cpp
#	src/Core/Settings.h
#	src/DataTypes/DataTypeByteMap.cpp
#	src/DataTypes/DataTypeByteMap.h
#	src/DataTypes/Serializations/SerializationByteMap.cpp
#	src/DataTypes/Serializations/SerializationByteMap.h
#	src/Functions/FunctionsByteMap.cpp
#	src/Storages/MergeTree/MergeTreeDataPartWriterWide.cpp
#	src/Storages/MergeTree/MergeTreeDataWriter.cpp
#	src/Storages/MergeTree/MergeTreeIOSettings.h
#	src/Storages/StorageCloudMergeTree.cpp
#	src/Storages/StorageCnchMergeTree.cpp
#	src/WorkerTasks/MergeTreeDataMerger.cpp
#	tests/queries/4_cnch_problematic_stateless/00745_merge_tree_map.reference
#	tests/queries/4_cnch_problematic_stateless/00745_merge_tree_map.sh
#	tests/queries/4_cnch_stateless/00900_orc_arrow_parquet_maps.reference
#	tests/queries/4_cnch_stateless/00900_orc_arrow_parquet_maps.sh
#	tests/queries/4_cnch_stateless/01318_map_add_map_subtract_on_map_type.sql
#	tests/queries/4_cnch_stateless/01475_read_subcolumns_3.reference
#	tests/queries/4_cnch_stateless/01475_read_subcolumns_3.sql
#	tests/queries/4_cnch_stateless/01550_create_map_type.reference
#	tests/queries/4_cnch_stateless/01550_create_map_type.sql
#	tests/queries/4_cnch_stateless/01592_length_map.reference
#	tests/queries/4_cnch_stateless/01592_length_map.sql
#	tests/queries/4_cnch_stateless/01651_map_functions.reference
#	tests/queries/4_cnch_stateless/01651_map_functions.sql
#	tests/queries/4_cnch_stateless/01715_tuple_insert_null_as_default.reference
#	tests/queries/4_cnch_stateless/01715_tuple_insert_null_as_default.sql
#	tests/queries/4_cnch_stateless/01720_type_map_and_casts.reference
#	tests/queries/4_cnch_stateless/01720_type_map_and_casts.sql
#	tests/queries/4_cnch_stateless/01744_tuple_cast_to_map_bugfix.reference
#	tests/queries/4_cnch_stateless/01744_tuple_cast_to_map_bugfix.sql
#	tests/queries/4_cnch_stateless/01803_const_nullable_map.reference
#	tests/queries/4_cnch_stateless/01939_type_map_json.reference
#	tests/queries/4_cnch_stateless/01939_type_map_json.sql
#	tests/queries/4_cnch_stateless/02029_aggregate_function_session_split.reference
#	tests/queries/4_cnch_stateless/02029_aggregate_function_session_split.sql
#	tests/queries/4_cnch_stateless/10066_test_function_map.reference
#	tests/queries/4_cnch_stateless/10066_test_function_map.sql
 2024-01-22 10:57:19 +08:00
Dao 69454da01a Merge branch 'cherry-pick-ff49d6f9-3' into 'cnch-ce-merge' 
fix(clickhousech@m-3000544259): Fix Window Limit Push Down CNCH

See merge request dp/ClickHouse!18569
 2024-01-21 18:21:07 +08:00
Dao 3dfc2639fe Merge branch 'cnch2.0_read_subquery_result_by_name' into 'cnch-ce-merge' 
fix(optimizer@m-16556997): Subquery results are accessed by name

See merge request dp/ClickHouse!18482
 2024-01-21 15:58:23 +08:00
Dao b72d22ef6e disable test 2024-01-19 21:57:59 +08:00
Dao 6282e4860e fix build 2024-01-19 20:39:07 +08:00
Dao 52cbe1c4fa Merge branch 'cnch_ck23p3_alignment_4jan' into 'cnch-ce-merge' 
feat(clickhousech@m-16749763): Cnch ck23p3 alignment

See merge request dp/ClickHouse!18366
 2024-01-19 16:10:28 +08:00
Dao Minh Thuc 94408165ea
Merge pull request #1012 from blueskygzhz/master 
apply where filter for cnch tables/columns tables to accelerate query speed
 2024-01-18 16:48:27 +08:00
Dao 9637687bdb Merge branch 'cnch2.0_fix_header_column_type' into 'cnch-ce-merge' 
fix(optimizer@m-3000476822): column type in the header is inconsistent after ColumnPruning

See merge request dp/ClickHouse!18524
 2024-01-15 18:06:05 +08:00
Dao d4642951bd Merge branch 'rq_sync_ksam_1.4_feature' into 'cnch-ce-merge' 
feat(clickhousech@m-15672589): complete AVRO format and support for CnchKafka in cnch-2.0

See merge request dp/ClickHouse!18388
# Conflicts:
#	src/Storages/Kafka/IStorageCnchKafka.cpp
 2024-01-15 18:03:21 +08:00
Dao e454aebd51 Merge branch 'wuwen-fix-nullable-array' into 'cnch-ce-merge' 
fix(clickhousech@m-3000449731): Fix Nullable Array Join for CNCH-2.0

See merge request dp/ClickHouse!18444
# Conflicts:
#	tests/queries/0_stateless/50007_arrayJoin_test.reference
 2024-01-15 15:45:34 +08:00
Dao f2b415f3ea Merge branch 'fix/cnch-2.0-bitmap_parse' into 'cnch-ce-merge' 
fix(clickhousech@m-13860299): refactor BitMap64 parsing

See merge request dp/ClickHouse!18491
# Conflicts:
#	src/DataTypes/Serializations/SerializationBitMap64.cpp
 2024-01-15 15:42:54 +08:00
Dao 7343d5834f Merge branch 'fix/cnch-2.0-groupBitmap_arg_type_check' into 'cnch-ce-merge' 
fix(clickhousech@m-14305931): Prevent crash when passing wrong aggregation states to groupBitmap

See merge request dp/ClickHouse!18487
 2024-01-15 15:27:22 +08:00
Dao 3a017f3839 Merge branch 'enable_drop_staged_parts4cnch-ce-merge' into 'cnch-ce-merge' 
feat(clickhousech@m-17312186): enable detach/drop staged part/partition command

See merge request dp/ClickHouse!18331
# Conflicts:
#	src/Storages/StorageCnchMergeTree.cpp
 2024-01-15 15:11:23 +08:00
Dao 64d9af4a7d Merge branch 'zema/cnch-2.0-aggressiveMerge' into 'cnch-ce-merge' 
feat(clickhousech@m-16585448): [cp] set max merge concurrency based on number of workers & allow aggressive/final merge for small partition

See merge request dp/ClickHouse!18250
# Conflicts:
#	src/Storages/MergeTree/MergeTreeSettings.h
 2024-01-15 09:58:44 +08:00
Dao 5293240bdd Merge branch 'move_simple_reorder_join_into_cascades_in_cnch2.0' into 'cnch-ce-merge' 
feat(optimizer@m-15325949): Move simple reorder join into cascades

See merge request dp/ClickHouse!17831
# Conflicts:
#	src/Optimizer/Property/PropertyMatcher.cpp
 2024-01-12 14:28:43 +08:00
Dao eb6c807217 Merge branch 'fix_optimizer_join_1_equals_1-cnch-ce' into 'cnch-ce-merge' 
fix(clickhousech@m-3000251479): fix optimizer join 1 equals 1

See merge request dp/ClickHouse!18350
# Conflicts:
#	src/Core/Settings.h
#	src/Interpreters/HashJoin.cpp
 2024-01-12 11:00:59 +08:00
blueskygzhz d3b85d3bb9 fix count error 2024-01-11 11:33:19 +08:00
blueskygzhz c4acbc110b fix mispelling 2024-01-11 10:38:28 +08:00
blueskygzhz aab78a606f fix 50003 2024-01-11 10:10:38 +08:00
blueskygzhz 1753c65aa1 fix reference 2024-01-11 09:58:38 +08:00
blueskygzhz 41a8d1da7e Merge branch 'master' of github.com:blueskygzhz/ByConity 2024-01-11 09:33:01 +08:00
blueskygzhz 35c8df7a36 fix sql syntax 2024-01-11 09:30:51 +08:00
blueskygzhz 6ca3bc5682
Merge branch 'master' into master 2024-01-10 14:02:11 +08:00
Dao Minh Thuc 4905690b76
Merge pull request #1036 from ByConity/cherry-pick3 
Daily cherry-pick from internal
 2024-01-10 14:01:14 +08:00
blueskygzhz 72dd0fb055
Merge branch 'master' into master 2024-01-10 13:11:46 +08:00
blueskygzhz b621d06c88 add test cases 2024-01-10 12:56:29 +08:00
Dao 784d8318ae Merge branch 'dao_refine_query_cache' into 'cnch-ce-merge' 
fix(clickhousech@m-14990358): rework query cache for optimizer

See merge request dp/ClickHouse!18375
# Conflicts:
#	src/Interpreters/InterpreterSelectQueryUseOptimizer.cpp
#	src/Interpreters/executeQuery.cpp
 2024-01-09 19:30:00 +08:00
Dao eeb803c99b Merge branch 'insert_null_as_defaul_20' into 'cnch-ce-merge' 
feat(clickhousech@m-3000306421): fully support for insert_null_as_default

See merge request dp/ClickHouse!18392
# Conflicts:
#	src/Interpreters/InterpreterInsertQuery.cpp
#	tests/queries/0_ce_problematic_stateless/00690_insert_select_converting_exception_message.reference
#	tests/queries/0_ce_problematic_stateless/00690_insert_select_converting_exception_message.sh
 2024-01-09 17:19:01 +08:00
Dao edb65bf47c Merge branch 'cnch2.0_gz_fix' into 'cnch-ce-merge' 
fix(clickhousech@m-3000278348): fix compatibility issue in TTL expression

See merge request dp/ClickHouse!18377
 2024-01-08 20:20:04 +08:00
Dao 1f4d9f7854 Merge branch 'single_prop' into 'cnch-ce-merge' 
fix(clickhousech@m-17581940): union single property

See merge request dp/ClickHouse!18247
 2024-01-08 19:15:05 +08:00
Dao 91eec41923 Merge branch 'fix-tombstone-gc-cnch-ce' into 'cnch-ce-merge' 
fix(clickhousech@m-3000229994): fix a bug that tombstone may be trashed before covered parts

See merge request dp/ClickHouse!18330
 2024-01-08 19:15:05 +08:00
Dao 737460d277 Merge branch 'cherry-pick-76c60d8b' into 'cnch-ce-merge' 
fix(clickhousech@m-3000164509): [cp] cnch-ce-merge fix map parse null value

See merge request dp/ClickHouse!18322
# Conflicts:
#	src/Core/Settings.h
#	tests/queries/4_cnch_stateless/01550_type_map_formats.reference
 2024-01-08 16:47:00 +08:00
Dao 6ae812c14f Merge branch 'dog-cnch-ce-dev-intrusive-rewrite' into 'cnch-ce-merge' 
fix(optimizer@m-3000173583): rewrite arrayElement to mapElement in optimizer

See merge request dp/ClickHouse!18315
 2024-01-08 14:32:23 +08:00
Dao c294b836c2 Merge branch 'unequal_join_cnch_ce_merge' into 'cnch-ce-merge' 
feat(clickhousech@m-15770226): implement left (anti, semi, outer) , right(anti, semi, outer), inner join with unequal conditions

See merge request dp/ClickHouse!17801
# Conflicts:
#	src/Common/ProfileEvents.cpp
#	src/Interpreters/HashJoin.cpp
 2024-01-05 14:13:31 +08:00
Dao fa5d4c9d17 Merge branch 'jiashuo_fix-index-cache-miss' into 'cnch-ce-merge' 
fix(clickhousech@m-3000061803): fix index col cache miss

See merge request dp/ClickHouse!18248
 2024-01-05 10:28:38 +08:00
Dao a1738da94b Merge branch 'dao_stop_all_bg_jobs' into 'cnch-ce-merge' 
feat(clickhousech@m-17502109): control all bg threads

See merge request dp/ClickHouse!18157
 2024-01-04 20:35:44 +08:00
Dao 62a54eb915 Merge branch 'zema/cnch-2.0-fixAdaptiveGranu' into 'cnch-ce-merge' 
fix(clickhousech@m-17059632): skip adaptive load when index_granularities is empty & disable merge prefetcher for adaptive_granularity

See merge request dp/ClickHouse!17727
# Conflicts:
#	src/WorkerTasks/MergeTreeDataMerger.cpp
 2024-01-04 20:35:43 +08:00
Dao 7b421c3f33 Merge branch 'supportCompression' into 'cnch-ce-merge' 
feat(clickhousech@m-16252399): Add support for infile compression

See merge request dp/ClickHouse!18005
# Conflicts:
#	src/Interpreters/InterpreterInsertQuery.cpp
#	tests/queries/skip_list.json
 2024-01-04 20:35:43 +08:00
Dao 514188736a Merge branch 'join_default_shuffle_cnch-dev' into 'cnch-ce-merge' 
fix(optimizer@m-17459697): use replicated-join as default join shuffle, when statistics not exists

See merge request dp/ClickHouse!18172
 2024-01-04 19:13:58 +08:00
Dao 15c22ca691 Merge branch 'fix_create_view_bugs_cnch-ce' into 'cnch-ce-merge' 
fix(clickhousech@m-17508315): fix create view bugs

See merge request dp/ClickHouse!18200
# Conflicts:
#	src/Interpreters/InterpreterSelectQueryUseOptimizer.cpp
 2024-01-02 18:15:45 +08:00
Dao 6bb35276fa Merge branch 'cherry-pick-0f08b0d5' into 'cnch-ce-merge' 
fix(clickhousech@m-17266094): disable rename column with bitmap index

See merge request dp/ClickHouse!18116
 2024-01-02 15:13:02 +08:00
Dao 13c067429b Merge branch 'cnch_2.0_fix_map_parse_error_pop_back' into 'cnch-ce-merge' 
fix(clickhousech@m-17347277): [cp] cnch-2.0 fix map parse error pop back

See merge request dp/ClickHouse!18146
 2024-01-02 10:15:01 +08:00
Dao 157973cabd disabled 01001_alter_rename_column.sql 2024-01-02 10:13:50 +08:00
Dao e3545ecc0f fix(clickhousech@m-16269529): use the correct schema when doing merge 
* use the correct schema when doing merge
* fix testcase

https://code.byted.org/dp/ClickHouse/merge_requests/17768
 2024-01-02 10:09:16 +08:00
Dao 45ee1c31cf Merge branch 'retry' into 'cnch-ce-merge' 
feat(clickhousech@m-17386966): Support multiple instances of same plan segment on same node in bsp mode

See merge request dp/ClickHouse!17633
# Conflicts:
#	src/Interpreters/Context.cpp
 2023-12-29 16:37:43 +08:00
Dao 48b3efa2c1 Merge branch 'ship_norm_nullable' into 'cnch-ce-merge' 
feat(clickhousech@m-16673278): Normalize the representation of nullable types in ANSI mode

See merge request dp/ClickHouse!17351
 2023-12-29 10:45:16 +08:00
Dao 9aef48ea60 Merge branch 'fix_array_join_with_lambda-cnch-ce' into 'cnch-ce-merge' 
fix(clickhousech@m-17363291): fix array join with lambda

See merge request dp/ClickHouse!18091
 2023-12-27 13:42:01 +08:00