Commit Graph

2388 Commits

Author SHA1 Message Date
fredwang 1594e184f5 Merge branch 'zichun_add_nexusfs_p2' into 'cnch-dev'
feat(clickhousech@m-3000508658): add BufferManager and InodeManager to NexusFS

See merge request dp/ClickHouse!24109
# Conflicts:
#	.codebase/pipelines/ci.yaml
#	src/Disks/CloudFS/DiskCloudFS.cpp
#	src/Disks/DiskByteS3.cpp
#	src/Disks/HDFS/DiskByteHDFS.cpp
#	tests/queries/4_cnch_stateless/00474_readonly_settings.sh
2024-10-11 04:38:22 +00:00
fredwang d44e8fc44b Merge '547/cnch_metrics_ci' into 'cnch-dev'
ci(clickhousech@m-4770399785): add ci metric case

See merge request: !23853
# Conflicts:
#	docker/docker-compose/byconity-simple-cluster/worker.yml
2024-10-02 02:49:01 +00:00
Feng Kaiyu 79d4de2486 build: support to llvm16. 2024-09-27 18:00:07 +08:00
fredwang e5d4fe7297 Merge branch 'jiashuo_add-all-preload-index-dev' into 'cnch-dev'
fix(clickhousech@m-4770084743): support multi index preload

See merge request dp/ClickHouse!23524
# Conflicts:
#	docker/docker-compose/byconity-simple-cluster/worker.yml
#	src/Interpreters/PartLog.h
#	src/Storages/DiskCache/MetaFileDiskCacheSegment.cpp
#	src/Storages/MergeTree/MergeTreeDataPartCNCH.cpp
2024-09-27 07:43:48 +00:00
fredwang 35b5f0be1b fix compile/link error due to dependencies in docker image 2024-09-27 03:20:54 +00:00
fredwang e4f4b75917 fix ci 2024-09-20 06:29:38 +00:00
fredwang 6f2ca30ca5 Merge 'fky@cnch-dev@fix@tr-gc-with-sd-local' into 'cnch-dev'
fix(clickhousech@m-5165139004): sd local mode will lead to falsely deleting TR.

See merge request: !24184
2024-09-11 07:41:20 +00:00
fredwang bd4b6cad6d Merge branch 'lta@ETL_perf_optimize4cnch-dev' into 'cnch-dev'
feat(clickhousech@m-3012442647): optimize ETL perf for unique table

See merge request dp/ClickHouse!21744
# Conflicts:
#	src/CloudServices/CnchDataWriter.cpp
#	src/CloudServices/CnchWorkerClient.cpp
#	src/Core/Settings.h
#	src/MergeTreeCommon/MergeTreeMetaBase.cpp
#	src/MergeTreeCommon/MergeTreeMetaBase.h
#	src/Protos/cnch_worker_rpc.proto
#	src/Storages/BitEngineEncodePartitionHelper.cpp
#	src/Storages/MergeTree/CloudMergeTreeBlockOutputStream.h
#	src/Transaction/Actions/InsertAction.cpp
#	src/Transaction/Actions/InsertAction.h
#	src/Transaction/CnchWorkerTransaction.cpp
2024-08-29 05:36:32 +00:00
fredwang ac94f2ec99 Merge branch 'hive-partition-filter-cnch-dev' into 'cnch-dev'
fix(clickhousech@m-4086605550): Hive partition filter cnch dev

See merge request dp/ClickHouse!21900
2024-07-29 07:59:52 +00:00
fredwang a883e94540 Merge 'revert-2adc9e9b' into 'cnch-dev'
feat(clickhousech@m-3265377520): do not show information for system tables without rbac check

See merge request: https://code.byted.org/dp/ClickHouse/merge_requests/20724
# Conflicts:
#	.codebase/ci_scripts/cnch_config/1_single_server/config/server.xml
#	.codebase/ci_scripts/cnch_config/3_multiple_server/config/server0.xml
#	.codebase/ci_scripts/cnch_config/3_multiple_server/config/server1.xml
#	deploy/template/byconity-server.xml
#	docker/docker-compose/byconity-multiworkers-cluster/server.yml
#	docker/docker-compose/byconity-simple-cluster/server.yml
#	docker/docker-compose/byconity-simple-cluster/worker.yml
#	src/Access/AccessControlManager.cpp
#	src/Access/AccessControlManager.h
#	src/Access/ContextAccess.cpp
#	src/Access/ContextAccess.h
#	src/Interpreters/Context.cpp
#	src/Interpreters/Context.h
#	src/Storages/System/StorageSystemExternalTables.cpp
2024-07-22 07:52:22 +00:00
fredwang 28adb73aed fix sensitive permission ci 2024-07-12 03:50:48 +00:00
fredwang eb47ebbbe6 Merge branch 'feat-sensitive-permissions-dev' into 'cnch-dev'
feat(clickhousech@m-17322645): RBAC Sensitive Permissions

See merge request dp/ClickHouse!20380
# Conflicts:
#	programs/server/config.xml
#	src/Catalog/MetastoreProxy.h
2024-07-11 08:55:11 +00:00
fredwang 3761483b46 Merge branch 'fix-security' into 'cnch-dev'
fix(clickhousech@m-3878496073): move restrict tenant users to use certain functions out to become a cluster config

See merge request dp/ClickHouse!21508
# Conflicts:
#	docker/CI/multi-servers/server.yml
#	docker/CI/multi-servers/worker.yml
#	docker/CI/multi-workers/server.yml
#	docker/CI/s3/server.yml
#	docker/CI/s3/worker.yml
#	docker/docker-compose/byconity-multiworkers-cluster/server.yml
#	docker/docker-compose/byconity-simple-cluster/server.yml
#	docker/docker-compose/byconity-simple-cluster/worker.yml
#	programs/server/Server.cpp
2024-07-11 08:36:36 +00:00
fredwang 5e42f19ac0 update ci to set tenant_id
* add skip list
* fix test cases
2024-07-05 02:27:51 +00:00
skyoct 07c4e7f264 fix docker-compose docs 2024-06-27 12:14:30 +00:00
fanqi1909 b6e69fbf70 Merge 'cnch_dev_unique_table_support_system_log' into 'cnch-dev'
feat(clickhousech@m-3047891595): unique table support system log

See merge request: https://code.byted.org/dp/ClickHouse/merge_requests/20683
 Conflicts:
	.codebase/ci_scripts/cnch_config/1_single_server/config/server.xml
	.codebase/ci_scripts/cnch_config/1_single_server/config/worker0.xml
	.codebase/ci_scripts/cnch_config/1_single_server/config/worker1.xml
	.codebase/ci_scripts/cnch_config/2_backward_compability/config/server.xml
	.codebase/ci_scripts/cnch_config/2_backward_compability/config/worker1.xml
	.codebase/ci_scripts/cnch_config/3_multiple_server/config/server0.xml
	.codebase/ci_scripts/cnch_config/3_multiple_server/config/server1.xml
	.codebase/ci_scripts/cnch_config/3_multiple_server/config/worker0.xml
	.codebase/ci_scripts/cnch_config/3_multiple_server/config/worker1.xml
	deploy/template/byconity-worker.xml
	docker/CI/multi-servers/server.yml
	docker/CI/s3/server.yml
	docker/docker-compose/byconity-multiworkers-cluster/server.yml
	docker/docker-compose/byconity-simple-cluster/server.yml
	docker/docker-compose/byconity-simple-cluster/worker.yml
	programs/server/cnch-server.xml
2024-05-13 17:29:50 +08:00
fanqi1909 3c04794769 Revert "Merge branch 'zy_system_disable' into 'cnch-dev'"
This reverts commit f8da9209e7.
2024-05-06 17:30:20 +08:00
fanqi1909 da4d92aea6 Merge branch 'cch-cnch_dev-ingest-with-bucket' into 'cnch-dev'
feat(clickhousech@m-3348298112): Ingest with bucket

See merge request dp/ClickHouse!20774
# Conflicts:
#	docker/CI/docker-compose-s3.yml
#	docker/CI/docker-compose-single.yml
#	docker/CI/docker-compose.yml
#	docker/CI/multi-servers/cnch-config.yml
#	docker/CI/multi-servers/daemon-manager.yml
#	docker/CI/multi-servers/server.yml
#	docker/CI/multi-servers/tso.yml
#	docker/CI/multi-servers/worker.yml
#	docker/CI/s3/daemon-manager.yml
#	docker/CI/s3/docker-compose-patch.yml
#	docker/CI/s3/server.yml
#	docker/CI/s3/tso.yml
#	docker/CI/s3/worker.yml
#	docker/CI/single-server/cnch-config.yml
#	docker/CI/single-server/daemon-manager.yml
#	docker/CI/single-server/tso.yml
#	docker/docker-compose/byconity-multi-cluster/resource-manager.yml
#	docker/docker-compose/byconity-multiworkers-cluster/resource-manager.yml
#	docker/docker-compose/byconity-simple-cluster/resource-manager.yml
#	docker/docker-compose/byconity-simple-cluster/server.yml
#	docker/docker-compose/byconity-simple-cluster/worker.yml
#	src/Storages/IngestColumnCnch/IngestColumnCnch.cpp
2024-04-26 17:35:32 +08:00
fanqi1909 03d3051791
Merge pull request #1635 from ByConity/fky@master@fix@ci
ci: fix bin dir inside the docker.
2024-04-15 17:52:21 +08:00
Feng Kaiyu a670330bbc
ci: fix bin dir inside the docker. 2024-04-15 14:14:57 +08:00
Dao e65b2efd40 ci: fix unstable s3 ci 2024-04-11 13:46:28 +08:00
Dao 9fcddec04d testing: improve test image 2024-04-04 16:46:45 +08:00
Dao f8da9209e7 Merge branch 'zy_system_disable' into 'cnch-dev'
feat(clickhousech@m-3265377520): do not show information for system tables without rbac check

See merge request dp/ClickHouse!20474
# Conflicts:
#	.codebase/ci_scripts/cnch_config/1_single_server/config/server.xml
#	.codebase/ci_scripts/cnch_config/3_multiple_server/config/server0.xml
#	.codebase/ci_scripts/cnch_config/3_multiple_server/config/server1.xml
#	deploy/template/byconity-server.xml
#	docker/CI/multi-servers/server.yml
#	docker/CI/multi-workers/server.yml
#	docker/CI/s3/server.yml
#	docker/CI/s3/worker.yml
#	docker/docker-compose/byconity-multiworkers-cluster/server.yml
#	docker/docker-compose/byconity-simple-cluster/server.yml
#	docker/docker-compose/byconity-simple-cluster/worker.yml
#	src/Storages/System/StorageSystemExternalTables.cpp
2024-04-02 10:35:36 +08:00
Dao eb830fbac9 ci: fix ci 2024-03-25 11:54:31 +08:00
Feng Kaiyu 5600af962e
Merge pull request #1369 from ByConity/fky-ci-auto-release
Add an GitHub action for auto release.
2024-03-14 20:36:45 +08:00
Feng Kaiyu fe3e3a231b
ci: add action for auto release. 2024-03-14 15:42:53 +08:00
Dao f367513abd ci: use 2 write workers in CI 2024-03-14 15:37:43 +08:00
Dao b71032b25c Merge branch 'fky@cnch-dev@feat@additional-services' into 'cnch-dev'
feat(clickhousech@m-3011528179): support additional-services for fulltext search.

See merge request dp/ClickHouse!19761
# Conflicts:
#	docker/CI/multi-servers/worker.yml
#	docker/CI/s3/worker.yml
#	docker/docker-compose/byconity-multiworkers-cluster/server.yml
#	docker/docker-compose/byconity-simple-cluster/worker.yml
2024-03-13 15:32:58 +08:00
Dao 230ab989d6 fix: fix docker compose 2024-03-11 17:19:50 +08:00
Dao 8b1d0797d5 test: make mysql db init idempotent 2024-03-08 16:45:15 +08:00
Dao a41153389a test: debug compose integration 2024-03-08 15:58:58 +08:00
Dao 0ddfdab7cb test: increase start period for healthcheck for mysql in integration test 2024-03-08 11:54:50 +08:00
Dao a0e752f73b test: add health check for mysql db in integration test 2024-03-08 11:45:01 +08:00
Dao cb04d6ff09 test: fix mysql integration test docker compose 2024-03-07 19:35:36 +08:00
Dao 52452d2128 fix: mysql integration test docker compose 2024-03-07 17:29:31 +08:00
Dao 4fee1ca95e fix: mysql integration test 2024-03-07 17:17:42 +08:00
Dao 6c2a0e99f3 Merge branch 'fky@cnch-ce-merge@ci@mysql' into 'cnch-dev'
ci(clickhousech@m-17456259): support test environment for materialized mysql.

See merge request dp/ClickHouse!18328
2024-03-07 15:42:13 +08:00
Dao a68babc889 fix: nightly test docker compose 2024-03-06 11:26:35 +08:00
Dao 1b3072d049 fix: nightly test docker compose 2024-03-06 10:51:12 +08:00
Dao 683f37fb7a fix: nightly test docker compose 2024-03-05 18:47:31 +08:00
Dao d3aab053b4 test: testing remote function to community clickhouse 2024-03-05 16:53:37 +08:00
Dao 506b73d511 fix: github workflow for nightly integration test 2024-03-05 15:58:30 +08:00
Dao 4b03a13a4c fix: fix nightly integration test 2024-03-05 15:10:41 +08:00
Dao 965d72813d feat: add nightly integration test 2024-03-04 18:19:46 +08:00
Dao 4e18b43578 fix: fix docker compose 2024-02-21 16:24:05 +08:00
Dao 4e440aa60a fix ci 2024-02-06 10:19:23 +08:00
Dao 4bfea6e863 Merge branch 'cnch-mysql-sync' into 'cnch-dev'
feat(clickhousech@m-3000223500): MySQL BI compatibility improvements

See merge request dp/ClickHouse!18833
# Conflicts:
#	docker/CI/s3/server.yml
#	docker/docker-compose/byconity-simple-cluster/server.yml
#	docker/docker-compose/byconity-simple-cluster/worker.yml
#	programs/server/config.xml
#	src/Common/ErrorCodes.cpp
#	src/Server/MySQLHandler.cpp
2024-01-31 20:08:17 +08:00
Dao 040aa53196 Merge branch 'jiacheng.sun-add-information-schema-cnch' into 'cnch-dev'
feat(clickhousech@m-3000223371): add information schema

See merge request dp/ClickHouse!18538
2024-01-30 11:08:54 +08:00
Dao c24d7a466e add s3 ci 2024-01-29 14:46:47 +08:00
Dao bbf99a1176 Merge branch 'las-integ' into 'cnch-ce-merge'
fix(clickhousech@m-16576383): Las integ

See merge request dp/ClickHouse!17691
2024-01-21 18:23:58 +08:00