dify/api
-LAN- d3157b46ee
feat(large_language_model): Adds plugin-based token counting configuration option (#17706)
Signed-off-by: -LAN- <laipz8200@outlook.com>
Co-authored-by: Yeuoly <admin@srmxy.cn>
2025-04-09 20:52:58 +08:00
..
.idea fix nltk averaged_perceptron_tagger download and fix score limit is none (#7582) 2024-08-26 15:14:05 +08:00
.vscode feat/enhance the multi-modal support (#8818) 2024-10-21 10:43:49 +08:00
configs feat(large_language_model): Adds plugin-based token counting configuration option (#17706) 2025-04-09 20:52:58 +08:00
constants fix document extractor node incorrectly processing doc and ppt files (#12902) 2025-02-12 18:04:28 +08:00
contexts feat: Add caching mechanism for plugin model schemas (#14898) 2025-03-04 18:02:06 +08:00
controllers refactor: add API endpoint to list latest plugin versions and query it in a asynchronous way (#17695) 2025-04-09 17:49:27 +08:00
core feat(large_language_model): Adds plugin-based token counting configuration option (#17706) 2025-04-09 20:52:58 +08:00
docker Set default LOG_LEVEL to INFO for celery workers and beat (#13066) 2025-01-27 17:09:41 +08:00
events chore(quota): Update deduct quota (#14337) 2025-02-25 20:10:08 +08:00
extensions feat: cleanup free tenants expired data like messages/conversations/workflow_runs/workflow_node_executions (#16490) 2025-03-21 21:30:35 +08:00
factories fix: skip file format check of mime types for generated files by tools (#17455) 2025-04-05 10:29:14 +08:00
fields fix:weight_type missing when create document in dataset (#16503) 2025-03-22 20:21:57 +08:00
libs Update login.py (#15320) 2025-03-10 09:49:14 +08:00
migrations Fix Performance Issues: (#17083) 2025-04-09 11:22:53 +08:00
models Fix Performance Issues: (#17083) 2025-04-09 11:22:53 +08:00
schedule Fix function's name mismatch (#16681) 2025-03-25 10:25:15 +08:00
services refactor: add API endpoint to list latest plugin versions and query it in a asynchronous way (#17695) 2025-04-09 17:49:27 +08:00
tasks deal db session in celery worker (#17549) 2025-04-07 20:31:26 +08:00
templates feat: account delete (#11829) 2024-12-30 11:33:42 +08:00
tests FEAT: support Tencent vectordb to full text search (#16865) 2025-04-07 09:50:03 +08:00
.dockerignore Introduce Plugins (#13836) 2025-02-17 17:05:13 +08:00
.env.example feat(large_language_model): Adds plugin-based token counting configuration option (#17706) 2025-04-09 20:52:58 +08:00
.ruff.toml chore(api): enhance ruff rules to disallow dangerous functions and modules (#16461) 2025-03-21 17:49:35 +08:00
Dockerfile chore: remove useless doc and font (#15838) 2025-03-14 16:47:42 +08:00
README.md feat: update backend documentation (#13374) 2025-02-08 20:36:33 +08:00
app.py fix(app.py): if condition (#12314) 2025-01-03 01:36:23 +08:00
app_factory.py Fix/plugin race condition (#14253) 2025-02-25 12:20:47 +08:00
commands.py feat: support Tablestore vector database (#16601) 2025-03-27 15:53:33 +08:00
dify_app.py refactor: assembling the app features in modular way (#9129) 2024-11-30 23:05:22 +08:00
mypy.ini Remove the useless excluded item in mypy.ini (#16777) 2025-03-26 09:02:45 +08:00
poetry.lock chore: add script for running mypy type checks and speed up mypy checks in CI jobs (#17489) 2025-04-09 13:03:53 +08:00
poetry.toml build: initial support for poetry build tool (#4513) 2024-06-11 13:11:28 +08:00
pyproject.toml chore: add script for running mypy type checks and speed up mypy checks in CI jobs (#17489) 2025-04-09 13:03:53 +08:00
pytest.ini fix: add missing package xinference_client to pass vdb CI tests (#13865) 2025-02-17 23:37:49 +08:00

README.md

Dify Backend API

Usage

[!IMPORTANT] In the v0.6.12 release, we deprecated pip as the package management tool for Dify API Backend service and replaced it with poetry.

  1. Start the docker-compose stack

    The backend require some middleware, including PostgreSQL, Redis, and Weaviate, which can be started together using docker-compose.

    cd ../docker
    cp middleware.env.example middleware.env
    # change the profile to other vector database if you are not using weaviate
    docker compose -f docker-compose.middleware.yaml --profile weaviate -p dify up -d
    cd ../api
    
  2. Copy .env.example to .env

    cp .env.example .env 
    
  3. Generate a SECRET_KEY in the .env file.

    bash for Linux

    sed -i "/^SECRET_KEY=/c\SECRET_KEY=$(openssl rand -base64 42)" .env
    

    bash for Mac

    secret_key=$(openssl rand -base64 42)
    sed -i '' "/^SECRET_KEY=/c\\
    SECRET_KEY=${secret_key}" .env
    
  4. Create environment.

    Dify API service uses Poetry to manage dependencies. First, you need to add the poetry shell plugin, if you don't have it already, in order to run in a virtual environment. [Note: Poetry shell is no longer a native command so you need to install the poetry plugin beforehand]

    poetry self add poetry-plugin-shell
    

    Then, You can execute poetry shell to activate the environment.

  5. Install dependencies

    poetry env use 3.12
    poetry install
    
  6. Run migrate

    Before the first launch, migrate the database to the latest version.

    poetry run python -m flask db upgrade
    
  7. Start backend

    poetry run python -m flask run --host 0.0.0.0 --port=5001 --debug
    
  8. Start Dify web service.

  9. Setup your application by visiting http://localhost:3000...

  10. If you need to handle and debug the async tasks (e.g. dataset importing and documents indexing), please start the worker service.

poetry run python -m celery -A app.celery worker -P gevent -c 1 --loglevel INFO -Q dataset,generation,mail,ops_trace,app_deletion

Testing

  1. Install dependencies for both the backend and the test environment

    poetry install -C api --with dev
    
  2. Run the tests locally with mocked system environment variables in tool.pytest_env section in pyproject.toml

    poetry run -P api bash dev/pytest/pytest_all_tests.sh