dify/api
AichiB7A 6c167038af
[Observability] Instrument with celery (#18029)
2025-04-15 11:35:34 +08:00
..
.idea fix nltk averaged_perceptron_tagger download and fix score limit is none (#7582) 2024-08-26 15:14:05 +08:00
.vscode feat/enhance the multi-modal support (#8818) 2024-10-21 10:43:49 +08:00
configs [Observability] Integrate OpenTelemetry (#17627) 2025-04-11 17:04:06 +08:00
constants fix: fix file number limit error (#17848) 2025-04-11 15:26:26 +08:00
contexts feat: Add caching mechanism for plugin model schemas (#14898) 2025-03-04 18:02:06 +08:00
controllers feat: add minimum dify version requirement to plugins (#18022) 2025-04-14 20:09:22 +08:00
core fix basic auth encoding (#18047) 2025-04-15 11:34:50 +08:00
docker Set default LOG_LEVEL to INFO for celery workers and beat (#13066) 2025-01-27 17:09:41 +08:00
events Remove dead code (#17899) 2025-04-11 20:33:52 +08:00
extensions [Observability] Instrument with celery (#18029) 2025-04-15 11:35:34 +08:00
factories fix: skip file format check of mime types for generated files by tools (#17455) 2025-04-05 10:29:14 +08:00
fields fix:weight_type missing when create document in dataset (#16503) 2025-03-22 20:21:57 +08:00
libs Update login.py (#15320) 2025-03-10 09:49:14 +08:00
migrations Fix Performance Issues: (#17083) 2025-04-09 11:22:53 +08:00
models fix: fix file number limit error (#17848) 2025-04-11 15:26:26 +08:00
schedule Fix function's name mismatch (#16681) 2025-03-25 10:25:15 +08:00
services feat: add minimum dify version requirement to plugins (#18022) 2025-04-14 20:09:22 +08:00
tasks chore: skip document segments fetching with non-existed dataset of DatasetDocument in add_document_to_index_task task (#17784) 2025-04-10 17:12:48 +08:00
templates feat: account delete (#11829) 2024-12-30 11:33:42 +08:00
tests Remove dead code (#17899) 2025-04-11 20:33:52 +08:00
.dockerignore Introduce Plugins (#13836) 2025-02-17 17:05:13 +08:00
.env.example [Observability] Integrate OpenTelemetry (#17627) 2025-04-11 17:04:06 +08:00
.ruff.toml chore(api): enhance ruff rules to disallow dangerous functions and modules (#16461) 2025-03-21 17:49:35 +08:00
Dockerfile chore: remove useless doc and font (#15838) 2025-03-14 16:47:42 +08:00
README.md feat: update backend documentation (#13374) 2025-02-08 20:36:33 +08:00
app.py fix(app.py): if condition (#12314) 2025-01-03 01:36:23 +08:00
app_factory.py [Observability] Integrate OpenTelemetry (#17627) 2025-04-11 17:04:06 +08:00
commands.py feat: support Tablestore vector database (#16601) 2025-03-27 15:53:33 +08:00
dify_app.py refactor: assembling the app features in modular way (#9129) 2024-11-30 23:05:22 +08:00
mypy.ini Remove the useless excluded item in mypy.ini (#16777) 2025-03-26 09:02:45 +08:00
poetry.lock [Observability] Instrument with celery (#18029) 2025-04-15 11:35:34 +08:00
poetry.toml build: initial support for poetry build tool (#4513) 2024-06-11 13:11:28 +08:00
pyproject.toml [Observability] Instrument with celery (#18029) 2025-04-15 11:35:34 +08:00
pytest.ini fix: add missing package xinference_client to pass vdb CI tests (#13865) 2025-02-17 23:37:49 +08:00
test_workflow_deletion.py fix: published workflow(tool) can be deleted. (#17900) 2025-04-11 19:39:09 +08:00

README.md

Dify Backend API

Usage

[!IMPORTANT] In the v0.6.12 release, we deprecated pip as the package management tool for Dify API Backend service and replaced it with poetry.

  1. Start the docker-compose stack

    The backend require some middleware, including PostgreSQL, Redis, and Weaviate, which can be started together using docker-compose.

    cd ../docker
    cp middleware.env.example middleware.env
    # change the profile to other vector database if you are not using weaviate
    docker compose -f docker-compose.middleware.yaml --profile weaviate -p dify up -d
    cd ../api
    
  2. Copy .env.example to .env

    cp .env.example .env 
    
  3. Generate a SECRET_KEY in the .env file.

    bash for Linux

    sed -i "/^SECRET_KEY=/c\SECRET_KEY=$(openssl rand -base64 42)" .env
    

    bash for Mac

    secret_key=$(openssl rand -base64 42)
    sed -i '' "/^SECRET_KEY=/c\\
    SECRET_KEY=${secret_key}" .env
    
  4. Create environment.

    Dify API service uses Poetry to manage dependencies. First, you need to add the poetry shell plugin, if you don't have it already, in order to run in a virtual environment. [Note: Poetry shell is no longer a native command so you need to install the poetry plugin beforehand]

    poetry self add poetry-plugin-shell
    

    Then, You can execute poetry shell to activate the environment.

  5. Install dependencies

    poetry env use 3.12
    poetry install
    
  6. Run migrate

    Before the first launch, migrate the database to the latest version.

    poetry run python -m flask db upgrade
    
  7. Start backend

    poetry run python -m flask run --host 0.0.0.0 --port=5001 --debug
    
  8. Start Dify web service.

  9. Setup your application by visiting http://localhost:3000...

  10. If you need to handle and debug the async tasks (e.g. dataset importing and documents indexing), please start the worker service.

poetry run python -m celery -A app.celery worker -P gevent -c 1 --loglevel INFO -Q dataset,generation,mail,ops_trace,app_deletion

Testing

  1. Install dependencies for both the backend and the test environment

    poetry install -C api --with dev
    
  2. Run the tests locally with mocked system environment variables in tool.pytest_env section in pyproject.toml

    poetry run -P api bash dev/pytest/pytest_all_tests.sh