Files
deer-flow/backend/docs/APPLE_CONTAINER.md
DanielWalnut 76803b826f refactor: split backend into harness (deerflow.*) and app (app.*) (#1131)
* refactor: extract shared utils to break harness→app cross-layer imports

Move _validate_skill_frontmatter to src/skills/validation.py and
CONVERTIBLE_EXTENSIONS + convert_file_to_markdown to src/utils/file_conversion.py.
This eliminates the two reverse dependencies from client.py (harness layer)
into gateway/routers/ (app layer), preparing for the harness/app package split.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

* refactor: split backend/src into harness (deerflow.*) and app (app.*)

Physically split the monolithic backend/src/ package into two layers:

- **Harness** (`packages/harness/deerflow/`): publishable agent framework
  package with import prefix `deerflow.*`. Contains agents, sandbox, tools,
  models, MCP, skills, config, and all core infrastructure.

- **App** (`app/`): unpublished application code with import prefix `app.*`.
  Contains gateway (FastAPI REST API) and channels (IM integrations).

Key changes:
- Move 13 harness modules to packages/harness/deerflow/ via git mv
- Move gateway + channels to app/ via git mv
- Rename all imports: src.* → deerflow.* (harness) / app.* (app layer)
- Set up uv workspace with deerflow-harness as workspace member
- Update langgraph.json, config.example.yaml, all scripts, Docker files
- Add build-system (hatchling) to harness pyproject.toml
- Add PYTHONPATH=. to gateway startup commands for app.* resolution
- Update ruff.toml with known-first-party for import sorting
- Update all documentation to reflect new directory structure

Boundary rule enforced: harness code never imports from app.
All 429 tests pass. Lint clean.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

* chore: add harness→app boundary check test and update docs

Add test_harness_boundary.py that scans all Python files in
packages/harness/deerflow/ and fails if any `from app.*` or
`import app.*` statement is found. This enforces the architectural
rule that the harness layer never depends on the app layer.

Update CLAUDE.md to document the harness/app split architecture,
import conventions, and the boundary enforcement test.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

* feat: add config versioning with auto-upgrade on startup

When config.example.yaml schema changes, developers' local config.yaml
files can silently become outdated. This adds a config_version field and
auto-upgrade mechanism so breaking changes (like src.* → deerflow.*
renames) are applied automatically before services start.

- Add config_version: 1 to config.example.yaml
- Add startup version check warning in AppConfig.from_file()
- Add scripts/config-upgrade.sh with migration registry for value replacements
- Add `make config-upgrade` target
- Auto-run config-upgrade in serve.sh and start-daemon.sh before starting services
- Add config error hints in service failure messages

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

* fix comments

* fix: update src.* import in test_sandbox_tools_security to deerflow.*

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

* fix: handle empty config and search parent dirs for config.example.yaml

Address Copilot review comments on PR #1131:
- Guard against yaml.safe_load() returning None for empty config files
- Search parent directories for config.example.yaml instead of only
  looking next to config.yaml, fixing detection in common setups

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

* fix: correct skills root path depth and config_version type coercion

- loader.py: fix get_skills_root_path() to use 5 parent levels (was 3)
  after harness split, file lives at packages/harness/deerflow/skills/
  so parent×3 resolved to backend/packages/harness/ instead of backend/
- app_config.py: coerce config_version to int() before comparison in
  _check_config_version() to prevent TypeError when YAML stores value
  as string (e.g. config_version: "1")
- tests: add regression tests for both fixes

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

* fix: update test imports from src.* to deerflow.*/app.* after harness refactor

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

---------

Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-14 22:55:52 +08:00

6.2 KiB

Apple Container Support

DeerFlow now supports Apple Container as the preferred container runtime on macOS, with automatic fallback to Docker.

Overview

Starting with this version, DeerFlow automatically detects and uses Apple Container on macOS when available, falling back to Docker when:

  • Apple Container is not installed
  • Running on non-macOS platforms

This provides better performance on Apple Silicon Macs while maintaining compatibility across all platforms.

Benefits

On Apple Silicon Macs with Apple Container:

  • Better Performance: Native ARM64 execution without Rosetta 2 translation
  • Lower Resource Usage: Lighter weight than Docker Desktop
  • Native Integration: Uses macOS Virtualization.framework

Fallback to Docker:

  • Full backward compatibility
  • Works on all platforms (macOS, Linux, Windows)
  • No configuration changes needed

Requirements

For Apple Container (macOS only):

  • macOS 15.0 or later
  • Apple Silicon (M1/M2/M3/M4)
  • Apple Container CLI installed

Installation:

# Download from GitHub releases
# https://github.com/apple/container/releases

# Verify installation
container --version

# Start the service
container system start

For Docker (all platforms):

  • Docker Desktop or Docker Engine

How It Works

Automatic Detection

The AioSandboxProvider automatically detects the available container runtime:

  1. On macOS: Try container --version

    • Success → Use Apple Container
    • Failure → Fall back to Docker
  2. On other platforms: Use Docker directly

Runtime Differences

Both runtimes use nearly identical command syntax:

Container Startup:

# Apple Container
container run --rm -d -p 8080:8080 -v /host:/container -e KEY=value image

# Docker
docker run --rm -d -p 8080:8080 -v /host:/container -e KEY=value image

Container Cleanup:

# Apple Container (with --rm flag)
container stop <id>  # Auto-removes due to --rm

# Docker (with --rm flag)
docker stop <id>     # Auto-removes due to --rm

Implementation Details

The implementation is in backend/packages/harness/deerflow/community/aio_sandbox/aio_sandbox_provider.py:

  • _detect_container_runtime(): Detects available runtime at startup
  • _start_container(): Uses detected runtime, skips Docker-specific options for Apple Container
  • _stop_container(): Uses appropriate stop command for the runtime

Configuration

No configuration changes are needed! The system works automatically.

However, you can verify the runtime in use by checking the logs:

INFO:deerflow.community.aio_sandbox.aio_sandbox_provider:Detected Apple Container: container version 0.1.0
INFO:deerflow.community.aio_sandbox.aio_sandbox_provider:Starting sandbox container using container: ...

Or for Docker:

INFO:deerflow.community.aio_sandbox.aio_sandbox_provider:Apple Container not available, falling back to Docker
INFO:deerflow.community.aio_sandbox.aio_sandbox_provider:Starting sandbox container using docker: ...

Container Images

Both runtimes use OCI-compatible images. The default image works with both:

sandbox:
  use: deerflow.community.aio_sandbox:AioSandboxProvider
  image: enterprise-public-cn-beijing.cr.volces.com/vefaas-public/all-in-one-sandbox:latest  # Default image

Make sure your images are available for the appropriate architecture:

  • ARM64 for Apple Container on Apple Silicon
  • AMD64 for Docker on Intel Macs
  • Multi-arch images work on both

Important: Container images are typically large (500MB+) and are pulled on first use, which can cause a long wait time without clear feedback.

Best Practice: Pre-pull the image during setup:

# From project root
make setup-sandbox

This command will:

  1. Read the configured image from config.yaml (or use default)
  2. Detect available runtime (Apple Container or Docker)
  3. Pull the image with progress indication
  4. Verify the image is ready for use

Manual pre-pull:

# Using Apple Container
container pull enterprise-public-cn-beijing.cr.volces.com/vefaas-public/all-in-one-sandbox:latest

# Using Docker
docker pull enterprise-public-cn-beijing.cr.volces.com/vefaas-public/all-in-one-sandbox:latest

If you skip pre-pulling, the image will be automatically pulled on first agent execution, which may take several minutes depending on your network speed.

Cleanup Scripts

The project includes a unified cleanup script that handles both runtimes:

Script: scripts/cleanup-containers.sh

Usage:

# Clean up all DeerFlow sandbox containers
./scripts/cleanup-containers.sh deer-flow-sandbox

# Custom prefix
./scripts/cleanup-containers.sh my-prefix

Makefile Integration:

All cleanup commands in Makefile automatically handle both runtimes:

make stop   # Stops all services and cleans up containers
make clean  # Full cleanup including logs

Testing

Test the container runtime detection:

cd backend
python test_container_runtime.py

This will:

  1. Detect the available runtime
  2. Optionally start a test container
  3. Verify connectivity
  4. Clean up

Troubleshooting

Apple Container not detected on macOS

  1. Check if installed:

    which container
    container --version
    
  2. Check if service is running:

    container system start
    
  3. Check logs for detection:

    # Look for detection message in application logs
    grep "container runtime" logs/*.log
    

Containers not cleaning up

  1. Manually check running containers:

    # Apple Container
    container list
    
    # Docker
    docker ps
    
  2. Run cleanup script manually:

    ./scripts/cleanup-containers.sh deer-flow-sandbox
    

Performance issues

  • Apple Container should be faster on Apple Silicon
  • If experiencing issues, you can force Docker by temporarily renaming the container command:
    # Temporary workaround - not recommended for permanent use
    sudo mv /opt/homebrew/bin/container /opt/homebrew/bin/container.bak
    

References