Anything-llm、DeepSeek与Ollama

1、安装ollama

见安装文档《Ollama与DeekSeek》，注意，即使在同一台主机，ollama必须开启对外访问，否则anything会找不到ollama。

[Unit]
Description=Ollama Service
After=network-online.target

[Service]
Environment="OLLAMA_HOST=0.0.0.0:11434"
ExecStart=/usr/local/bin/ollama serve
User=ollama
Group=ollama
Restart=always
RestartSec=3
Environment="PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"

[Install]
WantedBy=default.target                            

2、安装并运行anything-llm

（1）编写docker-compose文件

services:
  anythingllm:
    image: mintplexlabs/anythingllm
    container_name: anythingllm
    ports:
    - "3001:3001"
    cap_add:
      - SYS_ADMIN
    user: "${UID}:${GID}"
    environment:
    # Adjust for your environment
      - STORAGE_DIR=/app/server/storage
    env_file:
      - .env
    volumes:
      - ./data:/app/server/storage
      - ./.env:/app/server/.env
    restart: always
    networks:
      - anything-llm
    extra_hosts:
      - "host.docker.internal:host-gateway"
networks:
  anything-llm:
    driver: bridge

（2）编写环境变量

# Auto-dump ENV from system call on 14:38:16 GMT+0000 (Coordinated Universal Time)
LLM_PROVIDER='ollama'
EMBEDDING_MODEL_PREF='nomic-embed-text:latest'
OLLAMA_BASE_PATH='http://192.168.50.193:11434'
OLLAMA_MODEL_PREF='deepseek-r1:1.5b'
OLLAMA_MODEL_TOKEN_LIMIT='4096'
VECTOR_DB='lancedb'
EMBEDDING_ENGINE='ollama'
EMBEDDING_BASE_PATH='http://192.168.50.193:11434'
EMBEDDING_MODEL_MAX_CHUNK_LENGTH='8192'
JWT_SECRET='make this a large list of random numbers and letters 20+'
STORAGE_DIR='/app/server/storage'
SIG_KEY='4baa099f0c1a27ad90f34b0a6fe25e9a05b4171f582d5565e1355ca1a118f4a7'
SIG_SALT='dd9f6a0edeac570591be35a2d0210ade052bee8b1621aa861925390a292653a8'

（3）运行anything-llm

docker-compose -f anythin-compose.yaml up