向量DB milvus环境

向量数据库milvus安装
CentOS + Docker + Milvus Standalone（单机版）
CentOS 8GB
Docker
│
├── Redis
├── PostgreSQL
├── MinIO(RELEASE.2023-03-20T20-16-18Z)
├── etcd(v3.5.18)
└── Milvus(v2.5.16)

docker pull minio/minio:latest

docker pull quay.io/coreos/etcd:v3.5.5

docker pull minio/minio:RELEASE.2023-03-20T20-16-18Z

docker images

docker.1ms.run/milvusdb/milvus             v2.5.16                        3f557a22084c   10 months ago   1.96GB
quay.io/coreos/etcd                        v3.5.18                        b9e6889272c9   16 months ago   59MB
minio/minio                                RELEASE.2023-03-20T20-16-18Z   400c20c8aac0   3 years ago     252MB

镜像获取之后启动milvus

1. 创建工作目录

/opt/milvus
├── docker-compose.yml
└── volumes
    ├── etcd
    ├── minio
    └── milvus

mkdir -p /opt/milvus
cd /opt/milvus
mkdir -p volumes/{etcd,minio,milvus}

创建docker-compose.yml

services:

  etcd:
    container_name: milvus-etcd
    image: quay.io/coreos/etcd:v3.5.18
    environment:
      ETCD_AUTO_COMPACTION_MODE: revision
      ETCD_AUTO_COMPACTION_RETENTION: 1000
      ETCD_QUOTA_BACKEND_BYTES: 4294967296
      ALLOW_NONE_AUTHENTICATION: "yes"
      ETCD_ADVERTISE_CLIENT_URLS: http://etcd:2379
      ETCD_LISTEN_CLIENT_URLS: http://0.0.0.0:2379
    command: etcd
    volumes:
      - ./volumes/etcd:/etcd
    restart: unless-stopped

  minio:
    container_name: milvus-minio
    image: minio/minio:RELEASE.2023-03-20T20-16-18Z
    environment:
      MINIO_ROOT_USER: minioadmin
      MINIO_ROOT_PASSWORD: minioadmin
    command: minio server /data --console-address ":9001"
    volumes:
      - ./volumes/minio:/data
    ports:
      - "9000:9000"
      - "9001:9001"
    restart: unless-stopped

  milvus:
    container_name: milvus-standalone
    image: milvusdb/milvus:v2.5.16
    command: ["milvus", "run", "standalone"]
    environment:
      ETCD_ENDPOINTS: etcd:2379
      MINIO_ADDRESS: minio:9000
    volumes:
      - ./volumes/milvus:/var/lib/milvus
    ports:
      - "19530:19530"
      - "9091:9091"
    depends_on:
      - etcd
      - minio
    restart: unless-stopped

查看启动情况

03604b1cb39b   milvusdb/milvus:v2.5.16                                         "/tini -- milvus run…"   4 minutes ago   Up 3 minutes    0.0.0.0:9091->9091/tcp, :::9091->9091/tcp, 0.0.0.0:19530->19530/tcp, :::19530->19530/tcp   milvus-standalone
a5f98dfad0d4   minio/minio:RELEASE.2023-03-20T20-16-18Z                        "/usr/bin/docker-ent…"   4 minutes ago   Up 3 minutes    0.0.0.0:9000-9001->9000-9001/tcp, :::9000-9001->9000-9001/tcp                              milvus-minio
eab8f503e735   quay.io/coreos/etcd:v3.5.18                                     "etcd"                   4 minutes ago   Up 3 minutes    2379-2380/tcp                                                                              milvus-etcd

stop & restart

docker stop milvus-standalone milvus-minio milvus-etcd

docker restart milvus-standalone milvus-minio milvus-etcd

单机结构

Milvus Standalone
        │
        ├── etcd（元数据存储）
        │      ├── Collection
        │      ├── Schema
        │      └── 索引信息
        │
        └── MinIO（对象存储）
               ├── 向量数据
               ├── Segment
               └── 索引文件

AI Agent架构

CentOS
 ├── Docker
 │
 ├── Redis  # 缓存， Celery Broker
 │
 ├── Milvus # 向量检索
 │
 ├── MinIO # 文档存储
 │
 ├── PostgreSQL # 业务数据
 │
 └── Ollama # 本地模型
        ↓
 FastAPI # AI服务层
        ↓
 LangChain / LlamaIndex
        ↓
 Agent系统

推荐目录结构

/opt/middleware
├── redis
├── postgres
├── milvus
│   ├── docker-compose.yml
│   └── volumes
│       ├── etcd
│       ├── minio
│       └── milvus
└── minio-data