milvus异机恢复(standalone-to-k8s)

环境:
OS:Centos 7
milvusdb:2.4.6
源端为standalone,目的端为k8s环境的milvusdb

1.源库进行备份
/opt/milvus_backup/milvus-backup create -n mvsdb_ai_bak_20241211 -d mvsdb_ai --config=/opt/milvus_backup/conf/backup.yaml


2.使用mc工具将minio里的备份文件拷贝到本地存储
##下载minio备份
/opt/minio_client/mc cp --recursive myminio/a-bucket/backup/mvsdb_ai_bak_20241211 /backup/milvus_mc_download_bak/


3.进入到mc下载目录进行压缩备份目录
[root@threegene-milvus0821-prd milvus_mc_download_bak]# tar -zcvf mvsdb_ai_bak_20241211.tar.gz ./mvsdb_ai_bak_20241211
这个时候可以下载压缩文件到本机
sz mvsdb_ai_bak_20241211.tar.gz


4.上传备份文件到目的端的minio存储
这个时候可以将压缩文件在本地解压,然后通过minio界面进行上传到目标minio服务器
若源端服务器可以链接目的端的minio服务器的话,可以使用mc的cp命令传到目的端

或者使用mc cp命令拷贝到k8s目的端的minio服务器(新minio服务器的backup目录不需要提前创建好,会自动创建)

tar -xvf mvsdb_ai_bak_20241211.tar.gz

/opt/minio_client/mc cp -r /backup/milvus_mc_download_bak/mvsdb_ai_bak_20241211 new_minioserver/a-bucket/backup

 

提前需要创建好新minio服务器的alias,如下:

[root@middle milvus_mc_download_bak]# /opt/minio_client/mc alias set new_minioserver http://192.168.1.134:9000 minioadmin minioadmin
Added `new_minioserver` successfully.


查看别名
[root@middle milvus_mc_download_bak]#/opt/minio_client/mc alias list
new_minioserver
  URL       : http://192.168.1.134:9000
  AccessKey : minioadmin
  SecretKey : minioadmin
  API       : s3v4
  Path      : auto
  Src       : /root/.mc/config.json

 

 

5.目的端进行恢复
查看备份列表
/opt/milvus_backup/milvus-backup list --config=/opt/milvus_backup/conf/backup.yaml
>> Backups:
mvsdb_ai_bak_20241211

 

6.进行恢复
/opt/milvus_backup/milvus-backup restore -n mvsdb_ai_bak_20241211 -d mvsdb_ai --restore_index=true --skip_create_collection=true --drop_exist_collection=true --drop_exist_index=true --config=/opt/milvus_backup/conf/backup.yaml

遇到的问题:
workerpool: execute job All attempts results:
attempt #1:storage: copier copy object Object name contains unsupported characters.
attempt #2:storage: copier copy object Object name contains unsupported characters.
attempt #3:storage: copier copy object Object name contains unsupported characters.
attempt #4:storage: copier copy object Object name contains unsupported characters.
attempt #5:storage: copier copy object Object name contains unsupported characters.

原因:源端使用的minio版本是RELEASE.2023-03-20T20-16-18Z,目标端部署的minio是lastest最新版的,重新部署minio,保持与源端一致的版本.

 

posted @ 2024-12-12 17:39  slnngk  阅读(180)  评论(0)    收藏  举报