002-DMDSC集群部署

一、摘要

本次学习达梦数据库,重点掌握 DMDSC 共享集群架构、部署流程;完成2节点DSC+1节点DW的集群部署。DMASM采用非镜像模式。

二、理论知识学习

2.1 DMDSC共享集群

DMDSC 集群是一个多实例、单数据库的系统。多个数据库实例可以同时访问、修改同一个数据库的数据。用户可以登录集群中的任意一个数据库实例,获得完整的数据库服务。

数据文件、控制文件在集群系统中只有一份,不论有几个节点,这些节点都平等地使用这些

文件,这些文件保存在共享存储上。每个节点有自己独立的联机日志和归档日志,联机日志和归档日志都需要保存在共享存储上。

DMDSC 集群主要由数据库和数据库实例、共享存储、DMASM 或 DMASM 镜像、本地存储、通信网络、集群控制软件 DMCSS、集群监视器 DMCSSM 组成。DMDSC 集群最多支持 8 个数据库实例节点。

下图展示了一个两节点的 DMDSC 集群系统结构图:

2.2 DMASM介绍

DM 自动存储管理器(DM Auto Storage Manager,简称 DMASM)是一个专用的分布式文件系统。

DMDSC 如果直接使用块设备作为共享存储来存放数据库文件,会因为块设备本身的诸多功能限制,造成 DMDSC 集群在使用、维护上并不是那么灵活方便。为了克服块设备的这些使用限制,DM 专门设计了一款分布式文件系统 DMASM,来管理块设备的磁盘和文件。

DMASM 的出现为 DMDSC 灵活管理和使用块设备提供了完美的解决方案。

使用 DMASM 自动存储管理方案,可以帮助用户更加便捷地管理 DMDSC 集群的数据库文件。DMASM 的主要部件包括:提供存储服务的块设备、DMASMSVR服务器、DMASMAPI接口、初始化工具 DMASMCMD 和管理工具 DMASMTOOL 等。

DMASM结构图:

三、实验环境与准备

3.1 软硬件资源

(1)硬件配置信息如下:

硬件类别

硬件名称

配置

数量

数据库服务器

-

CPU:英特尔2核

内存:4GB

两块网卡

3

(2)软件配置信息如下:

软件类别

软件名称

版本

操作系统

Kylin V10

4.19.90-52.22.v2207.ky10.x86_64

数据库

达梦数据库

V8.1.5.60

(3)拓扑结构

be6eb769568c57c66751f57a5e0932a

3.2 主机名IP规划

节点名称

公共IP地址

专用IP地址

虚拟IP地址

备注

dsc1

10.*.*.28

10.*.*.25

 

主节点1

dsc2

10.*.*.29

10.*.*.26

 

主节点2

grp1_dsc3

10.*.*.27

10.*.*.27

 

备节点

3.3 目录与存储规划

本地磁盘:

参数

值

备注

/home/dmdba/DSC

DSC0:

/home/dmdba/DSC/DSC0

DSC1:

/home/dmdba/DSC/DSC1

40GB

/home/dmdba

 

达梦专有用户dmdba

DM_HOME

/home/dmdba/dmdbms

 

/dmbak

DSC0:

/dmbak

DSC1:

/dmbak

本地盘备份

共享磁盘:

DCR

/dev/DCR:/dev/mapper/mpatha

5G*1

VOTE

/dev/DM_VOTE:/dev/mapper/mpathb

5G*1

LOG

/dev/DM_LOG:/dev/mapper/mpathc

10G

ARCH

/dev/DM_ARCH:/dev/mapper/mpathd

10GB*1

DATA

/dev/DM_DATA:/dev/mapper/mpathe

10G*1

3.4 属组规划

分类

属主

所属组

$HOME

/home/dmdba/*

dmdba

dinstall

 

/home/dmdba/DSC

dmdba

dinstall

 

/dev_DMDATA/DM*

dmdba

dinstall

755

3.5 节点部署信息

节点

IP地址

用户名/密码:端口号

启动服务(建议使用4.7章节方式)

DSC0

外部服务IP:10.*.*.28

内部通讯IP:10.*.*.25

管理员SYSDBA:

SYSDBA/****:10038

启动CSS:

systemctl start DmCSSServiceCSS0.service

启动ASM:

systemctl start

DmASMSvrServiceASM0.service

启动实例:

systemctl start DmServiceDSC0.service

启动守护:

systemctl start DmWatcherServiceDSC0.service

Dmcssm监控:

cd /home/dmdba/dmdbms/bin

./dmcssm ini_path=/home/dmdba/DSC/dmcssm.ini

DSC1

外部服务IP:10.*.*.29

内部通讯IP:10.*.*.26

管理员SYSDBA:

SYSDBA/****:10038

启动CSS:

systemctl start DmCSSServiceCSS0.service

启动ASM:

systemctl start

DmASMSvrServiceASM0.service

启动实例:

systemctl start DmServiceDSC1.service

启动守护:

systemctl start DmWatcherServiceDSC1.service

DSC_STADNBY01

外部服务IP:10.*.*.27

内部通讯IP:10.*.*.27

管理员SYSDBA:

SYSDBA/****:10038

启动实例:

systemctl start DmServiceDSC_STADNBY.service

启动守护:

systemctl start DmWatcherServiceDSC_STADNBY.service

监视器

10.*.*.27

SYSDBA/SYSDBA

dmmonitor /dmdata/monitor/dmmonitor_manual.ini

四、实验操作(DMDSC部署过程)

4.1 环境配置

所有数据库服务器,均需进行环境配置操作!

4.1.1 创建dmdba 用户

groupadd dinstall

useradd -g dinstall -d /home/dmdba -s /bin/bash -m dmdba

passwd dmdba

4.1.2 创建目录并赋权

mkdir -p /{dmdata,dmbak}

mkdir -p /dmdata/{dmlog,dmarch}

chown -R dmdba:dinstall /{dmdata,dmbak}

chmod -R 775 /{dmdata,dmbak}

4.1.3 关闭防火墙

systemctl stop firewalld

systemctl disable firewalld

4.1.4 关闭SELinux 组件

vim /etc/selinux/config

修改:

SELINUX=disabled

setenforce 0

4.1.5 操作系统参数优化

sysctl.conf 参数配置修改

vi /etc/sysctl.conf

#添加:

fs.file-max =6815744

fs.aio-max-nr =1048576

kernel.shmmni =4096

kernel.sem =250 32000 100 128

net.ipv4.ip_local_port_range =9000 65500

net.core.rmem_default =4194304

net.core.rmem_max =4194304

net.core.wmem_default =262144

net.core.wmem_max =1048576

vm.dirty_ratio =80

vm.dirty_expire_centisecs =500

vm.dirty_writeback_centisecs =100

vm.dirty_background_ratio =0

vm.overcommit_memory=0

vm.swappiness=10

#vm.min_free_kbytes =512000

kernel.core_pattern=/dmdata/core_%e_%p_%t

kernel.core_uses_pid=1

#生效

sysctl -p

4.1.6用户资源限制修改

limit.conf 参数配置修改

vim /etc/security/limits.conf

dmdba soft data unlimited

dmdba hard data unlimited

dmdba soft fsize unlimited

dmdba hard fsize unlimited

dmdba soft nofile 65536

dmdba hard nofile 65536

dmdba soft nproc 10240

dmdba hard nproc 10240

dmdba soft nice 0

dmdba hard nice 0

dmdba soft as unlimited

dmdba hard as unlimited

dmdba soft core unlimited

dmdba hard core unlimited

4.1.7 关闭透明大页

#追加参数

vi /etc/default/grub

GRUB_CMDLINE_LINUX="crashkernel=auto rd.lvm.lv=centos/root rd.lvm.lv=centos/swap rhgb transparent_hugepage=never quiet"

#生效

grub2-mkconfig -o /etc/grub2 .cfg

4.1.8 修改磁盘调度算法

#查看调度算法

cat /sys/block/$device-name/queue/scheduler

#修改调度算法为deadline。如果磁盘是nvme 协议的闪存盘,使用none 调度算法

echo deadline >/sys/block/sda/queue/scheduler

#永久生效写入rc.local

echo deadline >/sys/block/sda/queue/scheduler

4.1.9时钟同步

#建议客户配置时钟服务器

#检查各节点时间,并统一调整

#date -s "2026-10-15 15 :22 :00"

注:-s 后面跟年-月-日小时:分钟:秒

4.1.10配置环境变量

vi /home/dmdba/.bash_profile

#新增如下内容

export MALLOC_ARENA_MAX=1

export DM_HOME=/home/dmdba/dmdbms

#需依据实际路径修改

export PATH=$PATH:$DM_HOME/bin

export LD_LIBRARY_PATH=$LD_LIBRARY_PATH:$DM_HOME/bin

#使环境变量生效

source /home/dmdba/.bash_profile

4.2软件安装(所有节点)

4.2.1 上传挂载镜像

步骤1:上传安装文件

# mkdir /soft

# mkdir /soft/dmiso

# cd /soft

[root@dpc1 soft]# ll

总用量 935204

-rw-r--r-- 1 root root 957646848 9月 17 2025 dm8_20260710_x86_kylin10_sp3_64.iso

步骤2:挂载安装介质

[root@dpc1 soft]# mount -o loop dm8_20260710_x86_kylin10_sp3_64.iso /soft/dmiso/

mount: /soft/dmiso: WARNING: source write-protected, mounted read-only.

[root@dpc1 soft]#

# cd /soft/dmiso

[root@dpc1 dmiso]# ll

总用量 935141

-r-xr-xr-x 1 root root 2967103 7月 18 2025 DM8 Install.pdf

-r-xr-xr-x 1 root root 954616471 9月 10 2025 DMInstall.bin

4.2.2 命令行安装

[root@dpc1 dmiso]# su - dmdba

[dmdba@dpc1 ~]$ cd /soft/dmiso/

[dmdba@dpc1 dmiso]$ ./DMInstall.bin -i

安装语言:

[1]: 简体中文

[2]: English

请选择安装语言 [1]:

解压安装程序.........

硬件架构校验通过!

欢迎使用达梦数据库安装程序

是否输入Key文件路径? (Y/y:是 N/n:否) [Y/y]:n

是否设置时区? (Y/y:是 N/n:否) [Y/y]:

设置时区:

[ 1]: (GTM-12:00) 日界线西

[ 2]: (GTM-11:00) 萨摩亚群岛

[ 3]: (GTM-10:00) 夏威夷

[ 4]: (GTM-09:00) 阿拉斯加

[ 5]: (GTM-08:00) 太平洋时间(美国和加拿大)

[ 6]: (GTM-07:00) 亚利桑那

[ 7]: (GTM-06:00) 中部时间(美国和加拿大)

[ 8]: (GTM-05:00) 东部时间(美国和加拿大)

[ 9]: (GTM-04:00) 大西洋时间(美国和加拿大)

[10]: (GTM-03:00) 巴西利亚

[11]: (GTM-02:00) 中大西洋

[12]: (GTM-01:00) 亚速尔群岛

[13]: (GTM) 格林威治标准时间

[14]: (GTM+01:00) 萨拉热窝

[15]: (GTM+02:00) 开罗

[16]: (GTM+03:00) 莫斯科

[17]: (GTM+04:00) 阿布扎比

[18]: (GTM+05:00) 伊斯兰堡

[19]: (GTM+06:00) 达卡

[20]: (GTM+07:00) 曼谷,河内

[21]: (GTM+08:00) 中国标准时间

[22]: (GTM+09:00) 首尔

[23]: (GTM+10:00) 关岛

[24]: (GTM+11:00) 所罗门群岛

[25]: (GTM+12:00) 斐济

[26]: (GTM+13:00) 努库阿洛法

[27]: (GTM+14:00) 基里巴斯

请选择时区 [21]:

安装类型:

1 典型安装

2 服务器

3 客户端

4 自定义

请选择安装类型的数字序号 [1 典型安装]:

所需空间: 2077M

请选择安装目录 [/home/dmdba/dmdbms]:

可用空间: 36G

是否确认安装路径(/home/dmdba/dmdbms)? (Y/y:是 N/n:否) [Y/y]:y

安装前小结

安装位置: /home/dmdba/dmdbms

所需空间: 2077M

可用空间: 36G

版本信息:

有效日期:

安装类型: 典型安装

是否确认安装? (Y/y:是 N/n:否):y

2026-10-15 22:51:37

[INFO] 安装 基础 模块...

2026-10-15 22:51:37

[INFO] 安装达梦数据库...

2026-10-15 22:51:56

[INFO] 安装 服务器 模块...

2026-10-15 22:51:58

[INFO] 安装 客户端 模块...

2026-10-15 22:52:10

[INFO] 安装 驱动 模块...

2026-10-15 22:52:15

[INFO] 安装 手册 模块...

2026-10-15 22:52:17

[INFO] 安装 服务 模块...

2026-10-15 22:52:25

[INFO] 移动日志文件。

2026-10-15 22:52:28

[INFO] 安装达梦数据库完成。

请以root系统用户执行命令:

/home/dmdba/dmdbms/script/root/root_installer.sh

安装结束

[dmdba@dpc1 dmiso]$ exit

注销

[root@dpc1 soft]# /home/dmdba/dmdbms/script/root/root_installer.sh

移动 /home/dmdba/dmdbms/bin/dm_svc.conf 到/etc目录

创建DmAPService服务

Created symlink /etc/systemd/system/multi-user.target.wants/DmAPService.service → /usr/lib/systemd/system/DmAPService.service.

创建服务(DmAPService)完成

启动DmAPService服务

[root@dpc1 soft]#

4.3服务器块设备绑定步骤:

4.3.1获取信息

确认服务器共享磁盘信息

[root@dsc1 ~]# fdisk -l|grep mpath

Disk /dev/mapper/mpathc:5 GiB,5368709120 字节,10485760 个扇区

Disk /dev/mapper/mpathd:5 GiB,5368709120 字节,10485760 个扇区

Disk /dev/mapper/mpathe:10 GiB,10737418240 字节,20971520 个扇区

Disk /dev/mapper/mpathf:10 GiB,10737418240 字节,20971520 个扇区

Disk /dev/mapper/mpathg:10 GiB,10737418240 字节,20971520 个扇区

确认多路径信息

[root@dsc1 ~]# multipath -l

mpathe (23c970233c64b5eb0) dm-4 ROCKET,IMAGEFILE

size=10G features='2 queue_mode mq' hwhandler='0' wp=rw

|-+- policy='service-time 0' prio=0 status=active

| `- 3:0:0:3 sde 8:64 active undef running

|-+- policy='service-time 0' prio=0 status=enabled

| `- 4:0:0:3 sdj 8:144 active undef running

|-+- policy='service-time 0' prio=0 status=enabled

| `- 5:0:0:3 sdo 8:224 active undef running

`-+- policy='service-time 0' prio=0 status=enabled

`- 6:0:0:3 sdt 65:48 active undef running

mpathd (298d801759b31597d) dm-3 ROCKET,IMAGEFILE

size=5.0G features='2 queue_mode mq' hwhandler='0' wp=rw

|-+- policy='service-time 0' prio=0 status=active

| `- 3:0:0:1 sdc 8:32 active undef running

|-+- policy='service-time 0' prio=0 status=enabled

| `- 4:0:0:1 sdh 8:112 active undef running

|-+- policy='service-time 0' prio=0 status=enabled

| `- 5:0:0:1 sdm 8:192 active undef running

`-+- policy='service-time 0' prio=0 status=enabled

`- 6:0:0:1 sdr 65:16 active undef running

mpathc (2aa10c3def7599d13) dm-2 ROCKET,IMAGEFILE

size=5.0G features='2 queue_mode mq' hwhandler='0' wp=rw

|-+- policy='service-time 0' prio=0 status=active

| `- 3:0:0:0 sdb 8:16 active undef running

|-+- policy='service-time 0' prio=0 status=enabled

| `- 4:0:0:0 sdg 8:96 active undef running

|-+- policy='service-time 0' prio=0 status=enabled

| `- 5:0:0:0 sdl 8:176 active undef running

`-+- policy='service-time 0' prio=0 status=enabled

`- 6:0:0:0 sdq 65:0 active undef running

mpathg (2232a8b00d65e878e) dm-6 ROCKET,IMAGEFILE

size=10G features='2 queue_mode mq' hwhandler='0' wp=rw

|-+- policy='service-time 0' prio=0 status=active

| `- 3:0:0:2 sdd 8:48 active undef running

|-+- policy='service-time 0' prio=0 status=enabled

| `- 4:0:0:2 sdi 8:128 active undef running

|-+- policy='service-time 0' prio=0 status=enabled

| `- 5:0:0:2 sdn 8:208 active undef running

`-+- policy='service-time 0' prio=0 status=enabled

`- 6:0:0:2 sds 65:32 active undef running

mpathf (2af1495ac19ca57e3) dm-5 ROCKET,IMAGEFILE

size=10G features='2 queue_mode mq' hwhandler='0' wp=rw

|-+- policy='service-time 0' prio=0 status=active

| `- 3:0:0:4 sdf 8:80 active undef running

|-+- policy='service-time 0' prio=0 status=enabled

| `- 4:0:0:4 sdk 8:160 active undef running

|-+- policy='service-time 0' prio=0 status=enabled

| `- 5:0:0:4 sdp 8:240 active undef running

`-+- policy='service-time 0' prio=0 status=enabled

`- 6:0:0:4 sdu 65:64 active undef running

获取共享磁盘的uuid

[root@dsc1 ~]# /usr/lib/udev/scsi_id -g -u /dev/mapper/mpathc

2aa10c3def7599d13

[root@dsc1 ~]# /usr/lib/udev/scsi_id -g -u /dev/mapper/mpathd

298d801759b31597d

[root@dsc1 ~]# /usr/lib/udev/scsi_id -g -u /dev/mapper/mpathe

23c970233c64b5eb0

[root@dsc1 ~]# /usr/lib/udev/scsi_id -g -u /dev/mapper/mpathf

2af1495ac19ca57e3

[root@dsc1 ~]# /usr/lib/udev/scsi_id -g -u /dev/mapper/mpathg

2232a8b00d65e878e

4.3.2 udev绑定块设备

DSC0和DSC1服务器分别编辑

/etc/udev/rules.d/66-dmasmdevices.rules,增加如下语句

[root@dzgwdbnode1 ~]#

cat /etc/udev/rules.d/66-dmasmdevices.rules

cat /etc/udev/rules.d/66-dmasmdevices.rules

KERNEL=="dm*",SUBSYSTEM=="block",PROGRAM=="/usr/lib/udev/scsi_id --whitelisted --replace-whitespace --device=/dev/$name",RESULT=="2aa10c3def7599d13",SYMLINK+="DM_DCR", RUN+="/bin/sh -c 'chown -R dmdba:dinstall /dev/DM_DCR; chmod 0660 /dev/DM_DCR ;chmod 777 /dev/dm-*'"

KERNEL=="dm*",SUBSYSTEM=="block",PROGRAM=="/usr/lib/udev/scsi_id --whitelisted --replace-whitespace --device=/dev/$name",RESULT=="298d801759b31597d",SYMLINK+="DM_VOTE", RUN+="/bin/sh -c 'chown -R dmdba:dinstall /dev/DM_VOTE; chmod 0660 /dev/DM_VOTE ;chmod 777 /dev/dm-*'"

KERNEL=="dm*",SUBSYSTEM=="block",PROGRAM=="/usr/lib/udev/scsi_id --whitelisted --replace-whitespace --device=/dev/$name",RESULT=="23c970233c64b5eb0",SYMLINK+="DM_LOG", RUN+="/bin/sh -c 'chown -R dmdba:dinstall /dev/DM_LOG; chmod 0660 /dev/DM_LOG ;chmod 777 /dev/dm-*'"

KERNEL=="dm*",SUBSYSTEM=="block",PROGRAM=="/usr/lib/udev/scsi_id --whitelisted --replace-whitespace --device=/dev/$name",RESULT=="2af1495ac19ca57e3",SYMLINK+="DM_ARCH", RUN+="/bin/sh -c 'chown -R dmdba:dinstall /dev/DM_ARCH; chmod 0660 /dev/DM_ARCH ;chmod 777 /dev/dm-*'"

KERNEL=="dm*",SUBSYSTEM=="block",PROGRAM=="/usr/lib/udev/scsi_id --whitelisted --replace-whitespace --device=/dev/$name",RESULT=="2232a8b00d65e878e",SYMLINK+="DM_DATA", RUN+="/bin/sh -c 'chown -R dmdba:dinstall /dev/DM_DATA; chmod 0660 /dev/DM_DATA ;chmod 777 /dev/dm-*'"

ln -s /dev/DM_VOTE /dev_DMDATA/DM_VOTE

ln -s /dev/DM_DCR /dev_DMDATA/DM_DCR

ln -s /dev/DM_ARCH /dev_DMDATA/DM_ARCH

ln -s /dev/DM_LOG /dev_DMDATA/DM_LOG

ln -s /dev/DM_DATA /dev_DMDATA/DM_DATA

ls -ltr /dev/DM_*

4.3.3刷新磁盘读取信息,使配置生效

/sbin/udevadm control --reload-rules

udevadm trigger --action=add

/sbin/udevadm trigger --type=devices --action=change

4.3.4刷新后,确认生效

chown dmdba.dinstall -R /dev_DMDATA/

ls -ltr /dev_DMDATA/DM*

ls -ltr /dev/DM_*

ls -ltr /dev/mapper/*

注:最后查看磁盘属主设置是否生效,属主不对会造成服务起不来。

4.4 搭建基于ASM的共享存储集群

详细搭建步骤可参考手册/home/dmdba/dmdbms/doc/DM8共享存储集群.pdf

4.4.1格式化 DCR 和 Voting Disk 的配置文件dmdcr_cfg.ini。

vim /home/dmdba/DSC/dmdcr_cfg.ini

配置信息包括三类:集群环境全局信息、集群组信息、以及组内节点信息。

DCR_N_GRP = 3

DCR_VTD_PATH = /dev_DMDATA/DM_VOTE #规划为vote的磁盘

DCR_OGUID = 210715

[GRP]

DCR_GRP_TYPE = CSS

DCR_GRP_NAME = GRP_CSS

DCR_GRP_N_EP = 2

DCR_GRP_DSKCHK_CNT = 65

[GRP_CSS]

DCR_EP_NAME = CSS0

DCR_EP_HOST = 10.*.*.25

DCR_EP_PORT = 11286

[GRP_CSS]

DCR_EP_NAME = CSS1

DCR_EP_HOST = 10.*.*.26

DCR_EP_PORT = 11286

[GRP]

DCR_GRP_TYPE = ASM

DCR_GRP_NAME = GRP_ASM

DCR_GRP_N_EP = 2

DCR_GRP_DSKCHK_CNT = 61

[GRP_ASM]

DCR_EP_NAME = ASM0

DCR_EP_SHM_KEY = 42424

DCR_EP_SHM_SIZE = 1024

DCR_EP_HOST = 10.*.*.25

DCR_EP_PORT = 11276

DCR_EP_ASM_LOAD_PATH = /dev_DMDATA

[GRP_ASM]

DCR_EP_NAME = ASM1

DCR_EP_SHM_KEY = 42425

DCR_EP_SHM_SIZE = 1024

DCR_EP_HOST = 10.*.*.26

DCR_EP_PORT = 11277

DCR_EP_ASM_LOAD_PATH = /dev_DMDATA

[GRP]

DCR_GRP_TYPE = DB

DCR_GRP_NAME = GRP_DSC

DCR_GRP_N_EP = 2

DCR_GRP_DSKCHK_CNT = 57

[GRP_DSC]

DCR_EP_NAME = DSC0

DCR_EP_SEQNO = 0

DCR_EP_PORT = 10038

DCR_CHECK_PORT = 11256

[GRP_DSC]

DCR_EP_NAME = DSC1

DCR_EP_SEQNO = 1

DCR_EP_PORT = 10038

DCR_CHECK_PORT = 11257

4.4.2使用DMASMCMD工具初始化磁盘

(1) 在1台机器,启动dmasmcmd工具,依次输入以下命令,dmasmcmd进入交互模式运

行,逐条解析、运行命令:

cd /home/dmdba/dmdbms/bin

./dmasmcmd

create dcrdisk '/dev_DMDATA/DM_DCR' 'dcr'

create votedisk '/dev_DMDATA/DM_VOTE' 'vote'

create asmdisk '/dev_DMDATA/DM_LOG' 'LOG0'

create asmdisk '/dev_DMDATA/DM_DATA' 'DATA0'

create asmdisk '/dev_DMDATA/DM_ARCH' 'ARCH0'

init dcrdisk '/dev_DMDATA/DM_DCR' from '/home/dmdba/DSC/dmdcr_cfg.ini' identified by 'Dameng123'

init votedisk '/dev_DMDATA/DM_VOTE' from '/home/dmdba/DSC/dmdcr_cfg.ini'

4.4.3准备DMASM的MAL配置文件dmasvrmal.ini

使用DMASM的所有节点都要配置,内容完全一样:

vim /home/dmdba/DSC/dmasvrmal.ini

[MAL_INST0]

MAL_INST_NAME = ASM0

MAL_HOST = 10.*.*.25

MAL_PORT = 11266

[MAL_INST1]

MAL_INST_NAME = ASM1

MAL_HOST = 10.*.*.26

MAL_PORT = 11266

4.4.4准备dmdcr.ini 配置文件

DMASM的两个节点分别配置 dmdcr.ini:

dmdcr_path 相同,dmasvrmal.ini 文件内容也相同,dmdcr_seqo 分别为 0 和 1。

节点1:10.*.*.25

vim /home/dmdba/DSC/dmdcr.ini

DMDCR_PATH = /dev_DMDATA/DM_DCR

DMDCR_MAL_PATH = /home/dmdba/DSC/dmasvrmal.ini

DMDCR_SEQNO = 0

DMDCR_ASM_RESTART_INTERVAL = 0

DMDCR_ASM_STARTUP_CMD = /home/dmdba/dmdbms/bin/DmAsmServiceASM0 start

DMDCR_DB_RESTART_INTERVAL = 1 #设置为0不自动拉起

DMDCR_DB_STARTUP_CMD = /home/dmdba/dmdbms/bin/DmServiceDSC0 start

DMDCR_AUTO_OPEN_CHECK = 120

DMDCR_ASM_TRACE_LEVEL = 2

节点2:10.*.*.26

vim /home/dmdba/DSC/dmdcr.ini

DMDCR_PATH = /dev_DMDATA/DM_DCR

DMDCR_MAL_PATH = /home/dmdba/DSC/dmasvrmal.ini

DMDCR_SEQNO = 1

DMDCR_ASM_RESTART_INTERVAL = 0

DMDCR_ASM_STARTUP_CMD = /home/dmdba/dmdbms/bin/DmAsmServiceASM1 start

DMDCR_DB_RESTART_INTERVAL = 1 #设置为0不自动拉起

DMDCR_DB_STARTUP_CMD = /home/dmdba/dmdbms/bin/DmServiceDSC1 start

DMDCR_AUTO_OPEN_CHECK = 120

DMDCR_ASM_TRACE_LEVEL = 2

4.4.5启动DMCSS、DMASM服务程序

#在两个节点先后分别启动dmcss、dmasmsvr程序:

cd /home/dmdba/dmdbms/bin

#手动启动dmcss命令:

./dmcss DCR_INI=/home/dmdba/DSC/dmdcr.ini

#手动启动dmasmsvr命令:

./dmasmsvr DCR_INI=/home/dmdba/DSC/dmdcr.ini

#如果DMCSS配置有自动拉起dmasmsvr的功能,可以等待DMCSS自动拉起 dmasmsvr程序,不需要手动启动。

4.4.6使用dmasmtool工具创建DMASM磁盘组

在1个节点上启动dmasmtool 工具:

cd /home/dmdba/dmdbms/bin

[/dmdbms/bin]# ./dmasmtool DCR_INI=/home/dmdba/DSC/dmdcr.ini

输入下列语句创建 DMASM 磁盘组:

--创建日志磁盘组

ASM>create diskgroup 'DMLOG' asmdisk '/dev_DMDATA/DM_LOG'

--创建数据磁盘组

ASM>create diskgroup 'DMDATA' asmdisk '/dev_DMDATA/DM_DATA'

--创建归档磁盘组

ASM>create diskgroup 'DMARCH' asmdisk '/dev_DMDATA/DM_ARCH'

[dmdba@dsc1 bin]$ dmasmtool DCR_INI=/home/dmdba/DSC/dmdcr.ini

dmasmtool V8

ASM>lsdsk

group DMLOG include 1 disks......

NO.1 disk :

name: DMASMLOG0

path: /dev_DMDATA/DM_LOG

size: 9.97 GB

create_time: 2026-10-19 14:13:56

modify_time: 2026-10-19 14:28:55

UUID: UNKNOWN

belong group: DMLOG

group DMDATA include 1 disks......

NO.1 disk :

name: DMASMDATA0

path: /dev_DMDATA/DM_DATA

size: 9.97 GB

create_time: 2026-10-19 14:13:57

modify_time: 2026-10-19 14:29:07

UUID: UNKNOWN

belong group: DMDATA

group DMARCH include 1 disks......

NO.1 disk :

name: DMASMARCH0

path: /dev_DMDATA/DM_ARCH

size: 9.97 GB

create_time: 2026-10-19 14:13:58

modify_time: 2026-10-19 14:29:21

UUID: UNKNOWN

belong group: DMARCH

group VOTE include 1 disks......

NO.1 disk :

name: DMASMvote

path: /dev_DMDATA/DM_VOTE

size: 5.00 GB

create_time: 2026-10-19 14:13:46

modify_time: 2026-10-19 14:14:57

UUID: UNKNOWN

belong group: VOTE

group DCR include 1 disks......

NO.1 disk :

name: DMASMdcr

path: /dev_DMDATA/DM_DCR

size: 5.00 GB

create_time: 2026-10-19 14:13:33

modify_time: 2026-10-19 14:14:42

UUID: UNKNOWN

belong group: DCR

total 0 disks unused......

Used time: 7.743(ms).

4.4.7dminit 创建数据库环境的配置文件dminit.ini

vim /home/dmdba/DSC/dminit.ini

DB_NAME = DAMENG

SYSDBA_PWD = Dameng123

SYSAUDITOR_PWD = Dameng123

SYSTEM_PATH = +DMDATA/

LOG_SIZE = 2048

DCR_PATH = /dev_DMDATA/DM_DCR

DCR_SEQNO = 0

AUTO_OVERWRITE = 2

PAGE_SIZE = 32

EXTENT_SIZE = 16

BLANK_PAD_MODE = 0

CHARSET = 0

CASE_SENSITIVE = 1

[DSC0]

CONFIG_PATH = /home/dmdba/DSC/DSC0

PORT_NUM = 10038

MAL_HOST = 10.*.*.25

MAL_PORT = 8344

LOG_PATH = +DMLOG/DSC0_LOG01.log

LOG_PATH = +DMLOG/DSC0_LOG02.log

[DSC1]

CONFIG_PATH = /home/dmdba/DSC/DSC1

PORT_NUM = 10038

MAL_HOST = 10.*.*.26

MAL_PORT = 8346

LOG_PATH = +DMLOG/DSC1_LOG01.log

LOG_PATH = +DMLOG/DSC1_LOG02.log

4.4.8使用dminit初始化DB环境

#在1个节点,启动dminit工具初始化数据库。dminit 执行完成后,会在 config_path目

录(/home/dmdba/DSC/DSC0 和/home/dmdba/DSC/DSC1)下生成配置文件 dm.ini 和 dmmal.ini。

./dminit control=/home/dmdba/DSC/dminit.ini

4.4.9启动数据库服务

#将节点1机器/home/dmdba/DSC/DSC1目录拷贝到节点2机器相同目录下,再分别启动dmserver即可完成DMDSC集群搭建。

[dmdba@dsc1 DSC]$ ls

dmasvrmal.ini dmdcr_cfg.ini dmdcr.ini dminit.ini DSC0 DSC1

[dmdba@dsc1 DSC]$ scp -r DSC1 dmdba@10.*.*.26:/home/dmdba/DSC/

#如果DMCSS配置有自动拉起 dmserver 的功能,可以等待DMCSS自动拉起实例,不需要手动启动。

#如果需要手动启动,可参考下面的操作步骤:

#10.*.*.25机器:

cd /home/dmdba/dmdbms/bin

./dmserver /home/dmdba/DSC/DSC0/dm.ini dcr_ini=/home/dmdba/DSC/dmdcr.ini

#10.*.*.26机器:

cd /home/dmdba/dmdbms/bin

./dmserver /home/dmdba/DSC/DSC1/dm.ini dcr_ini=/home/dmdba/DSC/dmdcr.ini

4.4.10配置DMCSSM监视器

同一个 DMDSC 集群中,允许最多同时启动10个监视器,建议监视器放在独立的第三方机器上,避免由于节点间网络不稳定等原因导致监视器误判节点故障。

  1. 编辑dmcssm.ini

mkdir /home/dmdba/DSC

vim /home/dmdba/DSC/dmcssm.ini

CSSM_OGUID=210715

CSSM_CSS_IP = 10.*.*.25:11286

CSSM_CSS_IP = 10.*.*.26:11286

CSSM_LOG_PATH = /home/dmdba/DSC/log

CSSM_LOG_FILE_SIZE = 32

CSSM_LOG_SPACE_LIMIT = 0

2)启动监视器

[/dmdbms/bin]#cd /home/dmdba/dmdbms/bin

[/dmdbms/bin]#./dmcssm INI_PATH=/home/dmdba/DSC/dmcssm.ini

集群正常

CSS

ASM

DB

4.5 共享存储集群DSC备节点搭建

4.5.1DSC dsc1节点备份

cd /home/dmdba/dmdbms/bin

./dmrman ctlstmt="backup database '/home/dmdba/DSC/DSC0/dm.ini' backupset '/home/dmdba/DSC/dmbackup/bak_first'" dcr_ini=/home/dmdba/DSC/dmdcr.ini

4.5.2发送备份集到备库

scp -r /home/dmdba/DSC/dmbackup/bak_first 10.*.*.27:/home/dmdba/

4.5.3初始化库,并备库还原

--初始化

./dminit path=/dmdata/data DB_NAME=DSC_STANDBY01 INSTANCE_NAME=DSC_STANDBY01 page_size=32 CASE_SENSITIVE=1 charset=1 log_size=2048 SYSDBA_PWD=Dameng123 SYSAUDITOR_PWD=Dameng123

--备份还原

su - dmdba

cd /home/dmdba/dmdbms/bin

./dmrman ctlstmt="restore database '/dmdata/data/DSC_STANDBY01/dm.ini' from backupset '/home/dmdba/bak_first'"

./dmrman ctlstmt="recover database '/dmdata/data/DSC_STANDBY01/dm.ini' from backupset '/home/dmdba/bak_first'"

./dmrman ctlstmt="recover database '/dmdata/data/DSC_STANDBY01/dm.ini'update db_magic"

4.5.4修改配置信息

--主库1配置:

  1. vi /home/dmdba/DSC/DSC0/dm.ini

ALTER_MODE_STATUS = 0

ENABLE_OFFLINE_TS = 2

ARCH_INI =1

MAL_INI =1

  1. vi /home/dmdba/DSC/DSC0/dmmal.ini

MAL_CHECK_INTERVAL = 30

MAL_CONN_FAIL_INTERVAL = 30

[MAL_INST0]

MAL_INST_NAME = DSC0

MAL_HOST = 10.*.*.25

MAL_PORT = 8344

MAL_INST_HOST = 10.*.*.25

MAL_INST_PORT = 10038

MAL_DW_PORT = 3567

MAL_INST_DW_PORT = 4576

[MAL_INST1]

MAL_INST_NAME = DSC1

MAL_HOST = 10.*.*.26

MAL_PORT = 8346

MAL_INST_HOST = 10.*.*.26

MAL_INST_PORT = 10038

MAL_DW_PORT = 3568

MAL_INST_DW_PORT = 4568

[MAL_INST2]

MAL_INST_NAME = DSC_STANDBY01

MAL_HOST = 10.*.*.27

MAL_PORT = 8738

MAL_INST_HOST = 10.*.*.27

MAL_INST_PORT = 10038

MAL_DW_PORT = 3569

MAL_INST_DW_PORT = 4569

  1. vi /home/dmdba/DSC/DSC0/dmarch.ini

ARCH_WAIT_APPLY = 0

ARCH_LOCAL_SHARE=1

ARCH_LOCAL_SHARE_CHECK=0

[ARCHIVE_LOCAL1]

ARCH_TYPE = LOCAL

ARCH_DEST = +DMARCH/DSC0

ARCH_FILE_SIZE = 2048

ARCH_SPACE_LIMIT = 100000

ARCH_FLUSH_BUF_SIZE = 0

ARCH_HANG_FLAG = 1

[ARCH_REMOTE1]

ARCH_TYPE = REMOTE

ARCH_DEST = DSC1

ARCH_INCOMING_PATH = +DMARCH/DSC1

[ARCHIVE_REALTIME1]

ARCH_TYPE = REALTIME

ARCH_DEST = DSC_STANDBY01

ARCH_FAILOVER = 1

  1. vi /home/dmdba/DSC/DSC0/dmwatcher.ini

[GRP1]

DW_TYPE = GLOBAL

DW_MODE = MANUAL

DW_ERROR_TIME = 60

INST_RECOVER_TIME = 60

INST_ERROR_TIME = 35

INST_OGUID = 26101901

INST_INI = /home/dmdba/DSC/DSC0/dm.ini

DCR_INI = /home/dmdba/DSC/dmdcr.ini

INST_AUTO_RESTART = 0

INST_STARTUP_CMD = /home/dmdba/dmdbms/bin/dmserver

RLOG_SEND_THRESHOLD = 0

RLOG_APPLY_THRESHOLD = 0

--主库2配置:

  1. vi /home/dmdba/DSC/DSC1/dm.ini

ALTER_MODE_STATUS = 0

ENABLE_OFFLINE_TS = 2

ARCH_INI =1

MAL_INI =1

  1. vi /home/dmdba/DSC/DSC1/dmmal.ini

MAL_CHECK_INTERVAL = 30

MAL_CONN_FAIL_INTERVAL = 30

[MAL_INST0]

MAL_INST_NAME = DSC0

MAL_HOST = 10.*.*.25

MAL_PORT = 8344

MAL_INST_HOST = 10.*.*.25

MAL_INST_PORT = 10038

MAL_DW_PORT = 3567

MAL_INST_DW_PORT = 4576

[MAL_INST1]

MAL_INST_NAME = DSC1

MAL_HOST = 10.*.*.26

MAL_PORT = 8346

MAL_INST_HOST = 10.*.*.26

MAL_INST_PORT = 10038

MAL_DW_PORT = 3568

MAL_INST_DW_PORT = 4568

[MAL_INST2]

MAL_INST_NAME = DSC_STANDBY01

MAL_HOST = 10.*.*.27

MAL_PORT = 8738

MAL_INST_HOST = 10.*.*.27

MAL_INST_PORT = 10038

MAL_DW_PORT = 3569

MAL_INST_DW_PORT = 4569

  1. vi /home/dmdba/DSC/DSC1/dmarch.ini

ARCH_WAIT_APPLY = 0

ARCH_LOCAL_SHARE=1

ARCH_LOCAL_SHARE_CHECK=0

[ARCHIVE_LOCAL1]

ARCH_TYPE = LOCAL

ARCH_DEST = +DMARCH/DSC1

ARCH_FILE_SIZE = 2048

ARCH_SPACE_LIMIT = 100000

ARCH_FLUSH_BUF_SIZE = 0

ARCH_HANG_FLAG = 1

[ARCH_REMOTE1]

ARCH_TYPE = REMOTE

ARCH_DEST = DSC0

ARCH_INCOMING_PATH = +DMARCH/DSC0

[ARCHIVE_REALTIME1]

ARCH_TYPE = REALTIME

ARCH_DEST = DSC_STANDBY01

ARCH_FAILOVER = 1

  1. vi /home/dmdba/DSC/DSC1/dmwatcher.ini

[GRP1]

DW_TYPE = GLOBAL

DW_MODE = MANUAL

DW_ERROR_TIME = 60

INST_RECOVER_TIME = 60

INST_ERROR_TIME = 35

INST_OGUID = 26101901

INST_INI = /home/dmdba/DSC/DSC1/dm.ini

DCR_INI = /home/dmdba/DSC/dmdcr.ini

INST_AUTO_RESTART = 0

INST_STARTUP_CMD = /home/dmdba/dmdbms/bin/dmserver

RLOG_SEND_THRESHOLD = 0

RLOG_APPLY_THRESHOLD = 0

--备库配置

  1. vi /dmdata/data/DSC_STANDBY01/dm.ini

ALTER_MODE_STATUS = 0

ENABLE_OFFLINE_TS = 2

ARCH_INI =1

MAL_INI =1

  1. vi /dmdata/data/DSC_STANDBY01/dmarch.ini

ARCH_WAIT_APPLY = 0

[ARCHIVE_LOCAL1]

ARCH_TYPE = LOCAL

ARCH_DEST = /dmdata/dmarch

ARCH_FILE_SIZE = 2048

ARCH_SPACE_LIMIT = 100000

ARCH_FLUSH_BUF_SIZE = 0

ARCH_HANG_FLAG = 1

[ARCHIVE_REALTIME]

ARCH_TYPE = REALTIME

ARCH_DEST = DSC0/DSC1

ARCH_FAILOVER = 1

  1. vi /dmdata/data/DSC_STANDBY01/dmmal.ini

MAL_CHECK_INTERVAL = 30

MAL_CONN_FAIL_INTERVAL = 30

[MAL_INST0]

MAL_INST_NAME = DSC0

MAL_HOST = 10.*.*.25

MAL_PORT = 8344

MAL_INST_HOST = 10.*.*.25

MAL_INST_PORT = 10038

MAL_DW_PORT = 3567

MAL_INST_DW_PORT = 4576

[MAL_INST1]

MAL_INST_NAME = DSC1

MAL_HOST = 10.*.*.26

MAL_PORT = 8346

MAL_INST_HOST = 10.*.*.26

MAL_INST_PORT = 10038

MAL_DW_PORT = 3568

MAL_INST_DW_PORT = 4568

[MAL_INST2]

MAL_INST_NAME = DSC_STANDBY01

MAL_HOST = 10.*.*.27

MAL_PORT = 8738

MAL_INST_HOST = 10.*.*.27

MAL_INST_PORT = 10038

MAL_DW_PORT = 3569

MAL_INST_DW_PORT = 4569

  1. vi /dmdata/data/DSC_STANDBY01/dmwatcher.ini

[GRP1]

DW_TYPE = GLOBAL

DW_MODE = MANUAL

DW_ERROR_TIME = 60

INST_RECOVER_TIME = 60

INST_ERROR_TIME = 10

INST_OGUID = 26101901

INST_INI =/dmdata/data/DSC_STANDBY01/dm.ini

INST_AUTO_RESTART = 1

INST_STARTUP_CMD = /home/dmdba/dmdbms/bin/dmserver

RLOG_SEND_THRESHOLD = 0

RLOG_APPLY_THRESHOLD = 0

4.5.5以mount模式启动各节点dmserver,并修改OGUID及实例类型

主库:

./dmserver /home/dmdba/DSC/DSC0/dm.ini dcr_ini=/home/dmdba/DSC/dmdcr.ini mount

SQL>

SP_SET_OGUID(26101901);

ALTER DATABASE PRIMARY;

备库:

./dmserver /dmdata/data/DSC_STANDBY01/dm.ini mount

SP_SET_OGUID(26101901);

ALTER DATABASE STANDBY;

4.5.6配置监视器

vi /dmdata/monitor/dmmonitor_auto.ini

MON_DW_CONFIRM=1

MON_LOG_PATH=/dmdata/monitor/log

MON_LOG_INTERVAL=60

MON_LOG_FILE_SIZE=64

MON_LOG_SPACE_LIMIT=0

[GRP1]

MON_INST_OGUID =26101901

MON_DW_IP = 10.*.*.25:3567/10.*.*.26:3568

MON_DW_IP = 10.*.*.27:3569

4.6 注册服务

节点1:

01、注册dmcss服务

su - root

cd /home/dmdba/dmdbms/script/root/

./dm_service_installer.sh -t dmcss -dcr_ini /home/dmdba/DSC/dmdcr.ini -p CSS0

Finished to create the service (DmCSSServiceCSS0)

02、注册dmasmsvr服务

./dm_service_installer.sh -t dmasmsvr -dcr_ini /home/dmdba/DSC/dmdcr.ini -p ASM0 -y DmCSSServiceCSS0

Finished to create the service (DmASMSvrServiceASM0)

03、注册数据库服务

./dm_service_installer.sh -t dmserver -dm_ini /home/dmdba/DSC/DSC0/dm.ini -dcr_ini /home/dmdba/DSC/dmdcr.ini -p DSC0 -y DmASMSvrServiceASM0 -m mount

Finished to create the service (DmServiceDSC0)

04、注册数据库守护服务

./dm_service_installer.sh -t dmwatcher -dm_ini /home/dmdba/DSC/DSC0/dmwatcher.ini -watcher_ini /home/dmdba/DSC/DSC0/dmwatcher.ini -p DSC0

Finished to create the service (DmWatcherServiceDSC0)

节点2:

01、注册dmcss服务

su - root

cd /home/dmdba/dmdbms/script/root/

./dm_service_installer.sh -t dmcss -dcr_ini /home/dmdba/DSC/dmdcr.ini -p CSS1

Finished to create the service (DmCSSServiceCSS0)

02、注册dmasmsvr服务

./dm_service_installer.sh -t dmasmsvr -dcr_ini /home/dmdba/DSC/dmdcr.ini -p ASM1 -y DmCSSServiceCSS1

Finished to create the service (DmASMSvrServiceASM0)

03、注册数据库服务

./dm_service_installer.sh -t dmserver -dm_ini /home/dmdba/DSC/DSC1/dm.ini -dcr_ini /home/dmdba/DSC/dmdcr.ini -p DSC1 -y DmASMSvrServiceASM1 -m mount

Finished to create the service (DmServiceDSC1)

04、注册数据库守护服务

./dm_service_installer.sh -t dmwatcher -dm_ini /home/dmdba/DSC/DSC1/dmwatcher.ini -watcher_ini /home/dmdba/DSC/DSC1/dmwatcher.ini -p DSC1

Finished to create the service (DmWatcherServiceDSC1)

备库

01、注册数据库服务

./dm_service_installer.sh -t dmserver -dm_ini /dmdata/data/DSC_STANDBY01/dm.ini -p DSC_STANDBY -m mount

创建服务(DmServiceDSC_STANDBY)完成

02、注册数据库守护服务

./dm_service_installer.sh -t dmwatcher -dm_ini /dmdata/data/DSC_STANDBY01/dmwatcher.ini -watcher_ini /dmdata/data/DSC_STANDBY01/dmwatcher.ini -p DSC_STANDBY

03、注册数据库监视器服务

./dm_service_installer.sh -t dmmonitor -monitor_ini /dmdata/monitor/dmmonitor_auto.ini -p GRP1

Finished to create the service (DmMonitorServiceGRP1)

注册完服务后,服务会被加入开机自启动,可以根据实际情况是否取消开机自启动。

4.7 DMDSC启动/停止说明

4.7.1启动DMDSC集群

su - dmdba

cd /home/dmdba/dmdbms/bin

1>启动node1的DMCSS:./DmCSSServiceCSS0 start

2>启动node1的DMASM:./DmASMSvrServiceASM0 start

3>启动node2的DMCSS:./DmCSSServiceCSS1 start

4>启动node2的DMASM:./DmASMSvrServiceASM1 start

5>启动node1的DMSERVER:./DmServiceDSC0 start

6>启动node2的DMSERVER:./DmServiceDSC1 start

7>启动node1的DMWATCHER:./DmWatcherServiceDSC0 start

8>启动node2的DMWATCHER:./DmWatcherServiceDSC1 start

9>启动node3的DMSERVER:./DmServiceDSC_STANDBY start

10>启动node3的DMWATCHER:./DmWatcherServiceDSC_STANDBY start

11>启动node3的DMMONITOR:./DmMonitorServiceGRP1 start

4.7.2停止DMDSC集群

su - dmdba

cd /home/dmdba/dmdbms/bin

1>停止node3的DMMONITOR:./DmMonitorServiceGRP1 stop

2>停止node1的DMWATCHER:./DmWatcherServiceDSC0 stop

3>停止node2的DMWATCHER:./DmWatcherServiceDSC1 stop

4>停止node3的DMWATCHER:./DmWatcherServiceDSC_STANDBY stop

5>停止node1的dmserver:./DmServiceDSC0 stop

6>停止node2的dmserver:./DmServiceDSC1 stop

7>停止node3的dmserver:./DmServiceDSC_STANDBY stop

8>停止node1的dmasmsvr:./DmASMSvrServiceASM0 stop

9>停止node2的dmasmsvr:./DmASMSvrServiceASM1 stop

10>停止node1的dmcss:./DmCSSServiceCSS0 stop

11>停止node2的dmcss:./DmCSSServiceCSS1 stop

4.8 检查集群状态

[dmdba@grp1dsc3 bin]$ dmmonitor /dmdata/monitor/dmmonitor_manual.ini

五、实验遇到的问题、原因分析与解决方案

/

六、学习总结与体会

DSC+DW集群是比较常用的高可用+容灾架构,部署本身并不涉及难点,但要保证在大量配置文件调整过程中不出错,需要提前规划好端口,一份完整、可直接复用的部署手册也很重要。

七、参考资源

达梦官方文档《DM8数据共享集群》、《DMDSC集群部署手册》

 

达梦官网:https://eco.dameng.com

达梦技术社区:https://eco.dameng.com/community/

posted @ 2026-11-12 00:56  那个人后来  阅读(8)  评论(0)    收藏  举报