acfs要先于单实例ohasd启动？

Unable To mount ACFS after Reboot On Standalone GI [SIHA] (文档 ID 2348133.1)

In this Document

Oracle Database - Standard Edition - Version 12.2.0.1 and later

---

 

APPLIES TO:

Information in this document applies to any platform.

SYMPTOMS

On 12.2.0.1 Oracle Restart. We could successfully create diskgroups, create ACFS and create files on it, after reboot of the server it cannot be mounted even after loading the drivers

oracle@boston [ +ASM ] ~]$ asmcmd volcreate -G ACFS -s 500G ACFS_VOL
oracle@boston [ +ASM ] ~]$ asmcmd volinfo --all
Diskgroup Name: ACFS

Volume Name: ACFS_VOL
Volume Device: /dev/asm/acfs_vol-142
State: ENABLED
Size (MB): 512000
Resize Unit (MB): 64
Redundancy: MIRROR
Stripe Columns: 8
Stripe Width (K): 1024
Usage:
Mountpath:

[root@boston ~]# mkfs -t acfs /dev/asm/acfs_vol-142
mkfs.acfs: version = 12.2.0.1.0
mkfs.acfs: on-disk version = 46.0
mkfs.acfs: volume = /dev/asm/acfs_vol-142
mkfs.acfs: volume size = 536870912000 ( 500.00 GB )
mkfs.acfs: Format complete.
[root@boston ~]# mount -t acfs /dev/asm/acfs_vol-142 /acfs
[root@boston ~]# chown oracle:dba /acfs
[root@boston ~]# chmod 775 /acfs/
oracle@boston [ +ASM ] acfs]$ df -h /acfs
Filesystem Size Used Avail Use% Mounted on
/dev/asm/acfs_vol-142 500G 1.3G 499G 1% /acfs
oracle@boston [ +ASM ] ~]$ cd /acfs/
oracle@boston [ +ASM ] acfs]$ ll
total 64
drwx------ 2 root root 65536 Dec 29 15:06 lost+found
oracle@boston [ +ASM ] acfs]$ touch works
oracle@boston [ +ASM ] acfs]$ ll
total 64
drwx------ 2 root root 65536 Dec 29 15:06 lost+found
-rw-r--r-- 1 oracle oinstall 0 Dec 29 15:07 works

 After reboot of the server ACFS mount path failed to mount even after loading the drivers

[root@boston bin]# ps -ef |grep smon
oracle 4177 1 0 15:14 ? 00:00:00 asm_smon_+ASM
root 4466 3757 0 15:14 ttyS0 00:00:00 grep --color=auto smon
[root@boston bin]# lsmod | grep orac
oracleasm 61440 1
[root@boston bin]# ./acfsload start -s
[ 171.168011] oracleoks: module license 'Proprietary' taints kernel.
[ 171.241796] Disabling lock debugging due to kernel taint
[ 171.308638] OKSK-00028: In memory kernel log buffer address: 0xffff881035213f40, size: 10485760
[ 171.414359] OKSK-00027: Oracle kernel distributed lock manager hash size is 2000000
[ 171.511591] OKSK-00004: Module load succeeded. Build information: (LOW DEBUG) USM_12.2.0.1.0_LINUX.X64_161110 2016/11/10 21:56:06
[ 171.835675] ADVMK-0001: Module load succeeded. Build information: (LOW DEBUG) - USM_12.2.0.1.0_LINUX.X64_161110 built on 2016/11/10 22:15:12.
[ 171.988445] asmInit: rval=0 mode=0 offload=0
[ 172.454071] ACFSK-0037: Module load succeeded. Build information: (LOW DEBUG) USM_12.2.0.1.0_LINUX.X64_161110 2016/11/10 22:40:06
[root@boston bin]# lsmod | grep orac
oracleacfs 4616192 0
oracleadvm 782336 0
oracleoks 655360 2 oracleacfs,oracleadvm
oracleasm 61440 1
[root@boston bin]# su - oracle

[oracle@boston ~]$ . oraenv
ORACLE_SID = [oracle] ? +ASM
The Oracle base has been set to /u01/app/oracle
[oracle@boston ~]$ asmcmd volinfo --all
Diskgroup Name: ACFS

Volume Name: ACFS_VOL
Volume Device: /dev/asm/acfs_vol-142
State: DISABLED
Size (MB): 512000
Resize Unit (MB): 64
Redundancy: MIRROR
Stripe Columns: 8
Stripe Width (K): 1024
Usage: ACFS
Mountpath: /acfs

[oracle@boston ~]$ asmcmd volenable --all
[oracle@boston ~]$ asmcmd volinfo --all
Diskgroup Name: ACFS

Volume Name: ACFS_VOL
Volume Device: /dev/asm/acfs_vol-142
State: ENABLED
Size (MB): 512000
Resize Unit (MB): 64
Redundancy: MIRROR
Stripe Columns: 8
Stripe Width (K): 1024
Usage: ACFS
Mountpath: /acfs

[root@boston bin]# mount -t acfs /dev/asm/acfs_vol-142 /acfs
mount.acfs: CLSU-00100: operating system function: open64 failed with error data: 1
mount.acfs: CLSU-00101: operating system error message: Operation not permitted
mount.acfs: CLSU-00103: error location: OOF_1
mount.acfs: CLSU-00104: additional error information: open64 (/dev/asm/acfs_vol-142)
mount.acfs: ACFS-02017: Failed to open volume /dev/asm/acfs_vol-142. Verify the volume exists.<<<<<<<<<<<<<<<

[root@boston bin]# ls -l /dev/asm/
total 0
brwxrwx--- 1 root dba 247, 72705 Dec 29 15:16 acfs_vol-142

 

 

CAUSE

 This issue was discussed in Internal Bug 25574975 - ACFS IS NOT MOUNTING WITH ACFS-02017: FAILED TO OPEN VOLUME MESSAGE and closed as "Not a bug" with below comment.

"ACFS Drivers should get loaded before ASM starts."

SOLUTION

 Standalone setup does not start ACFS automatically, so create rc.local script to load the ACFS drivers well before the OHASD service starts. ACFS drivers should get loaded before ASM starts.

Example script

cat /etc/systemd/system/oracle-acfsload.service
#
# Oracle ACFS Drivers
#
[Unit]
Description=Load ACFS Drivers during boot
After=syslog.target oracle-ohasd.service

[Service]
ExecStart=/u01/app/grid/12.2.0.1/bin/acfsload start -s >/dev/null 2>&1 </dev/null
Type=simple

[Install]
WantedBy=multi-user.target graphical.target