因修改SYS密码引起的gap问题修复
早上对数据库进行例行巡检时发现有一台数据库，读库无法正常接收日志。查看备库日志发现最后一次同步时间是2017年7月8号（依赖EM监控，但是没有收到报警，这个需要后期排查原因）。
之前对主库巡检时通过user$视图查看到sys密码有效期低于14天后，将sys密码通过密文修改的和之前一样：
查看密码有效期语句：
select 'alter user '||d.username || ' identified by values ' || ''''|| u.password || ''';' from dba_users d,user$ u where account_status='OPEN' and d.username=u.name and (trunc(expiry_date)-trunc(sysdate))<14;因为改成与之前相同的密码，所以没有对备库进行同步密码文件，看来是这个步骤导致主备库password files不同。
手动在主库切换一次日志后，通过主库日志发现报错密码文件过期：
SQL> alter system switch logfile;Error 1017 received logging on to the standby
------------------------------------------------------------
Check that the primary and standby are using a password file
and remote_login_passwordfile is set to SHARED or EXCLUSIVE,
and that the SYS password is same in the password files.
returning error ORA-16191
------------------------------------------------------------
将主库的password files同步到备库：
[oracle@gzkDB26 ~]$ scp $ORACLE_HOME/dbs/orapwsid @standby:$ORACLE_HOME/dbs查看备库日志后发现出现gap：
[oracle@gzkdb15 ~]$ tail -f /oracle/app/oracle/diag/rdbms/maindb/center/trace/alert_center.log
Mon Jul 10 09:32:53 2017
Primary database is in MAXIMUM PERFORMANCE mode
RFS[867]: Assigned to RFS process 21640
RFS[867]: Selected log 4 for thread 1 sequence 1585060 dbid 41334651 branch 907452801
Mon Jul 10 09:32:54 2017
RFS[868]: Assigned to RFS process 21642
RFS[868]: Opened log for thread 1 sequence 1585059 dbid 41334651 branch 907452801
Mon Jul 10 09:32:55 2017
Fetching gap sequence in thread 1, gap sequence 1574855-1574855
Archived Log entry 1830170 added for thread 1 sequence 1585059 rlc 907452801 ID 0x4cf4ed4 dest 3:
Fetching gap sequence in thread 1, gap sequence 1574855-1574954
Mon Jul 10 09:34:53 2017
FAL[client]: Failed to request gap sequence
GAP - thread 1 sequence 1574855-1574954
DBID 41334651 branch 907452801
FAL[client]: All defined FAL servers have been attempted.
------------------------------------------------------------
Check that the CONTROL_FILE_RECORD_KEEP_TIME initialization
parameter is defined to a value that's sufficiently large
enough to maintain adequate log switch information to resolve
archivelog gaps.
------------------------------------------------------------在备库查看丢失的日志：
SQL> select * from v$archive_gap;
THREAD# LOW_SEQUENCE# HIGH_SEQUENCE#
---------- ------------- --------------
1 1574855 1585058
在主库上查看日志文件，发现物理文件已经被删除（因空间有限，做了脚本只保留一天归档日志）：
SQL> select name from v$archived_log where thread#=1 and dest_id=1 and sequence# between 1574855 and 1574954;
NAME
--------------------------------------------------------------------------------
....
....
....
100 rows selected.
因为主库每天都在做增量备份，所以查找丢失的日志序列号对应的增量备份文件：
[oracle@gzkDB26 dbs]$ rman target /
Recovery Manager: Release 11.2.0.4.0 - Production on Mon Jul 10 09:49:23 2017
Copyright (c) 1982, 2011, Oracle and/or its affiliates. All rights reserved.
connected to target database: CENTER (DBID=41334651)
RMAN> list backup of archivelog from sequence 1574855 until sequence 1574954;
List of Backup Sets
===================
BS Key Size Device Type Elapsed Time Completion Time
------- ---------- ----------- ------------ ---------------
20852 575.33M DISK 00:03:43 09-JUL-17
BP Key: 20852 Status: AVAILABLE Compressed: YES Tag: TAG20170709T010329
Piece Name: /oracle/app/oracle/fast_recovery_area/STBYDB26/backupset/2017_07_09/o1_mf_annnn_TAG20170709T010329_dp26mfks_.bkp
List of Archived Logs in backup set 20852
Thrd Seq Low SCN Low Time Next SCN Next Time
---- ------- ---------- --------- ---------- ---------
1 1574855 15526665068890 08-JUL-17 15526665070403 08-JUL-17
1 1574856 15526665070403 08-JUL-17 15526665070512 08-JUL-17
1 1574857 15526665070512 08-JUL-17 15526665071554 08-JUL-17
1 1574858 15526665071554 08-JUL-17 15526665072816 08-JUL-17
1 1574859 15526665072816 08-JUL-17 15526665072924 08-JUL-17
1 1574860 15526665072924 08-JUL-17 15526665073727 08-JUL-17
1 1574861 15526665073727 08-JUL-17 15526665074722 08-JUL-17
1 1574862 15526665074722 08-JUL-17 15526665075331 08-JUL-17
BS Key Size Device Type Elapsed Time Completion Time
------- ---------- ----------- ------------ ---------------
20853 664.32M DISK 00:03:29 09-JUL-17
BP Key: 20853 Status: AVAILABLE Compressed: YES Tag: TAG20170709T010329
Piece Name: /oracle/app/oracle/fast_recovery_area/STBYDB26/backupset/2017_07_09/o1_mf_annnn_TAG20170709T010329_dp26qwks_.bkp
List of Archived Logs in backup set 20853
Thrd Seq Low SCN Low Time Next SCN Next Time
---- ------- ---------- --------- ---------- ---------
1 1574863 15526665075331 08-JUL-17 15526665075470 08-JUL-17
1 1574864 15526665075470 08-JUL-17 15526665075556 08-JUL-17
1 1574865 15526665075556 08-JUL-17 15526665075658 08-JUL-17
1 1574866 15526665075658 08-JUL-17 15526665075746 08-JUL-17
1 1574867 15526665075746 08-JUL-17 15526665075843 08-JUL-17
1 1574868 15526665075843 08-JUL-17 15526665075984 08-JUL-17
1 1574869 15526665075984 08-JUL-17 15526665076076 08-JUL-17
1 1574870 15526665076076 08-JUL-17 15526665076225 08-JUL-17
1 1574871 15526665076225 08-JUL-17 15526665076329 08-JUL-17
1 1574872 15526665076329 08-JUL-17 15526665076502 08-JUL-17
1 1574873 15526665076502 08-JUL-17 15526665076594 08-JUL-17
1 1574874 15526665076594 08-JUL-17 15526665076898 08-JUL-17
1 1574875 15526665076898 08-JUL-17 15526665077298 08-JUL-17
1 1574876 15526665077298 08-JUL-17 15526665077441 08-JUL-17
1 1574877 15526665077441 08-JUL-17 15526665077556 08-JUL-17
1 1574878 15526665077556 08-JUL-17 15526665077676 08-JUL-17
1 1574879 15526665077676 08-JUL-17 15526665077757 08-JUL-17
1 1574880 15526665077757 08-JUL-17 15526665077836 08-JUL-17
1 1574881 15526665077836 08-JUL-17 15526665077935 08-JUL-17
1 1574882 15526665077935 08-JUL-17 15526665078038 08-JUL-17
1 1574883 15526665078038 08-JUL-17 15526665078243 08-JUL-17
1 1574884 15526665078243 08-JUL-17 15526665078358 08-JUL-17
1 1574885 15526665078358 08-JUL-17 15526665078493 08-JUL-17
1 1574886 15526665078493 08-JUL-17 15526665078584 08-JUL-17
1 1574887 15526665078584 08-JUL-17 15526665078745 08-JUL-17
1 1574888 15526665078745 08-JUL-17 15526665078989 08-JUL-17
1 1574889 15526665078989 08-JUL-17 15526665079710 08-JUL-17
1 1574890 15526665079710 08-JUL-17 15526665080320 08-JUL-17
1 1574891 15526665080320 08-JUL-17 15526665080904 08-JUL-17
1 1574892 15526665080904 08-JUL-17 15526665081721 08-JUL-17
1 1574893 15526665081721 08-JUL-17 15526665082046 08-JUL-17
1 1574894 15526665082046 08-JUL-17 15526665082237 08-JUL-17
1 1574895 15526665082237 08-JUL-17 15526665082438 08-JUL-17
1 1574896 15526665082438 08-JUL-17 15526665082709 08-JUL-17
1 1574897 15526665082709 08-JUL-17 15526665083262 08-JUL-17
1 1574898 15526665083262 08-JUL-17 15526665083807 08-JUL-17
1 1574899 15526665083807 08-JUL-17 15526665084451 08-JUL-17
1 1574900 15526665084451 08-JUL-17 15526665085055 08-JUL-17
1 1574901 15526665085055 08-JUL-17 15526665085812 08-JUL-17
1 1574902 15526665085812 08-JUL-17 15526665086714 08-JUL-17
1 1574903 15526665086714 08-JUL-17 15526665087266 08-JUL-17
1 1574904 15526665087266 08-JUL-17 15526665088073 08-JUL-17
1 1574905 15526665088073 08-JUL-17 15526665088598 08-JUL-17
1 1574906 15526665088598 08-JUL-17 15526665089078 08-JUL-17
1 1574907 15526665089078 08-JUL-17 15526665089851 08-JUL-17
1 1574908 15526665089851 08-JUL-17 15526665090271 08-JUL-17
1 1574909 15526665090271 08-JUL-17 15526665090677 08-JUL-17
1 1574910 15526665090677 08-JUL-17 15526665091157 08-JUL-17
1 1574911 15526665091157 08-JUL-17 15526665091394 08-JUL-17
1 1574912 15526665091394 08-JUL-17 15526665091835 08-JUL-17
1 1574913 15526665091835 08-JUL-17 15526665092178 08-JUL-17
1 1574914 15526665092178 08-JUL-17 15526665092641 08-JUL-17
1 1574915 15526665092641 08-JUL-17 15526665093420 08-JUL-17
1 1574916 15526665093420 08-JUL-17 15526665094878 08-JUL-17
1 1574917 15526665094878 08-JUL-17 15526665095217 08-JUL-17
1 1574918 15526665095217 08-JUL-17 15526665095744 08-JUL-17
1 1574919 15526665095744 08-JUL-17 15526665106594 08-JUL-17
1 1574920 15526665106594 08-JUL-17 15526665124092 08-JUL-17
1 1574921 15526665124092 08-JUL-17 15526665138686 08-JUL-17
1 1574922 15526665138686 08-JUL-17 15526665153341 08-JUL-17
1 1574923 15526665153341 08-JUL-17 15526665167840 08-JUL-17
1 1574924 15526665167840 08-JUL-17 15526665182098 08-JUL-17
1 1574925 15526665182098 08-JUL-17 15526665198149 08-JUL-17
1 1574926 15526665198149 08-JUL-17 15526665212460 08-JUL-17
BS Key Size Device Type Elapsed Time Completion Time
------- ---------- ----------- ------------ ---------------
20854 648.35M DISK 00:03:30 09-JUL-17
BP Key: 20854 Status: AVAILABLE Compressed: YES Tag: TAG20170709T010329
Piece Name: /oracle/app/oracle/fast_recovery_area/STBYDB26/backupset/2017_07_09/o1_mf_annnn_TAG20170709T010329_dp26tvdj_.bkp
List of Archived Logs in backup set 20854
Thrd Seq Low SCN Low Time Next SCN Next Time
---- ------- ---------- --------- ---------- ---------
1 1574927 15526665212460 08-JUL-17 15526665217101 08-JUL-17
1 1574928 15526665217101 08-JUL-17 15526665217670 08-JUL-17
1 1574929 15526665217670 08-JUL-17 15526665217941 08-JUL-17
1 1574930 15526665217941 08-JUL-17 15526665218065 08-JUL-17
1 1574931 15526665218065 08-JUL-17 15526665218140 08-JUL-17
1 1574932 15526665218140 08-JUL-17 15526665218260 08-JUL-17
1 1574933 15526665218260 08-JUL-17 15526665218340 08-JUL-17
1 1574934 15526665218340 08-JUL-17 15526665218512 08-JUL-17
1 1574935 15526665218512 08-JUL-17 15526665218618 08-JUL-17
1 1574936 15526665218618 08-JUL-17 15526665218698 08-JUL-17
1 1574937 15526665218698 08-JUL-17 15526665218814 08-JUL-17
1 1574938 15526665218814 08-JUL-17 15526665218956 08-JUL-17
1 1574939 15526665218956 08-JUL-17 15526665219211 08-JUL-17
1 1574940 15526665219211 08-JUL-17 15526665237040 08-JUL-17
1 1574941 15526665237040 08-JUL-17 15526665237620 08-JUL-17
1 1574942 15526665237620 08-JUL-17 15526665238033 08-JUL-17
1 1574943 15526665238033 08-JUL-17 15526665238460 08-JUL-17
1 1574944 15526665238460 08-JUL-17 15526665238873 08-JUL-17
1 1574945 15526665238873 08-JUL-17 15526665239443 08-JUL-17
1 1574946 15526665239443 08-JUL-17 15526665239827 08-JUL-17
1 1574947 15526665239827 08-JUL-17 15526665240243 08-JUL-17
1 1574948 15526665240243 08-JUL-17 15526665240690 08-JUL-17
1 1574949 15526665240690 08-JUL-17 15526665241123 08-JUL-17
1 1574950 15526665241123 08-JUL-17 15526665241560 08-JUL-17
1 1574951 15526665241560 08-JUL-17 15526665242041 08-JUL-17
1 1574952 15526665242041 08-JUL-17 15526665242449 08-JUL-17
1 1574953 15526665242449 08-JUL-17 15526665242849 08-JUL-17
1 1574954 15526665242849 08-JUL-17 15526665243281 08-JUL-17
传输备份文件到备库：
[oracle@gzkDB26 2017_07_09]$ scp o1_mf_annnn_TAG20170709T010329_dp26* 172.23.9.15:/oracle/backup
oracle@172.23.9.15's password:
o1_mf_annnn_TAG20170709T010329_dp266yj9_.bkp 100% 723MB 14.5MB/s 00:50
o1_mf_annnn_TAG20170709T010329_dp2679d4_.bkp 100% 833MB 26.9MB/s 00:31
o1_mf_annnn_TAG20170709T010329_dp26fnso_.bkp 100% 690MB 15.0MB/s 00:46
o1_mf_annnn_TAG20170709T010329_dp26mfks_.bkp 100% 575MB 14.8MB/s 00:39
o1_mf_annnn_TAG20170709T010329_dp26qwks_.bkp 100% 664MB 11.9MB/s 00:56
o1_mf_annnn_TAG20170709T010329_dp26tvdj_.bkp 100% 648MB 14.4MB/s 00:45
o1_mf_annnn_TAG20170709T010329_dp26ynxv_.bkp 100% 761MB 13.6MB/s 00:56
备库基于增量备份进行恢复：
[oracle@gzkdb15 ~]$ rman target /
Recovery Manager: Release 11.2.0.4.0 - Production on Mon Jul 10 11:10:31 2017
Copyright (c) 1982, 2011, Oracle and/or its affiliates. All rights reserved.
connected to target database: CENTER (DBID=41334651)
RMAN> catalog start with '/oracle/backup';
using target database control file instead of recovery catalog
searching for all files that match the pattern /oracle/backup
List of Files Unknown to the Database
=====================================
File Name: /oracle/backup/o1_mf_annnn_TAG20170709T010329_dp26ynxv_.bkp
File Name: /oracle/backup/o1_mf_annnn_TAG20170709T010329_dp26qwks_.bkp
File Name: /oracle/backup/o1_mf_annnn_TAG20170709T010329_dp2679d4_.bkp
File Name: /oracle/backup/o1_mf_annnn_TAG20170709T010329_dp26tvdj_.bkp
File Name: /oracle/backup/o1_mf_annnn_TAG20170709T010329_dp26mfks_.bkp
File Name: /oracle/backup/o1_mf_annnn_TAG20170709T010329_dp266yj9_.bkp
File Name: /oracle/backup/o1_mf_annnn_TAG20170709T010329_dp26fnso_.bkp
Do you really want to catalog the above files (enter YES or NO)? yes
cataloging files...
cataloging done
List of Cataloged Files
=======================
File Name: /oracle/backup/o1_mf_annnn_TAG20170709T010329_dp26ynxv_.bkp
File Name: /oracle/backup/o1_mf_annnn_TAG20170709T010329_dp26qwks_.bkp
File Name: /oracle/backup/o1_mf_annnn_TAG20170709T010329_dp2679d4_.bkp
File Name: /oracle/backup/o1_mf_annnn_TAG20170709T010329_dp26tvdj_.bkp
File Name: /oracle/backup/o1_mf_annnn_TAG20170709T010329_dp26mfks_.bkp
File Name: /oracle/backup/o1_mf_annnn_TAG20170709T010329_dp266yj9_.bkp
File Name: /oracle/backup/o1_mf_annnn_TAG20170709T010329_dp26fnso_.bkp
RMAN> restore archivelog from sequence 1574855 until sequence 1574954;
Starting restore at 10-JUL-17
allocated channel: ORA_DISK_1
channel ORA_DISK_1: SID=1566 device type=DISK
channel ORA_DISK_1: starting archived log restore to default destination
channel ORA_DISK_1: restoring archived log
archived log thread=1 sequence=1574855
channel ORA_DISK_1: restoring archived log
archived log thread=1 sequence=1574856
channel ORA_DISK_1: restoring archived log
archived log thread=1 sequence=1574857
channel ORA_DISK_1: restoring archived log
archived log thread=1 sequence=1574858
channel ORA_DISK_1: restoring archived log
archived log thread=1 sequence=1574859
channel ORA_DISK_1: restoring archived log
archived log thread=1 sequence=1574860
channel ORA_DISK_1: restoring archived log
archived log thread=1 sequence=1574861
channel ORA_DISK_1: restoring archived log
archived log thread=1 sequence=1574862
channel ORA_DISK_1: reading from backup piece /oracle/backup/o1_mf_annnn_TAG20170709T010329_dp26mfks_.bkp
channel ORA_DISK_1: piece handle=/oracle/backup/o1_mf_annnn_TAG20170709T010329_dp26mfks_.bkp tag=TAG20170709T010329
channel ORA_DISK_1: restored backup piece 1
channel ORA_DISK_1: restore complete, elapsed time: 00:01:25
channel ORA_DISK_1: starting archived log restore to default destination
channel ORA_DISK_1: restoring archived log
archived log thread=1 sequence=1574863
channel ORA_DISK_1: restoring archived log
archived log thread=1 sequence=1574864
channel ORA_DISK_1: restoring archived log
archived log thread=1 sequence=1574865
channel ORA_DISK_1: restoring archived log
archived log thread=1 sequence=1574866
channel ORA_DISK_1: restoring archived log
archived log thread=1 sequence=1574867
channel ORA_DISK_1: restoring archived log
archived log thread=1 sequence=1574868
channel ORA_DISK_1: restoring archived log
archived log thread=1 sequence=1574869
channel ORA_DISK_1: restoring archived log
archived log thread=1 sequence=1574870
channel ORA_DISK_1: restoring archived log
archived log thread=1 sequence=1574871
channel ORA_DISK_1: restoring archived log
archived log thread=1 sequence=1574872
channel ORA_DISK_1: restoring archived log
archived log thread=1 sequence=1574873
channel ORA_DISK_1: restoring archived log
archived log thread=1 sequence=1574874
channel ORA_DISK_1: restoring archived log
archived log thread=1 sequence=1574875
channel ORA_DISK_1: restoring archived log
archived log thread=1 sequence=1574876
channel ORA_DISK_1: restoring archived log
archived log thread=1 sequence=1574877
channel ORA_DISK_1: restoring archived log
archived log thread=1 sequence=1574878
channel ORA_DISK_1: restoring archived log
archived log thread=1 sequence=1574879
channel ORA_DISK_1: restoring archived log
archived log thread=1 sequence=1574880
channel ORA_DISK_1: restoring archived log
archived log thread=1 sequence=1574881
channel ORA_DISK_1: restoring archived log
archived log thread=1 sequence=1574882
channel ORA_DISK_1: restoring archived log
archived log thread=1 sequence=1574883
channel ORA_DISK_1: restoring archived log
archived log thread=1 sequence=1574884
channel ORA_DISK_1: restoring archived log
archived log thread=1 sequence=1574885
channel ORA_DISK_1: restoring archived log
archived log thread=1 sequence=1574886
channel ORA_DISK_1: restoring archived log
archived log thread=1 sequence=1574887
channel ORA_DISK_1: restoring archived log
archived log thread=1 sequence=1574888
channel ORA_DISK_1: restoring archived log
archived log thread=1 sequence=1574889
channel ORA_DISK_1: restoring archived log
archived log thread=1 sequence=1574890
channel ORA_DISK_1: restoring archived log
archived log thread=1 sequence=1574891
channel ORA_DISK_1: restoring archived log
archived log thread=1 sequence=1574892
channel ORA_DISK_1: restoring archived log
archived log thread=1 sequence=1574893
channel ORA_DISK_1: restoring archived log
archived log thread=1 sequence=1574894
channel ORA_DISK_1: restoring archived log
archived log thread=1 sequence=1574895
channel ORA_DISK_1: restoring archived log
archived log thread=1 sequence=1574896
channel ORA_DISK_1: restoring archived log
archived log thread=1 sequence=1574897
channel ORA_DISK_1: restoring archived log
archived log thread=1 sequence=1574898
channel ORA_DISK_1: restoring archived log
archived log thread=1 sequence=1574899
channel ORA_DISK_1: restoring archived log
archived log thread=1 sequence=1574900
channel ORA_DISK_1: restoring archived log
archived log thread=1 sequence=1574901
channel ORA_DISK_1: restoring archived log
archived log thread=1 sequence=1574902
channel ORA_DISK_1: restoring archived log
archived log thread=1 sequence=1574903
channel ORA_DISK_1: restoring archived log
archived log thread=1 sequence=1574904
channel ORA_DISK_1: restoring archived log
archived log thread=1 sequence=1574905
channel ORA_DISK_1: restoring archived log
archived log thread=1 sequence=1574906
channel ORA_DISK_1: restoring archived log
archived log thread=1 sequence=1574907
channel ORA_DISK_1: restoring archived log
archived log thread=1 sequence=1574908
channel ORA_DISK_1: restoring archived log
archived log thread=1 sequence=1574909
channel ORA_DISK_1: restoring archived log
archived log thread=1 sequence=1574910
channel ORA_DISK_1: restoring archived log
archived log thread=1 sequence=1574911
channel ORA_DISK_1: restoring archived log
archived log thread=1 sequence=1574912
channel ORA_DISK_1: restoring archived log
archived log thread=1 sequence=1574913
channel ORA_DISK_1: restoring archived log
archived log thread=1 sequence=1574914
channel ORA_DISK_1: restoring archived log
archived log thread=1 sequence=1574915
channel ORA_DISK_1: restoring archived log
archived log thread=1 sequence=1574916
channel ORA_DISK_1: restoring archived log
archived log thread=1 sequence=1574917
channel ORA_DISK_1: restoring archived log
archived log thread=1 sequence=1574918
channel ORA_DISK_1: restoring archived log
archived log thread=1 sequence=1574919
channel ORA_DISK_1: restoring archived log
archived log thread=1 sequence=1574920
channel ORA_DISK_1: restoring archived log
archived log thread=1 sequence=1574921
channel ORA_DISK_1: restoring archived log
archived log thread=1 sequence=1574922
channel ORA_DISK_1: restoring archived log
archived log thread=1 sequence=1574923
channel ORA_DISK_1: restoring archived log
archived log thread=1 sequence=1574924
channel ORA_DISK_1: restoring archived log
archived log thread=1 sequence=1574925
channel ORA_DISK_1: restoring archived log
archived log thread=1 sequence=1574926
channel ORA_DISK_1: reading from backup piece /oracle/backup/o1_mf_annnn_TAG20170709T010329_dp26qwks_.bkp
channel ORA_DISK_1: piece handle=/oracle/backup/o1_mf_annnn_TAG20170709T010329_dp26qwks_.bkp tag=TAG20170709T010329
channel ORA_DISK_1: restored backup piece 1
channel ORA_DISK_1: restore complete, elapsed time: 00:02:45
channel ORA_DISK_1: starting archived log restore to default destination
channel ORA_DISK_1: restoring archived log
archived log thread=1 sequence=1574927
channel ORA_DISK_1: restoring archived log
archived log thread=1 sequence=1574928
channel ORA_DISK_1: restoring archived log
archived log thread=1 sequence=1574929
channel ORA_DISK_1: restoring archived log
archived log thread=1 sequence=1574930
channel ORA_DISK_1: restoring archived log
archived log thread=1 sequence=1574931
channel ORA_DISK_1: restoring archived log
archived log thread=1 sequence=1574932
channel ORA_DISK_1: restoring archived log
archived log thread=1 sequence=1574933
channel ORA_DISK_1: restoring archived log
archived log thread=1 sequence=1574934
channel ORA_DISK_1: restoring archived log
archived log thread=1 sequence=1574935
channel ORA_DISK_1: restoring archived log
archived log thread=1 sequence=1574936
channel ORA_DISK_1: restoring archived log
archived log thread=1 sequence=1574937
channel ORA_DISK_1: restoring archived log
archived log thread=1 sequence=1574938
channel ORA_DISK_1: restoring archived log
archived log thread=1 sequence=1574939
channel ORA_DISK_1: restoring archived log
archived log thread=1 sequence=1574940
channel ORA_DISK_1: restoring archived log
archived log thread=1 sequence=1574941
channel ORA_DISK_1: restoring archived log
archived log thread=1 sequence=1574942
channel ORA_DISK_1: restoring archived log
archived log thread=1 sequence=1574943
channel ORA_DISK_1: restoring archived log
archived log thread=1 sequence=1574944
channel ORA_DISK_1: restoring archived log
archived log thread=1 sequence=1574945
channel ORA_DISK_1: restoring archived log
archived log thread=1 sequence=1574946
channel ORA_DISK_1: restoring archived log
archived log thread=1 sequence=1574947
channel ORA_DISK_1: restoring archived log
archived log thread=1 sequence=1574948
channel ORA_DISK_1: restoring archived log
archived log thread=1 sequence=1574949
channel ORA_DISK_1: restoring archived log
archived log thread=1 sequence=1574950
channel ORA_DISK_1: restoring archived log
archived log thread=1 sequence=1574951
channel ORA_DISK_1: restoring archived log
archived log thread=1 sequence=1574952
channel ORA_DISK_1: restoring archived log
archived log thread=1 sequence=1574953
channel ORA_DISK_1: restoring archived log
archived log thread=1 sequence=1574954
channel ORA_DISK_1: reading from backup piece /oracle/backup/o1_mf_annnn_TAG20170709T010329_dp26tvdj_.bkp
channel ORA_DISK_1: piece handle=/oracle/backup/o1_mf_annnn_TAG20170709T010329_dp26tvdj_.bkp tag=TAG20170709T010329
channel ORA_DISK_1: restored backup piece 1
channel ORA_DISK_1: restore complete, elapsed time: 00:02:25
Finished restore at 10-JUL-17
此时查看备库日志已经开始注册丢失的日志文件：
Media Recovery Log /oracle/app/oracle/fast_recovery_area/MAINDB/archivelog/2017_07_10/o1_mf_1_1574947_dp5whllr_.arc
Mon Jul 10 11:28:38 2017
Media Recovery Log /oracle/app/oracle/fast_recovery_area/MAINDB/archivelog/2017_07_10/o1_mf_1_1574948_dp5wh40h_.arc
Mon Jul 10 11:28:45 2017
RFS[867]: Selected log 5 for thread 1 sequence 1585192 dbid 41334651 branch 907452801
Mon Jul 10 11:28:45 2017
Archived Log entry 1830402 added for thread 1 sequence 1585191 ID 0x4cf4ed4 dest 1:
RFS[867]: Selected log 4 for thread 1 sequence 1585193 dbid 41334651 branch 907452801
Mon Jul 10 11:28:49 2017
Archived Log entry 1830403 added for thread 1 sequence 1585192 ID 0x4cf4ed4 dest 1:
Mon Jul 10 11:28:51 2017
Media Recovery Log /oracle/app/oracle/fast_recovery_area/MAINDB/archivelog/2017_07_10/o1_mf_1_1574949_dp5whl86_.arc
RFS[867]: Selected log 5 for thread 1 sequence 1585194 dbid 41334651 branch 907452801
Mon Jul 10 11:28:55 2017
Archived Log entry 1830404 added for thread 1 sequence 1585193 ID 0x4cf4ed4 dest 1:
重新查看gap，如果还有继续按上面的步骤修复，直到dg broker提示集群正常：
DGMGRL> show configuration
Configuration - sgsdgmb
Protection Mode: MaxAvailability
Databases:
maindb - Primary database
stbydb - Physical standby database
Fast-Start Failover: DISABLED
Configuration Status:
SUCCESS