Welcome to www.freeoraclehelp.com Got questions? Post comments Like the facebook page to get instant updates. Thank you!!!
Total Pageviews

SCAN Setup for Oracle 11g Release2(11gR2) RAC implementation

Single client access name (SCAN) is introduced in Oracle 11g R2 Cluster Ready Software(CRS) to simplify the database connection strings that an Oracle Client uses to connect to an Oracle Cluster Database. I have received a few emails about SCAN setup issues and I have promised that I would come up with an article addressing the following questions:

  1. What is SCAN in Oracle 11g R2 RAC?
  2. How does SCAN work ?
  3. How to setup DNS for Oracle 11g R2 SCAN?
  4. How to setup GNS for Oracle 11g R2 SCAN?
  5. How to install Oracle 11g R2 RAC without SCAN Setup in DNS or GNS?
  6. How to move SCAN from DNS to /etc/hosts?
  7. How to move SCAN from /etc/hosts to DNS?
  8. How to rename SCAN in Cluster?
  9. How to rename SCAN Port in Cluster?

What is SCAN in Oracle 11g R2 RAC?

Single client access name (SCAN) is meant to facilitate single name for all Oracle clients to connect to the cluster database, irrespective of number of nodes and node location. Until now, we have to keep adding multiple address records in all clients tnsnames.ora, when a new node gets added to or deleted from the cluster.

Client TNS Entry in pre 11gR2 RAC environments:

[oid1@rac1 admin]$cat tnsnames.ora 
OIDDB =
(DESCRIPTION =
  (ADDRESS = (PROTOCOL = TCP)(HOST = rac1-vip.freeoraclehelp.com)(PORT = 1521))   
  (ADDRESS = (PROTOCOL = TCP)(HOST = rac2-vip.freeoraclehelp.com)(PORT = 1521))   
    (CONNECT_DATA =
      (SERVER = DEDICATED)
      (SERVICE_NAME = oid.freeoraclehelp.com)
   )
)

[oid1@rac1 admin]$tnsping oiddb

TNS Ping Utility for Linux: Version 11.2.0.2.0 - Production on 15-DEC-2011 14:21:18

Copyright (c) 1997, 2010, Oracle.  All rights reserved.

Used parameter files:


Used TNSNAMES adapter to resolve the alias
Attempting to contact (DESCRIPTION = (ADDRESS = (PROTOCOL = TCP)(HOST = rac1-vip.freeoraclehelp.com)(PORT = 1521)) (ADDRESS = (PROTOCOL = TCP)(HOST = rac2-vip.freeoraclehelp.com)(PORT = 1521)) (CONNECT_DATA = (SERVER = DEDICATED) (SERVICE_NAME = oid.freeoraclehelp.com)))
OK (10 msec)
[oid1@rac1 admin]$sqlplus system@oiddb

SQL*Plus: Release 11.2.0.2.0 Production on Thu Dec 15 14:21:32 2011

Copyright (c) 1982, 2010, Oracle.  All rights reserved.

Enter password: 

Connected to:
Oracle Database 11g Enterprise Edition Release 11.2.0.2.0 - Production
With the Partitioning, Real Application Clusters, Automatic Storage Management, OLAP,
Data Mining and Real Application Testing options

SQL> 

As you see above, we got to list all the addresses of all DB nodes. If the cluster has got more than cluster nodes, we got to list each and every node out here. This need to be updated when a new node is added or existing node is removed.

OIDDB =
(DESCRIPTION =
  (ADDRESS = (PROTOCOL = TCP)(HOST = rac1-vip.freeoraclehelp.com)(PORT = 1521))  
  (ADDRESS = (PROTOCOL = TCP)(HOST = rac2-vip.freeoraclehelp.com)(PORT = 1521))  
  (ADDRESS = (PROTOCOL = TCP)(HOST = rac3-vip.freeoraclehelp.com)(PORT = 1521))  
  (ADDRESS = (PROTOCOL = TCP)(HOST = rac4-vip.freeoraclehelp.com)(PORT = 1521))  
  ....
  ....

    (CONNECT_DATA =
      (SERVER = DEDICATED)
      (SERVICE_NAME = oid.freeoraclehelp.com)
   )
)

This is big problem when the cluster has many nodes and end user application makes connections to the databases. SCAN would help us easily manage the DB Connection strings in Client tnsnames.ora files. Here is how a SCAN entry would appear:

[oid1@rac1 admin]$cat tnsnames.ora
OIDDB =
(DESCRIPTION =
  (ADDRESS = (PROTOCOL = TCP)(HOST = scan.freeoraclehelp.com)(PORT = 1521))   
    (CONNECT_DATA =
      (SERVER = DEDICATED)
      (SERVICE_NAME = oid.freeoraclehelp.com)
   )
)

[oid1@rac1 admin]$tnsping oiddb


TNS Ping Utility for Linux: Version 11.2.0.2.0 - Production on 15-DEC-2011 14:37:16

Copyright (c) 1997, 2010, Oracle.  All rights reserved.

Used parameter files:


Used TNSNAMES adapter to resolve the alias
Attempting to contact (DESCRIPTION = (ADDRESS = (PROTOCOL = TCP)(HOST = scan.freeoraclehelp.com)(PORT = 1521)) (CONNECT_DATA = (SERVER = DEDICATED) (SERVICE_NAME = oid.freeoraclehelp.com)))
OK (0 msec)
[oid1@rac1 admin]$
[oid1@rac1 admin]$sqlplus system@OIDDB

SQL*Plus: Release 11.2.0.2.0 Production on Thu Dec 15 14:37:28 2011

Copyright (c) 1982, 2010, Oracle.  All rights reserved.

Enter password: 

Connected to:
Oracle Database 11g Enterprise Edition Release 11.2.0.2.0 - Production
With the Partitioning, Real Application Clusters, Automatic Storage Management, OLAP,
Data Mining and Real Application Testing options

SQL> 

So, you would see only one SCAN ADDRESS in tnsnames.ora files no matter how many nodes in the cluster are.

  (ADDRESS = (PROTOCOL = TCP)(HOST = scan.freeoraclehelp.com)(PORT = 1521)) 

How does SCAN work ?

SCAN is a GSD resource, which is managed by CRS. So, SCAN is pretty much aware of what's going on in the cluster.  Though Oracle documentation suggests that SCAN is a recommendation, but its a kind of mandatory as Oracle 11gR2 OUI would not proceed without it. SCAN is on top of VIPs, but you can directly connect to the local listener if you would like to bypass SCAN in client’s tnsnames.ora. Clients use SCAN name in tnsnames.ora to make the DB connection. SCAN Listener would forward the request to local listener that’s running on VIPs.

Oracle 11gR2 SCAN load balancing

You would see these redirections at the SQLPLUS trace below.

connect(6, {sa_family=AF_FILE, path="/var/run/nscd/socket"}, 110) = -1 ENOENT (No such file or directory)
connect(6, {sa_family=AF_FILE, path="/var/run/nscd/socket"}, 110) = -1 ENOENT (No such file or directory)
connect(8, {sa_family=AF_FILE, path="/var/run/nscd/socket"}, 110) = -1 ENOENT (No such file or directory)
connect(8, {sa_family=AF_FILE, path="/var/run/nscd/socket"}, 110) = -1 ENOENT (No such file or directory)
connect(8, {sa_family=AF_INET, sin_port=htons(0), sin_addr=inet_addr("192.168.1.10")}, 16) = 0
connect(9, {sa_family=AF_INET, sin_port=htons(53), sin_addr=inet_addr("192.168.1.20")}, 28) = 0
connect(9, {sa_family=AF_INET, sin_port=htons(53), sin_addr=inet_addr("192.168.1.20")}, 28) = 0
connect(9, {sa_family=AF_INET, sin_port=htons(53), sin_addr=inet_addr("192.168.1.20")}, 28) = 0
connect(9, {sa_family=AF_INET, sin_port=htons(53), sin_addr=inet_addr("192.168.1.20")}, 28) = 0
connect(9, {sa_family=AF_INET, sin_port=htons(53), sin_addr=inet_addr("192.168.1.20")}, 28) = 0
connect(9, {sa_family=AF_INET, sin_port=htons(53), sin_addr=inet_addr("192.168.1.20")}, 28) = 0
connect(9, {sa_family=AF_INET, sin_port=htons(1521), sin_addr=inet_addr("192.168.1.23")}, 16) = 0
connect(9, {sa_family=AF_INET, sin_port=htons(1521), sin_addr=inet_addr("192.168.1.24")}, 16) = 0
connect(9, {sa_family=AF_INET, sin_port=htons(1521), sin_addr=inet_addr("192.168.1.25")}, 16) = 0
connect(9, {sa_family=AF_INET, sin_port=htons(53), sin_addr=inet_addr("192.168.1.20")}, 28) = 0
connect(9, {sa_family=AF_INET, sin_port=htons(53), sin_addr=inet_addr("192.168.1.20")}, 28) = 0
connect(9, {sa_family=AF_INET, sin_port=htons(53), sin_addr=inet_addr("192.168.1.20")}, 28) = 0
connect(9, {sa_family=AF_INET, sin_port=htons(53), sin_addr=inet_addr("192.168.1.20")}, 28) = 0
connect(9, {sa_family=AF_INET, sin_port=htons(53), sin_addr=inet_addr("192.168.1.20")}, 28) = 0
connect(9, {sa_family=AF_INET, sin_port=htons(53), sin_addr=inet_addr("192.168.1.20")}, 28) = 0
connect(9, {sa_family=AF_INET, sin_port=htons(0), sin_addr=inet_addr("192.168.1.24")}, 16) = 0
connect(9, {sa_family=AF_INET, sin_port=htons(0), sin_addr=inet_addr("192.168.1.25")}, 16) = 0
connect(9, {sa_family=AF_INET, sin_port=htons(0), sin_addr=inet_addr("192.168.1.23")}, 16) = 0
connect(9, {sa_family=AF_INET, sin_port=htons(1521), sin_addr=inet_addr("192.168.1.25")}, 16) = -1 EINPROGRESS (Operation now in progress)
connect(9, {sa_family=AF_INET, sin_port=htons(1521), sin_addr=inet_addr("192.168.1.11")}, 16) = -1 EINPROGRESS (Operation now in progress)

192.168.1.25 is one of the SCAN IPs and 192.168.1.11 is the VIP of the first RAC node.

[oid1@rac1 ~]$ nslookup 192.168.1.11
Server:         192.168.1.20
Address:        192.168.1.20#53

11.1.168.192.in-addr.arpa       name = rac1-vip.freeoraclehelp.com.

[oid1@rac1 ~]$ nslookup 192.168.1.25
Server:         192.168.1.20
Address:        192.168.1.20#53

25.1.168.192.in-addr.arpa       name = scan.freeoraclehelp.com.

[oid1@rac1 ~]$ nslookup scan.freeoraclehelp.com
Server:         192.168.1.20
Address:        192.168.1.20#53

Name:   scan.freeoraclehelp.com
Address: 192.168.1.25
Name:   scan.freeoraclehelp.com
Address: 192.168.1.23
Name:   scan.freeoraclehelp.com
Address: 192.168.1.24

[oid1@rac1 ~]$ 

So, SCAN needs to resolve to one to three IP addresses with the same name. Oracle recommends using three IP Addresses for SCAN in DNS. There would be three SCAN listeners only, though the cluster has got dozens of nodes. SCAN listeners would be started from GRID Oracle Home, not the database/rdbms home. Since its part of a grid, this can be used for all the database in the cluster. So, we don't to run netca to create listeners in DB Homes anymore. If the default port, 1521, is used, Oracle instances (PMON) automatically registers with the SCAN listener. Here is a quick look at Oracle documentation's load balancing flow with SCAN:

Oracle 11gR2 SCAN load balancing

  1. PMON process of each instance registers the database services with the default listener on the local node and with each SCAN listener, which is specified by the REMOTE_LISTENER database parameter.
  2. Oracle client connects using SCAN name: myscan:1521/sales.example.com
  3. Client queries DNS to resolve scan_name.
  4. SCAN listener selects least loaded node (node in this example)
  5. The client connects to the local listener on node2. The local listener starts a dedicated server process for the connection to the database.
  6. The client connects directly to the dedicated server process on node2 and accesses the sales2 database instance.
SQL> show parameter local_listener

NAME                    TYPE        VALUE
--------------------   ---------    --------- 
local_listener          string     (DESCRIPTION=(ADDRESS_LIST=(ADDRESS=(PROTOCOL=TCP)
       (HOST=192.168.1.11)(PORT=1521))))

SQL> show parameter remote_listener

NAME                    TYPE        VALUE
--------------------   ---------    --------- 
remote_listener        string      scan.freeoraclehelp.com:1521
SQL> 

After the installation, two SCAN listeners would be started on one node and another SCAN listener on another node in a two node cluster. 

[grid@rac1 ~]$srvctl config scan
SCAN name: scan.freeoraclehelp.com, Network: 1/192.168.1.0/255.255.255.0/eth0
SCAN VIP name: scan1, IP: /scan.freeoraclehelp.com/192.168.1.25
SCAN VIP name: scan2, IP: /scan.freeoraclehelp.com/192.168.1.23
SCAN VIP name: scan3, IP: /scan.freeoraclehelp.com/192.168.1.24
[grid@rac1 ~]$srvctl config scan_listener
SCAN Listener LISTENER_SCAN1 exists. Port: TCP:1521
SCAN Listener LISTENER_SCAN2 exists. Port: TCP:1521
SCAN Listener LISTENER_SCAN3 exists. Port: TCP:1521
[grid@rac1 ~]$crsctl stat res -w "TYPE = ora.scan_listener.type"
NAME=ora.LISTENER_SCAN1.lsnr
TYPE=ora.scan_listener.type
TARGET=ONLINE
STATE=ONLINE on rac1

NAME=ora.LISTENER_SCAN2.lsnr
TYPE=ora.scan_listener.type
TARGET=ONLINE
STATE=ONLINE on rac2

NAME=ora.LISTENER_SCAN3.lsnr
TYPE=ora.scan_listener.type
TARGET=ONLINE
STATE=ONLINE on rac2

[grid@rac1 ~]$


[grid@rac1 ~]$ps -ef|grep tnsl
oracle    6873     1  0 13:11 ?        00:00:00 /oracle/product/11.2.0/11.2.0/grid/bin/tnslsnr LISTENER_SCAN1 -inherit
oracle    6892     1  0 13:11 ?        00:00:00 /oracle/product/11.2.0/11.2.0/grid/bin/tnslsnr LISTENER -inherit
[grid@rac1 ~]$

[grid@rac1 ~]$lsnrctl status LISTENER_SCAN1

LSNRCTL for Linux: Version 11.2.0.2.0 - Production on 15-DEC-2011 15:13:48

Copyright (c) 1991, 2010, Oracle.  All rights reserved.

Connecting to (DESCRIPTION=(ADDRESS=(PROTOCOL=IPC)(KEY=LISTENER_SCAN1)))
STATUS of the LISTENER
------------------------
Alias                     LISTENER_SCAN1
Version                   TNSLSNR for Linux: Version 11.2.0.2.0 - Production
Start Date                15-DEC-2011 13:11:15
Uptime                    0 days 2 hr. 2 min. 33 sec
Trace Level               off
Security                  ON: Local OS Authentication
SNMP                      OFF
Listener Parameter File   /oracle/product/11.2.0/11.2.0/grid/network/admin/listener.ora
Listener Log File         /oracle/product/11.2.0/11.2.0/grid/log/diag/tnslsnr/rac1/listener_scan1/alert/log.xml
Listening Endpoints Summary...
  (DESCRIPTION=(ADDRESS=(PROTOCOL=ipc)(KEY=LISTENER_SCAN1)))
  (DESCRIPTION=(ADDRESS=(PROTOCOL=tcp)(HOST=192.168.1.25)(PORT=1521)))
Services Summary...
Service "oid.freeoraclehelp.com" has 2 instance(s).
  Instance "oid1", status READY, has 1 handler(s) for this service...
  Instance "oid2", status READY, has 1 handler(s) for this service...
The command completed successfully
[grid@rac1 ~]$

[grid@rac2 ~]$ps -ef|grep tnsl
oracle    5830     1  0 12:38 ?        00:00:00 /oracle/product/11.2.0/11.2.0/grid/bin/tnslsnr LISTENER_SCAN3 -inherit
oracle    5833     1  0 12:38 ?        00:00:00 /oracle/product/11.2.0/11.2.0/grid/bin/tnslsnr LISTENER_SCAN2 -inherit
oracle    5836     1  0 12:38 ?        00:00:00 /oracle/product/11.2.0/11.2.0/grid/bin/tnslsnr LISTENER -inherit
oracle    7423  7372  0 15:14 pts/1    00:00:00 grep tnsl
[grid@rac2 ~]$

[grid@rac2 ~]$lsnrctl status LISTENER_SCAN2

LSNRCTL for Linux: Version 11.2.0.2.0 - Production on 15-DEC-2011 15:14:04

Copyright (c) 1991, 2010, Oracle.  All rights reserved.

Connecting to (DESCRIPTION=(ADDRESS=(PROTOCOL=IPC)(KEY=LISTENER_SCAN2)))
STATUS of the LISTENER
------------------------
Alias                     LISTENER_SCAN2
Version                   TNSLSNR for Linux: Version 11.2.0.2.0 - Production
Start Date                15-DEC-2011 12:38:45
Uptime                    0 days 2 hr. 35 min. 19 sec
Trace Level               off
Security                  ON: Local OS Authentication
SNMP                      OFF
Listener Parameter File   /oracle/product/11.2.0/11.2.0/grid/network/admin/listener.ora
Listener Log File         /oracle/product/11.2.0/11.2.0/grid/log/diag/tnslsnr/rac2/listener_scan2/alert/log.xml
Listening Endpoints Summary...
  (DESCRIPTION=(ADDRESS=(PROTOCOL=ipc)(KEY=LISTENER_SCAN2)))
  (DESCRIPTION=(ADDRESS=(PROTOCOL=tcp)(HOST=192.168.1.23)(PORT=1521)))
Services Summary...
Service "oid.freeoraclehelp.com" has 2 instance(s).
  Instance "oid1", status READY, has 1 handler(s) for this service...
  Instance "oid2", status READY, has 1 handler(s) for this service...
The command completed successfully
[grid@rac2 ~]$lsnrctl status LISTENER_SCAN3

LSNRCTL for Linux: Version 11.2.0.2.0 - Production on 15-DEC-2011 15:14:06

Copyright (c) 1991, 2010, Oracle.  All rights reserved.

Connecting to (DESCRIPTION=(ADDRESS=(PROTOCOL=IPC)(KEY=LISTENER_SCAN3)))
STATUS of the LISTENER
------------------------
Alias                     LISTENER_SCAN3
Version                   TNSLSNR for Linux: Version 11.2.0.2.0 - Production
Start Date                15-DEC-2011 12:38:45
Uptime                    0 days 2 hr. 35 min. 21 sec
Trace Level               off
Security                  ON: Local OS Authentication
SNMP                      OFF
Listener Parameter File   /oracle/product/11.2.0/11.2.0/grid/network/admin/listener.ora
Listener Log File         /oracle/product/11.2.0/11.2.0/grid/log/diag/tnslsnr/rac2/listener_scan3/alert/log.xml
Listening Endpoints Summary...
  (DESCRIPTION=(ADDRESS=(PROTOCOL=ipc)(KEY=LISTENER_SCAN3)))
  (DESCRIPTION=(ADDRESS=(PROTOCOL=tcp)(HOST=192.168.1.24)(PORT=1521)))
Services Summary...
Service "oid.freeoraclehelp.com" has 2 instance(s).
  Instance "oid1", status READY, has 1 handler(s) for this service...
  Instance "oid2", status READY, has 1 handler(s) for this service...
The command completed successfully
[grid@rac2 ~]$ 

How to setup DNS for Oracle 11g R2 SCAN?

Oracle recommends three IP Addresses be used for SCAN. SCAN setup has become a big problem for RAC Setups at home or test environments.. especially where there is no real DNS Server in the network. If you're trying to set up 11gR2 RAC at home on VMWare, Oracle Virtualbox, Oracle VM, Xen..etc, you probably hit this situation. Oracle 11gR2 RAC SCAN - DNS (bind) Configuration on Linux would explain setting up a DNS daemon on one of the RAC nodes. Of course, you wouldn’t want to run bind in your production RAC nodes. You would have DNS Administrator add three A records for the same name, SCAN.  Once DNS is set up, make sure that all three A records are returned in nslookup.

[oid1@rac1 ~]$ nslookup scan.freeoraclehelp.com
Server:         192.168.1.20
Address:        192.168.1.20#53

Name:   scan.freeoraclehelp.com
Address: 192.168.1.25
Name:   scan.freeoraclehelp.com
Address: 192.168.1.23
Name:   scan.freeoraclehelp.com
Address: 192.168.1.24

[oid1@rac1 ~]$ 

How to setup GNS for Oracle 11g R2 SCAN?

Grid Naming Service (GNS) is another new service introduced in Oracle RAC 11g R2. With GNS, Oracle Cluster Software (CRS) can manage DHCP and DNS Services for the dynamic node registration and configuration. If you’re go to use GNS for the cluster, you should set up a different subdomain in the main DNS Server and delegate name lookups in the subdomain to GNS. For example, if your company domain is freeoraclehelp.com, you’re going to create grid.freeoraclehelp.com in the DNS Servers of freeoraclehelp.com and delegate lookups for grid.freeoraclehelp.com to GNS VIP.

# Delegate to GNS Server in DNS Servers
grid.freeoraclehelp.com NS gnsvip.freeoraclehelp.com
# Address Record for the GNS VIP
gnsvip.freeoraclehelp.com. 192.168.1.31

Once subdomain is complete, lookups for the subdomain names from the main domain would be forwarded to GNS Services. You would be entering the subdomain name and GNS VIP during the Grid Infrastructure installation.

Oracle 11gR2 SCAN GNS Configuration

Oracle 11gR2 RAC Installation with GNS, without SCAN explains the Oracle 11g R2 RAC installation with GNS.

How to install Oracle 11g R2 RAC without SCAN Setup in DNS or GNS?

This is mostly suited in three tier web environments where end users would not connect to the database directly and Application Servers can use Local listener Connections (10g like connections over VIPs). So, you would not see much benefits using SCAN here.  Whatever may be your reasons, if you’d like to use SCAN from hosts file (no DNS changes or No GNS Setup), here is how to do that.

If you would like to Install Oracle 11g R2 RAC without SCAN setup in DNS, you would need to create an entry in /etc/hosts for the scan name to point to a different IP address (other than Public IP, Private IP, and VIP addresses) and supply this name for SCAN Prompts during the installation. Make sure that you pick the new IP address in the same subnet as that of VIP addresses and that it is not currently in use.

[root@rac1 ~]# cat /etc/hosts
# Do not remove the following line, or various programs
# that require network functionality will fail.
127.0.0.1               localhost.localdomain localhost
# Public
192.168.1.10   rac1.freeoraclehelp.com     rac1
192.168.1.20   rac2.freeoraclehelp.com     rac2
#Private
192.168.2.10   rac1-priv.freeoraclehelp.com  rac1-priv
192.168.2.20   rac2-priv.freeoraclehelp.com  rac2-priv
#Virtual
192.168.1.11   rac1-vip.freeoraclehelp.com   rac1-vip
192.168.1.22   rac2-vip.freeoraclehelp.com   rac2-vip
#SCAN Entry
192.168.1.25   scan.freeoraclehelp.com   scan
[root@rac1 ~]# 

This would let you proceed with the installation, however would hit the following error in Cluster Verify Utility, which runs after the installation is complete. Of course, you can ignore this error safely if you’re using SCAN entry from hosts file.

INFO: PRVF-4664 : Found inconsistent name resolution entries for SCAN name "scan.freeoraclehelp.com"
INFO: ERROR:
INFO: PRVF-4657 : Name resolution setup check for "scanclunm" (IP address: 192.168.1.25) failed
INFO: ERROR:
INFO: PRVF-4664 : Found inconsistent name resolution entries for SCAN name "scan.freeoraclehelp.com"

How to move SCAN from DNS to /etc/hosts?

After the installation of the cluster with DNS SCAN name, If you need to switch from DNS SCAN name to local /etc/hosts entry SCAN Name, here are steps. Of course, you cannot have multiple IP addresses in hosts file. So, it would be resolved to only one IP address in this method.

1. Stop the SCAN: Source Grid home, srvctl stop scan_listener, and srvctl stop scan then.

[grid@rac1 ~]$srvctl stop scan
PRCR-1065 : Failed to stop resource ora.scan1.vip
CRS-2529: Unable to act on 'ora.scan1.vip' because that would require stopping or relocating 'ora.LISTENER_SCAN1.lsnr', but the force option was not specified
PRCR-1065 : Failed to stop resource ora.scan2.vip
CRS-2529: Unable to act on 'ora.scan2.vip' because that would require stopping or relocating 'ora.LISTENER_SCAN2.lsnr', but the force option was not specified
PRCR-1065 : Failed to stop resource ora.scan3.vip
CRS-2529: Unable to act on 'ora.scan3.vip' because that would require stopping or relocating 'ora.LISTENER_SCAN3.lsnr', but the force option was not specified

Stop the scan_listener first and then stop scan resource

[grid@rac1 ~]$srvctl stop scan_listener
[grid@rac1 ~]$srvctl stop scan
[grid@rac1 ~]$ps -ef|grep tnsl
oracle    6892     1  0 13:11 ?        00:00:00 /oracle/product/11.2.0/11.2.0/grid/bin/tnslsnr LISTENER -inherit
oracle    6940     1  0 13:11 ?        00:00:00 /oracle/product/10.2.0/rdbms/bin/tnslsnr OID_RAC1 -inherit
[grid@rac1 ~]$

2. Add an entry in /etc/hosts file for SCAN name:

[root@rac2 ~]# nslookup scan.freeoraclehelp.com
Server:         192.168.1.20
Address:        192.168.1.20#53

Name:   scan.freeoraclehelp.com
Address: 192.168.1.25
Name:   scan.freeoraclehelp.com
Address: 192.168.1.23
Name:   scan.freeoraclehelp.com
Address: 192.168.1.24

[root@rac2 ~]# vi /etc/resolv.conf 

#nameserver 192.168.1.20  # Second RAC Node
nameserver 192.168.1.1   # Primary DNS in the domain
search freeoraclehelp.com # Local Domain


[root@rac1 ~]# vi /etc/resolv.conf 

#nameserver 192.168.1.20  # Second RAC Node
nameserver 192.168.1.1   # Primary DNS in the domain
search freeoraclehelp.com # Local Domain


[root@rac2 ~]# cat /etc/hosts
# Do not remove the following line, or various programs
# that require network functionality will fail.
127.0.0.1       localhost.localdomain   localhost
# Public
192.168.1.10   rac1.freeoraclehelp.com     rac1
192.168.1.20   rac2.freeoraclehelp.com     rac2
#Private
192.168.2.10   rac1-priv.freeoraclehelp.com  rac1-priv
192.168.2.20   rac2-priv.freeoraclehelp.com  rac2-priv
#Virtual
192.168.1.11   rac1-vip.freeoraclehelp.com   rac1-vip
192.168.1.22   rac2-vip.freeoraclehelp.com   rac2-vip
#SCAN Entry
192.168.1.25   scan.freeoraclehelp.com   scan
[root@rac2 ~]# 

[root@rac1 ~]# cat /etc/hosts
# Do not remove the following line, or various programs
# that require network functionality will fail.
127.0.0.1               localhost.localdomain localhost
# Public
192.168.1.10   rac1.freeoraclehelp.com     rac1
192.168.1.20   rac2.freeoraclehelp.com     rac2
#Private
192.168.2.10   rac1-priv.freeoraclehelp.com  rac1-priv
192.168.2.20   rac2-priv.freeoraclehelp.com  rac2-priv
#Virtual
192.168.1.11   rac1-vip.freeoraclehelp.com   rac1-vip
192.168.1.22   rac2-vip.freeoraclehelp.com   rac2-vip
#SCAN Entry
192.168.1.25   scan.freeoraclehelp.com   scan
[root@rac1 ~]# 

[root@rac1 ~]# nslookup scan.freeoraclehelp.com
Server:         192.168.1.1
Address:        192.168.1.1#53

** server can't find scan.freeoraclehelp.com: NXDOMAIN

[root@rac1 ~]# ping scan.freeoraclehelp.com
PING scan.freeoraclehelp.com (192.168.1.25) 56(84) bytes of data.
From rac1.freeoraclehelp.com (192.168.1.10) icmp_seq=0 Destination Host Unreachable
From rac1.freeoraclehelp.com (192.168.1.10) icmp_seq=1 Destination Host Unreachable
From rac1.freeoraclehelp.com (192.168.1.10) icmp_seq=2 Destination Host Unreachable

--- scan.freeoraclehelp.com ping statistics ---
4 packets transmitted, 0 received, +3 errors, 100% packet loss, time 3027ms
, pipe 4
[root@rac1 ~]# 


[root@rac2 ~]#  nslookup scan.freeoraclehelp.com
Server:         192.168.1.1
Address:        192.168.1.1#53

** server can't find scan.freeoraclehelp.com: NXDOMAIN

[root@rac2 ~]# ping scan.freeoraclehelp.com
PING scan.freeoraclehelp.com (192.168.1.25) 56(84) bytes of data.
From rac2.freeoraclehelp.com (192.168.1.20) icmp_seq=0 Destination Host Unreachable
From rac2.freeoraclehelp.com (192.168.1.20) icmp_seq=1 Destination Host Unreachable
From rac2.freeoraclehelp.com (192.168.1.20) icmp_seq=2 Destination Host Unreachable

--- scan.freeoraclehelp.com ping statistics ---
11 packets transmitted, 0 received, +9 errors, 100% packet loss, time 10071ms
, pipe 4
[root@rac2 ~]# 

3. Configure the Cluster to take the new VIPs
As root user on one of the cluster nodes (not needed on both the nodes):

[root@rac1 ~]# /oracle/product/11.2.0/11.2.0/grid/bin/srvctl modify scan -n scan.freeoraclehelp.com

As grid user on one of the cluster nodes (not needed on both the nodes):

[grid@rac1 ~]$ srvctl modify scan_listener -u
[grid@rac1 ~]$ srvctl start scan_listener

Verify that only one SCAN Listener is started and IP is right. 

[grid@rac1 ~]$ps -ef|grep tnsl
oracle    7961     1  0 15:44 ?        00:00:00 /oracle/product/11.2.0/11.2.0/grid/bin/tnslsnr LISTENER -inherit
oracle    9148  4994  0 16:10 pts/2    00:00:00 grep tnsl
[grid@rac1 ~]$


[grid@rac2 ~]$ps -ef|grep tnsl
oracle    9014     1  0 15:52 ?        00:00:00 /oracle/product/11.2.0/11.2.0/grid/bin/tnslsnr LISTENER -inherit
oracle    9451     1  0 16:10 ?        00:00:00 /oracle/product/11.2.0/11.2.0/grid/bin/tnslsnr LISTENER_SCAN1 -inherit
oracle    9463  7372  0 16:10 pts/1    00:00:00 grep tnsl
[grid@rac2 ~]$lsnrctl status LISTENER_SCAN1

LSNRCTL for Linux: Version 11.2.0.2.0 - Production on 15-DEC-2011 16:10:39

Copyright (c) 1991, 2010, Oracle.  All rights reserved.

Connecting to (DESCRIPTION=(ADDRESS=(PROTOCOL=IPC)(KEY=LISTENER_SCAN1)))
STATUS of the LISTENER
------------------------
Alias                     LISTENER_SCAN1
Version                   TNSLSNR for Linux: Version 11.2.0.2.0 - Production
Start Date                15-DEC-2011 16:10:14
Uptime                    0 days 0 hr. 0 min. 25 sec
Trace Level               off
Security                  ON: Local OS Authentication
SNMP                      OFF
Listener Parameter File   /oracle/product/11.2.0/11.2.0/grid/network/admin/listener.ora
Listener Log File         /oracle/product/11.2.0/11.2.0/grid/log/diag/tnslsnr/rac2/listener_scan1/alert/log.xml
Listening Endpoints Summary...
  (DESCRIPTION=(ADDRESS=(PROTOCOL=ipc)(KEY=LISTENER_SCAN1)))
  (DESCRIPTION=(ADDRESS=(PROTOCOL=tcp)(HOST=192.168.1.25)(PORT=1521)))
The listener supports no services
The command completed successfully
[grid@rac2 ~]$

[grid@rac1 ~]$srvctl config scan
SCAN name: scan.freeoraclehelp.com, Network: 1/192.168.1.0/255.255.255.0/eth0
SCAN VIP name: scan1, IP: /scan.freeoraclehelp.com/192.168.1.25
[grid@rac1 ~]$srvctl config scan_listener
SCAN Listener LISTENER_SCAN1 exists. Port: TCP:1521
[grid@rac1 ~]$

How to move SCAN from /etc/hosts to DNS?

After the installation of the cluster with SCAN with one IP address in /etc/hosts, If you need to switch to DNS SCAN, here are steps.

1. Stop the SCAN: Source Grid home, srvctl stop scan_listener, and srvctl stop scan then.

[grid@rac1 ~]$srvctl stop scan_listener
[grid@rac1 ~]$srvctl stop scan

2. Remove/comment the entry in /etc/hosts file for SCAN and setup a DNS name with multiple A (three A records), if it is not already setup. I have the SCAN setup in a DNS server that runs on the second cluster node. I just have to use it (in resolv.conf). For more information about DNS Setup, refer to How to setup DNS for Oracle 11g R2 SCAN?

[root@rac1 ~]# cat /etc/hosts
# Do not remove the following line, or various programs
# that require network functionality will fail.
127.0.0.1               localhost.localdomain localhost
# Public
192.168.1.10   rac1.freeoraclehelp.com     rac1
192.168.1.20   rac2.freeoraclehelp.com     rac2
#Private
192.168.2.10   rac1-priv.freeoraclehelp.com  rac1-priv
192.168.2.20   rac2-priv.freeoraclehelp.com  rac2-priv
#Virtual
192.168.1.11   rac1-vip.freeoraclehelp.com   rac1-vip
192.168.1.22   rac2-vip.freeoraclehelp.com   rac2-vip
#SCAN Entry
#192.168.1.25   scan.freeoraclehelp.com   scan
[root@rac1 ~]# 

[root@rac2 ~]# cat /etc/hosts
# Do not remove the following line, or various programs
# that require network functionality will fail.
127.0.0.1       localhost.localdomain   localhost
# Public
192.168.1.10   rac1.freeoraclehelp.com     rac1
192.168.1.20   rac2.freeoraclehelp.com     rac2
#Private
192.168.2.10   rac1-priv.freeoraclehelp.com  rac1-priv
192.168.2.20   rac2-priv.freeoraclehelp.com  rac2-priv
#Virtual
192.168.1.11   rac1-vip.freeoraclehelp.com   rac1-vip
192.168.1.22   rac2-vip.freeoraclehelp.com   rac2-vip
#SCAN Entry
#192.168.1.25   scan.freeoraclehelp.com   scan
[root@rac2 ~]# 

[root@rac2 ~]# vi /etc/resolv.conf 

nameserver 192.168.1.20  # Second RAC Node
nameserver 192.168.1.1   # Primary DNS in the domain
search freeoraclehelp.com # Local Domain


[root@rac1 ~]# vi /etc/resolv.conf 

nameserver 192.168.1.20  # Second RAC Node
nameserver 192.168.1.1   # Primary DNS in the domain
search freeoraclehelp.com # Local Domain

[root@rac2 ~]# nslookup scan.freeoraclehelp.com
Server:         192.168.1.20
Address:        192.168.1.20#53

Name:   scan.freeoraclehelp.com
Address: 192.168.1.25
Name:   scan.freeoraclehelp.com
Address: 192.168.1.23
Name:   scan.freeoraclehelp.com
Address: 192.168.1.24

3. Configure the Cluster to take the new VIPs
As root user on one of the cluster nodes (not needed on both the nodes):

[root@rac1 ~]# /oracle/product/11.2.0/11.2.0/grid/bin/srvctl modify scan -n scan.freeoraclehelp.com

As grid user on one of the cluster nodes (not needed on both the nodes):

[grid@rac1 ~]$ srvctl modify scan_listener -u
[grid@rac1 ~]$ srvctl start scan_listener

Verify that configuration is right and three SCAN listeners are started. 

[grid@rac1 ~]$srvctl config scan
SCAN name: scan.freeoraclehelp.com, Network: 1/192.168.1.0/255.255.255.0/eth0
SCAN VIP name: scan1, IP: /scan.freeoraclehelp.com/192.168.1.25
SCAN VIP name: scan2, IP: /scan.freeoraclehelp.com/192.168.1.23
SCAN VIP name: scan3, IP: /scan.freeoraclehelp.com/192.168.1.24
[grid@rac1 ~]$srvctl config scan_listener
SCAN Listener LISTENER_SCAN1 exists. Port: TCP:1521
SCAN Listener LISTENER_SCAN2 exists. Port: TCP:1521
SCAN Listener LISTENER_SCAN3 exists. Port: TCP:1521
[grid@rac1 ~]$ps -ef|grep tnsl
oracle    6873     1  0 13:11 ?        00:00:00 /oracle/product/11.2.0/11.2.0/grid/bin/tnslsnr LISTENER_SCAN1 -inherit
oracle    6892     1  0 13:11 ?        00:00:00 /oracle/product/11.2.0/11.2.0/grid/bin/tnslsnr LISTENER -inherit
[grid@rac1 ~]$

[grid@rac1 ~]$lsnrctl status LISTENER_SCAN1

LSNRCTL for Linux: Version 11.2.0.2.0 - Production on 15-DEC-2011 15:13:48

Copyright (c) 1991, 2010, Oracle.  All rights reserved.

Connecting to (DESCRIPTION=(ADDRESS=(PROTOCOL=IPC)(KEY=LISTENER_SCAN1)))
STATUS of the LISTENER
------------------------
Alias                     LISTENER_SCAN1
Version                   TNSLSNR for Linux: Version 11.2.0.2.0 - Production
Start Date                15-DEC-2011 13:11:15
Uptime                    0 days 2 hr. 2 min. 33 sec
Trace Level               off
Security                  ON: Local OS Authentication
SNMP                      OFF
Listener Parameter File   /oracle/product/11.2.0/11.2.0/grid/network/admin/listener.ora
Listener Log File         /oracle/product/11.2.0/11.2.0/grid/log/diag/tnslsnr/rac1/listener_scan1/alert/log.xml
Listening Endpoints Summary...
  (DESCRIPTION=(ADDRESS=(PROTOCOL=ipc)(KEY=LISTENER_SCAN1)))
  (DESCRIPTION=(ADDRESS=(PROTOCOL=tcp)(HOST=192.168.1.25)(PORT=1521)))
Services Summary...
Service "oid.freeoraclehelp.com" has 2 instance(s).
  Instance "oid1", status READY, has 1 handler(s) for this service...
  Instance "oid2", status READY, has 1 handler(s) for this service...
The command completed successfully
[grid@rac1 ~]$

[grid@rac2 ~]$ ps -ef|grep tnsl
oracle    5830     1  0 12:38 ?        00:00:00 /oracle/product/11.2.0/11.2.0/grid/bin/tnslsnr LISTENER_SCAN3 -inherit
oracle    5833     1  0 12:38 ?        00:00:00 /oracle/product/11.2.0/11.2.0/grid/bin/tnslsnr LISTENER_SCAN2 -inherit
oracle    5836     1  0 12:38 ?        00:00:00 /oracle/product/11.2.0/11.2.0/grid/bin/tnslsnr LISTENER -inherit
oracle    7423  7372  0 15:14 pts/1    00:00:00 grep tnsl
[grid@rac2 ~]$

[grid@rac2 ~]$ lsnrctl status LISTENER_SCAN2

LSNRCTL for Linux: Version 11.2.0.2.0 - Production on 15-DEC-2011 15:14:04

Copyright (c) 1991, 2010, Oracle.  All rights reserved.

Connecting to (DESCRIPTION=(ADDRESS=(PROTOCOL=IPC)(KEY=LISTENER_SCAN2)))
STATUS of the LISTENER
------------------------
Alias                     LISTENER_SCAN2
Version                   TNSLSNR for Linux: Version 11.2.0.2.0 - Production
Start Date                15-DEC-2011 12:38:45
Uptime                    0 days 2 hr. 35 min. 19 sec
Trace Level               off
Security                  ON: Local OS Authentication
SNMP                      OFF
Listener Parameter File   /oracle/product/11.2.0/11.2.0/grid/network/admin/listener.ora
Listener Log File         /oracle/product/11.2.0/11.2.0/grid/log/diag/tnslsnr/rac2/listener_scan2/alert/log.xml
Listening Endpoints Summary...
  (DESCRIPTION=(ADDRESS=(PROTOCOL=ipc)(KEY=LISTENER_SCAN2)))
  (DESCRIPTION=(ADDRESS=(PROTOCOL=tcp)(HOST=192.168.1.23)(PORT=1521)))
Services Summary...
Service "oid.freeoraclehelp.com" has 2 instance(s).
  Instance "oid1", status READY, has 1 handler(s) for this service...
  Instance "oid2", status READY, has 1 handler(s) for this service...
The command completed successfully
[grid@rac2 ~]$ lsnrctl status LISTENER_SCAN3

LSNRCTL for Linux: Version 11.2.0.2.0 - Production on 15-DEC-2011 15:14:06

Copyright (c) 1991, 2010, Oracle.  All rights reserved.

Connecting to (DESCRIPTION=(ADDRESS=(PROTOCOL=IPC)(KEY=LISTENER_SCAN3)))
STATUS of the LISTENER
------------------------
Alias                     LISTENER_SCAN3
Version                   TNSLSNR for Linux: Version 11.2.0.2.0 - Production
Start Date                15-DEC-2011 12:38:45
Uptime                    0 days 2 hr. 35 min. 21 sec
Trace Level               off
Security                  ON: Local OS Authentication
SNMP                      OFF
Listener Parameter File   /oracle/product/11.2.0/11.2.0/grid/network/admin/listener.ora
Listener Log File         /oracle/product/11.2.0/11.2.0/grid/log/diag/tnslsnr/rac2/listener_scan3/alert/log.xml
Listening Endpoints Summary...
  (DESCRIPTION=(ADDRESS=(PROTOCOL=ipc)(KEY=LISTENER_SCAN3)))
  (DESCRIPTION=(ADDRESS=(PROTOCOL=tcp)(HOST=192.168.1.24)(PORT=1521)))
Services Summary...
Service "oid.freeoraclehelp.com" has 2 instance(s).
  Instance "oid1", status READY, has 1 handler(s) for this service...
  Instance "oid2", status READY, has 1 handler(s) for this service...
The command completed successfully
[grid@rac2 ~]$

How to rename SCAN in Cluster?

After the installation of the Oracle 11g R2 cluster with SCAN, If you need to change the scan name from scan.freeoraclehelp.com to newscan.freeoraclehelp.com, here is how.

1. Stop the SCAN: Source Grid home, srvctl stop scan_listener, and srvctl stop scan then.

[grid@rac1 ~]$ srvctl stop scan_listener
[grid@rac1 ~]$ srvctl stop scan

2.  Configure the new SCAN in your DNS, or /etc/hosts, or GNS and make sure that lookups are working for the new name.

[root@rac2 ~]# nslookup newscan.freeoraclehelp.com
Server:         192.168.1.20
Address:        192.168.1.20#53

Name:   newscan.freeoraclehelp.com
Address: 192.168.1.32
Name:   newscan.freeoraclehelp.com
Address: 192.168.1.33
Name:   newscan.freeoraclehelp.com
Address: 192.168.1.34
[root@rac2 ~]#

3. Configure the Cluster to take the new VIPs
As root user on one of the cluster nodes (not needed on both the nodes):

[root@rac1 ~]# /oracle/product/11.2.0/11.2.0/grid/bin/srvctl modify scan -n newscan.freeoraclehelp.com
[root@rac1 ~]# 

As grid user on one of the cluster nodes (not needed on both the nodes):

[grid@rac1 ~]$ srvctl modify scan_listener -u
[grid@rac1 ~]$ srvctl start scan_listener

Verify that configuration is right and three SCAN listeners are started. 

[grid@rac1 ~]$ srvctl config scan
SCAN name: newscan.freeoraclehelp.com, Network: 1/192.168.1.0/255.255.255.0/eth0
SCAN VIP name: scan1, IP: /newscan.freeoraclehelp.com/192.168.1.34
SCAN VIP name: scan2, IP: /newscan.freeoraclehelp.com/192.168.1.33
SCAN VIP name: scan3, IP: /newscan.freeoraclehelp.com/192.168.1.32
[grid@rac1 ~]$ srvctl config scan_listener
SCAN Listener LISTENER_SCAN1 exists. Port: TCP:1521
SCAN Listener LISTENER_SCAN2 exists. Port: TCP:1521
SCAN Listener LISTENER_SCAN3 exists. Port: TCP:1521
[grid@rac1 ~]$

How to rename SCAN Port in Cluster?

As grid user, source the grid environment to make sure $GRID_HOME/bin is in PATH and

1. Modify SCAN listener port:
[oid1@rac1 ~]$ srvctl modify scan_listener -p 1522
2. Restart SCAN listener so the new port will be effective:
[oid1@rac1 ~]$ srvctl stop scan_listener
[oid1@rac1 ~]$ srvctl start scan_listener
3. Confirm the change:
[oid1@rac1 ~]$ srvctl config scan_listener
SCAN Listener LISTENER_SCAN1 exists. Port: TCP:1522
SCAN Listener LISTENER_SCAN2 exists. Port: TCP:1522
SCAN Listener LISTENER_SCAN3 exists. Port: TCP:1522
[oid1@rac1 ~]$

Related Posts

199 Comments:

Monowar M said...

Hi Raj,

Thanks for your article. nslookup is fine from both nodes.

[root@rac1 ~]# nslookup rac-scan.localdomain
Server: 192.168.2.102
Address: 192.168.2.102#53

Name: rac-scan.localdomain
Address: 192.168.2.25
Name: rac-scan.localdomain
Address: 192.168.2.23
Name: rac-scan.localdomain
Address: 192.168.2.24

But ping for above IP address is not working. Again I can'u use 192.168.2.102 as this is 2nd node virtual IP.
I see all your installation you used separate DNS server IP [192.168.1.31].

Please let me know if there any way to use above scan DNS IP address. I have no separate DNS server.

Regards
Monowar

Raj Mareddi said...

Monowar,

Yes, we cannot ping them until cluster is installed and started.. basically Oracle Cluster (Grid) uses these IPs to start SCAN listeners on.

I think you're confused between DNS and GNS. If you're going to use GNS, Oracle Cluster starts a DHCP and DNS Server for you and you do not need to setup the SCAN in DNS at all.

If you have DNS server in your network, you do not need to select the GNS (unlike the one in above screenshot). I see that you have setup DNS record for SCAN. You just need to supply this SCAN info and not select "Configure GNS" during the installation. Refer to the following two grid installations.. first one is without GNS (with DNS.. just like your case) and second one is with GNS (and without DNS Setup for SCAN):

Oracle 11gR2 RAC Upgrade from 10gR2 RAC on Linux

Oracle 11gR2 RAC Installation with GNS, without SCAN

Cheers,
Raj Mareddi

Anonymous said...

Thank you very much. very helpfull article.

Venkat said...

Really very good article.Please keep it up and publish more.

Anonymous said...

Man this is a great article. I was struggling to understand SCAN and this article has done the magic and made the concepts clear. Thanks Raj Mareddi.

regards,
Mohammed.

Anonymous said...

Dear Raj,

Such a great article and easy to follow. It helped me a great deal.

Keep up the great work.

Thanks.

Anonymous said...

Thank You Raj for sharing the gr8 article.Its really good.

Anonymous said...

Really good article, in-depth on SCAN. Great Thanks.
-Jagadish

Anonymous said...

Dear Raj
Its wonder article
All my doubts has been cleared about SCAN IP.
Thanks for sharing ……..

Raj Mareddi said...

Thank you, guys.

Satya Thirumani said...

Superb work...
Thanks for sharing.

-Satya
http://satya-racdba.blogspot.com/2012/07/virtual-ip-vip-address-rac-oracle.html

kranthipdba said...

Nice article. Good share !!!!

Gulyaka said...

Great article, thanks!!!

Anonymous said...

Thanks for sharing this!!!!

Anonymous said...

if we run ifconfig on both node, is there any scan ip avaiable on both nodes

Ramesh said...

Great Job ...

Anonymous said...

Thank you so much. My 11.2.0.3 grid installation failed to create the scan entry on the second node, following your "rename cluster name" steps was able to create that on the second node.

Anonymous said...

Hey Man, this is an excellent article. There is always a chance to represent one thing in different words or sentences. Even though we might mean the same but just a vocabulary can be different and that is more than enough to create confusion.

This is superb where you also showed the output from the nods and i can't thank you enough for putting this together.

aakash said...

its very helpful thanx and keep posting..

Anonymous said...

Hi Raj,

It is very good post with detail. Output is helpful with different scenario.

Thanks a lot.

Gang

Monowar M said...

Hi Raj,

I have come to your side to say thanks for your nice article. This post was helped me to prepare for my OCM 11g exam on my pc (with/without - GNS and DNS).

Thanks Again
Monowar Mukul

Anonymous said...

Awesome post....

Anonymous said...

Excellent and very detailed article. Thanks for sharing it!

Anonymous said...

How to restart some listener_scan1 or lister_scan2 in specifc node?
We ensure listern_scan1 is up in node1 (ps -ef), but we can not connect to that node1 (instance1) which always points to other nodes by application client for sure.
The woraound is to reboot node1 and then new listen_scan1 or listen_scan2 be active agin in node1. Any other soution to restart scan_listenr?

amy said...

very good article

Rawish Siddiqui said...

Sure! its very helpful article.

============
Rawish Siddiqui
============

Vivek Rapariya said...

Good one ....

Regards,

Vivek

Muthu said...

Hi,

None of the articles / posts under Oracle IDM or Oracle Apps is opening. Can you check ?

Thanks
Muthu

GK said...
This comment has been removed by the author.
amine lahragui said...

Your work is very good and I appreciate you and hopping for some more informative posts. happy new year 2016 new year 2016 happy new year 2016 images feliz año nuevo 2016 imagenes de año nuevo 2016 feliz año 2016 happy new year images 2016 new year 2016 images new year images 2016

salman said...

I really enjoy the article post.Really looking forward to read more. Great.
Prem ratan dhan payo kickass torrent

prem said...

Really appreciate you sharing this blog post.Really thank you!
Prem ratan dhan payo torrent

Diwali Wishes said...

Thank you ever so for you article post.Much thanks again. Really Cool.
diwali sms

happy said...

Really informative article post.Really looking forward to read more. Great.
Diwali wishes 2015

Rohit Malik said...

childrens day wishes

Ankit Das said...

Great article.... Thanx a lot for uploading....
Happy New Year 2016



Happy New Year eCards




Happy New Year 2016 Messages

Ankit Das said...

Great article.... Thanx a lot for uploading...
Keep uploading stuffs like it....
To know about tech related topics...
Visit my blog...

MickWay

asds said...

Inspirational Love Quotes
Love Quotes
Inspirational Quotes

Inspirational Quotes
Love Quotes
Photoshop Tutorials

Happy Mothers Day
Happy Mother's Day
Happy Mothers Day 2016
Happy Mother's Day 2016
Mothers Day 2016
Mother's Day 2016

happy mothers day quotes
happy mothers day messages
happy mothers day poems

asds said...

mothers day quotes from daughter
mothers day quotes from son
mothers day quotes from husband to wife

mothers day quotes from family
mothers day quotes
mothers day messages

mothers day poems
mothers day poems from daughter
funny mothers day quotes

funny mothers day messages
funny mothers day sayings
mothers day sayings

mothers day love quotes
inspirational mothers day quotes

asds said...

Happy Mothers Day
Happy Mother's Day
Happy Mothers Day 2016

Happy Mother's Day 2016
Mothers Day 2016
Mother's Day 2016
Happy Mothers Day
Happy Mother's Day
Happy Mothers Day 2016

Happy Mother's Day 2016
Mothers Day 2016
Mother's Day 2016

asds said...

Happy fathers Day
Happy father's Day
Happy fathers Day 2016

Happy father's Day 2016
fathers Day 2016
father's Day 2016

father's day
fathers day

fathers day quotes
fathers day messages
fathers day poems
Happy fathers Day
Happy father's Day
Happy fathers Day 2016

Happy father's Day 2016
fathers Day 2016
father's Day 2016

Happy Father’S Day 2016 Quotes

asds said...

Wishes Quotes
Wishes Quotes Greetings
Easter Sunday
Easter Sunday 2016
Recover Deleted Files on Android
Apple iPad Mini 4 Cases and Covers
Online Music Identification Services

Multiplayer Games for your iPhone
Free Stock Photo Websites
Design Resources

Free Android Apps
Improve the Performance of Android Tablet
Screen Recording Software
Screen Sharing Software for Remote Access

asds said...

Valentines day 2016
Happy Valentines day 2016
Happy Valentines day
Valentine's day 2016

Happy Valentine Day Quotes For Husband
kiss quotes for her
kiss quotes for girlfriend

happy valentines day 2016
valentines day 2016
valentine's day 2016

happy propose day
valentines day quotes
happy valentines day quotes
happy valentines day quotes

kiss quotes for boyfriend
anti valentines day quotes
anti valentines day quotes

propose day sms
short valentines day poems

asds said...

valentines day poems for her
valentines day poems for girlfriend
Happy Rose Day Quotes SMS And Sayings

Happy Propose Day SMS - Messages For Him And Her
Valentines Day Quotes
Happy Chocolate Day Love Quotes

Happy Chocolate Day Sms Messages
Valentines Day Gifts For Her
Cheap Valentines Day Cards

Cute Valentines Day Quotes
Valentines Day Poems For Him
Happy Valentines Day Whatsapp Messages

Valentines Day Ideas For Kids
Valentines Day Pick Up Lines
Happy Chocolate Day Quotes For Him And Her

happy valentines day quotes
valentines day quotes
Happy Valentine Day Quotes For Husband

asds said...

Valentines day 2016
Happy Valentines day 2016
Happy Valentines day
Valentine's day 2016

Funny Valentines Day Quotes
Valentine Week List 2016
Valentines Day Quotes
Happy Valentines Day Quotes
fathers day quotes
fathers day messages
fathers day poems

Easter Quotes From The Bible
Happy Easter Quotes
Easter Quotes


Ankit Das said...

Happy Valentines Day 2016

Valentines Day Images

Happy Valentines Day Images

Rose Day SMS

Rose Day Quotes

Rose Day Wishes

Phone Prices said...

Mothers day gifts
Mother's day special quotes
Free mothers day 2016 SMS
Latest top 10 Quotes for mom
Free mothers day text message
when is mothers day
when is mothers day
when is mothers day

Easter Sunday Games for Kids
Easter Eggs 2015 Pictures HD | Images | Pictures


easter images
Easter Quotes From The Bible
Funny Easter Sunday 2016 Quotes


goodfriday
easter friday
friday before easter
good friday catholic services
good friday dp

passover 2016 cruise


memorial day school
memorial day quotes for loved ones

Phone Prices said...

Saint Patricks day 2016
st patricks day images
st patrick's day
saint patricks day ireland
st patrick's day
st patrick's school
st patrick's day 2016 chicago
saint patricks day images

B.ed Sample Resume
Free Resume Creator online
Professional Resume Critique
sample cv format usa

Mothers Day said...

Mothers Day Messages
Happy Mothers Day Messages
Indians go wrong
Happy Mothers Day Quotes
Happy Mothers Day Poems
Mothers Day Wishes
Happy Mothers Day Wishes
Mothers Day Quotes
Mothers Day Poems
Mothers Day Ideas
Happy Mothers Day Ideas
Mothers Day Idea
Happy Mothers Day Idea
Mothers Day Gifts
Happy Mothers Day Gifts
Mothers Day Gift
Happy Mothers Day Gift

sidharth Mitra said...

must check.. Kerala Updates

Ankit Das said...

Want to know about Exam Reasults 2016. Get CBSE 10th Result 2016,PSEB 12th Result 2016,PSEB Result 2016,Board Exam Result 2016. Visit my blog.
Board Exam Result 2016
CBSE 10th Result 2016
PSEB 12th Result 2016

Jayesh khandait said...


this blog is really helpful. i found very interesting things here.
fan movie box office collection earning reports
fan movie worldwide earnings
fan movie 1st DAY 2nd day 3rd day 4th day box office collection
fan movie 1st day EXPECTED box office collection
fan movie first day box office collection

ipl 9 live score said...

this blog is really helpful. i found very interesting things here.
happy mothers day 2016 quotes
happy mothers day 2016 quotes messages sms pictures
happy mothers day 2016 quotes from daughter
happy mothers day 2016 images
happy mothers day 2016 pictures
happy mothers day 2016 GIFT IDEAS for mother

Sai Santosh said...

Great images in this posts are similar to love quotes for her and reminding of writing combination of poetry on the scenarios.

theri said...

Thank you ever so for you blog. Really Cool.
Theri Torrent Download Full Movie

ankit said...

I appreciate you sharing this blog. Fantastic.
Fan Kickass Torrent

freeonline said...

I truly appreciate this article post. Want more.
Fan Movie Torrent

fan said...

fan movie download hd

ravi prashant said...

BlueDart Tracking
Happy Diwali SMS
French Open Live French
<a href="http://halloweendecorations2016.com/”> Halloween Props</a>

Tom Sings said...

Awesome info. Keep it up! Hoping to read more from on here..have a great day indeed! Happy Birthday Wishes for Friends and Family Happy Birthday Wishes for Lovers 10 Best Anniversary Wishes ICC T20 World Cup Live Streaming
Teams Participating in Copa America Centenario
Copa America Centenario Valentines Day Texts for her Valentines Day Jokes Greetings and cards April Fools Day Prank Videos 50 Earth Day sayings, slogans and quotes When is Earth Day? Why is Earth Day celebrated? Earth Day Quotes Earth Day Activities

Tanvir maniyar said...

Grt Share...Looking Forward for more
Mothers Day Messages
Happy Mothers Day Messages 2016
Mothers Day Images
Mothers Day Images
Mothers Day Images
Mothers Day Images
Short Happy Mothers Day Poems
Inspirational Mothers Day Saying
Short Mothers Day Saying
Mothers Day DP
Happy Mothers Day DP
Mothers Day DP For Whatsapp
Mothers Day DP For Snapchat
Mothers Day DP For Hike

baaghi said...

Great, thanks for sharing this article.Thanks Again. Much obliged.
Baaghi Torrent Download

Rahul Lokhande said...


this blog is really helpful. i found very interesting things here. i am going to read this blog daily and will refer it to some of my friends are

blogger.
www.mahresult.nic.in
check ssc result 2016 on mobile
box office collection of sultan

shawn martin said...

Happy Mothers day Images 2016 Happy mothers day 2016 HD Images Happy Mothers day Wallpapers Happy mothers day Pics 2016 Happy Mothers day Pictures Happy mothers day Cards Happy Mothers day gifts ideas Happy Mothers day craft Ideas Happy Mothers day 2016 Free images download Happy Mothers day in heaven images Happy Mothers day Funny Images Happy Mothers day 2016 Love Quotes
http://www.happymothersday2016images.com

Happy Mothers Day Images Facebook


Top 10 Easy Diy Mother’s Day 2016 Gifts Ideas

Happy Mothers Day 2016 Cards

Happy Mothers Day Images Australia

Happy Mothers Day Images Arabic

Happy Mothers Day Images Pinterest

Happy Mothers Day Images Whatsapp

Happy Mothers Day Poems

Happy Mothers Day Gifts for mom

Happy Mothers Day Messages


Happy Mothers Day Status for facebook

brahm said...

A big thank you for your article.Really thank you! Want more.
Brahmotsavam Torrent

ipl said...

I appreciate you sharing this blog article.Much thanks again. Keep writing.
ipl semi final live streaming

Arushi Mathur said...

Sultan Movie
http://www.sultan-movie.com/
http://www.sultan-movie.com/2016/03/Sultan-Movie-Downlaod-Top-10-site-Must-See-for-Safe-Download.html
http://www.sultan-movie.com/2016/03/Sultan-Movie-Salman-Khan.html

akshay said...

Thanks again for the post.Really thank you! Really Great.
housefull 3 torrent download

Sultan Movie said...

A big thank you for your article.Thanks Again. Much obliged.
Sultan Torrent Download

salman said...

Really appreciate you sharing this blog.Really looking forward to read more. Much obliged.
Sultan Movie Download

Akshi Sharma said...

french open final live streaming
french open 2016 final live stream
french open live stream 2016

Akshi Sharma said...


Hello. Now You can share father's day quotes,images & messages
happy Father's Day messages
Fathers Day messages
Fathers Day Quotes

Happy birthday Cake said...

happy father's day 2016
happy father's day 2016 images
happy father's day 2016 pictures
happy fathers day quotes
happy fathers day quotes 2016
happy father's day 2016 greetings
fathers day 2016
happy father's day 2016 wishes
happy fathers day 2016 sms
happy father's day 2016 quotes
happy father's day 2016 message


Happy Memorial Day 2016 Images
Happy Memorial Day 2016 Quotes
Happy Memorial Day 2016
Memorial Day 2016

Surender Martha said...
This comment has been removed by the author.
Surender Martha said...
This comment has been removed by the author.
Surender Martha said...

Excellent Article ..! Thanks.

There are useful Oracle DBA info ,

Oracle DBA Learners Blog

suhail alam said...

fathers day
fathers day sms
fathers day wishes

suhail alam said...

fathers day
fathers day sms
fathers day wishes

suhail alam said...


Father's Day 2016
Fathers Day sms 2016
Fathers Day cards 2016
Fathers Day images 2016
Fathers Day poems 2016
Fathers Day quotes 2016
Fathers Day facebook whatsapp sms 2016
Fathers Day gift ideas 2016

suhail alam said...

happy ramadan 2016
ramadan time table 2016
ramadan message 2016
ramadan SMS 2016
ramadan Images 2016
ramadan Quotes 2016
ramadan Greetings 2016
ramadan Mubarak Whatsapp SMS 2016
ramadan Dua 2016
ramadan wishes 2016
ramadan Status 2016
ramadan Wallpapers 2016
ramadan Status 2016
ramadan Message for Facebook 2016
ramadan Mubarak Wishes 2016
ramadan SMS Quotes 2016
ramadan Kareem Wishes 2016
ramadan Pictures 2016
ramadan Ecards 2016
Happy ramadan SMS 2016
Happy ramadan SMS in Hindi 2016

suhail alam said...

Father's Day 2016
Father's Day wishes 2016
Father's Day Message 2016
Father's Day Quotes 2016
Father's Day Greetings 2016
USA Father's Day SMS 2016
USA Father's Day Wishes 2016
USA Father's Day Message 2016
Father's Day Images 2016
Father's Day SMS from son 2016
Fathers Day Quotes 2016
Fathers Day Poems 2016
Fathers Day Wishes From Daughter 2016
Fathers Day greetings 2016

Lakshya Dhillon said...

happy new year 2017

happy new year 2017 wishes

happy new year 2017 shayari

happy new year 2017 quotes

new year 2017 greetings

happy new year 2017 quotes

sample papers CBSE

new year 2017 quotes

Happy Diwali 2016

new year 2017 wishes

AMIT TRIPATHI said...

9 Best Fathers Day Messages for Happy Fathers Day
9 Awesome Father's Day Quotes for Happy Fathers Day
Best Fathers Day Poems for Happy Fathers Day
17 Awesome Fathers Day Quotes for Happy Fathers Day
7 Best Fathers Day Greetings for Happy Fathers Day
Amazing Fathers Day Poems for Happy Fathers Day
Best Father's Day Messages

kabali said...

A big thank you for your article.Much thanks again. Great.
Kabali Torrent Download

Kabali Torrent

Kabali Movie Torrent

Ankit Das said...

Want to know regular updates of Euro Cup 2016????
Get Euro Cup live Streaming,Euro Cup 2016 Schedule,Euro Cup 2016 Fixture,Euro Cup 2016 Live Streaming,Euro Cup 2016 Live Stream,Euro Cup 2016 Live Score.
Venue-France,From 10th june-10july. 24 teams,10 stadiums. Stay updated. Watch Wales vs Russia Live Streaming.

Shreya Mandal said...

I really enjoy the post. It is really awesome. Thanks for sharing.Watch Wales vs Belgium Live Streaming

robin singh said...

4th of July 2016
4th of july sms
4th of july quotes
4th of july message
4th of july wishes
4th of july fireworks
4th of july greeting cards
Fourth Of July Message to Employees
4th of July Quotes And Sayings
4th of July Poems
4th of July Images Flags
4th of July parade songs
4th of July wallpapers
4th of July sayings quotes
4th of July parades
4th of July Message for Twitter
4th of July cards
4th of July pictures
4th of July party Ideas
4th of July outfits Ideas
4th of July gift Ideas 2016

robin singh said...

happy 4th of July 2016
happy 4th of July pictures 2016
happy 4th of July quotes 2016
happy 4th of July SMS 2016
happy 4th of July Message 2016
happy 4th of July greetings 2016
happy 4th of July wishes 2016
happy 4th of July Sayings 2016
happy 4th of July Speech 2016
happy 4th of July Poems 2016
happy 4th of July Wallpapers 2016
happy 4th of July cards 2016
happy 4th of July greeting message 2016
happy 4th of July Pics 2016
happy 4th of July sms message 2016
happy 4th of July outfits ideas 2016
happy 4th of July fireworks 2016
happy 4th of July Party Ideas 2016
happy 4th of July Parade 2016
happy 4th of July gift Ideas 2016
happy 4th of July wishing quotes 2016

robin singh said...

happy eid 2016
happy eid wishes 2016
happy eid sms 2016
happy eid quotes 2016
happy eid images 2016
happy eid messages 2016
happy eid wallpapers 2016
happy eid greetings 2016
happy eid pic collections 2016
happy eid SMS for Facebook 2016
happy eid SMS wishing message 2016
happy eid SMS Message Wishes 2016

Bang Bang said...

Independence Day USA 2016 Fourth of July Mobile Wallpaper
Independence Day USA 2016 Fourth of July Inspirational Message
Independence Day USA 2016 Fourth of July WATCH Live Parade
Independence Day USA 2016 Fourth of July Message Card
Independence Day USA 2016 Fourth of July Wishes SMS Quotes
Independence Day USA 2016 Fourth of July Watch Live Parade
Independence Day USA 2016 Fourth of July Wishes Quotes for Family
Independence Day USA 2016 Fourth of July Parade images
Independence Day USA 2016 Fourth of July Graphic Images
Independence Day USA 2016 Fourth of July Greeting Cards
Independence Day USA 2016 Fourth of July Ecards
Independence Day USA 2016 Fourth of July Poem
Independence Day USA 2016 Fourth of July Desert Recipes
Independence Day USA 2016 Fourth of July Flag Wallpaper
Independence Day USA 2016 Fourth of July activities and celebration
Independence Day USA 2016 Fourth of July speech for kids

Akshay said...

great post really appreciatable work

FRIENDSHIP Day Wishes
Happy New Year 2017 SMS
happy birthday Wishes
nelly instagram
merry christmas greetings
sweet quotes for her

Independence Day said...

Independence Day 2016 Quotes
15th August 2016 Slogans
Messages Happy Canada Day
Photos Happy Canada Day
15th August 2016 Messages
Court Marriage In Mumbai

Independence Day said...

Friendship Day SMS
Happy Friendship Day 2016 Celebration
When Is Happy Friendship Day Celebrated
World Friendship Day
2016 Happy Friends Day Date

Cool n Hot said...

happy friendship day images, quotes, wallpapers, wishes, greetings everything is available here

Happy Friendship Day Quotes
Happy Friendship Day Messages
Happy Friendship Day wishes
Happy Friendship Day images
Happy Friendship Day

Imran Mansuri said...

this is the awesome article. keep sharing like this.

happy friendship day 2016 celebration
friendship day 2016 Quotes

Informations Point said...

Raksha Bandhan 2016
Happy Raksha Bandhan 2016
Raksha Bandhan Messages 2016
Raksha Bandhan Images 2016
Rakhi Poems 2016
Happy Friendship Day Images 2016

sahil said...

Happy Friendship Day
Friendship Bands Images Wallpaper Quotes For Friendship Day
Friendship day Images, Messages For Girlfriend
Friendship Day Messages, Best Friends, Facebook
Friendship Day Pictures Images Messages For Girl, Wife, Girlfriend
Happy Friendship day Images Quotes For Husband
Happy Independence Day 2016 Images Cards Wishes Wallpapers
Friendship Day Handmade Cards Greetings Messages Quotes For Facebook
Friendship Day Wishes Quotes Cards For Facebook, Whatsapp
Best 20 Images Of Friendship Day For Best Friends
Happy Friendship Day Wishes Quotes Pictures Greetings
Friendship day Cards, Cliparts, HD Wallpaper, Funny Messages
Happy Friendship Day Images In English,Hindi, Telugu Free Download
Happy Friendship Day Images, Sayings For Best friends
Happy Friendship Day Wallpaper Collections For True Friends
Happy Friendship Day 2016 Quotes, Animated Images
Happy Friendship Day Cards, Images Quotes, Messages 2016
Cute Happy Friendship day Images, Wishes, Pictures
Friendship Day Quotes, Inspirational Quotes, Images
Friendship Day Cards Messages Quotes For Best Friends
Friendship Day Images Greetings For Facebook Free Download
Friendship Day Greetings Messages For Facebook

Sunil Choudhary said...

Olympics 2016 medal tally
Olympics 2016 live tv channel
summer olympics 2016

Olympics 2016 closing ceremony
us medal tally in olympics 2016
Olympics 2016 medal tally

Russia Olympics 2016 medal list
Olympics 2016 live tv channel
Olympics 2016 medal tally

germany medal in rio olympics 2016
Olympics 2016 japan medal table
Olympics 2016 medal tally

Jayesh khandait said...

I do not know if it’s just me or if everyone else experiencing
issues with your site. It appears as though some of the text within your posts
are running off the screen. Can somebody else please provide feedbackThis might be a problem with my internet browser because I’ve had
this happen before.
Happy Halloween Pictures 2016
Happy Halloween 2016 Images
Happy Halloween 2016 Pictures
Happy Halloween 2016 Photos
Happy Halloween 2016 Wallpapers
Happy Halloween 2016 Quotes
Happy Halloween 2016 Greetings
Happy Halloween 2016 Sayings
Happy Halloween 2016 Wishes
Happy Halloween 2016 Messages
Happy Halloween 2016 Jokes
Happy Halloween 2016 Trolls
Pumpkin carving Ideas 2016
Halloween Pumpkin Ideas 2016
Halloween HD Wallpapers
Happy Halloween 2016 Clip Arts
Funny Halloween Quotes
Funny Halloween Pictures
Halloween Coloring Pages To Print
Halloween Images Free Download
Happy Halloween 2016 Costume Ideas
Happy Halloween 2016 Ideas
Happy Halloween 2016 Decoration
Happy Halloween 2016 Memes

Sanaz Marzban said...

پکیج تصفیه فاضلاب
پکیج تصفیه فاضلاب بهداشتی

Cherry Chitti said...

Good info.. olympics closing ceremony rio 2016

Sunil Choudhary said...

Thanx for ur great post
us open tennis 2016
diwali 2016
New Year 2017
shayari
love quotes

parvez khatri said...

This is the awesome article. keep sharing like this. wowww its to great too.

chand raat mubarak wishes 2016
eid ul adha whatsapp sms 2016
eid ul adha cliparts 2016
eid ul adha greeting cards 2016
top 10 eid ul adha sayings
eid ul adha preparation
wish you happy eid day wishes
wish you happy eid ul adha gift ideas
happy eid ul adha messages in hindi urdu
eid ul adha poems 2016

sahil said...

Happy Independence Day

Happy Teachers Day Wishes Images Quotes For Kids

Teachers Day Cards Design, Handmade Cards, Images

Teachers Day Quotes In English & Hindi

Happy Teachers Day {Adorable} Quotes Messages & Pictures

Teachers Day Quotes Images Wishes In {English}

Short Poem On {Special} Teachers Day In English

Poems on Teacher Day In English, Hindi, Marathi For Kids

Teachers Day {Best} Poems In Hindi, English, Marathi, Tamil

{Best}Happy Teachers Day Wishes, Cards, Quotes, Images

Teachers Day 2016 Quotes, Images, Pictures

Happy Teachers Day Wishes, HD Images 2016

Teacher Day Wishes Images Cards For Every Teacher

Pusat Penjualan Obat Herbal said...

If you are looking for a wide variety of drugs and supplements, this is the right way to treat a variety of diseases

Cara Menyembuhkan Bisul Secara Ampuh
Mengobati Ambein Sampai Tuntas
Cara Menyembuhkan Varises
Obat Kulit Gatal, Kulit Bersisik Dikepala
Pengobatan Campak Sampai Sembuh
Cara Penyembuhan Penyakit Rematik

Saradha Devi said...

very informative post

Best Selenium Training in Chennai | Android Training in Chennai | Java Training in chennai | Webdesigning Training in Chennai

shashank jain said...

How To Get Rid Of Blackheads

Rajapriya R said...

nice and good

selenium training in chennai | selenium training institute in chennai | Android training in chennai | android training institute in chennai

Rahul Pasha said...

Happy New Year 2017
Happy New Year 2017 Wishes
New Year 2017 Wishes
Happy New Year 2017 Wishes
New Year 2017 Wishes
Happy New Year 2017 Wishes
New Year 2017 Wishes
Happy New Year 2017 Images
Happy New Year Wishes 2017
Happy New Year 2017 Quotes
Happy New Year 2017 Wallpapers
Merry Christmas Wishes
Christmas Wishes

shashank jain said...

Nokia C1

Ranjit Ram said...

Want to know about Veterans Day,which is a day to celebrate the great officers of the US army,just checkout my blog Happy Veterans Day and stay updated.

Chinmaye Sri said...

Simply superb article thank you

Saradha Devi said...

great article nice to read
Best Selenium Training in Chennai | Selenium Training in Chennai

Amfi Smith said...

Nov 12, 2016 - UFC 205 - Alvarez vs. McGregor pits Conor Notorious McGregor vs Eddie Alvarez

fight in Madison Square Garden, New York, New York,
UFC 205
UFC 205 start time
UFC 205 live stream
UFC 205 stream
UFC 205 fight card
UFC 205 ppv

Amfi Smith said...

UFC 205
UFC 205 fight card
UFC 205 live stream
Watch ufc 205
UFC 205 live streaming
UFC 205 start time
UFC 205 date

Amfi Smith said...

mcgregor vs alvarez
mcgregor vs alvarez live
mcgregor vs alvarez live stream
alvarez vs mcgregor
alvarez mcgregor
alvarez mcgregor live stream
mcgregor alvarez
conor mcgregor vs eddie alvarez

Ridoy Hasan said...

UFC 205

UFC 205 streaming online. ufc 205 Fight card, start time, ufc 205 fight pass, ppv, TV channel and how to watch ufc 205 McGregor vs Alvarez live streaming free.


UFC 205
UFC 205 streaming
ufc 205 fight card
ufc 205 fight pass
UFC 205 stream
watch UFC 205

Ridoy Hasan said...

ufc 205 fight card

Complete UFC 205 Fight Card. How to watch ufc 205 fight card online and order ufc 205 ppv card, prelims, live stream, odds, lineup, ufc 205

ufc 205 fight card
UFC 205 card
UFC 205 main card
ufc fight ufc 205

Ridoy Hasan said...

UFC 205 Live Stream

Watch ufc 205 live stream ppv. Alvarez vs McGregor live coverage online. UFC 205 live streaming Main Card on PPV and Prelims on ufc fight

UFC 205 Live Stream
Live Stream ufc 205
UFC 205 Live Streaming
watch ufc 205 live
Live Streaming ufc 205

UFC 205 said...

UFC 205

UFC 205 start time

UFC 205 live stream

UFC 205 stream

UFC 205 fight card

UFC 205 ppv

UFC 205 said...

UFC 205

UFC 205 fight time

UFC 205 live stream

Alvarez vs McGregor

UFC 205 fight card

UFC 205 fight pass

UFC 205 said...

UFC 205

UFC 205 ppv

UFC 205 pay per view

UFC 205 PPV Order

UFC 205 PPV price

UFC 205 time

UFC 205 date

shiv said...


Thanks for posting this useful content, Good to know about new things here, Let me share this, . ORACLE training in pune

NFL Fan said...

NFL and college football update news is here.

penn state vs wisconsin

washington vs colorado

clemson vs virginia tech

panthers vs seahawks

patriots vs rams

cowboys vs vikings

carolina panthers vs seattle seahawks

nfl playoff

nfl playoff 2017

nfl playoff 2017

Rohit Dangar said...

happy new year wishes
new year wishes
new year greetings
new year quotes 2017
new year images
Merry Christmas Wishes
new year sms
new year messages
new year pics
new year status

abhishek said...

happy new year wishes
Happy New Year 2017 Wishes
Merry Christmas Wishes
Happy New Year Wishes 2017
christmas 2017 photos
happy new year pictures 2017
latest New year quotes 2017

Jmehedi Jibon said...

NFL Playoffs 2017

Watch NFL Playoffs 2017 live. NFL Playoff schedule 2017, Wild Card, divisional Playoffs, NFL Playoff Picture 2017, game times, live stream, score, teams, standings, afc, nfc championship.

NFL Playoff

NFL Playoffs 2017

Playoff Picture 2017

NFL Playoff schedule 2017

Jmehedi Jibon said...

Watch UFC 207 live on Dec 30 at T-Mobile Arena. Rousey vs Nunes, fight card, ufc 207 start time, ufc 207 streaming, tv channel, ppv and fight pass info.Nunes vs Rousey fight on the Biggest Event in This Year ufc 207 2016.

UFC 207

UFC 207 Live

UFC 207 Live Stream

Nunes vs Rousey

UFC 207 Stream

BVS Neha said...



quotes for her
good morning love quotes
funny meme
short inspirational quotes
funny birthday wishes
Belated birthday wishes
birthday status

Happy New Year 2017 said...

OMG , Amazing !! Everything Informative
This Is really Ah Very good post. Taking the time and actual effort to produce a superb article…
Thanks For Sharing
also Visit Our Sites

Happy New Year 2017

wishesquotescards.com

Happy New Year Gifs

Happy New Year Advance Wishes

Happy New Year Greetings Images

Happy New Year Advance SMS Messages

Happy New Year HD wallpapers Download

TOP Happy New Year Wishes

JULIA RUBY said...

http://packersvsgiants.com/

Packers vs Giants

Packers vs Giants Live

Packers vs Giants Stream

Giants vs Packers

Giants vs Packers Live

Giants vs Packers Stream

Packers vs Giants NFL Playoff

Packers vs Giants Wild Card Game

JULIA RUBY said...

http://nflplayoffs2017.org/

NFL Playoffs 2017

NFL Playoffs 2017 Live

NFL Playoffs 2017 Stream

NFL Playoff 2017 Game

suhail alam said...

Happy Good Friday Easter 2017 I
Valentines Day 2017
Raees Movie Collection 2017
Raees Movie 2017 releas date & Poster
First Day Collection Of Raees And Kaabil
All Lyrics Songs Raees And Lyrics Songs Kaabil
Hd Wallpaper Of Raees And Kaabil
Ind Vs England Odi 2017

suhail alam said...

Happy Valentine Day 2017
Happy Valentine Day 2017 Sms Wishes
Happy Valentine Day 2017 Image
Happy Valentine Day 2017 Message
Happy Valentine Day 2017 Hd Wallpaper
Happy Valentine Day 2017 Quotes Saying
Valentine day quotes 2017
Valentine day 2017 Week List
Valentine day 2017 Rose Day

suhail alam said...

Happy Republic Day 2017 Patriotic songs in hindi
Happy Republic Day 2017 flag image and wallpaper
Happy Republic Day 2017 Whatsapp & Facebbok Status
Happy Republic Day 2017 Wishing Quotes, Sms And Mesage
Happy Republic Day 2017 Sms Wishes, Message, Image And Wallpaper For Indian Army
Happy Republic Day 2017 Animated GIF
Happy Republic Day 2017 Message Shayari in Hindi Gujarati And Punjabi

suhail alam said...

Happy Republic Day 2017
Happy Republic Day 2017 Wallapper
Happy Republic Day 2017 Sms Wishes
Happy Republic Day 2017 Message
Happy Republic Day 2017 Image
Happy Republic Day 2017 Quotes
Happy Republic Day 2017 Wallpaper

Unknown said...

Patriots vs Steelers
Patriots vs Steelers live
Patriots vs Steelers stream
Steelers vs Patriots
Steelers vs Patriots live
Steelers vs Patriots stream
Patriots vs Steelers conference championship
Steelers vs Patriots AFC championship
New England Patriots vs Pittsburgh Steelers

Packers vs Falcons
Packers vs Falcons live
Packers vs Falcons stream
Falcons vs Packers
Falcons vs Packers live
Falcons vs Packers stream
Packers vs Falcons conference championship
Falcons vs Packers NFC championship
Green Bay Packers vs Atlanta Falcons

Unknown said...

Watch NFC Championship Game 2017 live stream. Packers vs Falcons NFC Championship Game 2017 live stream, streaming, free, game start time, tv channel, odds.


Packers vs Falcons

Falcons vs Packers

NFC Championship Game 2017

Packers vs Falcons Live Stream

NFC Championship 2017

NFC Championship 2017 Live Stream

Valentine Greetings said...

happy valentines day 2017
valentines day 2017
happy valentine's day 2017
valentines day quotes
valentines day messages
valentines day gifts
valentines day romantic gifts
valentines day 2017 cute
valentines day purpose day 2017
rose day 2017
purpose day 2017
happy rose day
propose day quotes
chocolate day 2017
valentines-greeting.com

klkkjkk said...

NFC Championship

NFC Championship Game 2017

NFC Championship 2017

ayesha said...

Visit us now to view & share beautiful collection of Best Images of
rose day 2017

Huma Siddiqui said...


Happy Valentine Day 2017
Happy Valentine Day 2017 Sms Wishes
Happy Valentine Day 2017 Image
Happy Valentine Day 2017 Message
Happy Valentine Day 2017 Hd Wallpaper
Happy Valentine Day 2017 Quotes Saying
Valentine day quotes 2017
Valentine day 2017 Week List
Valentine day 2017 Rose Day

Huma Siddiqui said...


Happy Rose day 2017 Hd Wallpaper
Happy Chocolate day 2017 Image cards
Happy Teddy day Hd Picture
Happy Promise day Hd Wallpaper
Hug day Hd Wallpaper 2017
Happy Kiss day 2017 Hd Wallpaper
14 February Image for Girlfriend/Boyfriend
14 February 2017 wishing message, quotes and sms
Valentines Day 2017 Gift Ideas

Huma Siddiqui said...

Happy Valentines Day 2017 Text Message Quotes Sms
Happy Valentines Day 2017 Hd Picture
Valentine Day 2017
Valentine Day 2017 Quotation
Valentine Day 2017 Sms Wishes
Valentine Day 2017 Message
Valentine Day 2017 Wishes For Husband Wife
Valentine Day 2017 Image

Huma Siddiqui said...

Happy President Day 2017 USA
Happy President Day 2017 Quotes
Happy Good Friday Easter 2017
Good Friday 2017 Wallpaper
Happy holi 2017

RdxPunjaB said...


happy teddy day
hug day images
happy chocolate day

mohit sharma said...


Hug Day
Hug Day 2017
Hug Day quotes
Hug Day messages

rashmi panwar said...

Ipl 2017 Tickets
Funny Happy Birthday Meme
Box Office Collection
Whatsapp Status New
Happy Birthday Images Download

CanelovsKhan said...

Oscars 2017 on February 26. Watch Oscars 2017, start time, TV Channel Coverage, Winners, oscars red carpet, live stream, streaming, online, free & News.


oscars 2017

oscars 2017 Live

oscars 2017 Live Stream

oscars 2017 Live Free

aiya rae said...

holi cartoons wallpapers
holi images
happy holi wallpapers
holi cartoons wallpapers
Holi images with quotes

oracle fusion said...

Nice article and explanation is good,Thank you for sharing your experience on oracle Scan.you have clearly explained about the process thus it is very much interesting and i got more information from your blog.

Oracle Fusion Oracle fusion financials training

Hitesh said...

April Fools Day Text Jokes

Best April Fools Day Text Pranks

Ankit Meena said...

Get all articles related to Happy Holi 2017. We have provided you the best Happy Holi Wallpapers Images Photos Status Messages Hindi SMS Profile Pics DPs For WhatsApp Facebook
Happy Holi HD Photos
Happy Holi 2017 Photos
Happy Holi Hindi Status for Facebook
Happy Holi GIF Images
Happy Holi Animation Cards
Happy Holi Advance Shayari
Happy Holi Whatsapp DP
Happy Holi Messages in Hindi
Happy Holi Ascii Messages
Happy Holi Funny Status

abdul ansari said...

Best Good Friday Quotes With Images

Hemant Sharma said...

Mother's Day 2017 India

Mothers Day Date 2017

Mothers Day Quotes

Happy Mother’s Day

MOTHER’S DAY

Mother’s Day Messages

Mothers Day SMS in Hindi

Happy Mothers Day Quotes

Happy Mothers Day Images,Sms,Quotes
Happy Mother"s Day

Kaushal Sah said...

Amazon Kindle customer service Number

News Times Daily said...

Nice and Informative Article Happy April Fool's Day 2017 Pranks and Jokes. Also, See April Fool Memes Images Pics.

1st April Fool Day 2017 GIF and Animated Images. Happy April Fool Day WhatsApp Troll and FB Funny Status

ERP said...

wonderful information, I had come to know about your blog from my friend nandu , hyderaba.
i have read atleast 7 posts of yours by now, and let me tell you, your website gives the
best and the most interesting information. This is just the kind of information that i had
been looking for, i'm already your rss reader now and i would regularly watch out for the new posts.



Oracle Fusion HCM Training

Niku babu said...

easter 2017
easter songs
easter wishes
easter quotes
Easter images

Hemant Sharma said...

Happy Mother’s Day

MOTHER’S DAY

Happy Easter Messages said...

Easter Decoration Ideas
Easter Quotes In Spanish
Happy Easter Quotations

Happy Father's Day said...

mothers day images

mothers day wishes

mothers day quotes

mothers day songs

Brave Technologies said...

Thank you for Sharing. We are leading erp software solution providers in chennai. For more details call +91 9677025199.
erp in chennai | erp software providers in chennai

Evelin Harriet said...

Nice Blog.Thank you for Sharing. We are leading erp software software solution providers in chennai. For more details call +91 9677025199. erp software in chennai | erp providers in chennai | online events registration

devo said...

Wonderful post. Java Training Institute in Chennai | Java Training Institute in Velachery.

srihariparu said...

Good Post with interesting content..Thanks for sharing your valuable article..

Android Training Institute in Chennai | Best Android Training in Velachery | IOS Training Institute in Chennai | Online Training in Chennai


melvin rajiv said...

I like your all post. You have done really good work. Thank you for the information you provide, it helped me a lot. I hope to have many more entries or so from you.
online banking services
finance guide
finance tips
latest banking finance

Giày tây nam Blucher said...

Great!
facebook giày tây nam
fanpage giày tây nam
giay tay nam
giày tây nam cao cấp
giày tây nam đẹp
giày tây nam da thật
giày tây nam công sở

Janadhar Election Management Software said...

Janadhar Election Management Software??
Election Campaign in india??
Election Digital Election Managament??
Election Managament Software in Rajasthan
www.janadhar.in

Dooiitt Tube said...

Best Outfits For Young ladies, Womens and Girls
We Have Some For You In Your Budget For more…
Plz visit:- Anarkali Dress

Sagar said...

Thanks for sharing this information and enjoy here.
Dehradun Escort Service
Dehradun Escort Service
Escorts in Dehradun
Female Escorts In Dehradun
Sexy Dehradun Escort Service

Dooiitt Tube said...

Best Outfits For Young ladies,Womens and Girls
We Have Some For You In Your Budget For more…
Plz visit:- Salwar Suit

Dooiitt Tube said...

Have Lovely and Beautiful Salwar Suit And Many More…
We Have Some For You In Your Budget For more…
Plz visit:- Online Shopping clothes

gmcs sialkot said...


eid mubarak wishes
eid mubarak status
eid mubarak image

satyajit Bhowmik said...

The US Open: You need to know the US Open Golf Championship will be the 117th US Open Golf 2017, US Open Schedule to be played June 15–18 at Erin Hills in Erin, Wisconsin, northwest of Milwaukee. For so many years, US Open Live everyone knew what to expect US Open Golf Live and US Open Live Stream. For the second time in three years, the 2017 US Open Golf is headed to a course that has never hosted a major. It will be the first US Golf Open in 25 years that doesn't have the names Tiger Woods or Phil Mickelson among the starting times US Golf Open 2017. Woods is missing all the majors for the second straight year because of a fourth back surgery, which was a month before his DUI arrest in Florida 2017 US Open Golf Live. Mickelson US Open Golf Live Stream, with a record six runner-up finishes in the only major he hasn't won, said he plans to skip because his daughter's high school graduation is the same day as the opening round. US Open TV Coverage and US Open 2017 Results


US Open Golf 2017
US Open Golf 2017 Live
US Open Golf 2017 Live Stream


US Open Championship
US Open Championship Live
US Open Championship 2017

robin singh said...

fathers day Wishing Quotes
fathers day Wishes From Wife
best quotes of fathers day
fathers day images with quotes
fathers day quotes sms
fathers day quotes sms
fathers day cakes chocolates
fathers day HD Wallpapers For Desktop
fathers day HD wishes with images
fathers day Quotes Sayings

robin singh said...

fathers day Display Picture 2017
fathers day card sayings 2017
fathers day HD Images with wishes 2017
fathers day Gif Images 2017
fathers day HD Photos 2017
fathers day Images Free Download 2017
fathers day Crafts 2017
fathers day Sayings From son 2017
fathers day quotes with images 2017
fathers day wallpapers in hd 2017

rahul pandey said...

funny happy fathers day sayings father's day message for husband fathers day sayings from daughter free happy fathers day images a father's love quotes cool fathers day pictures happy fathers day message to my husband happy fathers day message to my husband fathers day messages fathers day poems from son pictures for father's day
short fathers day sayings fathers day messages from wife to husband happy fathers day messages from daughter happy fathers day images quotes happy fathers day to my love good fathers day pictures husband fathers day quotes husband fathers day quotes father's day messages fathers day wishes happy fathers day wishes

Hemant sharma said...

blackmart
blackmart Alpha
blackmart Alpha apk

Venu Gopal Puram said...

Hi.. I gone through your post on "What is SCAN in Oracle 11g R2 RAC?" your way of presentation is simply good and having the command on the topic holds the best part. The way you focused on the content fetches the knowledge you have about the topic. I hope this information will help many a way who are in search of this topic oracle fusion financials training

hema kale said...

An extraordinary thought to praise friendship in an inventive way is make a blurb on Friendship Day this year.
friendship day 2017
friendship images
friendship day pic
friendship day pics
friendship day photos
For some the best sort of Friendship Day festivity is maybe a heart-to-heart converse with a best friend Sharing everything that has made a difference to you and your frinds for so......
friendship day wallpapers
photos of friendship
friendship quotes images

friendship images hd
true friendship images

hema kale said...

The most unique way to celebrate Friendship Day would be hold a gathering for your favorate images,quotes,hd wallpapers,messages,pics,photos and many more... Be that as it may, this thought needs a touch of arranging and exertion as you have to choose where to post(facebook,whatssapp,twitter,instagrame etc..) Once that is done, ring your pals and simply have your indulgence !

happy friendship day images
happy friendship day 2017
friendship day quotes
happy friendship day quotes
friendship images with quotes
friendship day messages
friendship day wishes
happy friendship day message
friendship day status
friendship day date
happy friendship day date
happy friendship day images

universal web said...

This is what i was looking for thak you for sharing this amazing post. keep on posting these kind of nice post
avast premier license file
independence day wishes
Birthday Quotes

yogareddy is said...

The most unique way to celebrate Friendship Day would be hold a gathering for your favorate images,quotes,
hd wallpapers,messages,pics,photos and many more... Be that as it may, this thought needs a touch of arranging and exertion as you have to choose where to post(facebook,whatssapp,twitter,instagrame etc..) Once that is done, ring your pals and simply have your indulgence !

happy friendship day images

happy friendship day 2017

friendship day quotes

happy friendship day quotes

friendship images with quotes

friendship day messages

friendship day wishes

happy friendship day message

friendship day status
friendship day date

happy friendship day date

happy friendship day images

An extraordinary thought to praise friendship in an inventive way is make a blurb on Friendship Day this year.

friendship day 2017

friendship images

friendship day pic

yogareddy is said...

friendship day pics

friendship day photos
For some the best sort of Friendship Day festivity is maybe a heart-to-heart converse with a best friend Sharing everything that has made a difference to you and your frinds for so......

friendship day wallpapers

photos of friendship

friendship quotes images


friendship images hd

true friendship images

jayachandrareddy said...

The most unique way to celebrate Friendship Day would be hold a gathering for your favorate images,quotes,hd wallpapers,messages,pics,photos and many more... Be that as it may, this thought needs a touch of arranging and exertion as you have to choose where to post(facebook,whatssapp,twitter,instagrame etc..) Once that is done, ring your pals and simply have your indulgence !

happy friendship day images

happy friendship day 2017

friendship day quotes

happy friendship day quotes

friendship images with quotes

friendship day messages

friendship day wishes

happy friendship day message

friendship day status
friendship day date

happy friendship day date

happy friendship day images

jayachandrareddy said...

An extraordinary thought to praise friendship in an inventive way is make a blurb on Friendship Day this year.

friendship day 2017

friendship images

friendship day pic

friendship day pics

friendship day photos
For some the best sort of Friendship Day festivity is maybe a heart-to-heart converse with a best friend Sharing everything that has made a difference to you and your frinds for so......

friendship day wallpapers

photos of friendship

friendship quotes images


friendship images hd

true friendship images

Packers Movers Kolkata said...

We are expert in Handling,Packers And Movers Kolkata and Packing & Shifting of Household Goods, Office goods, Commercial Equipment and Car, Logistics and Transportation. Packers and Movers Kolkata

lookandlike said...

good night meme
good morning meme
good morning gif
man arrested for everyting
i miss you meme

ails said...

Dussehra Wallpapers full hd

Animated Diya Gifs

happy Dussehra SMS

jayachandrareddy said...

we will solve all types of home applications like refrigerator, microwave oven, AC, etc. Repair & services are solve any problem contact us our technician will come in your home and solve that problem. Our contact numbers is call : 040-60506611, 040-60506622.
Godrej Refrigerator Repair Center in Hyderabad
IFB Microwave Oven Repair Center in Hyderabad
Samsung Washing Machine Service Center in Hyderabad

jayachandrareddy said...

we providing best repair & services with low cast and 100% customer satisfaction then we are providing 3 months warranty. Godrej Refrigerator Repair Center in Hyderabad Secunderabad washing machine, microwave oven, Ac all type of Home applications repair and services are providing if you are facing any problem jest contact us our technicians come your Home and solve the any problem our contact numbers given below.
Call :040-60506611,040-60506622 please contact us.
Whirlpool Microwave Oven Repair Center in Hyderabad
Whirlpool Microwave Oven Service Center in Hyderabad
Blue Star Air Conditioner Service Center in Hyderabad

sikat said...

Use this article to increase your knowledge . cara menggugurkan kandungan

Travail Detache said...

chauffagiste 75001vous souhaite bon courage.

ALINAAMEL said...

The website is looking bit flashy and it catches the visitors eyes. A design is pretty simple and a good user-friendly interface.

Programmierung in Lüdenscheid

Omid Yasini said...

تصفیه فاضلاب
تصفیه آب
سپتیک تانک
فروش آنتی اسکالانت
آب شیرین کن کشاورزی

Travail Detache said...

chauffagiste saunier duval nanterrea eu le plaisir de visiter le blog.

Fuzzy International said...

The best thing is that your blog really informative thanks for your great information!
cashew nuts suppliers and exporters in dubai
A4 paper suppliers and exporters in dubai

Narendra reddy said...

Best GRE prep books

Post a Comment