Welcome to www.freeoraclehelp.com Got questions? Post comments Like the facebook page to get instant updates. Thank you!!!
Total Pageviews

Oracle 11gR2 RAC Installation with GNS, without SCAN

Step by step procedure for installing Oracle 11g (11gR2, 11.2.0.2) Real Application Clusters (RAC) on Linux (OEL 5.5) without SCAN, DNS,NTP setup and with GNS and CTSS is describe here. You can pretty much run this installation on a desktop pc at home. I have used Oracle VM linux guests in this exercise. As always, do let me know any questions or comments you might have.

Introduction

Oracle 11gR2 has brought in a few new features. Couple of interesting new features and notes about 11g grid infrastructure:

  • Patch set installation: Starting with 11.2.0, direct upgrades to the most recent patch set are supported, meaning you don’t have to install 11.2.0 and apply patch set to get it to 11.2.0.2. You can directly perform the 11.2.0.2 installation. Download the installable from patch 10098816 in My Oracle Support.
  • Out-of-place upgrades for CRS/Grid home are supported. CRS/Grid goes into a seperate , new oracle home, instead of same CRS home as before.
  • Oracle Automatic Storage Management Cluster File System (Oracle ACFS) is introduced. We know that ASMLib is integrated with OS kernel. ACFS is one step further, offering ASM disks as OS cluster file system. Regular file systems are needed for Oracle binaries, needing another LVM for these regular file systems. With ACFS, you do not need any other LVM to manage oracle storage (let it be binaries, data files, etc..)
  • ASM and CRS are delivered into the same home, now called Grid Home
  • Single client access name (SCAN) is introduced in Oracle 11gR2 Grid Infrastructure. SCAN is meant to facilitate single name for all Oracle clients to connect to the cluster database, irrespective of number of nodes and node location. Until now, we have to keep adding multiple address records in all clients tnsnames.ora, when a new node gets added to or deleted from the cluster.
  • Cluster Time Synchronization Service (CTSS) is introduced to take care of the time synchronization between cluster nodes. Clusterware (CRS or Grid) used to depend on external services for time sync. This has been one of the key problems with node evictions and cluster instability. CTSS would be configured during the grid installation if NTP is not configured, which means /etc/ntp.conf should not exist and ntpd should not be running. With CTSS, you have one less thing to worry..
  • Grid Naming Service (GNS) is introduced to manage DNS lookups for the cluster node names, SCAN, and dynamically assign IP addresses to Oracle cluster nodes using Dynamic Host Configuration Protocol (DHCP). In short, GNS uses both DNS and DHCP to better address network requirements of the RAC. GNS would be creating a DNS service for a sub domain (for example: grid.freeoraclehelp.com) and regular DNS server delegates name resolutions to this GNS Server for the sub domain. Of course, GNS is optional, which needs SCAN to be configured in existing DNS servers of your organization. SCAN needs three address(A) records in DNS. This could be pretty simple for DNS administrator to set this up. There is no PTR required for these IP addresses.
  • However, if you’re installing RAC at your home, where you don’t have standard DNS to set up SCAN, you can spin up DNS service on one of the RAC nodes and set up SCAN quite easily.  Check my another blog post (Oracle 11gR2 RAC SCAN - DNS (bind) Configuration on Linux) to set up SCAN.
  • GNS assigns three IP addresses to SCAN VIPs, node VIPs, and even private interconnect interfaces. We just need to assign static IPs to the regular host names (as you normally would for any other linux server) only.
  • Multicasting is introduced in 11gR2 for private interconnect traffic. Check if your network supports multicasting before the installation. Refer to 1212703.1 for more information.
  • I have received a couple of requests for the RAC installation at home without SCAN setup. So, I would like to utilize both CTSS and GNS, to install grid infrastructure without SCAN or DNS server setup in this post.
  • This article explain a fresh 11gR2 installation from scratch. If you’re not installing it new and planning to upgrade, refer to Oracle 11gR2 RAC Upgrade from 10gR2 RAC on Linux
  • I have not set up ssh either. I wanted to have Installer (OUI) set this for both grid and oracle users
  • Two users are used in this install. Grid user for Grid infrastructure and oracle user for Oracle database software and databases. Role separation is another key feature in 11gR2. This comes handy in environments where storage and databases are managed by different teams.
  • OCR & Voting files should be stored in ASM Disk Groups from 11gR2 (for a new installation).  Normal redundancy means 3 disks and high redundancy means 5 disks.

OCR & Voting ASM storage requirements:

Redundancy Min no# of disks OCR Only Voting only Both OCR & Voting (min space)
External 1 300MB 300MB 600MB
Normal 3 600MB 900MB 2GB
High 5 900MB 1.5GB 2.4GB

This is the minimum storage required.. So, better get some room here.  Normal redundancy needs only two disks in a regular ASM disk group for data files.. and external needs min three disks. but, ASM disk group for OCR and Voting is special.

Grid Infrastructure home should NOT be under grid base and Oracle database home should be under oracle base. So, plan the homes accordingly. Also, /etc/resolv.conf should have GNS VIP listed, if GNS is going to be used.

Pre-install tasks

All of the following steps need to be executed on all cluster nodes (unless specified explicitly).
[root@rac4 ~]# groupadd -g 500 oinstall
[root@rac4 ~]# groupadd -g 501 asmadmin
[root@rac4 ~]# groupadd -g 502 asmdba
[root@rac4 ~]# groupadd -g 503 asmoper
[root@rac4 ~]# groupadd -g 504 oper
[root@rac4 ~]# groupadd -g 505 dba
[root@rac4 ~]# useradd -u 200  -g oinstall -G dba,oper,asmdba oracle
[root@rac4 ~]# useradd -u 201  -g oinstall -G asmdba,asmadmin,asmoper grid
[root@rac4 ~]# passwd oracle
[root@rac4 ~]# passwd grid
You may want to download asmlib rpm from http://www.oracle.com/technetwork/topics/linux/asmlib/index-101839.html 
[root@rac3 ~]# yum install oracleasm-support oracleasmlib oracleasm-`uname -r`
[root@rac3 ~]# rpm -qa |grep asm
oracleasmlib-2.0.4-1.el5
oracleasm-2.6.18-194.el5xen-2.0.5-1.el5
oracleasm-support-2.1.3-1.el5
[root@rac3 ~]# 
Once ASMLib is installed, configure ASMlib:
[root@rac4 ~]# /usr/sbin/oracleasm configure -i -e -u grid -g asmadmin -o "xvd"
Create ASM Disk labels on one node only, because these disks are shared. All other pre-install tasks to be run on all rac nodes.
[root@rac4 ~]# /etc/init.d/oracleasm enable
Writing Oracle ASM library driver configuration: done
Initializing the Oracle ASMLib driver:                     [  OK  ]
Scanning the system for Oracle ASMLib disks:               [  OK  ]
[root@rac4 ~]# /usr/sbin/oracleasm-discover 'ORCL:*'
Using ASMLib from /opt/oracle/extapi/32/asm/orcl/1/libasm.so
[ASM Library - Generic Linux, version 2.0.4 (KABI_V2)]
[root@rac4 ~]# /usr/sbin/oracleasm createdisk OCRV  /dev/xvdc1
Writing disk header: done
Instantiating disk: done
[root@rac4 ~]# /usr/sbin/oracleasm createdisk DATA1 /dev/xvdd1
Writing disk header: done
Instantiating disk: done
[root@rac4 ~]# /usr/sbin/oracleasm createdisk DATA2 /dev/xvde1
Writing disk header: done
Instantiating disk: done
[root@rac4 ~]# /usr/sbin/oracleasm createdisk DATA3 /dev/xvdf1
Writing disk header: done
Instantiating disk: done
[root@rac4 ~]# /usr/sbin/oracleasm-discover 'ORCL:*'
Using ASMLib from /opt/oracle/extapi/32/asm/orcl/1/libasm.so
[ASM Library - Generic Linux, version 2.0.4 (KABI_V2)]
Discovered disk: ORCL:DATA1 [4192902 blocks (2146765824 bytes), maxio 64]
Discovered disk: ORCL:DATA2 [4192902 blocks (2146765824 bytes), maxio 64]
Discovered disk: ORCL:DATA3 [4192902 blocks (2146765824 bytes), maxio 64]
Discovered disk: ORCL:OCRV [2088387 blocks (1069254144 bytes), maxio 64]
[root@rac4 ~]# 
ASM disks should be visible on all other RAC nodes.
[root@rac3 ~]# /usr/sbin/oracleasm-discover 'ORCL:*'
Using ASMLib from /opt/oracle/extapi/32/asm/orcl/1/libasm.so
[ASM Library - Generic Linux, version 2.0.4 (KABI_V2)]
[root@rac3 ~]#  /etc/init.d/oracleasm disable
Writing Oracle ASM library driver configuration: done
Dropping Oracle ASMLib disks:                              [  OK  ]
Shutting down the Oracle ASMLib driver:                    [  OK  ]
[root@rac3 ~]# /etc/init.d/oracleasm enable  
Writing Oracle ASM library driver configuration: done
Initializing the Oracle ASMLib driver:                     [  OK  ]
Scanning the system for Oracle ASMLib disks:               [  OK  ]
[root@rac3 ~]# /usr/sbin/oracleasm-discover 'ORCL:*'
Using ASMLib from /opt/oracle/extapi/32/asm/orcl/1/libasm.so
[ASM Library - Generic Linux, version 2.0.4 (KABI_V2)]
Discovered disk: ORCL:DATA1 [4192902 blocks (2146765824 bytes), maxio 64]
Discovered disk: ORCL:DATA2 [4192902 blocks (2146765824 bytes), maxio 64]
Discovered disk: ORCL:DATA3 [4192902 blocks (2146765824 bytes), maxio 64]
Discovered disk: ORCL:OCRV [2088387 blocks (1069254144 bytes), maxio 64]
[root@rac3 ~]#
[root@rac3 ~]# cat /etc/hosts
127.0.0.1       localhost.localdomain localhost
192.168.1.30   rac3.freeoraclehelp.com     rac3
192.168.1.40   rac4.freeoraclehelp.com     rac4
Install the following pre-requisite Linux packages
[root@rac3 ~]# yum install -y binutils compat-libstdc++-33 compat-libstdc++ elfutils-libelf elfutils-libelf-devel expat gcc gcc-c++ glibc glibc glibc-common glibc-devel glibc-headers libaio libaio libaio-devel libaio-devel libgcc libgcc libstdc++ libstdc++ libstdc++-devel make pdksh sysstat unixODBC unixODBC unixODBC-devel unixODBC-devel
Also, install cvuqdisk-1.0.9-1 rpm available from database installation dump directory.
Verify that multicast is supported in your network. The mcasttest script available in Note: 1212703.1.
[oracle@rac3 mcasttest]$ perl mcasttest.pl -n rac3,rac4 -i eth1
###########  Setup for node rac3  ##########
Checking node access 'rac3'
Checking node login 'rac3'
Checking/Creating Directory /tmp/mcasttest for binary on node 'rac3'
Distributing mcast2 binary to node 'rac3'
###########  Setup for node rac4  ##########
Checking node access 'rac4'
Checking node login 'rac4'
Checking/Creating Directory /tmp/mcasttest for binary on node 'rac4'
Distributing mcast2 binary to node 'rac4'
###########  testing Multicast on all nodes  ##########

Test for Multicast address 230.0.1.0

Sep 17 18:42:39 | Multicast Succeeded for eth1 using address 230.0.1.0:42000

Test for Multicast address 224.0.0.251

Sep 17 18:42:44 | Multicast Succeeded for eth1 using address 224.0.0.251:42001
[oracle@rac3 mcasttest]$ 
Change kernel parameters as per Oracle documentation and make sure that the same parameter is not duplicated. Here is my sysctl.conf
[root@rac3 ~]# tail /etc/sysctl.conf
kernel.shmall = 2097152
kernel.shmmax = 2147573760
kernel.shmmni = 4096
kernel.sem = 256 32000 100 142
fs.file-max = 6815744
net.ipv4.ip_local_port_range = 10000 65000
kernel.msgmni = 2878 
kernel.msgmax = 8192 
kernel.msgmnb = 65535
xen.independent_wallclock=1
fs.aio-max-nr = 1048576
net.core.rmem_default = 262144
net.core.rmem_max = 4194304
net.core.wmem_default = 262144
net.core.wmem_max = 1048586
[root@rac3 ~]# sysctl -p
Update ulimit settings for oracle and grid users. Add the following to /etc/security/limits.conf
cat >> /etc/security/limits.conf <<EOF
grid soft nproc 2047
grid hard nproc 16384
grid soft nofile 1024
grid hard nofile 65536
oracle soft nproc 2047
oracle hard nproc 16384
oracle soft nofile 1024
oracle hard nofile 65536
EOF
Run cluvfy script from the grid directory and address all the problems:
[root@rac3 ~]# /dumps/Database/11gR2/grid/runcluvfy.sh stage -pre crsinst -n rac3,rac4 -verbose
NTP Configuration has to be removed.
[root@rac3 ~]# mv /etc/ntp.conf /etc/ntp.conf.orig
[root@rac3 ~]# chkconfig ntpd off
[root@rac3 ~]# service ntpd stop

Install grid infrastructure

Oracle 11gR2 RAC Installation


Oracle 11gR2 RAC Installation


Oracle 11gR2 RAC Installation


Oracle 11gR2 RAC Installation


Oracle 11gR2 RAC Installation


Oracle 11gR2 RAC Installation


Oracle 11gR2 RAC Installation


Oracle 11gR2 RAC Installation


Oracle 11gR2 RAC Installation


Oracle 11gR2 RAC Installation


Oracle 11gR2 RAC Installation


Oracle 11gR2 RAC Installation


Oracle 11gR2 RAC Installation


Oracle 11gR2 RAC Installation


Oracle 11gR2 RAC Installation


Oracle 11gR2 RAC Installation
“Device Checks for ASM” seems to be a known bug. Please ignore.


Oracle 11gR2 RAC Installation


Oracle 11gR2 RAC Installation


Oracle 11gR2 RAC Installation


Oracle 11gR2 RAC Installation
 
Oracle 11gR2 RAC Installation

/etc/resolv.conf does not have GNS as the name server. After correcting the nameserver to GNS VIP, Cluster verification succeeded.

Edit /etc/resolv.conf  and replace

search freeoraclehelp.com
nameserver 192.168.1.1

to

search freeoraclehelp.com
nameserver 192.168.1.31

[root@rac4 ~]# nslookup scan.grid.freeoraclehelp.com
Server:         192.168.1.31
Address:        192.168.1.31#53

Name:   scan.grid.freeoraclehelp.com
Address: 192.168.1.101
Name:   scan.grid.freeoraclehelp.com
Address: 192.168.1.102
Name:   scan.grid.freeoraclehelp.com
Address: 192.168.1.103

[root@rac4 ~]#

Oracle 11gR2 RAC Installation



Oracle 11gR2 RAC Installation
 


Install database software and create database

Oracle 11gR2 RAC Installation

Oracle 11gR2 RAC Installation


Oracle 11gR2 RAC Installation


Oracle 11gR2 RAC Installation


Oracle 11gR2 RAC Installation


Oracle 11gR2 RAC Installation


Oracle 11gR2 RAC Installation


Oracle 11gR2 RAC Installation


Oracle 11gR2 RAC Installation


Oracle 11gR2 RAC Installation


Oracle 11gR2 RAC Installation


Oracle 11gR2 RAC Installation


Oracle 11gR2 RAC Installation


Oracle 11gR2 RAC Installation


Oracle 11gR2 RAC Installation


Oracle 11gR2 RAC Installation


Oracle 11gR2 RAC Installation


Oracle 11gR2 RAC Installation


Oracle 11gR2 RAC Installation


Oracle 11gR2 RAC Installation

I have not run ASMCA or created disk groups manually after grid installation. So, there are no disk groups here for database file storage. I have manually created the ASM disk group for database on the first node:

SQL> CREATE DISKGROUP DATA_DG EXTERNAL REDUNDANCY DISK
  2  'ORCL:DATA1',
  3  'ORCL:DATA2',
  4  'ORCL:DATA3' ;

Diskgroup created.

SQL> 

SQL> select group_number,name,state,type,total_mb,free_mb,usable_file_mb from v$asm_diskgroup;
           1 OCRV_GDG                       MOUNTED     EXTERN       1019        623            623
           2 DATA_DG                        MOUNTED     EXTERN       6141       6087           6087

SQL> 

Then, this mount this data group on the second RAC node.

SQL>  select group_number,name,state,type,total_mb,free_mb,usable_file_mb from v$asm_diskgroup;
           1 OCRV_GDG                       MOUNTED     EXTERN       1019        623            623
           0 DATA_DG                        DISMOUNTED                  0          0              0

SQL>  alter diskgroup DATA_DG mount ;

Diskgroup altered.

SQL>  select group_number,name,state,type,total_mb,free_mb,usable_file_mb from v$asm_diskgroup;
           1 OCRV_GDG                       MOUNTED     EXTERN       1019        623            623
           2 DATA_DG                        MOUNTED     EXTERN       6141       6044           6044

SQL> 

SQL> show parameter asm_diskgroups
asm_diskgroups                       string      DATA_DG
SQL> 

Once disk group is created and mounted on all RAC nodes, try refresh button here. You should see the newly created disk group.

Oracle 11gR2 RAC Installation


Oracle 11gR2 RAC Installation


Oracle 11gR2 RAC Installation


Oracle 11gR2 RAC Installation


Oracle 11gR2 RAC Installation


Oracle 11gR2 RAC Installation


Oracle 11gR2 RAC Installation


Oracle 11gR2 RAC Installation


Oracle 11gR2 RAC Installation


Oracle 11gR2 RAC Installation

 

Enterprise Manager (DBConsole)

You may to check few things out at OEM.. https://rac3.freeoraclehelp:1158/em and login as sys user (with sysdba).

Oracle 11gR2 RAC Installation

 

To connect to ASM instance, you need to login to ASM again.

Oracle 11gR2 RAC Installation


Oracle 11gR2 RAC Installation


Oracle 11gR2 RAC Installation


Oracle 11gR2 RAC Installation


Oracle 11gR2 RAC Installation


Oracle 11gR2 RAC Installation


Oracle 11gR2 RAC Installation


Oracle 11gR2 RAC Installation


Oracle 11gR2 RAC Installation


Oracle 11gR2 RAC Installation


Oracle 11gR2 RAC Installation


Oracle 11gR2 RAC Installation


Oracle 11gR2 RAC Installation

Related Posts

90 Comments:

Anonymous said...

Very informative

Raj Mareddi said...

Thank you!

Anonymous said...

This has helped me to install 11gR2 rac successfully. thanks

Hari

Anonymous said...

very good, Raj, this document really helps, have you tried 11g RAC with OCFS?

thanks,

-Hugo

Raj Mareddi said...

No, we have used ASM everywhere with 11g RAC. It is straight forward to use OCFS. Here is some basic info for you: http://www.oracle-base.com/articles/linux/OCFS2OnLinux.php. Let me know if any questions or problems.

Lalitha Terala said...

Hi Raj,
Thanks for very detailed documantation realy helps. Realy awesome.

Lalitha Terala.

Raj Mareddi said...

Thank you, Lalitha.

Siva Kumar said...

Dera Raj,

I need to migrate PROD ERP system from one DC to another DC, so for that i need to do 1st iteration in newly installed OS, ASM and cluster on server.

My doubt is once clone completed... i need to use these servers for PROD System migration. So in that case need to install once again ASM cluster on servers.

2-Node Apps Tier
2-Node 11g R2 RAC with ASM and OCFS

Thanks in Advance.

Raj Mareddi said...

Siva,

If this is just clone, and if your target servers have got Grid Installed already, you can just run the clone procedure to get the database cloned using RapidClone.

Anonymous said...

Thanks for taking the time to put all this together!

Can you explain why the grid infrastructure home should NOT be under the grid base? Thanks!

SY

Raj Mareddi said...

SY,

Grid infrastructure for a cluster installations assign root ownership to all parent directories of the Grid home location. As a result, ownership of all named directories in the software location path are changed to root, creating permissions errors for all subsequent installations into the same Oracle base.

~Raj Mareddi

Anonymous said...

Hi,

We have requirement to do POC for 11g R2 RAC with EBS R12,due to hardware constrains and short of time,shell i implement same on VMware,officially we have licensed VMware workstation with good enough memory 32GB with 1TB of disk space.can i complete setup.

Thanks
Rajkundra.

Anonymous said...

Can you provide adding and removing node from cluster on linux server

Monowar M said...

rac1 - 1st node; rac2 - 2nd node; rac3 -3rd node

Add New Node to cluster
======================
1. setup the ssh user equivalence for the GRID user between first node and the third node.
2. Check passwordless connection to 3rd node from 1st node
3.. set environment variable:
oraenv
+ASM
4. Pre installation check for 3rd node using cluvfy
$cluvfy stage -pre crsinst -n rac3
5. Generate the fixup script for the third node (rac3) with cluvfy with the -fixup option
$cluvfy stage -pre crsinst -n rac3 -fixup
6. Run the fixup script as directed by the above (step5 output)
$ssh root@rac3 /tmp/CVU_11.2.0.1.0_grid/runfixup.sh
7. using the cluster verification utility. make sure that you can add your third node to the cluster
$cluvfy stage -pre nodeadd -n rac3
#######################################
NOTE: ignore error like check failed on nodes:rac3
#######################################
8. Add your third node to the cluster from first node:
$ cd $GRID_HOME/oui/bin

$ ./addNode.sh -silent "CLUSTER_NEW_NODES={rac3}" "CLUSTER_NEW_VIRTUAL_HOSTNAMES={rac3-vip}"

9. Connected on third node (rac3) execute the following script

$ssh root@rac3
#/u01/app/oraInventory/oraintRoot.sh

10. from first node:
verify the cluster integration after install
============================================
$GRID_HOME/bin/cluvfy stage -post nodeadd -n rac3 -verbose

11. Make sure that the disk groups are mounted on all three nodes

$crsctl stat res ora.FRA.dg -t
$crsctl stat res ora.ACFS.dg -t
If
$ssh rac3
. oraenv
+ASM3
asmcmd mount ACFS
asmcmd mounr FRA

Check
========
$ crs_stat -t -v

$ srvctl status asm -a
$ olsnodes -n
===============================================
Remove Node From Cluster:
============================================
Set your environment
# . oraenv
+ASM1
# export $GRID_HOME=/u01/app/11.2.0/grid

Check the Node Status
===================
#cd $GRID_HOME/bin/
#./olsnodes -s -t

Unpin the node (being removed)
#./crsctl unpin css -n rac3

Stop Agent/database control on rac3
=============================
ssh rac3
# emctl
#export $GRID_HOME=/u01/app/11.2.0/grid
#cd $GRID_HOME/crs/install
# ./rootcrs.pl -deconfig -force

If there are issues with VIP then use to remove by force option

# srvctl stop vip -i rac3-vip -f
# srvctl remove vip -i rac3-vip -f

Update Cluster information to other node
=========================================
#./crsctl delete node -n rac3
Check pin again
#./olsnodes -t -s

Update Inventory
================
cd $GRID_HOME/oui/bin
./runInstaller -updateNodeList ORACLE_HOME=$GRID_HOME "CLUSTER_NODES={rac3}" CRS=TRUE -local

Ramesh Togara said...

Hi Raj,

You have used the IP "192.168.1.31" for GNS.
Is this IP need to be mentioned in any configuration files in the server? or it could be just a FREE ip in the same network?

Regards,
Ramesh Togara.

amine lahragui said...

Your work is very good and I appreciate you and hopping for some more informative posts. happy new year 2016 new year 2016 happy new year 2016 images feliz año nuevo 2016 imagenes de año nuevo 2016 feliz año 2016 happy new year images 2016 new year 2016 images new year images 2016

Sankar S said...

Your work is very good and I appreciate you and hoping for some more new informative posts.

happy new year 2016 images
new year quotes 2016
feliz ano novo 2016
imagens de ano novo 2016
frohes neues jahr 2016
feliz año 2016
feliz año nuevo 2016
imagenes de año nuevo 2016

Sankar S said...

Your work is very good and I appreciate you and hoping for some more new informative posts.
buon anno 2016
immagini di buon anno 2016
immagini di buon anno 2016
auguri di buon anno 2016

Ankit Das said...

Happy New Year 2016



Happy New Year eCards




Happy New Year 2016 Messages

David Clayton said...

australian open 2016 schedule
australian open 2016 tickets
australian open 2016 live
australian open tennis 2016
australian open 2016 live scores

Dhruv Shah said...

Thank You. You can celebrate new year with great sms, quotes & messages.
happy new year quotes
happy new year sms
happy new year wishes 2016
happy new year messages

Junaid Ahmed said...

New Year is the time at which a new calendar year begins and the calendar’s year count increments by one. new year 2016 wallpapers for android and windows Many cultures celebrate the event in some manner.

Dallas Larden said...

Thanks for sharing it!

Crazy Bulk

Dhruv Shah said...

Great. You can check easily here cat result 2015 online now
cat 2015 result
cat result 2015
cat 2015 results
cat2015results.in
cat results
cat result
cat results 2015
www.cat2015results.in
cat result date
cat result declared
download cat 2015 results
cat 2015

Ankit Das said...

Happy Valentines Day 2016

Valentines Day Images

Happy Valentines Day Images

Ankit Das said...

Happy Valentines Day 2016

Valentines Day Images

Happy Valentines Day Images

Ranveer Patil said...

Your blog was too good. i really appreciate with your blog.Thanks for sharing.
IPL Auction 2016
IPL Auction 2016 Players
IPL Auction 2016 Teams

Admin said...

india vs pak t20 wc live streaming
T20 world cup 2016 Highlights

ravi prashant said...

French Open Live
BlueDart Tracking
Happy Diwali
4th of july fireworks

Lakshya Dhillon said...

happy new year 2017

happy new year 2017 wishes

happy new year 2017 shayari

happy new year 2017 quotes

new year 2017 greetings

happy new year 2017 quotes

sample papers CBSE

new year 2017 quotes

Happy Diwali 2016

new year 2017 wishes

Ankit Das said...

Want to know regular updates of Euro Cup 2016????
Get Euro Cup live Streaming,Euro Cup 2016 Schedule,Euro Cup 2016 Fixture,Euro Cup 2016 Live Streaming,Euro Cup 2016 Live Stream,Euro Cup 2016 Live Score.
Venue-France,From 10th june-10july. 24 teams,10 stadiums. Stay updated. Watch Euro Cup 2016 Opening Ceremony.

mary Brown said...

Java Articles | IT Technical Articles | Dot Net Framework Articles |
JavaScript Articles | Java Training Institutes | Single Page Application Development

mary Brown said...

I have read your blog its very attractive and impressive. I like it your blog.

Java Training in Chennai Java Training in Chennai | Core Java Training in Chennai

Online Java Training Online Java Training | Java J2EE Online Training | JavaEE Training Institute in Chennai

soniboni said...

good top of products on your house windows? Therefore you must own mobdro app android download mobdro for pc Mobdro is certainly a no cost training video buffering iphone app nice.

ershovayuli said...

awsome all the Mobdro items will end up being frequently read more here Google android, iPhone, iPad. Mobdro mobdro pc nice.

Rahul said...

great post really appreciatable work.

Get friendship day quotes
new year 2017 images
Happy Birthday Greetings
kylie jenner instagram
Happy New Year 2017 Wishes
enjoy life quotes
Teachers Day Poems

Sridevi Koduru said...

Regards
Sridevi Koduru (Senior Oracle Apps Trainer Oracleappstechnical.com)
LinkedIn profile - https://in.linkedin.com/in/sridevi-koduru-9b876a8b
Please Contact for One to One Online Training on Oracle Apps Technical, Financials, SCM, Oracle Manufacturing, OAF, ADF, SQL, PL/SQL, D2K at sridevikoduru@oracleappstechnical.com | +91 - 9581017828.

robertgreene said...

good if your answer no then doesn’t worry here in our this post official site link As we have got utilized the Bluestacks for Personal computer videoder APK App nice.

Informations Point said...

Happy Teachers Day
Happy Teachers Day Gift Ideas
Teachers Day Speeches for Students
Happy Teachers day Greeting Cards
Teachers Day 2016 Poems
Teachers Day Messages
Teachers Day Images

harrymackay said...

good We expect that, the suggestions in this content, http://isnapchatemojis.com it can get applied at free of charge of charge. nice.

harrymackay said...

good I trust that you folks relished with this ShareIt for Laptop or computer official website for sharing the media files with any type of other files. Download SHAREit on PC nice.

Ranjit Ram said...

Have you heard about Cat Day 2016 checkout my blog to get all the latest information and stay updated

Ranjit Ram said...

Want to know about Veterans Day,which is a day to celebrate the great officers of the US army,just checkout my blog Happy Veterans Day 2016 and stay updated.

meganscott said...

good risk evaluation ,hot lists and actually Options chains. scottradeloginn lower price on selection of items. You can acquire nice.

Lalit Sharma said...

happy diwali quotes
happy diwali images
happy diwali greetings

meganscott said...

good software onto your unit will permit you to continue Play Store to a past release to steer clear of parasites. Here's nice.

حسام داود said...

شركة تسليك مجارى بالرياض
level تسليك المجاري بالرياض
افضل شركة تنظيف بالرياض
تنظيف شقق بالرياض
شركة تنظيف منازل بالرياض
شركة غسيل خزنات بالرياض
افضل شركة مكافحة حشرات بالرياض
رش مبيدات بالرياض
شركة تخزين عفش بالرياض
شركة تنظيف مجالس بالرياض
تنظيف فلل بالرياض
ابى شركة تنظيف بالرياض

shiv said...


Thanks for posting this useful content, Good to know about new things here, Let me share this, . ORACLE training in pune

danny donald said...

download the play store app and download free games and apps

dunncandace said...

good the problem material and dissolves it and carries it away. Best Water Softener if you have a large family and use up a lot of water great.

Nikita Friend said...

nice and best way of sharing guide is provided, check for more to understand meanings of emojis of snapchat. good.

dunncandace said...

Great It also allows you to focus on movie growing, <a href="https://livelymusically.com/lively-apk-android-download-app>Live.ly for Android</a> ability of it that allows you listen the sound while recording it Nice.

Rohit Dangar said...

New Year Wishes
New Year Greetings
New Year Messages
New Year Status
New Year Quotes

حسام داود said...

شركة تسليك مجاري المطبخ بالرياض
شركة تسليك مجاري بالرياض

شركة تسليك مجارى الحمام بالرياض
level تسليك المجاري بالرياض
افضل شركة تنظيف بالرياض
تنظيف شقق بالرياض
شركة تنظيف منازل بالرياض
شركة غسيل خزنات بالرياض
افضل شركة مكافحة حشرات بالرياض
رش مبيدات بالرياض
شركة تخزين عفش بالرياض
شركة تنظيف مجالس بالرياض
تنظيف فلل بالرياض
ابى شركة تنظيف بالرياض

Happy New Year 2017 said...

OMG , Amazing !! Everything Informative
This Is really Ah Very good post. Taking the time and actual effort to produce a superb article…
Thanks For Sharing
also Visit Our Sites

Happy New Year 2017 Wishes Quotes Cards
Happy New Year SMS QUOTES
Happy New Year 2017 Quotes
Happy New Year 2017 Cards
Happy New Year 2017 Wishes
Christmas 2016 Quotes Wishes

Happy Diwali said...

SHAREit availale for Android snartphons. The ap can be used on your computer and simple guide on this original site check for more. SHAREit for fast file transfer.

Happy New Year 2017 said...

Best Wishes 2017
New Year Wishes 2017
New Year Wishes Messages
Christmas Messages 2016
New Year 2017 HD Wallpapers
New Year Messages 2017
New Year Wishes for Lovers
Romantic New Year Wishes 2017
New Year Greetings 2017
New Year SMS 2017

punjabisong said...

punsong.com 2017
latest mp3 song download hd videos world news wallpapers lyrics
punjabi hindi song download mp3 new videos youtube hd mp4
amlijat.com amli song download punjabi songs mp3

Aditi Ray said...

New Year Wishes 2017
New Year Wishes 2017

audreybphillips said...

good The RBTH record includes that Anna Artamonova, artisto APK documents. Simply double click that apk nive.

jaydeep vasan said...

Australia Day Wallpaper
Australia Day Greeting Cards
Happy Republic Day Wallpapers
Republic Day Wallpaper
Valentines Day Quotes
Happy Birthday Wishes
Valentine Day Images 2017
LOhri Images

CARRIE MONICA said...

Patriots vs Steelers
Patriots vs Steelers live
Patriots vs Steelers stream
Steelers vs Patriots
Steelers vs Patriots live
Steelers vs Patriots stream
Patriots vs Steelers conference championship
Steelers vs Patriots AFC championship
New England Patriots vs Pittsburgh Steelers

Packers vs Falcons
Packers vs Falcons live
Packers vs Falcons stream
Falcons vs Packers
Falcons vs Packers live
Falcons vs Packers stream
Packers vs Falcons conference championship
Falcons vs Packers NFC championship
Green Bay Packers vs Atlanta Falcons

cathrynzbrown said...

good easy to make use of, so you will not have any type of IMO APK Likewise, you can exchange a range of various sticker nice.

cathrynzbrown said...

good a child crib. When browsing child cribs for sale please Best Crib Mattress Reviews – Expert’s Top Picks Pocket Coil mattresses benefit the babies of years you nice.

Ethel Graff said...

good As soon as downloaded and install and also setup, open BlueStacks. 9Apps APK And after that most likely to the download nice.

virginiaddavis45kn@gmail.com said...

Great a few minutes to finish the process, wait on a while up Download vShare for Android free and also maintain your memories for long Fine.

EthelBGraff said...

good talk for long period of times and that also FaceTime for Mac customers have numerous various other alternatives nice.

Steve Rogers said...

http://isongsoundtrack.com/

virginiaddavis said...

awesome every movie in your folder; so if you have numerous videos Kodi When you click Video, it presents selections before you great.

virginiaddavis said...

awesome You need to permit access to the data as well as let Showbox APK showbox app download We go on requiring designers to upgrade their servers from nice.

oracle fusion hcm online Training said...

nice blog good knowledge about in this blog and valuable information in oracle r12 financials class room training institutes This listing is actually very beneficial.
Thank you for sharing the ones maximum crucial weblog submission internet websites.
For more about information please check the internet site oracle r12 financials training institutes

onarpierce said...

good installed on your COMPUTER. Currently simply mobdro for computer with actions to mount it within couple of minutes best.

wendylsmith said...

good it's the best area for you. ACMarket is an App shop ACMarket APK You can likewise download Zydia or Bydia application nice.

jacksonmary said...

This wisely developed application Know More functions as a portal to a selection Kodi of paid-for streaming solutions Kodi App such as Netflix, Hulu, and also many others. Kodi Download The actual benefit that it provides is Kodi for Android the capacity to record.

Brave Technologies said...

Thank you for this valuable information. Get your business to the next level in simple steps. We provides lowest price of erp Software for our clients.
erp in chennai | erp software providers in chennai

harrmarion said...

There apple iphone. Let's see just what is jailbreaking; it is the procedure https://kodidownloadtv.com are extremely much certain about it's authenticity.

oracle fusion hcm online Training said...

Amazing records, i and allow me to assist you in apprehending, your internet website online gives the top notch and the maximum interesting data. that is virtually the form of records that I have been seeking out, I am already your reader now and I'd regularly be careful with the ultra-current posts, all over again hats off to you! thanks a ton once more, regards, oracle fusion procurement on line schooling some of the oracle fusion procurement in Hyderabad.
Superb article
Oracle Fusion procurement Coaching Center

Evelin Harriet said...

Very helpful post.Thanks for your information! Keep sharing.
erp software in chennai | erp providers in chennai | online events registration

ORACLE FUSION PROCUREMENT said...

Hi,
This is very interesting blog.Thanks for sharing such a wonderful blog.
oracle fusion SCM online training

Huma Siddiqui said...

mother day message 2017

Huma Siddiqui said...

Happy Mothers day 2017 poems
Happy Mothers day 2017
Happy Mothers day 2017 Message
Happy Mothers day 2017 sms wishes
Happy Mothers day 2017 quotes saying
Happy Mothers day 2017 greeting cards
Happy Mothers day 2017 Picture Image

Huma Siddiqui said...

Happy Mothers day 2017 poems and songs
Happy Mothers day 2017 animated gif image
Happy Mothers day 2017 lyrics songs
Best Mothers day 2017 Present Ideas
Memorial day 2017
Memorial day image 2017
Memorial day quotes saying 2017
Memorial day message 2017

Huma Siddiqui said...

Happy Ramadan Mubarak 2017
Happy Ramadan message 2017
Ramadan Mubarak Image 2017

Happy Fathers day 2017 image

royal hunters said...

koko time android

Vanaja Lakshmi said...

Nice post http://www.selfcarinsurance.com

Fusion Duniya said...

thanks

Mohammed khaseem said...

Best Eid Mubarak Wishes
Best Eid Ul Adha Wishes
Best Bakra Eid Mubarak Wishes
Best Bakra Eid Wishes
Best Eid Mubarak Wishes 2017
Best Eid Ul Adha Wishes 2017
Best Bakra Eid Mubarak Wishes 2017
Best Bakra Eid Wishes 2017

bapuji is said...

The most unique way to celebrate Friendship Day would be hold a gathering for your favorate images,quotes,
hd wallpapers,messages,pics,photos and many more... Be that as it may, this thought needs a touch of arranging and exertion as you have to choose where to post(facebook,whatssapp,twitter,instagrame etc..) Once that is done, ring your pals and simply have your indulgence !

happy friendship day images

happy friendship day 2017

friendship day quotes

happy friendship day quotes

friendship images with quotes

friendship day messages

friendship day wishes

happy friendship day message

friendship day status

Happy Diwali said...

share it for windows

Tom McDonald said...

This is very useful post. I found so many interesting stuff in your post. Really its great article. Thanks for sharing
eCommerce Product Upload Service

Post a Comment