OpenShift

System Requirements

• For this cluster setup you will need the following VM or Hardware Requirements:

3x CentOS 7.5 VMs or Hosts
8 vCPUs
12-16 GB RAM
80 GB HDD space (custom partition — 8GB swap, 1GB /boot, rest for / partition)
1 NIC interface with static address and gateway configured

Prequisites

Perform these steps on all 3 hosts

• Install the following pre-requirements:

yum -y install yum yum-utils wget git net-tools bind-utils iptables-services bridge-utils NetworkManager
yum -y install ansible pyOpenSSL python python-yaml python-dbus python-cryptography python-lxml docker tesseract nano
yum -y update

• Latest Ansible Version:

yum install epel-release
yum install ansible

• Setup Docker pre-requirements:

systemctl enable docker
systemctl start docker

• Add the IP address, hostname and FQDN of each node to /etc/hosts for each host

10.1.10.27  opshmaster Openshift01
10.1.10.28  opshnode1 Openshift02
10.1.10.29  opshnode2 Openshift03

• Run ssh-keygen, accept the default location of the key and do not set a password for the key.

• Run the following bash script:

for host in Openshift01 \
   Openshift02 \
   Openshift03; \
   do ssh-copy-id -i ~/.ssh/id_rsa.pub $host; \
   done

• Restart all 3 hosts

Installing

Openshift 3.9

• Version Details

Ansible 2.6.1
Python 2.7.5
OpenShift 3.9
CentOS 7.5.1804

• Create ansible hosts file

nano /etc/ansible/hosts

# Create an OSEv3 group that contains the masters and nodes groups
[OSEv3:children]
masters
nodes
etcd

# Set variables common for all OSEv3 hosts
[OSEv3:vars]
ansible_ssh_user=root
openshift_deployment_type=origin
openshift_master_identity_providers=[{'name': 'htpasswd_auth', 'login': 'true', 'challenge': 'true', 'kind': 'HTPasswdPasswordIdentityProvider', 'filename': '/etc/origin/master/htpasswd'}]
#openshift_master_identity_providers=[{'name': 'htpasswd_auth', 'login': 'true', 'challenge': 'true', 'kind': 'HTPasswdPasswordIdentityProvider'}]
os_sdn_network_plugin_name=redhat/openshift-ovs-multitenant
openshift_disable_check=memory_availability
#openshift_release=v3.7

# host group for masters
[masters]
Openshift01 openshift_hostname=Openshift01 openshift_public_hostname=Openshift01

[etcd]
Openshift01

# host group for nodes, includes region info
[nodes]
Openshift01 openshift_node_labels="{'region': 'infra', 'zone': 'default'}" openshift_hostname=Openshift01 openshift_public_hostname=Openshift01
Openshift02  openshift_node_labels="{'region': 'primary', 'zone': 'east'}" openshift_hostname=Openshift02 openshift_public_hostname=Openshift02
Openshift03  openshift_node_labels="{'region': 'primary', 'zone': 'west'}" openshift_hostname=Openshift03 openshift_public_hostname=Openshift03

• If parsing of this file fails, change the Quotes & Double Quotes symbols.

• Download the Files:

git clone --single-branch -b release-3.9 https://github.com/openshift/openshift-ansible

• Install Prerequisites:

ansible-playbook -i /etc/ansible/hosts openshift-ansible/playbooks/prerequisites.yml

• Install OpenShift:

ansible-playbook -i /etc/ansible/hosts openshift-ansible/playbooks/deploy_cluster.yml

Openshift 3.10

Source: server-world.info

• Version Details

Ansible 2.7.4
Python 2.7.5
OpenShift 3.10
CentOS 7.6.1810

• Install Packages

yum -y install centos-release-openshift-origin310 epel-release docker git pyOpenSSL 
yum -y install openshift-ansible

• Fix python-docker package issue:

nano /usr/share/ansible/openshift-ansible/playbooks/init/base_packages.yml

Changing the line:

"{{ 'python3-docker' if ansible_distribution == 'Fedora' else 'python-docker' }}"

to

"{{ 'python3-docker' if ansible_distribution == 'Fedora' else 'python-docker-py' }}"

Create Ansible Hosts file:

sudo vi /etc/ansible/hosts 

[OSEv3:children]
masters
nodes
etcd

[OSEv3:vars]
# admin user created in previous section
ansible_ssh_user=root
ansible_become=true
openshift_deployment_type=origin

# use HTPasswd for authentication
openshift_master_identity_providers=[{'name': 'htpasswd_auth', 'login': 'true', 'challenge': 'true', 'kind': 'HTPasswdPasswordIdentityProvider'}]
# define default sub-domain for Master node
#openshift_master_default_subdomain=apps.srv.world
# allow unencrypted connection within cluster
openshift_docker_insecure_registries=172.30.0.0/16

[masters]
Openshift01 openshift_schedulable=true containerized=false

[etcd]
Openshift01

[nodes]
# defined values for [openshift_node_group_name] in the file below
# [/usr/share/ansible/openshift-ansible/roles/openshift_facts/defaults/main.yml]
Openshift01 openshift_node_group_name='node-config-master-infra'
Openshift02 openshift_node_group_name='node-config-compute'
Openshift03 openshift_node_group_name='node-config-compute'

# if you'd like to separate Master node feature and Infra node feature, set like follows
# ctrl.srv.world openshift_node_group_name='node-config-master'
# Openshift02 openshift_node_group_name='node-config-compute'
# Openshift03 openshift_node_group_name='node-config-infra'

Install Prerequisites:

ansible-playbook /usr/share/ansible/openshift-ansible/playbooks/prerequisites.yml 

Instal Openshift:

ansible-playbook /usr/share/ansible/openshift-ansible/playbooks/deploy_cluster.yml

• You should see similar output once done:

PLAY RECAP *****************************************************************************************************
Openshift01                : ok=619  changed=251  unreachable=0    failed=0   
Openshift02                : ok=134  changed=53   unreachable=0    failed=0   
Openshift03                : ok=134  changed=53   unreachable=0    failed=0   
localhost                  : ok=12   changed=0    unreachable=0    failed=0   

INSTALLER STATUS ***********************************************************************************************
Initialization             : Complete (0:00:48)
Health Check               : Complete (0:01:23)
etcd Install               : Complete (0:01:37)
Master Install             : Complete (0:05:13)
Master Additional Install  : Complete (0:00:49)
Node Install               : Complete (0:07:34)
Hosted Install             : Complete (0:03:42)
Web Console Install        : Complete (0:01:04)
Service Catalog Install    : Complete (0:07:04)

WebUI

The Authentication is failing in below procedure, need to troubleshoot

• For initial installation, simply use htpasswd for simple authentication.
• Seed it with a couple of sample users to allow us to login to the OpenShift Console and validate the installation:

htpasswd -c /etc/origin/htpasswd admin

• Set cluster-role rights to admin user have access all projects in the cluster:

oc adm policy add-cluster-role-to-user cluster-admin admin

• WebUI should be available at:

https://openshift01:8443

Verification

• On Master:

oc status
oc get all

oc get nodes

NAME          STATUS    ROLES     AGE       VERSION
openshift01   Ready     master    18m       v1.9.1+a0ce1bc657
openshift02   Ready     compute   18m       v1.9.1+a0ce1bc657
openshift03   Ready     compute   18m       v1.9.1+a0ce1bc657

oc get pods

NAME                       READY     STATUS    RESTARTS   AGE
docker-registry-1-m8hgb    1/1       Running   0          13m
registry-console-1-zxpqh   1/1       Running   0          9m
router-1-vwl99             1/1       Running   0          13m

oc get -o wide pods

NAME                       READY     STATUS    RESTARTS   AGE       IP            NODE
avise-defaultgroup-8b77n   1/1       Running   0          12h       10.129.0.37   openshift01
avise-defaultgroup-bk48l   1/1       Running   0          12h       10.130.0.23   openshift03
avise-defaultgroup-r8hfx   1/1       Running   0          12h       10.128.0.23   openshift02
avitest-1-7ftb8            1/1       Running   2          18h       10.130.0.21   openshift03
avitest-1-fc9pv            1/1       Running   2          18h       10.128.0.22   openshift02
docker-registry-1-m8hgb    1/1       Running   2          40d       10.129.0.32   openshift01
registry-console-1-zxpqh   1/1       Running   2          40d       10.128.0.20   openshift02
router-1-vwl99             1/1       Running   2          40d       10.70.41.20   openshift01

Troubleshooting

Diagnostics

oc adm diagnostics

Firewall Rules

iptables -L

Uninstall

ansible-playbook -i /etc/ansible/hosts /usr/share/ansible/openshift-ansible/playbooks/adhoc/uninstall.yml

Disable Kube-Proxy

References

{{#widget:DISQUS |id=networkm |uniqid=OpenShift |url=https://aman.awiki.org/wiki/OpenShift }}