安装Ambari 2.7.5 + HDP3.1.5（附安装包）

2023-11-14

前置准备

1. 安装包准备

Ambari2.7.5、HDP31.5、libtirpc-devel:
链接：https://pan.baidu.com/s/1eteZ2jGkSq4Pz5YFfHyJgQ
提取码：6hq3
redhat7.6操作系统：
链接：https://pan.baidu.com/s/1fXb0wG8ODseXwrYa_WJhBw
提取码：srut

2.服务器配置

linux(redhat7.6)环境：
node001 16g + 120 g
node002 8g + 120 g
node003 8g + 120 g

3.配置静态IP

]# vim /etc/sysconfig/network-scripts/ifcfg-ens33

]# cat /etc/sysconfig/network-scripts/ifcfg-ens33
TYPE="Ethernet"
BOOTPROTO="static"
NAME="ens33"
UUID="f0728346-a3b1-4fc8-9952-d78c4caceae8"
DEVICE="ens33"
ONBOOT="yes"
IPADDR="10.168.1.25"
NETMASK="255.255.255.0"
GATEWAY="10.168.1.21"
DNS1="10.168.1.1"
DNS2="8.8.8.8"

重启网络使配置生效

]# systemctl restart network

查看是否修改成功

]# ifconfig
ens33: flags=4163<UP,BROADCAST,RUNNING,MULTICAST>  mtu 1500
        inet 10.168.1.25  netmask 255.255.255.0  broadcast 10.168.1.255
        inet6 fe80::20c:29ff:feef:fa55  prefixlen 64  scopeid 0x20<link>
        ether 00:0c:29:ef:fa:55  txqueuelen 1000  (Ethernet)
        RX packets 2245696  bytes 2793523273 (2.6 GiB)
        RX errors 0  dropped 3596  overruns 0  frame 0
        TX packets 825291  bytes 616615664 (588.0 MiB)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

同理配置其他服务器ip

4.配置主机名

修改主机名

vim /etc/hostname

分别将3台服务器hostname分别设置为node001.djin.com,node002.djin.com,node003.djin.com

修改hosts文件

vim /etc/hosts

]# cat /etc/hosts
127.0.0.1   localhost localhost.localdomain localhost4 localhost4.localdomain4
::1         localhost localhost.localdomain localhost6 localhost6.localdomain6

10.168.1.25 node001.djin.com node001
10.168.1.26 node002.djin.com node002
10.168.1.27 node003.djin.com node003

3台服务器的hosts都需要做如上修改

5.关闭防火墙及selinux

3台服务器上分别执行以下操作，关闭防火墙并配置开机不自动启动

systemctl stop firewalld.service
systemctl disable firewalld.service
systemctl status firewalld.service

关闭3台服务器selinux
临时关闭，不用重启服务器

setenforce 0

为了重启后依然关闭，配置如下文件

vim /etc/sysconfig/selinux

修改

SELINUX=disabled

重启后验证是否禁用成功

]# sestatus -v
SELinux status:                 disabled

6.配置ssh互信

方法一

在每台服务器上执行如下操作，一直回车即可

ssh-keygen -t rsa

在所有上执行，需要输入其他服务器的密码

ssh-copy-id -i /root/.ssh/id_rsa.pub node001
ssh-copy-id -i /root/.ssh/id_rsa.pub node002
ssh-copy-id -i /root/.ssh/id_rsa.pub node003

方法二
5. 在每台服务器上执行如下操作，一直回车即可

ssh-keygen -t rsa

在服务器1上将公钥（名为id_rsa.pub文件）追加到认证文件（名为authorized_keys文件）中:

cat ~/.ssh/id_rsa.pub >> ~/.ssh/authorized_keys

去其他服务器节点将~/.ssh/id_rsa.pub中的内容拷贝到服务器1的~/.ssh/authorized_keys中,查看文件中的内容

 ]# cat ~/.ssh/authorized_keys
ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/eA09X4s5RIYvuYNxVvtOo6unY1mgipsFyoz/hy/Gwk0onfZvBi/Sl3TVRZO5aqcHccAGlLF7OPTKH1qUuKVtnUOQik0TouL5VKsOBDMHHRT9D5UwqaIE8tYDC8V6uwieFgscZcBjhrsJ/Iramo9ce7N9RTO3otRMRQxOs+Wd1F/ZOmpRtMGU2N4RH4i2quRU6m2lt/eJKpNupSHKoztTQRsEanilHVASnikAXH8JpG70iO7RXR/hLz+/Of3ISUrOMSO4/ZIIu4xnYN3jvsXOdK/qIhP/PI2s+uF22IvVE6xZYVadQFa4zAuhQmCBWkE7vMyI1UJkxP7OQYj72LUH root@node001
ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCnz8wHoytR2Xlnl04rQq4I2vgUVWbkKjv30pj+Toz4719ah4cY9pvZj0JsfhVzaaCsR14BLFVLkqKUhCWK3K6muT4iHb+N0WirpbwfJkztmQeco7Ha9xrPQ8v/I4xZujFoMVA0tkb/32zRTxOkPv9AUgB8V6Lin6LnB/AcnhnmoIs5PdbAdh/kBGpQGKIZkbyCUOYz9/PZuGJoJBblqfWiqzxYYLN9+cYMkmPnB1HdDewAepIsIC18U3ujE+1Su2UlmISPvvr1zG4XR4ZZoKQsOOJq3XRMGVkDvmFhl03JHZpd6BW0796CeYVZ41UomWXTOduQql+tYWUbegzGLmRZ root@node002
ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC8AFoGJHp2M45xLYNzXUHLWzRwHsgRPHjeErStq0tEy9bQv4OkN41j0FrxVAYJiGHdHGturriVgUEtL59RjcrJH6bAvhP54nM5YiQlNnWnSUR27Zuaodz4nhYUFq/Co5eDN6lTfL8pgYiEdpBOvE5t1w3bisdblP7YGQ2lF1zzCEGfQ79QbntEbyGNoR9sGHm11x9fOH+fape8TjQJrEAO4d1tAhMqVygQKwqwAPKeqhEum6BaLli83TsXzd7gyz9H7AAc1m04NaLB26xfynW6MVuk1j94awXKlGXjrbNTC/Kg6M8bd5PT/k3DOkx4b+nEs8xZ5x1j4D2OaO1X6rZx root@node003

设置认证文件的权限：

chmod 600 ~/.ssh/authorized_keys

将~/.ssh/authorized_keys同步到其他节点

scp ~/.ssh/authorized_keys node002:~/.ssh/authorized_keys
scp ~/.ssh/authorized_keys node003:~/.ssh/authorized_keys

注意：这里第一次使用同步还需要密码，之后就不需要了

验证免密是否配置成功
ssh到不同服务器

ssh node002

7.安装pssh工具（非必须）

pssh基于Python编写的并发在多台服务器上批量执行命令的工具，它支持文件并行复制、远程并行执行命令、杀掉远程主机上的进程等,这里介绍安装及常用命令，完整的介绍参考这里。

cd /opt/bao
wget http://peak.telecommunity.com/dist/ez_setup.py
wget http://files.opstool.com/files/pssh-2.3.tar.gz

上面的网址可能下载不下来，用另一个

wget https://pypi.python.org/packages/60/9a/8035af3a7d3d1617ae2c7c174efa4f154e5bf9c24b36b623413b38be8e4a/pssh-2.3.1.tar.gz

tar -zxvf pssh-2.3.1.tar.gz -C /opt/src

更改包名,并cd到包里

cd /opt/src
mv pssh-2.3.1 pssh
cd pssh

build &install

python setup.py build
python setup.py install

查看安装

]# pssh --version
2.3.1

创建nodes文档，添加需要批处理的服务器节点
为了以后使用方便，在根目录下创建,文件名可随意，方便使用原则

vim /node.list

]# cat /node.list
root@10.168.1.25:22
root@10.168.1.26:22
root@10.168.1.27:22

使用实例

]# pssh -h /node.list -i -P 'date'
node001: 2021年 08月 28日 星期六 20:20:07 CST
[1] 20:20:07 [SUCCESS] root@node001:22
2021年 08月 28日 星期六 20:20:07 CST
node002: 2021年 08月 28日 星期六 20:20:07 CST
[2] 20:20:07 [SUCCESS] root@node002:22
2021年 08月 28日 星期六 20:20:07 CST
node003: 2021年 08月 28日 星期六 20:20:07 CST
[3] 20:20:07 [SUCCESS] root@node003:22
2021年 08月 28日 星期六 20:20:07 CST

8. 配置ntp时钟同步

卸载系统原装的chrony

yum -y remove chronyd

所有节点安装NTP服务

[root@node001 ~]# pssh -h /node.list -i 'yum -y install ntp'

选择一台服务器作为NTP Server
将如下配置vim /etc/ntp.conf

# Use public servers from the pool.ntp.org project.
# Please consider joining the pool (http://www.pool.ntp.org/join.html).
server 0.centos.pool.ntp.org iburst
server 1.centos.pool.ntp.org iburst
server 2.centos.pool.ntp.org iburst
server 3.centos.pool.ntp.org iburst

修改为

# Use public servers from the pool.ntp.org project.
# Please consider joining the pool (http://www.pool.ntp.org/join.html).
#server 0.centos.pool.ntp.org iburst
#server 1.centos.pool.ntp.org iburst
#server 2.centos.pool.ntp.org iburst
#server 3.centos.pool.ntp.org iburst
server 127.127.1.0 
fudge 127.127.1.0 stratum 10

其它节点做如下配置

vim /etc/ntp.conf

将

# Use public servers from the pool.ntp.org project.
# Please consider joining the pool (http://www.pool.ntp.org/join.html).
server 0.centos.pool.ntp.org iburst
server 1.centos.pool.ntp.org iburst
server 2.centos.pool.ntp.org iburst
server 3.centos.pool.ntp.org iburst

修改为

# Use public servers from the pool.ntp.org project.
# Please consider joining the pool (http://www.pool.ntp.org/join.html).
#server 0.centos.pool.ntp.org iburst
#server 1.centos.pool.ntp.org iburst
#server 2.centos.pool.ntp.org iburst
#server 3.centos.pool.ntp.org iburst
server 10.168.1.25

在每台服务器上启动ntpd服务，并配置服务开机自启动

[root@node001 ~]# pssh -h /node.list -i 'systemctl restart ntpd'
[1] 20:21:36 [SUCCESS] root@node002:22
[2] 20:21:36 [SUCCESS] root@node001:22
[3] 20:21:36 [SUCCESS] root@node003:22
[root@node001 ~]# pssh -h /node.list -i 'systemctl enable ntpd.service'
[1] 20:22:01 [SUCCESS] root@node002:22
[2] 20:22:01 [SUCCESS] root@node003:22
[3] 20:22:01 [SUCCESS] root@node001:22

验证所有节点NTP是否同步成功

[root@node001 ~]# pssh -h /node.list -i 'ntpq -p'
[1] 20:22:31 [SUCCESS] root@node002:22
     remote           refid      st t when poll reach   delay   offset  jitter
==============================================================================
 node001.djin.co .INIT.          16 u   54   64    0    0.000    0.000   0.000
[2] 20:22:31 [SUCCESS] root@node001:22
     remote           refid      st t when poll reach   delay   offset  jitter
==============================================================================
*LOCAL(0)        .LOCL.          10 l   54   64    1    0.000    0.000   0.000
[3] 20:22:31 [SUCCESS] root@node003:22
     remote           refid      st t when poll reach   delay   offset  jitter
==============================================================================
 node001.djin.co LOCAL(0)        11 u   54   64    1    0.514    0.329   0.000

可见每台服务器都指向node001表示同步成功

9.设置swap

[root@node001 ~]# pssh -h /node.list -i 'echo vm.swappiness = 1 >> /etc/sysctl.conf'
[root@node001 ~]# pssh -h /node.list -i 'sysctl vm.swappiness=1'                    
[root@node001 ~]# pssh -h /node.list -i 'sysctl -p'

修改/etc/sysctl.conf

vim /etc/sysctl.conf
vm.swappiness = 1

10. 关闭透明大页面

由于透明超大页面已知会导致意外的节点重新启动并导致RAC出现性能问题，因此Oracle强烈建议禁用

[root@node001 ~]# pssh -h /node.list -i "echo never > /sys/kernel/mm/transparent_hugepage/defrag "
[root@node001 ~]# pssh -h /node.list -i "echo never > /sys/kernel/mm/transparent_hugepage/enabled"

设置开自关闭，将如下脚本添加到/etc/rc.d/rc.local文件中并同步到所有节点

if test -f /sys/kernel/mm/transparent_hugepage/enabled; then echo never > /sys/kernel/mm/transparent_hugepage/enabled fi if test -f /sys/kernel/mm/transparent_hugepage/defrag; then echo never > /sys/kernel/mm/transparent_hugepage/defrag fi

同步到所有节点

[root@node001 ~]# pscp -h /node.list /etc/rc.d/rc.local /etc/rc.d/rc.local

修改服务器的/etc/rc.d/rc.local文件的权限以实现开机执行

pssh -h /node.list -i "chmod +x /etc/rc.d/rc.local"

11.安装http服务

安装apache的httpd服务主要用于搭建OS、Ambari和hdp的yum源。在集群服务器中选择一台服务器来安装httpd服务，命令如下：
安装HTTP服务

[root@node001 ~]# yum -y install httpd

启动停止

[root@node001 ~]# systemctl start httpd
[root@node001 ~]# systemctl stop httpd

设置开机启动

systemctl enable httpd.service

验证，在浏览器输入http://hostname看到如下截图则说明启动成功。
HTTP验证
在这里插入图片描述

12.配置操作系统本地repo

]# ls /media
rhel-server-7.6-x86_64-dvd.iso

挂载操作系统iso文件

[root@node001 /]# cd media/
[root@node001 media]# mkdir iso
[root@node001 media]# mount -o loop rhel-server-7.6-x86_64-dvd.iso /media/iso/
mount: /dev/loop0 写保护，将以只读方式挂载

查看挂载点

[root@node001 media]# df -h
文件系统        容量  已用  可用 已用% 挂载点
/dev/sda1       120G   13G  108G   11% /
..........
/dev/loop0      4.2G  4.2G     0  100% /media/iso

在/var/www/html目录下创建iso目录，并将/media/iso目录关联至/var/www/html/iso目录

[root@node001 html]# ln -s /media/iso /var/www/html/iso
[root@node001 html]# ls iso
CentOS_BuildTag  GPL       LiveOS    RPM-GPG-KEY-CentOS-7
EFI              images    Packages  RPM-GPG-KEY-CentOS-Testing-7
EULA             isolinux  repodata  TRANS.TBL

4.在浏览器输入http://node001/iso/即可看到iso目录下文件
在这里插入图片描述
也可以直接

cp -r /media/iso/* /var/www/html/iso

添加配置文件/etc/yum.repos.d/os.repo，配置操作系统yum源

]# vim /etc/yum.repos.d/redhat7.6.repo
]# cat vim /etc/yum.repos.d/redhat7.6.repo
[redhat_os_repo]
name=redhat7.6_repo
baseurl=http://10.168.1.25/iso/
enabled=true
gpgcheck=false

同步到其他节点

]# pscp -h /node.list /etc/yum.repos.d/redhat7.6.repo /etc/yum.repos.d/redhat7.6.repo

查看yum源是否配置成功,如下可见redhat7.6.repo配置成功

[root@node001 yum.repos.d]# pssh -h /node.list -i 'yum clean all'
[root@node001 yum.repos.d]# pssh -h /node.list -i 'yum repolist'

6.如redhat提示未注册出现告警，参考：redhat 未注册使用yum警告问题

13.安装Java

下载解压
下载地址：https://www.oracle.com/java/technologies/javase/javase-jdk8-downloads.html

tar -zxvf jdk-8u271-linux-x64.tar.gz 
mv jdk1.8.0_271/* /usr/local/java

拷贝到其他节点

[root@node001 java]# pscp -r -h /node.list /usr/local/java /usr/local/
[1] 03:10:07 [SUCCESS] root@node001:22
[2] 03:10:11 [SUCCESS] root@node002:22
[3] 03:10:12 [SUCCESS] root@node003:22

配置环境变量(所有服务器）

vim /root/.bashrc

添加如下配置

export JAVA_HOME=/usr/local/java
export PATH=$PATH:$JAVA_HOME/bin
export CLASSPATH=.:$JAVA_HOME/lib/dt.jar:$JAVA_HOME/lib/tools.jar
export JRE_HOME=$JAVA_HOME/jre

激活配置

source /root/.bashrc

14. 安装maven3.8

下载解压

[root@node001 bao]# wget https://downloads.apache.org/maven/maven-3/3.8.2/binaries/apache-maven-3.8.2-bin.tar.gz
[root@node001 bao]# tar -zxvf apache-maven-3.8.2-bin.tar.gz
[root@node001 bao]# mv apache-maven-3.8.2/* /opt/src/maven

配置maven环境变量

vim /root/.bashrc

# set maven home
export PATH=$PATH:/opt/src/maven/bin

激活

source /root/.bashrc

安装Ambari&HDP

1. 配置Ambari、HDP、libtirpc-devel本地源

解压

tar -zxvf  ambari-2.7.5.0-centos7.tar.gz -C /var/www/html/
tar -zxvf  HDP-3.1.5.0-centos7-rpm.tar.gz -C /var/www/html/
tar -zxvf  HDP-GPL-3.1.5.0-centos7-gpl.tar.gz -C /var/www/html/
tar -zxvf  HDP-UTILS-1.1.0.22-centos7.tar.gz -C /var/www/html/

[root@node001 html]# ll
总用量 4
drwxr-xr-x. 3 root root    21 8月  27 04:26 ambari
drwxr-xr-x. 3 1001 users   21 12月 18 2019 HDP
drwxr-xr-x. 3 1001 users   21 12月 18 2019 HDP-GPL
drwxr-xr-x. 3 1001 users   21 8月  13 2018 HDP-UTILS
drwxr-xr-x. 9 root root   254 8月  28 20:42 iso

设置设置用户组和授权

[root@node001 html]# chown -R root:root HDP
[root@node001 html]# chown -R root:root HDP-GPL
[root@node001 html]# chown -R root:root HDP-UTILS
[root@node001 html]# chmod -R 755 HDP
[root@node001 html]# chmod -R 755 HDP-GPL
[root@node001 html]# chmod -R 755 HDP-UTILS

创建libtirpc-devel本地源

mkdir /var/www/html/libtrpc
cd /var/www/html/libtrpc
wget http://mirror.centos.org/centos/7/os/x86_64/Packages/libtirpc-0.2.4-0.16.el7.x86_64.rpm
wget http://mirror.centos.org/centos/7/os/x86_64/Packages/libtirpc-devel-0.2.4-0.16.el7.x86_64.rpm
createrepo .

制作本地源
1.配置ambari.repo

vim /etc/yum.repos.d/ambari.repo
[Ambari-2.7.5.0]
name=Ambari-2.7.5.0
baseurl=http://10.168.1.25/ambari/centos7/2.7.5.0-72/
gpgcheck=0
enabled=1
priority=1

2.配置HDP和HDP-TILS

vim /etc/yum.repos.d/HDP.repo
[HDP-3.1.5.0]
name=HDP Version - HDP-3.1.5.0
baseurl=http://10.168.1.25/HDP/centos7/3.1.5.0-152/
gpgcheck=0
enabled=1
priority=1

[HDP-UTILS-1.1.0.22]
name=HDP-UTILS Version - HDP-UTILS-1.1.0.22
baseurl=http://10.168.1.25/HDP-UTILS/centos7/1.1.0.22/
gpgcheck=0
enabled=1
priority=1

[HDP-GPL-3.1.5.0]
name=HDP-GPL Version - HDP-GPL-3.1.5.0
baseurl=http://10.168.1.25/HDP-GPL/centos7/3.1.5.0-152
gpgcheck=0
enabled=1
priority=1

3.配置libtirpc.repo

vim /etc/yum.repos.d/libtirpc.repo
[libtirpc_repo]
name=libtirpc-0.2.4-0.16
baseurl=http://10.168.1.25/libtirpc/
gpgcheck=0
enabled=1
priority=1

4.拷贝到其他节点

[root@node001 yum.repos.d]# pscp -h /node.list /etc/yum.repos.d/* /etc/yum.repos.d/
[1] 02:01:56 [SUCCESS] root@node002:22
[2] 02:01:56 [SUCCESS] root@node003:22
[3] 02:01:56 [SUCCESS] root@node001:22

4.查看源

pssh -h /node.list -i 'yum clean all'
pssh -h /node.list -i 'yum repolist'

2. 安装mariadb

查看当前mysql和mariadb的包

rpm -qa |grep -i mysql
rpm -qa |grep -i mariadb

卸载旧版本

rpm -e --nodeps 旧包

安装MariaDB服务器

yum install mariadb-server

启动并设置开机启动

systemctl enable mariadb
systemctl start mariadb

初始化

/usr/bin/mysql_secure_installation

[...]
Enter current password for root (enter for none):
OK, successfully used password, moving on...
[...]
Set root password? [Y/n] Y
New password:123456
Re-enter new password:123456
[...] 
Remove anonymous users? [Y/n] Y 
[...] 
Disallow root login remotely? [Y/n] N 
[...] 
Remove test database and access to it [Y/n] Y 
[...] 
Reload privilege tables now? [Y/n] Y 
[...] 
All done! If you've completed all of the above steps, your MariaDB 18 installation should now be secure. 
Thanks for using MariaDB!

为MariaDB安装MySQL JDBC驱动程序

mv mysql-connector-java-5.1.46-bin.jar /usr/share/java/mysql-connector-java.jar

创建需要的数据库
如果需要ranger，编辑以下⽂件： vim /etc/my.cnf 并添加以下⾏：

 log_bin_trust_function_creators = 1

重启数据库并登录

systemctl restart mariadb
mysql -u root -p

3. 安装和配置ambari-server

安装ambari-server

yum -y install ambari-server

复制mysql jdbc驱动到/var/lib/ambari-server/resources/

cp /usr/share/java/mysql-connector-java.jar /var/lib/ambari-server/resources/

配置/etc/ambari-server/conf/ambari.properties，添加如下行

vim /etc/ambari-server/conf/ambari.properties
server.jdbc.driver.path=/usr/share/java/mysql-connector-java.jar

执行

ambari-server setup --jdbc-db=mysql --jdbc-driver=/usr/share/java/mysql-connector-java.jar

初始化ambari-server

ambari-server setup

1） 提示是否自定义设置。输入：y
Customize user account for ambari-server daemon [y/n] (n)? y
（2）ambari-server 账号。
Enter user account for ambari-server daemon (root):
如果直接回车就是默认选择root用户
如果输入已经创建的用户就会显示：
Enter user account for ambari-server daemon (root):ambari
Adjusting ambari-server permissions and ownership...
（3）检查防火墙是否关闭
Adjusting ambari-server permissions and ownership...
Checking firewall...
WARNING: iptables is running. Confirm the necessary Ambari ports are accessible. Refer to the Ambari documentation for more details on ports.
OK to continue [y/n] (y)?
直接回车
（4）设置JDK。输入：2
Checking JDK...
Do you want to change Oracle JDK [y/n] (n)? y
[1] Oracle JDK 1.8 + Java Cryptography Extension (JCE) Policy Files 8
[2] Custom JDK
==============================================================================
Enter choice (1): 2
如果上面选择3自定义JDK,则需要设置JAVA_HOME。输入：/usr/local/java
WARNING: JDK must be installed on all hosts and JAVA_HOME must be valid on all hosts.
WARNING: JCE Policy files are required for configuring Kerberos security. If you plan to use Kerberos,please make sure JCE Unlimited Strength Jurisdiction Policy Files are valid on all hosts.
Path to JAVA_HOME: /usr/local/java
Validating JDK on Ambari Server...done.
Completing setup...
（5）数据库配置。选择：y
Configuring database...
Enter advanced database configuration [y/n] (n)? y
（6）选择数据库类型。输入：3
Configuring database...
==============================================================================
Choose one of the following options:
[1] - PostgreSQL (Embedded)
[2] - Oracle
[3] - MySQL/ MariaDB
[4] - PostgreSQL
[5] - Microsoft SQL Server (Tech Preview)
[6] - SQL Anywhere
==============================================================================
Enter choice (3): 3
（7）设置数据库的具体配置信息，根据实际情况输入，如果和括号内相同，则可以直接回车。如果想重命名，就输入。
Hostname (localhost):node001
Port (3306): 3306
Database name (ambari): ambari
Username (ambari): ambari
Enter Database Password (bigdata):ambari123
Re-Enter password: ambari123
（8）将Ambari数据库脚本导入到数据库
WARNING: Before starting Ambari Server, you must run the following DDL against the database to create the schema: /var/lib/ambari-server/resources/Ambari-DDL-MySQL-CREATE.sql 这个sql后面会用到，导入数据库
Proceed with configuring remote database connection properties [y/n] (y)? y

登录mariadb创建ambari安装所需要的库
设置的账号后面配置ambari-server的时候会用到！

CREATE DATABASE ambari; 
use ambari; 
CREATE USER 'ambari'@'%' IDENTIFIED BY 'ambari123'; 
GRANT ALL PRIVILEGES ON *.* TO 'ambari'@'%'; 
CREATE USER 'ambari'@'localhost' IDENTIFIED BY 'ambari123'; 
GRANT ALL PRIVILEGES ON *.* TO 'ambari'@'localhost'; 
CREATE USER 'ambari'@'node001' IDENTIFIED BY 'ambari123'; 
GRANT ALL PRIVILEGES ON *.* TO 'ambari'@'node001'; 

source /var/lib/ambari-server/resources/Ambari-DDL-MySQL-CREATE.sql 
show tables; 
use mysql; 
select host,user from user where user='ambari'; 
CREATE DATABASE hive; 
use hive; 
CREATE USER 'hive'@'%' IDENTIFIED BY 'hive'; 
GRANT ALL PRIVILEGES ON *.* TO 'hive'@'%'; 
CREATE USER 'hive'@'localhost' IDENTIFIED BY 'hive'; 
GRANT ALL PRIVILEGES ON *.* TO 'hive'@'localhost'; 
CREATE USER 'hive'@'node001' IDENTIFIED BY 'hive'; 
GRANT ALL PRIVILEGES ON *.* TO 'hive'@'node001'; 

CREATE DATABASE oozie; 
use oozie; 
CREATE USER 'oozie'@'%' IDENTIFIED BY 'oozie'; 
GRANT ALL PRIVILEGES ON *.* TO 'oozie'@'%'; 
CREATE USER 'oozie'@'localhost' IDENTIFIED BY 'oozie'; 
GRANT ALL PRIVILEGES ON *.* TO 'oozie'@'localhost'; 
CREATE USER 'oozie'@'node001' IDENTIFIED BY 'oozie'; 
GRANT ALL PRIVILEGES ON *.* TO 'oozie'@'node001'; 
FLUSH PRIVILEGES;

4. 启动ambari服务

ambari-server start

5. 所有节点安装ambari-agent

pssh -h /node.list -i 'yum -y install ambari-agent'
pssh -h /node.list -i 'systemctl start ambari-agent'

6. 所有节点安装libtirpc-devel

pssh -h /node.list -i 'yum -y install libtirpc-devel'

部署集群

1、登录界面：http://node001:8080
默认管理员账户登录，账户：admin 密码：admin
在这里插入图片描述
2、选择版本，配置yum源
1）选择Launch Install Wizard
2）配置集群名称
3）选择版本并修改本地源地址
选HDP-3.1(Default Version Definition);
选Use Local Repository;
选redhat7:

HDP-3.1：http://node001/HDP/centos7/3.1.5.0-152/
HDP-3.1-GPL: http://node001/HDP-GPL/centos7/3.1.5.0-152/
HDP-UTILS-1.1.0.22: http://node001/HDP-UTILS/centos7/1.1.0.22/
在这里插入图片描述
3、配置节点和密钥
下载主节点的/root/.ssh/id_rsa，并上传！点击下一步，进入确认主机界面
也可直接cat /root/.ssh/id_rsa 粘贴即可

4、勾选需要安装的服务

5. 分配服务master

6.分配服务slaves

设置相关服务的密码
Grafana Admin:123456
Hive Database:hive
Activity Explorer’s Admin:admin
在这里插入图片描述
6.连接数据库

7.编辑配置，默认即可

8.点击继续

9.开始部署
在这里插入图片描述
10.等待安装完毕，如果集群缺少libtirpc的包，会安装失败,参考上面安装libtirpc的相关包

11.安装成功

本文内容由网友自发贡献，版权归原作者所有，本站不承担相应法律责任。如您发现有涉嫌抄袭侵权的内容，请联系:hwhale#tublm.com(使用前将#替换为@)

大数据

ambari