中文字幕理论片,69视频免费在线观看,亚洲成人app,国产1级毛片,刘涛最大尺度戏视频,欧美亚洲美女视频,2021韩国美女仙女屋vip视频

打開APP
userphoto
未登錄

開通VIP,暢享免費(fèi)電子書等14項(xiàng)超值服

開通VIP
007.基于CentOS7.8安裝Ambari2.7 HDP3.1大數(shù)據(jù)平臺(tái)

1. 集群規(guī)劃、配置說明

1.1 系統(tǒng)硬件說明

操作系統(tǒng)主機(jī)名內(nèi)網(wǎng)IP內(nèi)存CPU系統(tǒng)盤容量數(shù)據(jù)盤容量數(shù)據(jù)盤掛載點(diǎn)
CentOS-7.8.2003hdp0110.0.0.10544GB4核100GB200GB/data
CentOS-7.8.2003hdp0210.0.0.10624GB4核100GB200GB/data
CentOS-7.8.2003hdp0310.0.0.10720GB4核100GB200GB/data
CentOS-7.8.2003hdp0410.0.0.10820GB4核100GB200GB/data

1.2 組件、角色規(guī)劃

主機(jī)名角色安裝組件或服務(wù)
hdp01管理節(jié)點(diǎn)、數(shù)據(jù)節(jié)點(diǎn)Ambari-Server、Ambari-Agent、Apache、MySQL
hdp02數(shù)據(jù)節(jié)點(diǎn)Ambari-Agent
hdp03數(shù)據(jù)節(jié)點(diǎn)Ambari-Agent
hdp04數(shù)據(jù)節(jié)點(diǎn)Ambari-Agent

1.3 軟件準(zhǔn)備

安裝包文件名下載地址
ambari-2.7.4.0-centos7.tar.gzhttp://public-repo-1.hortonworks.com/ambari/centos7/2.x/updates/2.7.4.0/ambari-2.7.4.0-centos7.tar.gz
HDP-3.1.4.0-centos7-rpm.tar.gzhttp://public-repo-1.hortonworks.com/HDP/centos7/3.x/updates/3.1.4.0/HDP-3.1.4.0-centos7-rpm.tar.gz
HDP-UTILS-1.1.0.22-centos7.tar.gzhttp://public-repo-1.hortonworks.com/HDP-UTILS-1.1.0.22/repos/centos7/HDP-UTILS-1.1.0.22-centos7.tar.gz
HDP-GPL-3.1.4.0-centos7gpl.tar.gzhttp://public-repo-1.hortonworks.com/HDP-GPL/centos7/3.x/updates/3.1.4.0/HDP-GPL-3.1.4.0-centos7gpl.tar.gz
mysql-connector-java-8.0.22.jarhttps://repo1.maven.org/maven2/mysql/mysql-connector-java/8.0.22/mysql-connector-java-8.0.22.jar

2. 操作系統(tǒng)準(zhǔn)備工作

2.1 準(zhǔn)備一個(gè)具有sudo權(quán)限的普通用戶

我這里創(chuàng)建了一個(gè)普通用戶名為admin,并且具有sudo權(quán)限,4個(gè)節(jié)點(diǎn)都需要有這個(gè)用戶。

[admin@hdp01 ~]$ sudo vim /etc/sudoers## Allow root to run any commands anywhere root ALL=(ALL) ALL# 添加這一行配置admin ALL=(ALL) NOPASSWD:ALL# admin用戶使用sudo命令可以無密碼切換到root用戶[admin@hdp01 ~]$ sudo su - Last login: Thu Oct 22 21:12:24 CST 2020 on pts/0[root@hdp01 ~]#

2.2 hosts文件

4個(gè)節(jié)點(diǎn)的配置保持同步

# 文件:/etc/hosts# 注意,前兩行配置不要?jiǎng)h除127.0.0.1   localhost localhost.localdomain localhost4 localhost4.localdomain4::1         localhost localhost.localdomain localhost6 localhost6.localdomain610.0.0.105      hdp0110.0.0.106      hdp0210.0.0.107      hdp0310.0.0.108      hdp04

2.3 關(guān)閉防火墻

4個(gè)節(jié)點(diǎn)都要操作

# 關(guān)閉防火墻sudo systemctl stop firewalld# 禁止防火墻開機(jī)啟動(dòng)sudo systemctl disable firewalld# 查看防火墻狀態(tài)sudo systemctl status firewalld# 確認(rèn)4個(gè)節(jié)點(diǎn)的防火墻都是 inactive 和 disabled 狀態(tài)[root@hdp01 ~]# sudo systemctl status firewalld● firewalld.service - firewalld - dynamic firewall daemon Loaded: loaded (/usr/lib/systemd/system/firewalld.service; disabled; vendor preset: enabled) Active: inactive (dead) Docs: man:firewalld(1)

注意:生產(chǎn)環(huán)境一般由專業(yè)運(yùn)維人員來限制相關(guān)端口,而不是完全禁用防火墻

2.4 禁用SELINUX

4個(gè)節(jié)點(diǎn)都要操作

# 首先臨時(shí)關(guān)閉SELINUXsudo setenforce 0# 然后修改配置文件,永久關(guān)閉SELINUX# 文件:/etc/selinux/config# This file controls the state of SELinux on the system.# SELINUX= can take one of these three values:#     enforcing - SELinux security policy is enforced.#     permissive - SELinux prints warnings instead of enforcing.#     disabled - No SELinux policy is loaded.# 確保 SELINUX=disabledSELINUX=disabled# SELINUXTYPE= can take one of three values:#     targeted - Targeted processes are protected,#     minimum - Modification of targeted policy. Only selected processes are protected. #     mls - Multi Level Security protection.SELINUXTYPE=targeted

先臨時(shí)修改,后永久修改的好處:

如果只是臨時(shí)修改,那么重啟機(jī)器之后設(shè)置就會(huì)失效;如果只是永久修改,那么必須重啟機(jī)器才可能讓設(shè)置生效,產(chǎn)線環(huán)境是不可能重啟機(jī)器的;這樣先臨時(shí)修改,讓其生效,讓永久修改,那么在下一次服務(wù)器重啟后也不會(huì)擔(dān)心這個(gè)配置失效。

2.5 umask設(shè)置

4個(gè)節(jié)點(diǎn)都要操作

# 文件:/etc/profile# 在最后一行添加如下內(nèi)容umask 0022# 修改完之后使用source命令使其生效source /etc/profile# 在4個(gè)節(jié)點(diǎn)確保配置生效,0022是應(yīng)該出現(xiàn)的結(jié)果[root@hdp01 ~]# umask0022

2.6 文件描述符配置

4個(gè)節(jié)點(diǎn)都要操作

# 文件:/etc/security/limits.conf# 在文件末尾追加如下內(nèi)容*       soft    nofile  131072*       hard    nofile  131072

注意:修改之后,重啟服務(wù)器生效

2.7 SSH優(yōu)化

4個(gè)節(jié)點(diǎn)都要操作

# 文件:/etc/ssh/sshd_config# 此配置默認(rèn)為yes,改為noGSSAPIAuthentication no# 此配置默認(rèn)是注釋掉的,放開即可UseDNS no# 保存退出之后重啟ssh服務(wù)sudo systemctl restart sshd

2.8 SSH免秘鑰配置

設(shè)置hdp01機(jī)器遠(yuǎn)程連接自身以及遠(yuǎn)程連接其他3個(gè)機(jī)器免秘鑰

[admin@hdp01 ~]$ ssh-keygenGenerating public/private rsa key pair.# 直接EnterEnter file in which to save the key (/home/admin/.ssh/id_rsa):# 直接EnterEnter passphrase (empty for no passphrase): # 直接EnterEnter same passphrase again: Your identification has been saved in /home/admin/.ssh/id_rsa.Your public key has been saved in /home/admin/.ssh/id_rsa.pub.The key fingerprint is:SHA256:tAH9HF2xMFTCpmxDN7vjXat1NI/oPJX1avACPTi0UMU admin@hdp01The key's randomart image is:+---[RSA 2048]----+|      ..   **o+. ||       .. + E+ . ||        o* = o.  ||       ..oO .   .||        S+ = . +o||          = *.oo=||           +.B.++||           o+ *..||            o=.  |+----[SHA256]-----+[admin@hdp01 ~]$ ssh-copy-id -i ~/.ssh/id_rsa.pub admin@hdp01/usr/bin/ssh-copy-id: INFO: Source of key(s) to be installed: '/home/admin/.ssh/id_rsa.pub'The authenticity of host 'hdp01 (10.0.0.105)' can't be established.ECDSA key fingerprint is SHA256:/eVZsOkuW8gHUcJxKNvtRh9yJ3UYDz4p9hA4W4CpeEg.ECDSA key fingerprint is MD5:8c:e1:a8:0c:c9:80:e5:28:7a:25:96:32:c7:5f:25:47.# 輸入yesAre you sure you want to continue connecting (yes/no)? yes/usr/bin/ssh-copy-id: INFO: attempting to log in with the new key(s), to filter out any that are already installed/usr/bin/ssh-copy-id: INFO: 1 key(s) remain to be installed -- if you are prompted now it is to install the new keys# 輸入dmin@hdp01的密碼admin@hdp01's password: Number of key(s) added: 1Now try logging into the machine, with:   'ssh 'admin@hdp01''and check to make sure that only the key(s) you wanted were added.# 繼續(xù)給其他機(jī)器添加hdp01節(jié)點(diǎn)的公鑰,過程略...ssh-copy-id -i ~/.ssh/id_rsa.pub admin@hdp02ssh-copy-id -i ~/.ssh/id_rsa.pub admin@hdp03ssh-copy-id -i ~/.ssh/id_rsa.pub admin@hdp04# 以上操作執(zhí)行完成之后,修改.ssh目錄和authorized_keys文件的權(quán)限,4個(gè)節(jié)點(diǎn)都要執(zhí)行chmod 700 ~/.sshchmod 600 ~/.ssh/authorized_keys# 測試,每次ssh到其他機(jī)器都不需要輸入密碼[admin@hdp01 ~]$ ssh hdp01Last login: Thu Oct 22 21:11:53 2020 from 10.0.0.1[admin@hdp01 ~]$ exitlogoutConnection to hdp01 closed.[admin@hdp01 ~]$ ssh hdp02Last login: Thu Oct 22 21:11:53 2020 from 10.0.0.1[admin@hdp02 ~]$ exitlogoutConnection to hdp02 closed.[admin@hdp01 ~]$ ssh hdp03Last login: Thu Oct 22 21:11:53 2020 from 10.0.0.1[admin@hdp03 ~]$ exitlogoutConnection to hdp03 closed.[admin@hdp01 ~]$ ssh hdp04Last login: Thu Oct 22 21:11:53 2020 from 10.0.0.1[admin@hdp04 ~]$ exitlogoutConnection to hdp04 closed.[admin@hdp01 ~]$

2.9 時(shí)鐘同步

  • 4個(gè)節(jié)點(diǎn)安裝Chrony軟件,CentOS7默認(rèn)已經(jīng)安裝了,如果沒有安裝,執(zhí)行以下命令

    sudo yum -y install chrony
  • 規(guī)劃

    主機(jī)名Chrony角色
    hdp01Chrony Server
    hdp02Chrony Client
    hdp03Chrony Client
    hdp04Chrony Client
  • hdp01節(jié)點(diǎn)修改配置

    # 文件:/etc/chrony.conf# 注釋掉以下4行#server 0.centos.pool.ntp.org iburst#server 1.centos.pool.ntp.org iburst#server 2.centos.pool.ntp.org iburst#server 3.centos.pool.ntp.org iburst# 添加下面7行# 阿里云提供了7個(gè)NTP時(shí)間服務(wù)器server ntp1.aliyun.com iburstserver ntp2.aliyun.com iburstserver ntp3.aliyun.com iburstserver ntp4.aliyun.com iburstserver ntp5.aliyun.com iburstserver ntp6.aliyun.com iburstserver ntp7.aliyun.com iburst# 添加下面3行# 設(shè)置本機(jī)為Chrony Serverserver 127.127.1.1 iburst# 允許10.0.0.0網(wǎng)段的機(jī)器從本機(jī)同步時(shí)間allow 10.0.0.0/24# 允許本地同步時(shí)間allow 127/8
  • hdp02-hdp04節(jié)點(diǎn)配置

    # 文件:/etc/chrony.conf# 注釋掉以下4行#server 0.centos.pool.ntp.org iburst#server 1.centos.pool.ntp.org iburst#server 2.centos.pool.ntp.org iburst#server 3.centos.pool.ntp.org iburst# 添加如下一行# 從hdp01服務(wù)器同步時(shí)間server hdp01 iburst
  • 4個(gè)節(jié)點(diǎn)啟動(dòng)Chrony服務(wù),并設(shè)置Chrony服務(wù)開機(jī)自啟動(dòng)

    # 如果Chrony服務(wù)開啟,應(yīng)該重啟sudo systemctl restart chronyd# 如果Chrony服務(wù)未開啟,應(yīng)該啟動(dòng)sudo systemctl start chronyd# 設(shè)置開機(jī)自啟動(dòng)sudo systemctl enable chronyd# 查看運(yùn)行狀態(tài)sudo systemctl status chronyd
  • 驗(yàn)證

    # ^* 代表機(jī)器正在從這個(gè)服務(wù)器同步時(shí)間,hdp01顯示從120.25.115.20(這是一個(gè)阿里云時(shí)間服務(wù)器的地址)這個(gè)地址同步時(shí)間[admin@hdp01 ~]$ chronyc sources210 Number of sources = 3MS Name/IP address Stratum Poll Reach LastRx Last sample ===============================================================================^+ 127.127.1.1 3 6 77 2 -2979ns[-2979ns] +/- 23ms^* 120.25.115.20 2 6 77 6 -206us[ -35us] +/- 22ms^+ 203.107.6.88 2 6 77 6 +761us[ +761us] +/- 18ms# hdp02-hdp04從hdp01同步時(shí)間# chrony服務(wù)剛啟動(dòng)之后,是'^? hdp01'狀態(tài),需要等幾分鐘才能變成'^* hdp01'狀態(tài)# hdp03、hdp04應(yīng)該看到相同的情況,這里就不再貼代碼了[admin@hdp02 ~]$ chronyc sources210 Number of sources = 1MS Name/IP address Stratum Poll Reach LastRx Last sample ===============================================================================^* hdp01 3 6 37 25 +373us[ -124us] +/- 101ms

2.10 安裝JDK

在4個(gè)節(jié)點(diǎn)都安裝最新穩(wěn)定版JDK1.8,關(guān)于JDK的安裝就不再贅述了

[admin@hdp01 ~]$ echo $JAVA_HOME/usr/java/jdk[admin@hdp01 ~]$ java -versionjava version '1.8.0_251'Java(TM) SE Runtime Environment (build 1.8.0_251-b08)Java HotSpot(TM) 64-Bit Server VM (build 25.251-b08, mixed mode)[admin@hdp01 ~]$ tail -4 /etc/profileexport JAVA_HOME=/usr/java/jdkexport JRE_HOME=$JAVA_HOME/jreexport CLASSPATH=.:$JAVA_HOME/lib:$JRE_HOME/libexport PATH=$JAVA_HOME/bin:$PATH

3. Ambari Server安裝部署

3.1 安裝MySQL

3.1小節(jié)的操作在hdp01節(jié)點(diǎn)進(jìn)行

# HDP3.1要求MySQL的版本大于5.5,這里選擇5.7# 安裝MySQL的Yum倉庫sudo yum -y localinstall https://dev.mysql.com/get/mysql57-community-release-el7-8.noarch.rpm# 安裝MySQLsudo yum -y install mysql-community-server# 創(chuàng)建數(shù)據(jù)目錄sudo mkdir -p /data/mysqlsudo chown -R mysql:mysql /data/mysql# 文件:/etc/my.cnf,內(nèi)容:[client]default-character-set=utf8mb4[mysql]socket=/var/lib/mysql/mysql.sockdefault-character-set=utf8mb4[mysqld]socket=/var/lib/mysql/mysql.socksymbolic-links=0log-error=/var/log/mysqld.logpid-file=/var/run/mysqld/mysqld.pid# 注意將數(shù)據(jù)目錄修改為/data目錄,/data目錄的磁盤是獨(dú)立掛載的大容量磁盤datadir=/data/mysqlcharacter_set_server=utf8mb4character-set-client-handshake=FALSEcollation-server=utf8mb4_unicode_cimax_connections=800max_connect_errors=1000# 設(shè)置開機(jī)自啟動(dòng)sudo systemctl enable mysqld# 啟動(dòng)MySQLsudo systemctl start mysqld# 查看運(yùn)行狀態(tài)sudo systemctl status mysqld# 獲取臨時(shí)密碼,注意每個(gè)人的臨時(shí)密碼是不同的,我這里是'Vnyib*Yja9v/'[root@hdp01 ~]# sudo grep 'temporary password' /var/log/mysqld.log2020-10-26T13:51:29.134320Z 1 [Note] A temporary password is generated for root@localhost: Vnyib*Yja9v/# 進(jìn)入MySQL操作[root@hdp01 ~]# mysql -uroot -p'Vnyib*Yja9v/'mysql: [Warning] Using a password on the command line interface can be insecure.Welcome to the MySQL monitor. Commands end with ; or \g.Your MySQL connection id is 3Server version: 5.7.32Copyright (c) 2000, 2020, Oracle and/or its affiliates. All rights reserved.Oracle is a registered trademark of Oracle Corporation and/or itsaffiliates. Other names may be trademarks of their respectiveowners.Type 'help;' or '\h' for help. Type '\c' to clear the current input statement.mysql> set global validate_password_policy=0;Query OK, 0 rows affected (0.00 sec)mysql> set global validate_password_mixed_case_count=0;Query OK, 0 rows affected (0.00 sec)mysql> set global validate_password_number_count=3;Query OK, 0 rows affected (0.00 sec)mysql> set global validate_password_special_char_count=0;Query OK, 0 rows affected (0.00 sec)mysql> set global validate_password_length=3;Query OK, 0 rows affected (0.00 sec)# 在生產(chǎn)上建議把root密碼設(shè)置的更加復(fù)雜,我這里設(shè)置的root用戶只能本機(jī)連接mysql> ALTER USER 'root'@'localhost' IDENTIFIED BY '123456';Query OK, 0 rows affected (0.00 sec)mysql> exitBye# 將mysql-connector-java-8.0.22.jar上傳到/usr/share/java目錄下sudo mkdir -p /usr/share/javasudo mv ~/mysql-connector-java-8.0.22.jar /usr/share/java/

3.2 準(zhǔn)備本地yum源

3.2小節(jié)的操作在hdp01節(jié)點(diǎn)進(jìn)行

#安裝Apachesudo yum -y install httpd#講Apache設(shè)置為開機(jī)啟動(dòng)sudo systemctl enable httpd#啟動(dòng)Apachesudo systemctl start httpd

如果能看到如下界面Apache就安裝好了

HDP安裝包部署到Apache:

# 首先把下載好的ambari和HDP的3個(gè)安裝包上傳到home目錄下cd /var/www/html/sudo mv ~/ambari-2.7.4.0-centos7.tar.gz /var/www/html/sudo mv ~/HDP-3.1.4.0-centos7-rpm.tar.gz /var/www/html/sudo mv ~/HDP-GPL-3.1.4.0-centos7-gpl.tar.gz /var/www/html/sudo mv ~/HDP-UTILS-1.1.0.22-centos7.tar.gz /var/www/html/#解壓縮sudo tar -zxvf ambari-2.7.4.0-centos7.tar.gzsudo tar -zxvf HDP-3.1.4.0-centos7-rpm.tar.gzsudo tar -zxvf HDP-GPL-3.1.4.0-centos7-gpl.tar.gzsudo tar -zxvf HDP-UTILS-1.1.0.22-centos7.tar.gz#安裝包清理sudo rm -r ambari-2.7.4.0-centos7.tar.gzsudo rm -r HDP-3.1.4.0-centos7-rpm.tar.gzsudo rm -r HDP-GPL-3.1.4.0-centos7-gpl.tar.gzsudo rm -r HDP-UTILS-1.1.0.22-centos7.tar.gz#更改目錄權(quán)限sudo chown -R admin:admin /var/www/htmlsudo chmod -R ugo+rX /var/www/html/

最終,4個(gè)安裝包都可以在頁面訪問,其URL分別為:

安裝包URL
ambarihttp://hdp01/ambari/centos7/2.7.4.0-118/
HDPhttp://hdp01/HDP/centos7/3.1.4.0-315/
HDP-GPLhttp://hdp01/HDP-GPL/centos7/3.1.4.0-315/
HDP-UTILShttp://hdp01/HDP-UTILS/centos7/1.1.0.22/

配置本地yum源:

# 文件:/etc/yum.repos.d/ambari.repo,內(nèi)容如下:[ambari-repo]name=ambaribaseurl=http://hdp01/ambari/centos7/2.7.4.0-118/gpgcheck=0enabled=1# 驗(yàn)證,應(yīng)該看到ambari-repo那一行[admin@hdp01 yum.repos.d]$ yum repolistLoaded plugins: fastestmirrorLoading mirror speeds from cached hostfilerepo id               repo name                                          statusambari-repo           ambari                                             13base/7/x86_64         CentOS-7 - Base - mirrors.aliyun.com               10,070epel/x86_64           Extra Packages for Enterprise Linux 7 - x86_64     13,453extras/7/x86_64       CentOS-7 - Extras - mirrors.aliyun.com             413updates/7/x86_64      CentOS-7 - Updates - mirrors.aliyun.com            1,134repolist: 25,083

這樣,本地yum源就創(chuàng)建好了。

3.3 安裝Ambari-Server

3.3小節(jié)的操作在hdp01節(jié)點(diǎn)進(jìn)行

# 安裝ambari-serversudo yum -y install ambari-server# 核心日志信息Installed: ambari-server.x86_64 0:2.7.4.0-118# 數(shù)據(jù)庫操作[admin@hdp01 ~]$ mysql -uroot -p123456mysql> set global validate_password_policy=0;mysql> set global validate_password_mixed_case_count=0;mysql> set global validate_password_number_count=3;mysql> set global validate_password_special_char_count=0;mysql> set global validate_password_length=3;mysql> create database ambari;mysql> CREATE USER 'ambari'@'%' IDENTIFIED BY '123456';mysql> GRANT ALL ON ambari.* TO 'ambari'@'%';mysql> FLUSH PRIVILEGES;mysql> use ambari;mysql> source /var/lib/ambari-server/resources/Ambari-DDL-MySQL-CREATE.sql;mysql> exit# 配置AmbariServer[admin@hdp01 ~]$ sudo ambari-server setupUsing python /usr/bin/pythonSetup ambari-serverChecking SELinux...SELinux status is 'disabled'# 是否自定義ambari-server的運(yùn)行用戶,我們保持默認(rèn)root用戶即可,所以輸入n并回車Customize user account for ambari-server daemon [y/n] (n)? nAdjusting ambari-server permissions and ownership...Checking firewall status...Checking JDK...[1] Oracle JDK 1.8 + Java Cryptography Extension (JCE) Policy Files 8[2] Custom JDK==============================================================================# 選擇2,代表自定義JDK,然后回車Enter choice (1): 2WARNING: JDK must be installed on all hosts and JAVA_HOME must be valid on all hosts.WARNING: JCE Policy files are required for configuring Kerberos security. If you plan to use Kerberos,please make sure JCE Unlimited Strength Jurisdiction Policy Files are valid on all hosts.# 指定自己安裝的JDK的路徑/usr/local/jdk,然后回車Path to JAVA_HOME: /usr/java/jdkValidating JDK on Ambari Server...done.Check JDK version for Ambari Server...JDK version found: 8Minimum JDK version is 8 for Ambari. Skipping to setup different JDK for Ambari Server.Checking GPL software agreement...GPL License for LZO: https://www.gnu.org/licenses/old-licenses/gpl-2.0.en.html# 提示是否下載并安裝LZO的包,我們輸入y并回車Enable Ambari Server to download and install GPL Licensed LZO packages [y/n] (n)? y Completing setup...Configuring database...# 是否進(jìn)入數(shù)據(jù)庫高級(jí)設(shè)置,我們輸入y然后回車Enter advanced database configuration [y/n] (n)? yConfiguring database...==============================================================================Choose one of the following options:[1] - PostgreSQL (Embedded)[2] - Oracle[3] - MySQL / MariaDB[4] - PostgreSQL[5] - Microsoft SQL Server (Tech Preview)[6] - SQL Anywhere[7] - BDB==============================================================================# 在選擇數(shù)據(jù)庫的環(huán)節(jié),我們選擇3也就是MySQL,然后回車Enter choice (1): 3# MySQL的相關(guān)配置我們均采用默認(rèn)值,默認(rèn)用戶和db都是ambari,密碼輸入123456,然后回車Hostname (localhost): Port (3306): Database name (ambari): Username (ambari): Enter Database Password (bigdata): Re-enter password: Configuring ambari database...# 我們需要指定MySQL的驅(qū)動(dòng)包所在的路徑/usr/share/java/mysql-connector-java-8.0.22.jar,然后回車Enter full path to custom jdbc driver: /usr/share/java/mysql-connector-java-8.0.22.jarConfiguring remote database connection properties...WARNING: Before starting Ambari Server, you must run the following DDL directly from the database shell to create the schema: /var/lib/ambari-server/resources/Ambari-DDL-MySQL-CREATE.sql# 選擇可以遠(yuǎn)程連接該數(shù)據(jù)庫(y),然后回車就配置完畢了Proceed with configuring remote database connection properties [y/n] (y)? yExtracting system views...ambari-admin-2.7.4.0.118.jar....Ambari repo file doesn't contain latest json url, skipping repoinfos modificationAdjusting ambari-server permissions and ownership...Ambari Server 'setup' completed successfully.# 啟動(dòng)Ambari-Serversudo ambari-server start# 如果出現(xiàn)錯(cuò)誤,查看日志/var/log/ambari-server/ambari-server.log# 出現(xiàn)如下信息就是啟動(dòng)成功了Starting ambari-serverAmbari Server running with administrator privileges.Organizing resource files at /var/lib/ambari-server/resources...Ambari database consistency check started...Server PID at: /var/run/ambari-server/ambari-server.pidServer out at: /var/log/ambari-server/ambari-server.outServer log at: /var/log/ambari-server/ambari-server.logWaiting for server start.................................Server started listening on 8080DB configs consistency check: no errors and warnings were found.Ambari Server 'start' completed successfully.

訪問WEB-UI:

如果能看到上面的頁面,那么Ambari-Server就安裝成功了!

4. Ambari+HDP大數(shù)據(jù)平臺(tái)部署

4.1 部署Ambari集群和HDFS集群

接著要把滾動(dòng)條往下拉,把無用的其他操作系統(tǒng)的倉庫刪掉:

最終我們只保留'readhat7'的倉庫,接下來要把直接部署yum本地倉庫的地址填進(jìn)去,同時(shí)不要勾選下面的兩個(gè)高級(jí)選項(xiàng),如下圖:

4.2 部署YARN集群


4.3 部署HBase集群

后續(xù)一些重復(fù)的圖片就不再貼出來了。

4.4 部署Hive

# MySQL操作mysql> create database hive;mysql> CREATE USER 'hive'@'%' IDENTIFIED BY '123456';mysql> GRANT ALL ON hive.* TO 'hive'@'%';mysql> FLUSH PRIVILEGES;mysql> exit;# 執(zhí)行以下命令sudo ambari-server setup --jdbc-db=mysql --jdbc-driver=/usr/share/java/mysql-connector-java-8.0.22.jar

新服務(wù)部署后,可能會(huì)提示重啟其他相關(guān)服務(wù),重啟即可

4.5 部署Kafka

4.6 部署Spark2+Sqoop

剩余的組件的安裝都是一樣的,有需要的話直接在頁面操作安裝即可,要注意的就是需要修改日志目錄和數(shù)據(jù)目錄。

至此,Ambari2.7+HDP3.1大數(shù)據(jù)平臺(tái)就安裝部署完成了!

本站僅提供存儲(chǔ)服務(wù),所有內(nèi)容均由用戶發(fā)布,如發(fā)現(xiàn)有害或侵權(quán)內(nèi)容,請點(diǎn)擊舉報(bào)。
打開APP,閱讀全文并永久保存 查看更多類似文章
猜你喜歡
類似文章
Ambari系列(一):在離線環(huán)境中自動(dòng)化安裝Hadoop集群
優(yōu)雅地使用Apache Ambari安裝HDFS、HBase等分布式應(yīng)用
Apache Ambari安裝過程(CentOS 6)
安裝 OushuDB Ambari 插件
CentOS 7.4 安裝 Ambari 2.6.0 + HDP 2.6.3 搭建Hadoop集群
Ubuntu Server如何配置SFTP(建立用戶監(jiān)獄)
更多類似文章 >>
生活服務(wù)
熱點(diǎn)新聞
分享 收藏 導(dǎo)長圖 關(guān)注 下載文章
綁定賬號(hào)成功
后續(xù)可登錄賬號(hào)暢享VIP特權(quán)!
如果VIP功能使用有故障,
可點(diǎn)擊這里聯(lián)系客服!

聯(lián)系客服