yum install hadoop related client

摘要:
yumlistavaliblehadoop*yumlistinstalledyumrepolistrepoisin/etc/yum.repos.dyuminstallhadoop客户端yuminstallhive jdbc#beelineyuminstallhive#orhive。诺亚克?尤明斯塔斯qoophttps://community.cloudera.com/t

yum list avaliable hadoop*

yum list installed

yum repolist

repo is in /etc/yum.repos.d

yum install hadoop-client

yum install hive-jdbc  #beeline

yum install hive  # or hive.noarch?

yum install sqoop

https://community.cloudera.com/t5/Support-Questions/install-hadoop-client-on-unmanaged-host/m-p/78826

Here are some general instructions I found internally. Note: You can change the path to match the OS release and CDH version of the client you need.

On the external host download the CDH repo file to the /etc/yum.repos.d/ directory:

curl -O https://archive.cloudera.com/cdh5/redhat/6/x86_64/cdh/cloudera-cdh5.repo


Edit the base URL in the cloudera-cdh5.repo file to install the CDH version (otherwise it will install the latest). For example, to install the 5.7.1 hadoop-client, update the baseurl to:

baseurl=https://archive.cloudera.com/cdh5/redhat/6/x86_64/cdh/5.7.1/

Install the hadoop-client rpm:

$ yum clean all
$ yum install hadoop-client

(See http://archive.cloudera.com/cdh5/redhat/6/x86_64/cdh/5.7.1/RPMS/x86_64/)

In Cloudera Manager navigate to, HDFS -> "Actions" drop down -> "Download Client Configuration" (this will download a zip file called hdfs-clientconfig.zip).
Move the zip file over to the external host and unzip it.
Copy all the unzipped configuration files to /etc/hadoop/conf. Example:

$ cp * /etc/hadoop/conf

Run hadoop commands. Example:

$ sudo -u hdfs hadoop fs -ls

Note: You can also download the RPM file and install locally if desired.

/usr/lib/sqoop/lib   # add jars

https://stackoverflow.com/questions/22741183/sqoop-could-not-load-mysql-driver-exception

免责声明:文章转载自《yum install hadoop related client》仅用于学习参考。如对内容有疑问,请及时联系本站处理。

上篇爬虫和数据Linux下JDK、Tomcat安装及Web应用部署下篇

宿迁高防,2C2G15M,22元/月;香港BGP,2C5G5M,25元/月 雨云优惠码:MjYwNzM=

相关文章

CDH5.4.5运行Phoenix导入CSV文件

1.安装phoenix 在界面上设置Phoenix的parcel包: http://52.11.56.155:7180/cmf/settings?groupKey=config.scm.parcel.display_group&groupParent= 添加一个Remote Parcel Repository URLsurl:http://arch...

大数据培训班 cloudera公司讲师面对面授课 CCDH CCAH CCP

大数据助力成就非凡。大数据正在改变着商业游戏规则,为企业解决传统业务问题带来变革的机遇。毫无疑问,当未来企业尝试分析现有海量信息以推动业务价值增值时,必定会采用大数据技术。 目前对大数据的分析工具,首选的是Hadoop平台。由于Hadoop深受客户欢迎,许多公司都推出了各自版本的Hadoop,也有一些公司则围绕Hadoop开发产品。在Hadoop生态系统...

【转】linux Centos 6.5 安装桌面环境GNOME

在某种场合之下,我们使用的Linux还是要选择安装桌面环境的,所以在这里介绍一下如何给没有安装桌面环境的系统安装桌面环境。 以Centos 6.5 为例演示一下如何安装桌面环境。 一、首先查看系统的运行级别以及是否安装了桌面环境 1、使用命令 runlevel 查看当前系统运行级别 ,如图所示 2、使用命令 yum grouplist | more  查看...

Hive HMS Canary 时间较长异常分析

一、现象及异常 测试up1集群: create database 操作 200s 多一点。 # sudo -u hive hive --hiveconf hive.metastore.uris=thrift://10.197.1.141:9084 hive> create database wgtestdb_region3_1; OK Time ta...

alluxio2.0特性-预览

项目地址 https://github.com/Alluxio/alluxio/tree/branch-2.0-preview 2.0版本-构思和设计 支持超大规模数据工作负载 Alluxio作为计算和存储之间的数据编排层,使数据移动并且可以跨多个不同的存储系统访问:HDFS,对象存储,网络附加存储,随着时间的推移,Alluxio需要的元数据支持规模 提供...

使用hive访问elasticsearch的数据

使用hive访问elasticsearch的数据 1.配置 将elasticsearch-hadoop-2.1.1.jar拷贝到hive/lib hive -hiveconf hive.aux.jars.path=/usr/local/hive-1.2.1/lib/elasticsearch-hadoop-2.1.1.jar 或者配置: hive-s...