Install CM and CDH - Setup CM, Install CDH and Setup Cloudera Management Service - Install CM and CDH on all nodes

#1

Now let us install CM and CDH on all nodes using packages. It will take care of installing Cloudera Manager Agents along with CDH components such as Hadoop, Spark etc on all nodes in the cluster. Once installation is done, we will be configuring one service at a time as we get into the details with respect to each of the service that comes as part of CDH.

Let us start servers from 2 to 7 to set up CDH on all nodes except 8th one. We will use 8th one to perform tasks such as adding nodes to existing cluster.

  • Login to Cloudera manager – bigdataserver-1-external-ip :7180
  • Choose Version of Cloudera
  • Adding hosts to the cluster environment – Enter the hostnames
    of all servers. e.g.:bigdataserver-[1-7]. These are hostnames pointing to internal IPs.
  • Selecting a repository – Since we set up a local repository you can give the same URL.
  • Installing Java – Check to install JDK
  • Single User Mode – Don’t enable Single User Mode
  • SSH credentials for Cloudera Manager to login other hosts. – Give the username
    and Google Cloud Private Key
  • Cluster installation – Cluster install will take few minutes

CCA 131 Course is available on Udemy - Click here for $10 coupon.

You can also get coupons for our other courses by clicking on this link.


0 Likes

#2

Hello Sir, I have followed every step given for Installing CM and CDH two times but I’m still unable to install them. I’m facing this problem.

and

xyz@bigdataserver-1 ~]$ sudo tail -F /var/log/cloudera-scm-server/cloudera-scm-server.log

at net.schmizz.sshj.SSHClient.auth(SSHClient.java:226)

… 9 more

Caused by: java.io.IOException: unrecognised object: OPENSSH PRIVATE KEY

at org.bouncycastle.openssl.PEMParser.readObject(Unknown Source)

at net.schmizz.sshj.userauth.keyprovider.PKCS8KeyFile.readKeyPair(PKCS8KeyFile.java:132)

at net.schmizz.sshj.userauth.keyprovider.PKCS8KeyFile.getPublic(PKCS8KeyFile.java:78)

at net.schmizz.sshj.userauth.method.KeyedAuthMethod.putPubKey(KeyedAuthMethod.java:44)

… 14 more

2019-06-22 23:23:28,011 INFO NodeConfiguratorThread-40-5:com.cloudera.server.cmf.node.NodeConfiguratorProgress: bigdataserver-6.us-central1-a.c.celestial-baton-243120.internal: Setting AUTHENTICATE as failed and done state

2019-06-22 23:23:28,011 INFO NodeConfiguratorThread-40-5:net.schmizz.sshj.transport.TransportImpl: Disconnected - BY_APPLICATION

2019-06-22 23:23:32,943 ERROR CommandPusher:com.cloudera.cmf.command.flow.WorkOutputs: CMD id: 17 Failed to complete installation on host bigdataserver-1.us-central1-a.c.celestial-baton-243120.internal.

2019-06-22 23:23:32,943 ERROR CommandPusher:com.cloudera.cmf.command.flow.WorkOutputs: CMD id: 17 Failed to complete installation on host bigdataserver-2.us-central1-a.c.celestial-baton-243120.internal.

2019-06-22 23:23:32,943 ERROR CommandPusher:com.cloudera.cmf.command.flow.WorkOutputs: CMD id: 17 Failed to complete installation on host bigdataserver-3.us-central1-a.c.celestial-baton-243120.internal.

2019-06-22 23:23:32,944 ERROR CommandPusher:com.cloudera.cmf.command.flow.WorkOutputs: CMD id: 17 Failed to complete installation on host bigdataserver-4.us-central1-a.c.celestial-baton-243120.internal.

2019-06-22 23:23:32,944 ERROR CommandPusher:com.cloudera.cmf.command.flow.WorkOutputs: CMD id: 17 Failed to complete installation on host bigdataserver-5.us-central1-a.c.celestial-baton-243120.internal.

2019-06-22 23:23:32,944 ERROR CommandPusher:com.cloudera.cmf.command.flow.WorkOutputs: CMD id: 17 Failed to complete installation on host bigdataserver-6.us-central1-a.c.celestial-baton-243120.internal.

2019-06-22 23:23:32,945 ERROR CommandPusher:com.cloudera.cmf.command.flow.WorkOutputs: CMD id: 17 Failed to complete installation on host bigdataserver-7.us-central1-a.c.celestial-baton-243120.internal.

2019-06-22 23:23:32,945 INFO CommandPusher:com.cloudera.cmf.model.DbCommand: Command 17(GlobalHostInstall) has completed. finalstate:FINISHED, success:false, msg:Failed to complete installation.

0 Likes

#3

@Ankit_Chaudhary
Did you enable password less logins to all nodes? also check if you are passing the right private key.

0 Likes

#4

Yes, I enabled password less logins as suggested by you in your lecture. I’m passing ‘google_compute_engine’ [That i copied from ssh to desktop folder].

Now I’m stuck and not able to move ahead in this course.

0 Likes