Enable HTTPS for YARN and MAPREDUCE2

Short Description:

Steps to enable HTTPS for YARN and MAPREDUCE2

Article

1. As a first step, enable HTTPS for HDFS, you can follow the article https://community.hortonworks.com/articles/52875/enable-https-for-hdfs.html

2. Add/Update below configurations in "Custom mapred-site" mapred-site.xml

1. mapreduce.jobhistory.http.policy=HTTPS_ONLY
2. mapreduce.jobhistory.webapp.https.address=<JHS>:<JHS_HTTPS_PORT>
3. mapreduce.ssl.enabled=true
4. mapreduce.shuffle.ssl.enabled=true
5.  
6. Ex: mapreduce.jobhistory.webapp.https.address=apappu-hdp234-2.openstacklocal:19889

3. Add/update below configurations under "Advanced yarn-site" ( yarn-site.xml)

1. yarn.http.policy=HTTPS_ONLY
2. yarn.log.server.url=https://JHS:JHS_HTTPS_PORT/jobhistory/logs
3. yarn.resourcemanager.webapp.https.address=RM:RM_HTTPS_PORT
4. yarn.nodemanager.webapp.https.address=0.0.0.0:NM_HTTPS_PORT
5.  
6. Ex:
7. yarn.log.server.url=https://apappu-hdp234-2.ambari.org:19889/jobhistory/logs
8. yarn.resourcemanager.webapp.https.address=apappu-hdp234-2.ambari.org:8090
9. yarn.nodemanager.webapp.https.address=0.0.0.0:8042

4. Add/update below property in hdfs-site (hdfs-site.xml) under HDFS service.

1. dfs.https.enable=true

5. Restart HDFS, YARN, MAPREDUCE services

6. should be able to access the URLs now,

YARN: https://HT_HOST:19889/

MAPREDUCE:https://YARN-RM-HOST:19889/jobhistory

More articles

*. To enable HTTPS for HBASE - https://community.hortonworks.com/articles/51165/enable-httpsssl-for-hbase-master-ui.html