Tweaks to HDFS services to make them play nice with Kerberized Isilon access

If you are kerberizing a hadoop cluster against an Isilon, you’ll need to look at adding the following to the hdfs services to enable Isilon compatibility.

All Distro’s

1. Add custom property hadoop.security.token.service.use_ip=false to core-site.xml

When you kerberize with AD, Isilon’s cluster SPN is used and not the SCZ SPN.  (this is our odd behavior) . When hadoop.security.token.service.use_ip = true there is a lookup done on the IP address of the sender, which is compared to the SPN in the token.  Obviously with Isilon you don’t want to create a bunch of reverse PTR records in the case you are using MIT and in the case of AD the resolve will always come back with the wrong name because of the fact we are not addressing this configuration with the SCZ SPN anyway.  False, says trust the fact you have a ticket and leave it at that.  So hadoop.security.token.service.use_ip should always be false in our configurations when kerberized.  Firstly to avoid having to create a bunch of reverse PTR records when using non-AD kerberos, and to avoid our own oddity WRT the SPN used when using AD kerberos.

 

 

On Ambari

2. Add `hadoop classpath`:      to start of mapreduce.application.classpath

This is added here:

MapReduce2 -> Config -> Advanced -> Advanced mapred-site

Add `hadoop classpath`:      to start of  mapreduce.application.classpath

example:

`hadoop classpath`:$PWD/mr-framework/hadoop/share/hadoop/mapreduce/*:$PWD/mr-framework/hadoop/share/hadoop/mapreduce/lib/*:$PWD/mr-framework/hadoop/share/hadoop/common/*:$PWD/mr-framework/hadoop/share/hadoop/common/lib/*:$PWD/mr-framework/hadoop/share/hadoop/yarn/*:$PWD/mr-framework/hadoop/share/hadoop/yarn/lib/*:$PWD/mr-framework/hadoop/share/hadoop/hdfs/*:$PWD/mr-framework/hadoop/share/hadoop/hdfs/lib/*:$PWD/mr-framework/hadoop/share/hadoop/tools/lib/*:/usr/hdp/${hdp.version}/hadoop/lib/hadoop-lzo-0.6.0.${hdp.version}.jar:/etc/hadoop/conf/secure

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out /  Change )

Google+ photo

You are commenting using your Google+ account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

w

Connecting to %s