org.apache.storm.hive.security

Class AutoHive

java.lang.Object

org.apache.storm.common.AbstractAutoCreds

org.apache.storm.hive.security.AutoHive

All Implemented Interfaces:

Shutdownable, IAutoCredentials, ICredentialsRenewer, INimbusCredentialPlugin

public class AutoHive
extends AbstractAutoCreds

Automatically get hive delegation tokens and push it to user’s topology.

Field Summary

Fields

Modifier and Type	Field and Description
static String	HIVE_CREDENTIALS
static String	HIVE_CREDENTIALS_CONFIG_KEYS
static String	HIVE_KEYTAB_FILE_KEY
static String	HIVE_PRINCIPAL_KEY
String	hiveKeytab
String	hivePrincipal
String	metaStoreURI

Fields inherited from class org.apache.storm.common.AbstractAutoCreds

CONFIG_KEY_RESOURCES

Constructor Summary

Constructors

Constructor and Description
AutoHive()

Method Summary

Modifier and Type	Method and Description
org.apache.hadoop.hive.conf.HiveConf	createHiveConf(String metaStoreURI, String hiveMetaStorePrincipal)
void	doPrepare(Map conf) Prepare the plugin
void	doRenew(Map<String,String> credentials, Map<String,Object> topologyConf, String ownerPrincipal)
protected String	getConfigKeyString() The lookup key for the config key string
protected String	getCredentialKey(String configKey) The key with which the credentials are stored in the credentials map
protected byte[]	getHadoopCredentials(Map<String,Object> conf, org.apache.hadoop.conf.Configuration configuration, String topologyOwnerPrincipal)
protected byte[]	getHadoopCredentials(Map<String,Object> conf, String topologyOwnerPrincipal)
protected byte[]	getHadoopCredentials(Map<String,Object> conf, String configKey, String topologyOwnerPrincipal)
static void	main(String[] args)
void	populateCredentials(Map<String,String> credentials, Map topoConf) Method that will be called on nimbus as part of submit topology.
void	renew(Map<String,String> credentials, Map topologyConf) Renew any credentials that need to be renewed.
void	shutdown()

Methods inherited from class org.apache.storm.common.AbstractAutoCreds

fillHadoopConfiguration, getCredentials, populateCredentials, populateCredentials, populateSubject, prepare, renew, updateSubject

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

HIVE_CREDENTIALS

public static final String HIVE_CREDENTIALS

See Also:

Constant Field Values

HIVE_CREDENTIALS_CONFIG_KEYS

public static final String HIVE_CREDENTIALS_CONFIG_KEYS

See Also:

Constant Field Values

HIVE_KEYTAB_FILE_KEY

public static final String HIVE_KEYTAB_FILE_KEY

See Also:

Constant Field Values

HIVE_PRINCIPAL_KEY

public static final String HIVE_PRINCIPAL_KEY

See Also:

Constant Field Values

hiveKeytab

public String hiveKeytab

hivePrincipal

public String hivePrincipal

metaStoreURI

public String metaStoreURI

Constructor Detail

AutoHive

public AutoHive()

Method Detail

doPrepare

public void doPrepare(Map conf)

Description copied from class: AbstractAutoCreds

Prepare the plugin

Specified by:

doPrepare in class AbstractAutoCreds

Parameters:

conf - the storm cluster conf set via storm.yaml

getConfigKeyString

protected String getConfigKeyString()

Description copied from class: AbstractAutoCreds

The lookup key for the config key string

Specified by:

getConfigKeyString in class AbstractAutoCreds

Returns:

the config key string

shutdown

public void shutdown()

getHadoopCredentials

protected byte[] getHadoopCredentials(Map<String,Object> conf,
                                      String configKey,
                                      String topologyOwnerPrincipal)

Specified by:

getHadoopCredentials in class AbstractAutoCreds

getHadoopCredentials

protected byte[] getHadoopCredentials(Map<String,Object> conf,
                                      String topologyOwnerPrincipal)

Specified by:

getHadoopCredentials in class AbstractAutoCreds

createHiveConf

public org.apache.hadoop.hive.conf.HiveConf createHiveConf(String metaStoreURI,
                                                           String hiveMetaStorePrincipal)
                                                    throws IOException

Throws:

IOException

getHadoopCredentials

protected byte[] getHadoopCredentials(Map<String,Object> conf,
                                      org.apache.hadoop.conf.Configuration configuration,
                                      String topologyOwnerPrincipal)

doRenew

public void doRenew(Map<String,String> credentials,
                    Map<String,Object> topologyConf,
                    String ownerPrincipal)

Specified by:

doRenew in class AbstractAutoCreds

getCredentialKey

protected String getCredentialKey(String configKey)

Description copied from class: AbstractAutoCreds

The key with which the credentials are stored in the credentials map

Specified by:

getCredentialKey in class AbstractAutoCreds

main

public static void main(String[] args)
                 throws Exception

Throws:

Exception

populateCredentials

public void populateCredentials(Map<String,String> credentials,
                                Map topoConf)

Description copied from interface: INimbusCredentialPlugin

Method that will be called on nimbus as part of submit topology. This plugin will be called at least once during the submit Topology action. It will be not be called during activate instead the credentials return by this method will be merged with the other credentials in the topology and stored in zookeeper. NOTE: THIS METHOD WILL BE CALLED THROUGH REFLECTION. Existing compiled implementations will still work but new implementations will not compile. A NOOP implementation can be added to make it compile.

Parameters:

credentials - credentials map where more credentials will be added.

topoConf - topology configuration

renew

public void renew(Map<String,String> credentials,
                  Map topologyConf)

Description copied from interface: ICredentialsRenewer

Renew any credentials that need to be renewed. (Update the credentials if needed) NOTE: THIS WILL BE CALLED THROUGH REFLECTION. So if the newer renew exists it will be called instead, but if it does not exist this will be called. That means that this is binary compatible but not source compatible with older version. To make the compilation work this can become a noop when the new API is implemented.

Parameters:

credentials - the credentials that may have something to renew.

topologyConf - topology configuration.