| Modifier and Type | Method and Description |
|---|---|
static ClusterDescription |
ClusterDescriptionOperations.buildFromInstanceDefinition(AggregateConf aggregateConf) |
String |
ClusterDescription.getMandatoryOption(String key)
Get a cluster option or value
|
Map<String,String> |
ClusterDescription.getMandatoryRole(String role)
Get a role whose presence is mandatory
|
String |
ClusterDescription.getMandatoryRoleOpt(String role,
String option)
Get a mandatory role option
|
int |
ClusterDescription.getMandatoryRoleOptInt(String role,
String option)
Get a mandatory integer role option
|
String |
ClusterDescription.getZkHosts() |
String |
ClusterDescription.getZkPath() |
void |
ClusterDescription.verifyOptionSet(String key)
Verify that an option is set: that is defined AND non-empty
|
| Modifier and Type | Method and Description |
|---|---|
static void |
ConfigHelper.addConfigMap(org.apache.hadoop.conf.Configuration config,
Iterable<Map.Entry<String,String>> map,
String origin)
Set an entire map full of values
|
static void |
ConfigHelper.addConfigMap(org.apache.hadoop.conf.Configuration config,
Map<String,String> map,
String origin)
Set an entire map full of values
|
static String |
SliderUtils.checkCredentialCacheFile()
return a description of whether the current user has created credential
cache files from kerberos servers
|
static String |
SliderUtils.getApplicationDefinitionPath(ConfTreeOperations conf)
return the HDFS path where the application package has been uploaded
manually or by using slider client (install package command)
|
static int |
SliderUtils.getIntValue(Map<String,String> roleMap,
String key,
int defVal,
int min,
int max)
Get the int value of a role
|
static int |
SliderUtils.parseAndValidate(String errorKey,
String valS,
int defVal,
int min,
int max)
Parse an int value, replacing it with defval if undefined;
|
static String |
SliderUtils.translateTrailingHeapUnit(String heapsize) |
static File |
SliderUtils.verifyKeytabExists(org.apache.hadoop.conf.Configuration siteConf,
String prop)
Verify that a keytab property is defined and refers to a non-empty file
|
static String |
SliderUtils.verifyOptionSet(org.apache.hadoop.conf.Configuration configuration,
String key,
boolean allowEmpty)
verify that a config option is set
|
static void |
SliderUtils.verifyPrincipalSet(org.apache.hadoop.conf.Configuration conf,
String principal)
Verify that a Kerberos principal has been set -if not fail
with an error message that actually tells you what is missing
|
| Modifier and Type | Method and Description |
|---|---|
void |
InstanceBuilder.addZKBinding(ZKPathBuilder zkBinding)
Add the ZK paths to the application options.
|
void |
InstanceBuilder.setImageDetailsIfAvailable(org.apache.hadoop.fs.Path appImage,
String appHomeDir)
Set up the image/app home path
|
void |
InstanceBuilder.setQueue(String queue)
Set the queue used to start the application
|
void |
InstanceBuilder.takeSnapshotOfConfDir(org.apache.hadoop.fs.Path appconfdir) |
| Modifier and Type | Method and Description |
|---|---|
MapOperations |
ConfTreeOperations.getMandatoryComponent(String name)
Get a component whose presence is mandatory
|
String |
MapOperations.getMandatoryOption(String key)
Get a cluster option or value
|
int |
MapOperations.getMandatoryOptionInt(String option)
Get a mandatory integer option; use
Integer.decode(String) so as to take hex
oct and bin values too. |
void |
ConfTreeOperations.mergeFile(File file)
Load from a file and merge it in
|
void |
ConfTreeOperations.mergeFile(File file,
InputPropertiesValidator validator)
Load from a file and merge it in
|
void |
AggregateConf.resolve() |
void |
ConfTreeOperations.validate()
Validate the configuration
|
void |
AggregateConf.validate() |
void |
InputPropertiesValidator.validate(ConfTreeOperations props) |
void |
AbstractInputPropertiesValidator.validate(ConfTreeOperations props) |
void |
ConfTreeOperations.validate(InputPropertiesValidator validator)
Validate the configuration
|
protected void |
AbstractInputPropertiesValidator.validateComponentProperties(ConfTreeOperations props) |
protected void |
ResourcesInputPropertiesValidator.validateGlobalProperties(ConfTreeOperations props) |
void |
MapOperations.verifyOptionSet(String key)
Verify that an option is set: that is defined AND non-empty
|
| Modifier and Type | Method and Description |
|---|---|
void |
JavaCommandLineBuilder.addMandatoryConfOption(org.apache.hadoop.conf.Configuration conf,
String key)
Add a mandatory config option
|
| Modifier and Type | Method and Description |
|---|---|
void |
AppDefinitionPersister.persistPackages() |
void |
AppDefinitionPersister.processSuppliedDefinitions(String clustername,
AbstractClusterBuildingActionArgs buildInfo,
ConfTreeOperations appConf) |
| Modifier and Type | Method and Description |
|---|---|
static String |
ZookeeperUtils.convertToHostsOnlyList(String quorum) |
static int |
ZookeeperUtils.getFirstPort(String quorum,
int defVal) |
static List<com.google.common.net.HostAndPort> |
ZookeeperUtils.splitToHostsAndPortsStrictly(String quorum) |
| Modifier and Type | Method and Description |
|---|---|
String |
ProviderUtils.buildPathToHomeDir(AggregateConf instanceDefinition,
String bindir,
String script)
Build the image dir.
|
void |
ProviderUtils.propagateOption(MapOperations global,
String optionKey,
Map<String,String> sitexml,
String siteKey)
Propagate an option from the cluster specification option map
to the site XML map, using the site key for the name
|
static void |
ProviderUtils.validatePathReferencesLocalDir(String meaning,
String path) |
| Modifier and Type | Method and Description |
|---|---|
protected Metainfo |
AgentProviderService.getApplicationMetainfo(SliderFileSystem fileSystem,
String appDef) |
static Metainfo |
AgentUtils.getApplicationMetainfo(SliderFileSystem fileSystem,
String metainfoPath,
boolean metainfoForAddon) |
protected Metainfo |
AgentProviderService.getApplicationMetainfo(SliderFileSystem fileSystem,
String appDef,
boolean addonPackage) |
protected String |
AgentProviderService.getClusterOptionPropertyValue(String name) |
| Modifier and Type | Method and Description |
|---|---|
int |
Component.getMaxInstanceCountInt() |
int |
Component.getMinInstanceCountInt() |
| Modifier and Type | Method and Description |
|---|---|
void |
SliderAMClientProvider.addJVMOptions(AggregateConf aggregateConf,
JavaCommandLineBuilder cmdLine)
Extract any JVM options from the cluster specification and
add them to the command line
|
protected void |
SliderAMClientProvider.addKeytabResourceIfNecessary(SliderFileSystem fileSystem,
AggregateConf instanceDescription,
Map<String,org.apache.hadoop.yarn.api.records.LocalResource> providerResources)
If the cluster is secure, and an HDFS installed keytab is available for AM
authentication, add this keytab as a local resource for the AM launch.
|
| Modifier and Type | Method and Description |
|---|---|
void |
RoleHistory.addNewRole(RoleStatus roleStatus)
Add a new role
|
void |
AppState.buildInstance(AppStateBindingInfo binding) |
RoleStatus |
AppState.buildRole(ProviderRole providerRole)
Add knowledge of a role.
|
ProviderRole |
AppState.createDynamicProviderRole(String name,
MapOperations component)
Build a dynamic provider role
|
boolean |
RoleHistory.onStart(org.apache.hadoop.fs.FileSystem fs,
org.apache.hadoop.fs.Path historyDir)
Start up
|
boolean |
RoleHistory.onThaw()
Handle the start process after the history has been rebuilt,
and after any gc/purge
|
protected void |
RoleHistory.putRole(RoleStatus roleStatus)
safety check: make sure the role is unique amongst
the role stats...which is extended with the new role
|
int |
RoleHistory.rebuild(LoadedRoleHistory loadedRoleHistory)
rebuild the placement history from the loaded role history
|
protected void |
RoleHistory.reset()
Reset the variables -this does not adjust the fixed attributes
of the history, but the nodemap and failed node map are cleared.
|
void |
AppState.setInitialInstanceDefinition(AggregateConf definition)
Set the instance definition -this also builds the (now obsolete)
cluster specification from it.
|
List<ProviderRole> |
AppState.updateResourceDefinitions(ConfTree resources)
The resource configuration is updated -review and update state.
|
| Constructor and Description |
|---|
RoleHistory(Collection<RoleStatus> roles,
AbstractClusterServices recordFactory)
Instantiate
|
| Modifier and Type | Method and Description |
|---|---|
LoadedRoleHistory |
RoleHistoryWriter.attemptToReadHistory(org.apache.hadoop.fs.FileSystem fileSystem,
List<org.apache.hadoop.fs.Path> paths)
Iterate through the paths until one can be loaded
|
LoadedRoleHistory |
RoleHistoryWriter.loadFromHistoryDir(org.apache.hadoop.fs.FileSystem fs,
org.apache.hadoop.fs.Path dir)
Try to load the history from a directory -a failure to load a specific
file is downgraded to a log and the next older path attempted instead
|
LoadedRoleHistory |
RoleHistoryWriter.read(org.apache.hadoop.fs.FileSystem fs,
org.apache.hadoop.fs.Path path)
Read a role history from a path in a filesystem
|
LoadedRoleHistory |
RoleHistoryWriter.read(InputStream in)
Read a history, returning one that is ready to have its onThaw()
method called
|
LoadedRoleHistory |
RoleHistoryWriter.read(String resource)
Read from a resource in the classpath -used for testing
|
| Modifier and Type | Method and Description |
|---|---|
String |
AbstractSliderLaunchedService.lookupZKQuorum()
look up the registry quorum from the config
|
org.apache.hadoop.registry.client.api.RegistryOperations |
AbstractSliderLaunchedService.startRegistryOperationsService()
Create, adopt ,and start the YARN registration service
|
Copyright © 2014–2015 The Apache Software Foundation. All rights reserved.