SliderUtils (Slider Core 0.90.2-incubating API)

java.lang.Object
- org.apache.slider.common.tools.SliderUtils

public final class SliderUtils
extends Object

These are slider-specific Util methods

Nested Class Summary

Nested Classes
Modifier and Type	Class and Description
`static class`	`SliderUtils.DelayedHalt` Callable for async/scheduled halt
`static class`	`SliderUtils.OnDemandReportStringifier` This wraps ApplicationReports and generates a string version iff the toString() operator is invoked

Field Summary

Fields
Modifier and Type	Field and Description
`static String`	`DOCKER` name of docker program
`static String`	`JAVA_SECURITY_KRB5_KDC`
`static String`	`JAVA_SECURITY_KRB5_REALM`
`static int`	`NODE_LIST_LIMIT`
`static String`	`OPENSSL` name of openssl program
`static String`	`PYTHON` name of python program
`static String`	`WINUTILS` Winutils

Method Summary

Methods
Modifier and Type	Method and Description
`static void`	`addBuildInfo(Map<String,String> info, String prefix)` Add the cluster build information; this will include Hadoop details too
`static String`	`appendToURL(String base, String... paths)` Append a list of paths, inserting "/" signs as appropriate
`static String`	`appendToURL(String base, String path)` Add a subpath to an existing URL.
`static void`	`applyCommandLineRoleOptsToRoleMap(Map<String,Map<String,String>> clusterRoleMap, Map<String,Map<String,String>> commandOptions)` Apply a set of command line options to a cluster role map
`static String`	`appReportToString(org.apache.hadoop.yarn.api.records.ApplicationReport r, String separator)`
`static Map<String,org.apache.hadoop.yarn.api.records.ApplicationReport>`	`buildApplicationReportMap(List<org.apache.hadoop.yarn.api.records.ApplicationReport> instances, org.apache.hadoop.yarn.api.records.YarnApplicationState minState, org.apache.hadoop.yarn.api.records.YarnApplicationState maxState)` Built a (sorted) map of application reports, mapped to the instance name The list is sorted, and the addition process does not add a report if there is already one that exists.
`static ClasspathConstructor`	`buildClasspath(String sliderConfDir, String libdir, org.apache.hadoop.conf.Configuration config, SliderFileSystem sliderFileSystem, boolean usingMiniMRCluster)` Build up the classpath for execution -behaves very differently on a mini test cluster vs a production production one.
`static Map<String,String>`	`buildEnvMap(Map<String,String> roleOpts)` Build the environment map from a role option map, finding all entries beginning with "env.", adding them to a map of (prefix-removed) env vars
`static String`	`checkCredentialCacheFile()` return a description of whether the current user has created credential cache files from kerberos servers
`static String`	`checkForRequiredNativeLibraries()` Check for any needed libraries being present.
`static void`	`checkPort(String name, InetSocketAddress address, int connectTimeout)`
`static void`	`checkPort(String hostname, int port, int connectTimeout)`
`static void`	`checkURL(String name, String url, int timeout)`
`static List<String>`	`collectionToStringList(Collection c)` Take a collection, return a list containing the string value of every element in the collection.
`static int`	`compareTo(long left, long right)` A compareTo function that converts the result of a long comparision into the integer that `Comparable` expects.
`static int`	`compareTwoLongsReverse(long x, long y)` Compare two long values for sorting.
`static String`	`containersToString(List<ContainerInformation> containers, String version, Set<String> components)`
`static String`	`containerToString(org.apache.hadoop.yarn.api.records.Container container)`
`static int`	`copyDirectory(org.apache.hadoop.conf.Configuration conf, org.apache.hadoop.fs.Path srcDirPath, org.apache.hadoop.fs.Path destDirPath, org.apache.hadoop.fs.permission.FsPermission permission)` Copy a directory to a new FS -both paths must be qualified.
`static org.apache.hadoop.yarn.conf.YarnConfiguration`	`createConfiguration()` Create a configuration with Slider-specific tuning.
`static FilenameFilter`	`createJarFilter()` Accept all filenames ending with `.jar`
`static org.apache.hadoop.fs.Path`	`createLocalPath(File file)` Create a file:// path from a local file
`static Map<String,Map<String,String>>`	`deepClone(Map<String,Map<String,String>> src)`
`static void`	`deleteDirectoryTree(File dir)` recursive directory delete
`static ForkedProcessService`	`execCommand(String name, int status, long timeoutMillis, org.slf4j.Logger logger, String outputString, String... commands)` Execute a command for a test operation
`static org.apache.hadoop.fs.Path`	`extractImagePath(CoreFileSystem fs, MapOperations internalOptions)`
`static String`	`extractNodeLabel(org.apache.hadoop.yarn.api.records.NodeReport report)` Get a string node label value from a node report
`static boolean`	`filter(String value, Set<String> filters)` Filter a string value given a set of filters
`static boolean`	`filter(String value, String filter)` Filter a string value given a single filter
`static File`	`findContainingJar(Class my_class)` Find a containing JAR
`static File`	`findContainingJarOrFail(Class clazz)` Find a containing JAR
`static int`	`findFreePort(int start, int limit)`
`static void`	`forceLogin()` Force an early login: This catches any auth problems early rather than in RPC operations
`static String`	`getApplicationDefinitionPath(ConfTreeOperations conf)` return the HDFS path where the application package has been uploaded manually or by using slider client (install package command)
`static InputStream`	`getApplicationResourceInputStream(org.apache.hadoop.fs.FileSystem fs, org.apache.hadoop.fs.Path appPath, String entry)`
`static String`	`getClientConfigPath()` return the path to the slider-client.xml used by the current running slider command
`static String`	`getCurrentCommandPath()` return the path to the currently running slider command
`static org.apache.hadoop.security.UserGroupInformation`	`getCurrentUser()` Get the current user -relays to `UserGroupInformation.getCurrentUser()` with any Slider-specific post processing and exception handling
`static String`	`getHdpVersion()` Retrieve the HDP version if it is an HDP cluster, or null otherwise
`static int`	`getIntValue(Map<String,String> roleMap, String key, int defVal, int min, int max)` Get the int value of a role
`static String`	`getJDKInfo()` return the version and path of the JDK invoking the current running slider command
`static String`	`getKerberosRealm()`
`static InetSocketAddress`	`getRmAddress(org.apache.hadoop.conf.Configuration conf)`
`static InetSocketAddress`	`getRmSchedulerAddress(org.apache.hadoop.conf.Configuration conf)`
`static String`	`getSliderVersion()` Retrieve the version of the current Slider install
`static Map<String,String>`	`getSystemEnv()`
`static String`	`getSystemEnv(String property)`
`static Timer`	`haltAM(int status, String text, int delay)` trigger a JVM halt with no clean shutdown at all
`static boolean`	`hasAppFinished(org.apache.hadoop.yarn.api.records.ApplicationReport report)`
`static boolean`	`initProcessSecurity(org.apache.hadoop.conf.Configuration conf)` Turn on security.
`static String`	`instanceDetailsToString(String name, org.apache.hadoop.yarn.api.records.ApplicationReport report, List<ContainerInformation> containers, String version, Set<String> components, boolean verbose)` Convert the instance details of an application to a string
`static boolean`	`isAddressDefined(InetSocketAddress address)` probe to see if the address
`static boolean`	`isClusternameValid(String name)` Normalize a cluster name then verify that it is valid
`static boolean`	`isHadoopClusterSecure(org.apache.hadoop.conf.Configuration conf)` Flag to indicate whether the cluster is in secure mode
`static boolean`	`isHdp()` Query to find if it is an HDP cluster
`static boolean`	`isNotEmpty(List l)` Probe for a list existing and not being empty
`static boolean`	`isNotEmpty(Map m)` Probe for a map existing and not being empty
`static boolean`	`isPortAvailable(int port)` See if a port is available for listening on by trying to listen on it and seeing if that works or fails.
`static boolean`	`isRmSchedulerAddressDefined(org.apache.hadoop.conf.Configuration conf)` probe to see if the RM scheduler is defined
`static boolean`	`isSet(String s)`
`static boolean`	`isUnset(String s)` Implementation of set-ness, groovy definition of true/false for a string
`static String`	`join(Collection collection, String separator)` Join an collection of objects with a separator that appears after every instance in the list -including at the end
`static String`	`join(Collection collection, String separator, boolean trailing)` Join an collection of objects with a separator that appears after every instance in the list -optionally at the end
`static String`	`join(String[] collection, String separator)` Join an array of strings with a separator that appears after every instance in the list -including at the end
`static String`	`join(String[] collection, String separator, boolean trailing)` Join an array of strings with a separator that appears after every instance in the list -optionally at the end
`static String`	`joinWithInnerSeparator(String separator, Object... collection)` Join an array of strings with a separator that appears after every instance in the list -except at the end
`static String`	`listDir(File dir)` List a directory in the local filesystem
`static org.apache.hadoop.conf.Configuration`	`loadSliderClientXML()` Attempt to load the slider client resource.
`static String`	`mandatoryEnvVariable(String key)` Resolve a mandatory environment variable
`static boolean`	`maybeInitSecurity(org.apache.hadoop.conf.Configuration conf)` Init security if the cluster configuration declares the cluster is secure
`static void`	`maybeVerifyWinUtilsValid()` Strictly verify that windows utils is present.
`static Map<String,String>`	`mergeEntries(Map<String,String> dest, Iterable<Map.Entry<String,String>> entries)` Merge a set of entries into a map.
`static Map<String,String>`	`mergeMap(Map<String,String> first, Map<String,String> second)` Merge in one map to another -all entries in the second map are merged into the first -overwriting any duplicate keys.
`static <T1,T2> Map<T1,T2>`	`mergeMaps(Map<T1,T2> first, Map<T1,T2> second)` Generic map merge logic
`static <T1,T2> Map<T1,T2>`	`mergeMapsIgnoreDuplicateKeys(Map<T1,T2> first, Map<T1,T2> second)` Generic map merge logic
`static boolean`	`oldIsClusternameValid(String name)`
`static int`	`parseAndValidate(String errorKey, String valS, int defVal, int min, int max)` Parse an int value, replacing it with defval if undefined;
`static org.apache.hadoop.conf.Configuration`	`patchConfiguration(org.apache.hadoop.conf.Configuration conf)` Take an existing conf and patch it for Slider's needs.
`static String`	`propertiesToString(Properties props)`
`static void`	`putAllJars(Map<String,org.apache.hadoop.yarn.api.records.LocalResource> providerResources, SliderFileSystem sliderFileSystem, org.apache.hadoop.fs.Path tempPath, String libDir, String srcPath)` Submit a JAR containing and map it
`static void`	`putAmTarGzipAndUpdate(Map<String,org.apache.hadoop.yarn.api.records.LocalResource> providerResources, SliderFileSystem sliderFileSystem)` Submit the AM tar.gz containing all dependencies and map it
`static org.apache.hadoop.yarn.api.records.LocalResource`	`putJar(Map<String,org.apache.hadoop.yarn.api.records.LocalResource> providerResources, SliderFileSystem sliderFileSystem, Class clazz, org.apache.hadoop.fs.Path tempPath, String libdir, String jarName)` Submit a JAR containing a specific class and map it
`static URL`	`registerClientResource()` Register the client resource in `SliderKeys.SLIDER_CLIENT_XML` for Configuration instances.
`static String`	`reportToString(org.apache.hadoop.yarn.api.records.ApplicationReport report)` convert an AM report to a string for diagnostics
`static String`	`requestToString(org.apache.hadoop.yarn.client.api.AMRMClient.ContainerRequest request)`
`static File`	`requiredFile(String filename, String role)` A required file
`static String`	`sequenceToString(CharSequence charSequence)` Convert a char sequence to a string.
`static void`	`setInfoTime(Map info, String keyHumanTime, String keyMachineTime, long time)` Set the time for an information (human, machine) timestamp pair of fields.
`static void`	`setRmAddress(org.apache.hadoop.conf.Configuration conf, String rmAddr)`
`static void`	`setRmSchedulerAddress(org.apache.hadoop.conf.Configuration conf, String rmAddr)`
`static void`	`sortApplicationReport(List<org.apache.hadoop.yarn.api.records.ApplicationReport> instances)` Sorts the given list of application reports Finished instances are ordered by finished time and running/accepted instances are ordered by start time Finally Instance are order by finished instances coming after running instances
`static void`	`sortApplicationsByMostRecent(List<org.apache.hadoop.yarn.api.records.ApplicationReport> instances)` Sorts the given list of application reports, most recently started or finished instance first.
`static Map<String,String>`	`sortedMap(Map<String,String> source)` Take a map and produce a sorted equivalent
`static String`	`stringify(Throwable t)`
`static String`	`stringify(org.apache.hadoop.yarn.api.records.URL url)` Convert a YARN URL into a string value of a normal URL
`static String`	`stringifyMap(Map<String,String> map)` Convert a map to a multi-line string for printing
`static Map<String,String>`	`stringMapClone(Map<String,String> src)`
`static void`	`tarGzipFolder(File srcFolder, File tarGzipFile, FilenameFilter filter)` Given a source folder create a tar.gz file
`static String`	`toGMTString(long time)` Convert an epoch time to a GMT time.
`static Map<String,String>`	`toMap(Properties properties)` Convert a properties instance to a string map.
`static String`	`translateTrailingHeapUnit(String heapsize)`
`static String`	`truncate(String toTruncate, int maxSize)` Truncate the given string to a maximum length provided with a pad (...) added to the end if expected size if more than 10.
`static void`	`validateClientConfigFile()` validate if slider-client.xml under the path can be opened
`static void`	`validateClusterName(String clustername)` verify that the supplied cluster name is valid
`static void`	`validateExe(String program, File exe)` Validate an executable
`static void`	`validateHDFSFile(SliderFileSystem sliderFileSystem, String pathStr)` validate if a file on HDFS can be open
`static void`	`validateOpenSSLEnv(org.slf4j.Logger logger)`
`static void`	`validatePythonEnv(org.slf4j.Logger logger)`
`static void`	`validateSliderClientEnvironment(org.slf4j.Logger logger)` Validate the slider client-side execution environment.
`static void`	`validateSliderServerEnvironment(org.slf4j.Logger logger, boolean dependencyChecks)` Validate the slider server-side execution environment.
`static void`	`verifyFileExists(File file, org.slf4j.Logger errorlog)` Verify that a file exists
`static void`	`verifyFileSize(String program, File exe, int minFileSize)`
`static void`	`verifyIsDir(File dir, org.slf4j.Logger errorlog)` Verify that a path refers to a directory.
`static void`	`verifyIsFile(String program, File exe)`
`static File`	`verifyKeytabExists(org.apache.hadoop.conf.Configuration siteConf, String prop)` Verify that a keytab property is defined and refers to a non-empty file
`static String`	`verifyOptionSet(org.apache.hadoop.conf.Configuration configuration, String key, boolean allowEmpty)` verify that a config option is set
`static void`	`verifyPrincipalSet(org.apache.hadoop.conf.Configuration conf, String principal)` Verify that a Kerberos principal has been set -if not fail with an error message that actually tells you what is missing
`static void`	`verifyUnixExe(String program, File exe)` Verify that a Unix exe works
`static void`	`verifyWindowsExe(String program, File exe)` Look for the windows executable and check it has the right headers.
`static void`	`write(File outfile, byte[] data, boolean createParent)` Write bytes to a file
`static void`	`zipFolder(File srcFolder, File zipFile)` Given a source folder create zipped file

Methods inherited from class java.lang.Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

- Field Detail
  - JAVA_SECURITY_KRB5_REALM
```
public static final String JAVA_SECURITY_KRB5_REALM
```
    See Also:
    Constant Field Values
  - JAVA_SECURITY_KRB5_KDC
```
public static final String JAVA_SECURITY_KRB5_KDC
```
    See Also:
    Constant Field Values
  - WINUTILS
```
public static final String WINUTILS
```
    Winutils
    
    See Also:
    Constant Field Values
  - OPENSSL
```
public static final String OPENSSL
```
    name of openssl program
    
    See Also:
    Constant Field Values
  - PYTHON
```
public static final String PYTHON
```
    name of python program
    
    See Also:
    Constant Field Values
  - DOCKER
```
public static final String DOCKER
```
    name of docker program
    
    See Also:
    Constant Field Values
  - NODE_LIST_LIMIT
```
public static final int NODE_LIST_LIMIT
```
    See Also:
    Constant Field Values
- Method Detail
  - isUnset
```
public static boolean isUnset(String s)
```
    Implementation of set-ness, groovy definition of true/false for a string
    
    Parameters:
    s - string
    
    Returns:
    true iff the string is neither null nor empty
  - isSet
```
public static boolean isSet(String s)
```
  - isNotEmpty
```
public static boolean isNotEmpty(List l)
```
    Probe for a list existing and not being empty
    
    Parameters:
    l - list
    
    Returns:
    true if the reference is valid and it contains entries
  - isNotEmpty
```
public static boolean isNotEmpty(Map m)
```
    Probe for a map existing and not being empty
    
    Parameters:
    m - map
    
    Returns:
    true if the reference is valid and it contains map entries
  - translateTrailingHeapUnit
```
public static String translateTrailingHeapUnit(String heapsize)
                                        throws BadConfigException
```
    Throws:
    
    BadConfigException
  - deleteDirectoryTree
```
public static void deleteDirectoryTree(File dir)
                                throws IOException
```
    recursive directory delete
    
    Parameters:
    dir - dir to delete
    
    Throws:
    
    IOException - on any problem
  - findContainingJarOrFail
```
public static File findContainingJarOrFail(Class clazz)
                                    throws IOException
```
    Find a containing JAR
    
    Parameters:
    clazz - class to find
    
    Returns:
    the file
    
    Throws:
    
    IOException - any IO problem, including the class not having a classloader
    
    FileNotFoundException - if the class did not resolve to a file
  - findContainingJar
```
public static File findContainingJar(Class my_class)
                              throws IOException
```
    Find a containing JAR
    
    Parameters:
    my_class - class to find
    
    Returns:
    the file or null if it is not found
    
    Throws:
    
    IOException - any IO problem, including the class not having a classloader
  - checkPort
```
public static void checkPort(String hostname,
             int port,
             int connectTimeout)
                      throws IOException
```
    Throws:
    
    IOException
  - checkPort
```
public static void checkPort(String name,
             InetSocketAddress address,
             int connectTimeout)
                      throws IOException
```
    Throws:
    
    IOException
  - checkURL
```
public static void checkURL(String name,
            String url,
            int timeout)
                     throws IOException
```
    Throws:
    
    IOException
  - requiredFile
```
public static File requiredFile(String filename,
                String role)
                         throws IOException
```
    A required file
    
    Parameters:
    role - role of the file (for errors)
    filename - the filename
    
    Returns:
    the file
    
    Throws:
    
    ExitUtil.ExitException - if the file is missing
    
    IOException
  - isClusternameValid
```
public static boolean isClusternameValid(String name)
```
    Normalize a cluster name then verify that it is valid
    
    Parameters:
    name - proposed cluster name
    
    Returns:
    true iff it is valid
  - oldIsClusternameValid
```
public static boolean oldIsClusternameValid(String name)
```
  - copyDirectory
```
public static int copyDirectory(org.apache.hadoop.conf.Configuration conf,
                org.apache.hadoop.fs.Path srcDirPath,
                org.apache.hadoop.fs.Path destDirPath,
                org.apache.hadoop.fs.permission.FsPermission permission)
                         throws IOException,
                                BadClusterStateException
```
    Copy a directory to a new FS -both paths must be qualified. If a directory needs to be created, supplied permissions can override the default values. Existing directories are not touched
    
    Parameters:
    conf - conf file
    srcDirPath - src dir
    destDirPath - dest dir
    permission - permission for the dest directory; null means "default"
    
    Returns:
    # of files copies
    
    Throws:
    
    IOException
    
    BadClusterStateException
  - stringify
```
public static String stringify(Throwable t)
```
  - createConfiguration
```
public static org.apache.hadoop.yarn.conf.YarnConfiguration createConfiguration()
```
    Create a configuration with Slider-specific tuning. This is done rather than doing custom configs.
    
    Returns:
    the config
  - patchConfiguration
```
public static org.apache.hadoop.conf.Configuration patchConfiguration(org.apache.hadoop.conf.Configuration conf)
```
    Take an existing conf and patch it for Slider's needs. Useful in Service.init & RunService methods where a shared config is being passed in
    
    Parameters:
    conf - configuration
    
    Returns:
    the patched configuration
  - collectionToStringList
```
public static List<String> collectionToStringList(Collection c)
```
    Take a collection, return a list containing the string value of every element in the collection.
    
    Parameters:
    c - collection
    
    Returns:
    a stringified list
  - join
```
public static String join(Collection collection,
          String separator)
```
    Join an collection of objects with a separator that appears after every instance in the list -including at the end
    
    Parameters:
    collection - collection to call toString() on each element
    separator - separator string
    
    Returns:
    the joined entries
  - join
```
public static String join(Collection collection,
          String separator,
          boolean trailing)
```
    Join an collection of objects with a separator that appears after every instance in the list -optionally at the end
    
    Parameters:
    collection - collection to call toString() on each element
    separator - separator string
    trailing - add a trailing entry or not
    
    Returns:
    the joined entries
  - join
```
public static String join(String[] collection,
          String separator)
```
    Join an array of strings with a separator that appears after every instance in the list -including at the end
    
    Parameters:
    collection - strings
    separator - separator string
    
    Returns:
    the joined entries
  - join
```
public static String join(String[] collection,
          String separator,
          boolean trailing)
```
    Join an array of strings with a separator that appears after every instance in the list -optionally at the end
    
    Parameters:
    collection - strings
    separator - separator string
    trailing - add a trailing entry or not
    
    Returns:
    the joined entries
  - joinWithInnerSeparator
```
public static String joinWithInnerSeparator(String separator,
                            Object... collection)
```
    Join an array of strings with a separator that appears after every instance in the list -except at the end
    
    Parameters:
    collection - strings
    separator - separator string
    
    Returns:
    the list
  - mandatoryEnvVariable
```
public static String mandatoryEnvVariable(String key)
                                   throws BadClusterStateException
```
    Resolve a mandatory environment variable
    
    Parameters:
    key - env var
    
    Returns:
    the resolved value
    
    Throws:
    
    BadClusterStateException
  - appReportToString
```
public static String appReportToString(org.apache.hadoop.yarn.api.records.ApplicationReport r,
                       String separator)
```
  - instanceDetailsToString
```
public static String instanceDetailsToString(String name,
                             org.apache.hadoop.yarn.api.records.ApplicationReport report,
                             List<ContainerInformation> containers,
                             String version,
                             Set<String> components,
                             boolean verbose)
```
    Convert the instance details of an application to a string
    
    Parameters:
    name - instance name
    report - the application report
    verbose - verbose output
    
    Returns:
    a string
  - containersToString
```
public static String containersToString(List<ContainerInformation> containers,
                        String version,
                        Set<String> components)
```
  - filter
```
public static boolean filter(String value,
             String filter)
```
    Filter a string value given a single filter
    
    Parameters:
    value - the string value to check
    filter - a single string filter
    
    Returns:
    return true if value should be trapped, false if it should be let through
  - filter
```
public static boolean filter(String value,
             Set<String> filters)
```
    Filter a string value given a set of filters
    
    Parameters:
    value - the string value to check
    filters - a set of string filters
    
    Returns:
    return true if value should be trapped, false if it should be let through
  - sortApplicationsByMostRecent
```
public static void sortApplicationsByMostRecent(List<org.apache.hadoop.yarn.api.records.ApplicationReport> instances)
```
    Sorts the given list of application reports, most recently started or finished instance first.
    
    Parameters:
    instances - list of instances
  - sortApplicationReport
```
public static void sortApplicationReport(List<org.apache.hadoop.yarn.api.records.ApplicationReport> instances)
```
    Sorts the given list of application reports Finished instances are ordered by finished time and running/accepted instances are ordered by start time Finally Instance are order by finished instances coming after running instances
    
    Parameters:
    instances - list of instances
  - buildApplicationReportMap
```
public static Map<String,org.apache.hadoop.yarn.api.records.ApplicationReport> buildApplicationReportMap(List<org.apache.hadoop.yarn.api.records.ApplicationReport> instances,
                                                                                         org.apache.hadoop.yarn.api.records.YarnApplicationState minState,
                                                                                         org.apache.hadoop.yarn.api.records.YarnApplicationState maxState)
```
    Built a (sorted) map of application reports, mapped to the instance name The list is sorted, and the addition process does not add a report if there is already one that exists. If the list handed in is sorted, those that are listed first form the entries returned
    
    Parameters:
    instances - list of intances
    minState - minimum YARN state to be included
    maxState - maximum YARN state to be included
    
    Returns:
    all reports in the list whose state >= minimum and <= maximum
  - sortedMap
```
public static Map<String,String> sortedMap(Map<String,String> source)
```
    Take a map and produce a sorted equivalent
    
    Parameters:
    source - source map
    
    Returns:
    a map whose iterator returns the string-sorted ordering of entries
  - toMap
```
public static Map<String,String> toMap(Properties properties)
```
    Convert a properties instance to a string map.
    
    Parameters:
    properties - source property object
    
    Returns:
    a string map
  - mergeMap
```
public static Map<String,String> mergeMap(Map<String,String> first,
                          Map<String,String> second)
```
    Merge in one map to another -all entries in the second map are merged into the first -overwriting any duplicate keys.
    
    Parameters:
    first - first map -the updated one.
    second - the map that is merged in
    
    Returns:
    the first map
  - mergeEntries
```
public static Map<String,String> mergeEntries(Map<String,String> dest,
                              Iterable<Map.Entry<String,String>> entries)
```
    Merge a set of entries into a map. This will take the entryset of a map, or a Hadoop collection itself
    
    Parameters:
    dest - destination
    entries - entries
    
    Returns:
    dest -with the entries merged in
  - mergeMaps
```
public static <T1,T2> Map<T1,T2> mergeMaps(Map<T1,T2> first,
                           Map<T1,T2> second)
```
    Generic map merge logic
    
    Type Parameters:
    T1 - key type
    T2 - value type
    Parameters:
    first - first map
    second - second map
    
    Returns:
    'first' merged with the second
  - mergeMapsIgnoreDuplicateKeys
```
public static <T1,T2> Map<T1,T2> mergeMapsIgnoreDuplicateKeys(Map<T1,T2> first,
                                              Map<T1,T2> second)
```
    Generic map merge logic
    
    Type Parameters:
    T1 - key type
    T2 - value type
    Parameters:
    first - first map
    second - second map
    
    Returns:
    'first' merged with the second
  - stringifyMap
```
public static String stringifyMap(Map<String,String> map)
```
    Convert a map to a multi-line string for printing
    
    Parameters:
    map - map to stringify
    
    Returns:
    a string representation of the map
  - getIntValue
```
public static int getIntValue(Map<String,String> roleMap,
              String key,
              int defVal,
              int min,
              int max)
                       throws BadConfigException
```
    Get the int value of a role
    
    Parameters:
    roleMap - map of role key->val entries
    key - key the key to look for
    defVal - default value to use if the key is not in the map
    min - min value or -1 for do not check
    max - max value or -1 for do not check
    
    Returns:
    the int value the integer value
    
    Throws:
    
    BadConfigException - if the value could not be parsed
  - parseAndValidate
```
public static int parseAndValidate(String errorKey,
                   String valS,
                   int defVal,
                   int min,
                   int max)
                            throws BadConfigException
```
    Parse an int value, replacing it with defval if undefined;
    
    Parameters:
    errorKey - key to use in exceptions
    defVal - default value to use if the key is not in the map
    min - min value or -1 for do not check
    max - max value or -1 for do not check
    
    Returns:
    the int value the integer value
    
    Throws:
    
    BadConfigException - if the value could not be parsed
  - getRmAddress
```
public static InetSocketAddress getRmAddress(org.apache.hadoop.conf.Configuration conf)
```
  - getRmSchedulerAddress
```
public static InetSocketAddress getRmSchedulerAddress(org.apache.hadoop.conf.Configuration conf)
```
  - isRmSchedulerAddressDefined
```
public static boolean isRmSchedulerAddressDefined(org.apache.hadoop.conf.Configuration conf)
```
    probe to see if the RM scheduler is defined
    
    Parameters:
    conf - config
    
    Returns:
    true if the RM scheduler address is set to something other than 0.0.0.0
  - isAddressDefined
```
public static boolean isAddressDefined(InetSocketAddress address)
```
    probe to see if the address
    
    Parameters:
    address - network address
    
    Returns:
    true if the scheduler address is set to something other than 0.0.0.0
  - setRmAddress
```
public static void setRmAddress(org.apache.hadoop.conf.Configuration conf,
                String rmAddr)
```
  - setRmSchedulerAddress
```
public static void setRmSchedulerAddress(org.apache.hadoop.conf.Configuration conf,
                         String rmAddr)
```
  - hasAppFinished
```
public static boolean hasAppFinished(org.apache.hadoop.yarn.api.records.ApplicationReport report)
```
  - containerToString
```
public static String containerToString(org.apache.hadoop.yarn.api.records.Container container)
```
  - reportToString
```
public static String reportToString(org.apache.hadoop.yarn.api.records.ApplicationReport report)
```
    convert an AM report to a string for diagnostics
    
    Parameters:
    report - the report
    
    Returns:
    the string value
  - stringify
```
public static String stringify(org.apache.hadoop.yarn.api.records.URL url)
```
    Convert a YARN URL into a string value of a normal URL
    
    Parameters:
    url - URL
    
    Returns:
    string representatin
  - findFreePort
```
public static int findFreePort(int start,
               int limit)
```
  - isPortAvailable
```
public static boolean isPortAvailable(int port)
```
    See if a port is available for listening on by trying to listen on it and seeing if that works or fails.
    
    Parameters:
    port - port to listen to
    
    Returns:
    true if the port was available for listening on
  - buildEnvMap
```
public static Map<String,String> buildEnvMap(Map<String,String> roleOpts)
```
    Build the environment map from a role option map, finding all entries beginning with "env.", adding them to a map of (prefix-removed) env vars
    
    Parameters:
    roleOpts - role options. This can be null, meaning the role is undefined
    
    Returns:
    a possibly empty map of environment variables.
  - applyCommandLineRoleOptsToRoleMap
```
public static void applyCommandLineRoleOptsToRoleMap(Map<String,Map<String,String>> clusterRoleMap,
                                     Map<String,Map<String,String>> commandOptions)
```
    Apply a set of command line options to a cluster role map
    
    Parameters:
    clusterRoleMap - cluster role map to merge onto
    commandOptions - command opts
  - validateClusterName
```
public static void validateClusterName(String clustername)
                                throws BadCommandArgumentsException
```
    verify that the supplied cluster name is valid
    
    Parameters:
    clustername - cluster name
    
    Throws:
    
    BadCommandArgumentsException - if it is invalid
  - verifyPrincipalSet
```
public static void verifyPrincipalSet(org.apache.hadoop.conf.Configuration conf,
                      String principal)
                               throws BadConfigException
```
    Verify that a Kerberos principal has been set -if not fail with an error message that actually tells you what is missing
    
    Parameters:
    conf - configuration to look at
    principal - key of principal
    
    Throws:
    
    BadConfigException - if the key is not set
  - isHadoopClusterSecure
```
public static boolean isHadoopClusterSecure(org.apache.hadoop.conf.Configuration conf)
```
    Flag to indicate whether the cluster is in secure mode
    
    Parameters:
    conf - configuration to look at
    
    Returns:
    true if the slider client/service should be in secure mode
  - maybeInitSecurity
```
public static boolean maybeInitSecurity(org.apache.hadoop.conf.Configuration conf)
                                 throws IOException,
                                        SliderException
```
    Init security if the cluster configuration declares the cluster is secure
    
    Parameters:
    conf - configuration to look at
    
    Returns:
    true if the cluster is secure
    
    Throws:
    
    IOException - cluster is secure
    
    SliderException - the configuration/process is invalid
  - initProcessSecurity
```
public static boolean initProcessSecurity(org.apache.hadoop.conf.Configuration conf)
                                   throws IOException,
                                          SliderException
```
    Turn on security. This is setup to only run once.
    
    Parameters:
    conf - configuration to build up security
    
    Returns:
    true if security was initialized in this call
    
    Throws:
    
    IOException - IO/Net problems
    
    BadConfigException - the configuration and system state are inconsistent
    
    SliderException
  - forceLogin
```
public static void forceLogin()
                       throws IOException
```
    Force an early login: This catches any auth problems early rather than in RPC operations
    
    Throws:
    
    IOException - if the login fails
  - putJar
```
public static org.apache.hadoop.yarn.api.records.LocalResource putJar(Map<String,org.apache.hadoop.yarn.api.records.LocalResource> providerResources,
                                                      SliderFileSystem sliderFileSystem,
                                                      Class clazz,
                                                      org.apache.hadoop.fs.Path tempPath,
                                                      String libdir,
                                                      String jarName)
                                                               throws IOException,
                                                                      SliderException
```
    Submit a JAR containing a specific class and map it
    
    Parameters:
    providerResources - provider map to build up
    sliderFileSystem - remote fs
    clazz - class to look for
    libdir - lib directory
    jarName - At the destination
    
    Returns:
    the local resource ref
    
    Throws:
    
    IOException - trouble copying to HDFS
    
    SliderException
  - putAllJars
```
public static void putAllJars(Map<String,org.apache.hadoop.yarn.api.records.LocalResource> providerResources,
              SliderFileSystem sliderFileSystem,
              org.apache.hadoop.fs.Path tempPath,
              String libDir,
              String srcPath)
                       throws IOException,
                              SliderException
```
    Submit a JAR containing and map it
    
    Parameters:
    providerResources - provider map to build up
    sliderFileSystem - remote fs
    libDir - lib directory
    srcPath - copy jars from
    
    Throws:
    
    IOException, - SliderException trouble copying to HDFS
    
    IOException
    
    SliderException
  - createJarFilter
```
public static FilenameFilter createJarFilter()
```
    Accept all filenames ending with .jar
    
    Returns:
    a filename filter
  - putAmTarGzipAndUpdate
```
public static void putAmTarGzipAndUpdate(Map<String,org.apache.hadoop.yarn.api.records.LocalResource> providerResources,
                         SliderFileSystem sliderFileSystem)
                                  throws IOException,
                                         SliderException
```
    Submit the AM tar.gz containing all dependencies and map it
    
    Parameters:
    providerResources - provider map to build up
    sliderFileSystem - remote fs
    
    Throws:
    
    IOException, - SliderException trouble copying to HDFS
    
    IOException
    
    SliderException
  - deepClone
```
public static Map<String,Map<String,String>> deepClone(Map<String,Map<String,String>> src)
```
  - stringMapClone
```
public static Map<String,String> stringMapClone(Map<String,String> src)
```
  - listDir
```
public static String listDir(File dir)
```
    List a directory in the local filesystem
    
    Parameters:
    dir - directory
    
    Returns:
    a listing, one to a line
  - createLocalPath
```
public static org.apache.hadoop.fs.Path createLocalPath(File file)
```
    Create a file:// path from a local file
    
    Parameters:
    file - file to point the path
    
    Returns:
    a new Path
  - getCurrentUser
```
public static org.apache.hadoop.security.UserGroupInformation getCurrentUser()
                                                                      throws IOException
```
    Get the current user -relays to UserGroupInformation.getCurrentUser() with any Slider-specific post processing and exception handling
    
    Returns:
    user info
    
    Throws:
    
    IOException - on a failure to get the credentials
  - getKerberosRealm
```
public static String getKerberosRealm()
```
  - registerClientResource
```
public static URL registerClientResource()
```
    Register the client resource in SliderKeys.SLIDER_CLIENT_XML for Configuration instances.
    
    Returns:
    true if the resource could be loaded
  - loadSliderClientXML
```
public static org.apache.hadoop.conf.Configuration loadSliderClientXML()
```
    Attempt to load the slider client resource. If the resource is not on the CP an empty config is returned.
    
    Returns:
    a config
  - sequenceToString
```
public static String sequenceToString(CharSequence charSequence)
```
    Convert a char sequence to a string. This ensures that comparisions work
    
    Parameters:
    charSequence - source
    
    Returns:
    the string equivalent
  - buildClasspath
```
public static ClasspathConstructor buildClasspath(String sliderConfDir,
                                  String libdir,
                                  org.apache.hadoop.conf.Configuration config,
                                  SliderFileSystem sliderFileSystem,
                                  boolean usingMiniMRCluster)
```
    Build up the classpath for execution -behaves very differently on a mini test cluster vs a production production one.
    
    Parameters:
    sliderConfDir - relative path to the dir containing slider config options to put on the classpath -or null
    libdir - directory containing the JAR files
    config - the configuration
    usingMiniMRCluster - flag to indicate the MiniMR cluster is in use (and hence the current classpath should be used, not anything built up)
    
    Returns:
    a classpath
  - verifyIsDir
```
public static void verifyIsDir(File dir,
               org.slf4j.Logger errorlog)
                        throws FileNotFoundException
```
    Verify that a path refers to a directory. If not logs the parent dir then throws an exception
    
    Parameters:
    dir - the directory
    errorlog - log for output on an error
    
    Throws:
    
    FileNotFoundException - if it is not a directory
  - verifyFileExists
```
public static void verifyFileExists(File file,
                    org.slf4j.Logger errorlog)
                             throws FileNotFoundException
```
    Verify that a file exists
    
    Parameters:
    file - file
    errorlog - log for output on an error
    
    Throws:
    
    FileNotFoundException
  - verifyOptionSet
```
public static String verifyOptionSet(org.apache.hadoop.conf.Configuration configuration,
                     String key,
                     boolean allowEmpty)
                              throws BadConfigException
```
    verify that a config option is set
    
    Parameters:
    configuration - config
    key - key
    
    Returns:
    the value, in case it needs to be verified too
    
    Throws:
    
    BadConfigException - if the key is missing
  - verifyKeytabExists
```
public static File verifyKeytabExists(org.apache.hadoop.conf.Configuration siteConf,
                      String prop)
                               throws BadConfigException
```
    Verify that a keytab property is defined and refers to a non-empty file
    
    Parameters:
    siteConf - configuration
    prop - property to look for
    
    Returns:
    the file referenced
    
    Throws:
    
    BadConfigException - on a failure
  - toGMTString
```
public static String toGMTString(long time)
```
    Convert an epoch time to a GMT time. This uses the deprecated Date.toString() operation, so is in one place to reduce the number of deprecation warnings.
    
    Parameters:
    time - timestamp
    
    Returns:
    string value as ISO-9601
  - addBuildInfo
```
public static void addBuildInfo(Map<String,String> info,
                String prefix)
```
    Add the cluster build information; this will include Hadoop details too
    
    Parameters:
    info - cluster info
    prefix - prefix for the build info
  - setInfoTime
```
public static void setInfoTime(Map info,
               String keyHumanTime,
               String keyMachineTime,
               long time)
```
    Set the time for an information (human, machine) timestamp pair of fields. The human time is the time in millis converted via the Date class.
    
    Parameters:
    info - info fields
    keyHumanTime - name of human time key
    keyMachineTime - name of machine time
    time - timestamp
  - extractImagePath
```
public static org.apache.hadoop.fs.Path extractImagePath(CoreFileSystem fs,
                                         MapOperations internalOptions)
                                                  throws SliderException,
                                                         IOException
```
    Throws:
    
    SliderException
    
    IOException
  - haltAM
```
public static Timer haltAM(int status,
           String text,
           int delay)
```
    trigger a JVM halt with no clean shutdown at all
    
    Parameters:
    status - status code for exit
    text - text message
    delay - delay in millis
    
    Returns:
    the timer (assuming the JVM hasn't halted yet)
  - propertiesToString
```
public static String propertiesToString(Properties props)
```
  - appendToURL
```
public static String appendToURL(String base,
                 String path)
```
    Add a subpath to an existing URL. This extends the path, inserting a / between all entries if needed.
    
    Parameters:
    base - base path/URL
    path - subpath
    
    Returns:
    base+"/"+subpath
  - appendToURL
```
public static String appendToURL(String base,
                 String... paths)
```
    Append a list of paths, inserting "/" signs as appropriate
    
    Parameters:
    base - base path/URL
    paths - subpaths
    
    Returns:
    base+"/"+paths[0]+"/"+paths[1]...
  - truncate
```
public static String truncate(String toTruncate,
              int maxSize)
```
    Truncate the given string to a maximum length provided with a pad (...) added to the end if expected size if more than 10.
    
    Parameters:
    toTruncate - string to truncate; may be null
    maxSize - maximum size
    
    Returns:
    the truncated/padded string.
  - extractNodeLabel
```
public static String extractNodeLabel(org.apache.hadoop.yarn.api.records.NodeReport report)
```
    Get a string node label value from a node report
    
    Parameters:
    report - node report
    
    Returns:
    a single trimmed label or ""
  - compareTo
```
public static int compareTo(long left,
            long right)
```
    A compareTo function that converts the result of a long comparision into the integer that Comparable expects.
    
    Parameters:
    left - left side
    right - right side
    
    Returns:
    -1, 0, 1 depending on the diff
  - zipFolder
```
public static void zipFolder(File srcFolder,
             File zipFile)
                      throws IOException
```
    Given a source folder create zipped file
    
    Parameters:
    srcFolder -
    zipFile -
    
    Throws:
    
    IOException
  - tarGzipFolder
```
public static void tarGzipFolder(File srcFolder,
                 File tarGzipFile,
                 FilenameFilter filter)
                          throws IOException
```
    Given a source folder create a tar.gz file
    
    Parameters:
    srcFolder -
    tarGzipFile -
    
    Throws:
    
    IOException
  - getHdpVersion
```
public static String getHdpVersion()
```
    Retrieve the HDP version if it is an HDP cluster, or null otherwise
    
    Returns:
    HDP version
  - isHdp
```
public static boolean isHdp()
```
    Query to find if it is an HDP cluster
    
    Returns:
    true if this is invoked in an HDP cluster or false otherwise
  - getSliderVersion
```
public static String getSliderVersion()
```
    Retrieve the version of the current Slider install
    
    Returns:
    the version string of the Slider release
  - getApplicationResourceInputStream
```
public static InputStream getApplicationResourceInputStream(org.apache.hadoop.fs.FileSystem fs,
                                            org.apache.hadoop.fs.Path appPath,
                                            String entry)
                                                     throws IOException
```
    Throws:
    
    IOException
  - checkForRequiredNativeLibraries
```
public static String checkForRequiredNativeLibraries()
```
    Check for any needed libraries being present. On Unix none are needed; on windows they must be present
    
    Returns:
    true if all is well
  - maybeVerifyWinUtilsValid
```
public static void maybeVerifyWinUtilsValid()
                                     throws IOException,
                                            SliderException
```
    Strictly verify that windows utils is present. Checks go as far as opening the file and looking for the headers.
    
    Throws:
    
    IOException - on any problem reading the file
    
    FileNotFoundException - if the file is not considered valid
    
    SliderException
  - verifyIsFile
```
public static void verifyIsFile(String program,
                File exe)
                         throws FileNotFoundException
```
    Throws:
    
    FileNotFoundException
  - verifyFileSize
```
public static void verifyFileSize(String program,
                  File exe,
                  int minFileSize)
                           throws FileNotFoundException
```
    Throws:
    
    FileNotFoundException
  - verifyWindowsExe
```
public static void verifyWindowsExe(String program,
                    File exe)
                             throws IOException
```
    Look for the windows executable and check it has the right headers. File.canRead() doesn't work on windows, so the reading is mandatory.
    
    Parameters:
    program - program name for errors
    exe - executable
    
    Throws:
    
    IOException - IOE
  - verifyUnixExe
```
public static void verifyUnixExe(String program,
                 File exe)
                          throws IOException
```
    Verify that a Unix exe works
    
    Parameters:
    program - program name for errors
    exe - executable
    
    Throws:
    
    IOException - IOE
  - validateExe
```
public static void validateExe(String program,
               File exe)
                        throws IOException
```
    Validate an executable
    
    Parameters:
    program - program name for errors
    exe - program to look at
    
    Throws:
    
    IOException
  - write
```
public static void write(File outfile,
         byte[] data,
         boolean createParent)
                  throws IOException
```
    Write bytes to a file
    
    Parameters:
    outfile - output file
    data - data to write
    createParent - flag to indicate that the parent dir should be created
    
    Throws:
    
    IOException - on any IO problem
  - execCommand
```
public static ForkedProcessService execCommand(String name,
                               int status,
                               long timeoutMillis,
                               org.slf4j.Logger logger,
                               String outputString,
                               String... commands)
                                        throws IOException,
                                               SliderException
```
    Execute a command for a test operation
    
    Parameters:
    name - name in error
    status - status code expected
    timeoutMillis - timeout in millis for process to finish
    logger -
    outputString - optional string to grep for (must not span a line)
    commands - commands @return the process
    
    Throws:
    
    IOException - on any failure.
    
    SliderException
  - validateSliderClientEnvironment
```
public static void validateSliderClientEnvironment(org.slf4j.Logger logger)
                                            throws IOException,
                                                   SliderException
```
    Validate the slider client-side execution environment. This looks for everything felt to be critical for execution, including native binaries and other essential dependencies.
    
    Parameters:
    logger - logger to log to on normal execution
    
    Throws:
    
    IOException - on IO failures
    
    SliderException - on validation failures
  - validateSliderServerEnvironment
```
public static void validateSliderServerEnvironment(org.slf4j.Logger logger,
                                   boolean dependencyChecks)
                                            throws IOException,
                                                   SliderException
```
    Validate the slider server-side execution environment. This looks for everything felt to be critical for execution, including native binaries and other essential dependencies.
    
    Parameters:
    logger - logger to log to on normal execution
    dependencyChecks - flag to indicate checks for agent dependencies
    
    Throws:
    
    IOException - on IO failures
    
    SliderException - on validation failures
  - validateOpenSSLEnv
```
public static void validateOpenSSLEnv(org.slf4j.Logger logger)
                               throws IOException,
                                      SliderException
```
    Throws:
    
    IOException
    
    SliderException
  - validatePythonEnv
```
public static void validatePythonEnv(org.slf4j.Logger logger)
                              throws IOException,
                                     SliderException
```
    Throws:
    
    IOException
    
    SliderException
  - getCurrentCommandPath
```
public static String getCurrentCommandPath()
```
    return the path to the currently running slider command
    
    Throws:
    
    NullPointerException - - If the pathname argument is null
    
    SecurityException - - if a security manager exists and its checkPermission method doesn't allow getting the ProtectionDomain
  - getApplicationDefinitionPath
```
public static String getApplicationDefinitionPath(ConfTreeOperations conf)
                                           throws BadConfigException
```
    return the HDFS path where the application package has been uploaded manually or by using slider client (install package command)
    
    Parameters:
    conf - configuration
    
    Returns:
    
    Throws:
    
    BadConfigException
  - getClientConfigPath
```
public static String getClientConfigPath()
```
    return the path to the slider-client.xml used by the current running slider command
    
    Throws:
    
    SecurityException - - if a security manager exists and its checkPermission method denies access to the class loader for the class
  - validateClientConfigFile
```
public static void validateClientConfigFile()
                                     throws IOException
```
    validate if slider-client.xml under the path can be opened
    
    Throws:
    
    IOException - : the file can't be found or open
  - validateHDFSFile
```
public static void validateHDFSFile(SliderFileSystem sliderFileSystem,
                    String pathStr)
                             throws IOException,
                                    URISyntaxException
```
    validate if a file on HDFS can be open
    
    Throws:
    
    IOException - the file can't be found or opened
    
    URISyntaxException
  - getJDKInfo
```
public static String getJDKInfo()
```
    return the version and path of the JDK invoking the current running slider command
    
    Throws:
    
    SecurityException - - if a security manager exists and its checkPropertyAccess method doesn't allow access to the specified system property.
  - checkCredentialCacheFile
```
public static String checkCredentialCacheFile()
                                       throws IOException,
                                              BadConfigException
```
    return a description of whether the current user has created credential cache files from kerberos servers
    
    Throws:
    
    IOException
    
    BadConfigException
    
    SecurityException - - if a security manager exists and its checkPropertyAccess method doesn't allow access to the specified system property.
  - compareTwoLongsReverse
```
public static int compareTwoLongsReverse(long x,
                         long y)
```
    Compare two long values for sorting. As the return value for comparators must be int, the simple value of x-y is inapplicable
    
    Parameters:
    x - x value
    y - y value
    
    Returns:
    +ve if x is less than y, -ve if y is greater than x; 0 for equality
  - getSystemEnv
```
public static String getSystemEnv(String property)
```
  - getSystemEnv
```
public static Map<String,String> getSystemEnv()
```
  - requestToString
```
public static String requestToString(org.apache.hadoop.yarn.client.api.AMRMClient.ContainerRequest request)
```

Class SliderUtils

Nested Class Summary

Field Summary

Method Summary

Methods inherited from class java.lang.Object

Field Detail

JAVA_SECURITY_KRB5_REALM

JAVA_SECURITY_KRB5_KDC

WINUTILS

OPENSSL

PYTHON

DOCKER

NODE_LIST_LIMIT

Method Detail

isUnset

isSet

isNotEmpty

isNotEmpty

translateTrailingHeapUnit

deleteDirectoryTree

findContainingJarOrFail

findContainingJar

checkPort

checkPort

checkURL

requiredFile

isClusternameValid

oldIsClusternameValid

copyDirectory

stringify

createConfiguration

patchConfiguration

collectionToStringList

join

join

join

join

joinWithInnerSeparator

mandatoryEnvVariable

appReportToString

instanceDetailsToString

containersToString

filter

filter

sortApplicationsByMostRecent

sortApplicationReport

buildApplicationReportMap

sortedMap

toMap

mergeMap

mergeEntries

mergeMaps

mergeMapsIgnoreDuplicateKeys

stringifyMap

getIntValue

parseAndValidate

getRmAddress

getRmSchedulerAddress

isRmSchedulerAddressDefined

isAddressDefined

setRmAddress

setRmSchedulerAddress

hasAppFinished

containerToString

reportToString

stringify

findFreePort

isPortAvailable

buildEnvMap

applyCommandLineRoleOptsToRoleMap

validateClusterName

verifyPrincipalSet

isHadoopClusterSecure

maybeInitSecurity

initProcessSecurity

forceLogin

putJar

putAllJars

createJarFilter

putAmTarGzipAndUpdate