Hortonworks Smart Sense tool (HST)

Hadoop as a distributed cluster environment with very huge data value, velocity of data, verity of data and with hardware components, its different configurations makes Hadoop Cluster so complex. The daily operations on Hadoop Cluster and business need to on-board new component (Data/Technology) integrations increases workload on cluster. In this context it is very difficult to maintain health of the cluster, operational risk, optimized performance and efficiently resource their staff for Hadoop operations.

To resolve all the these Hortonworks come with Hortonworks Smart Sense tool (HST) is a proactive service from Hortonworks to monitor cluster, issue detection, improve your cluster performance, faster case resolution to solve problems before they occur. It provides details in terms of Operations, Performance, Security by analyzing diagnostic information based on your HDP Cluster data. It provide recommendations to your HDP cluster for the following components:

• ·         The Operating System
• ·         HDFS
• ·         YARN
• ·         MapReduce2
• ·         Apache Hive and Apache Tez

Here data refers to logs, HDP Cluster Component Metrics, Configurations. Hortonworks come up with vast list of best practices to take account a number of cluster diagnostic variables to meet their customer needs. Here Ambari is helping to collect all cluster diagnostic variables quickly, generate bundle and upload it on Hortonworks SFTP/ share it manually. Once bundle is uploaded, HST is plugs in to Ambari quickly capture cluster diagnostics and display support case resolution, and configuration-related recommendations to improve cluster performance, security, and operations. We can schedule to upload your cluster information to HDP SFTP weekly/month to keep an eye on your Cluster.

configuration-related recommendations contains details analysis with:

·         Justification for  recommendation.

·         How to apply recommendations.

·         List of components, services and hosts are effected with this.

·         Pros & Cons of the recommendations.

support case resolution: This required Hortonworks subscription.

Hortonworks subscription that provides faster support case resolution by easily capturing log files and metrics for insight into the root causes of issues. Hortonworks SmartSense also provides proactive cluster configuration via an intelligent stream of cluster analytics and data-driven recommendations.