Note
Access to this page requires authorization. You can try signing in or changing directories.
Access to this page requires authorization. You can try changing directories.
In this article, you learn about the open-source components and versions in Azure HDInsight 4.0.
Open-source components available with HDInsight version 4.0
The Open-source component versions associated with HDInsight 4.0 are present in the following table.
| Component | HDInsight 4.0 |
|---|---|
| Apache Hadoop and YARN | 3.1.1 |
| Apache Tez | 0.9.1 |
| Apache Pig | 0.16.1 |
| Apache Hive | 3.1.2 |
| Apache Ranger | 1.1.0 |
| Apache HBase | 2.1.6 |
| Apache Sqoop | 1.5.0 |
| Apache Oozie | 4.3.1 |
| Apache Zookeeper | 3.4.6 |
| Apache Phoenix | 5 |
| Apache Spark | 2.4.4 |
| Apache Livy | 0.5 |
| Apache Kafka | 2.1.1 |
| Apache Ambari | 2.7.0 |
| Apache Zeppelin | 0.8.0 |
This table lists certain HDInsight 4.0 cluster types that have retired or will be retiring soon.
| Cluster Type | Framework version | Support expiration date | Retirement date |
|---|---|---|---|
| HDInsight 4.0 Spark | 2.3 | June 30, 2020 | June 30, 2020 |
| HDInsight 4.0 Kafka | 1.1 | Dec 31, 2020 | Dec 31, 2020 |
| HDInsight 4.0 Kafka | 2.1.0 | Sep 30, 2022 | Oct 1, 2022 |
Apache Spark 2.4 to Spark 3.x Migration Guides
Spark 2.4 to Spark 3.x Migration Guides see here.