Azure Synapse Runtime for Apache Spark 3.4 is now Generally Available! This runtime has been in Public Preview since November 2023 and is now ready for production workloads. The key changes in the new runtime include features resulting from the upgrade of Apache Spark to version 3.4 and Delta Lake to 2.4. Additionally, the operating system has been upgraded to Mariner (an internal Linux distribution tailored for Microsoft’s cloud infrastructure), and Java has been upgraded from version 8 to 11. We encourage all Azure Synapse customers with Apache Spark workloads to migrate to the newest GA version.
For additional details, check the component versions of Azure Synapse Runtime for Apache Spark 3.4.