Coverage

22 Jul 2019 A.R. Guess, Dataversity

WANdisco and Neudesic Partner to Migrate Hadoop Analytical Workloads to Databricks

This new solution provides non-blocking and continuous data migration, automatic transition from Hadoop Distributed File System to Azure Data Lake Storage and Delta Lake, all while enabling a hybrid cloud architecture to migrate petabyte-scale data without disrupting analytics applications

A recent press release states, “WANdisco, the LiveData company, and Neudesic, a nationally recognized business and technology consulting firm, announced a partnership to accelerate the migration of data and analytics workloads to Microsoft Azure Cloud and in particular to Delta Lake, an open source data layer that brings reliability to data lakes. Delta Lake provides ACID transactions, scalable metadata handling, and unifies streaming and batch data processing. Delta Lake runs on top of existing data lakes and is fully compatible with Apache Spark APIs. This new solution provides non-blocking and continuous data migration, automatic transition from Hadoop Distributed File System to Azure Data Lake Storage and Delta Lake, all while enabling a hybrid cloud architecture to migrate petabyte-scale data without disrupting analytics applications.”

The release goes on, “Many organizations face the challenge of migrating their intricate and business critical big data environments to the Azure Cloud to take advantage of modern data and AI services including knowledge mining, machine learning and AI apps and agents to digitally transform their business. Data and analytics fuel business decision making and continues to mature as more data is generated, and analytics advance into prescriptive and ultimately learning algorithms. Accelerating the applications to the business are pre-built Microsoft Azure Cognitive Services for vision, speech, language, decision, and search. To take full advantage of these services, however, the data must be accessible on the cloud or within a hybrid architecture.”