WANdisco LiveDeltaLake

Consistent business and analytic insights using Databricks across multiple cloud regions and providers

Learn more

LiveDeltaLake ensures Databricks users get consistent business insights when using multiple cloud regions or providers. With LiveDeltaLake, any changes made to content in Managed Delta Lake on Databricks are replicated among these environments.

The Benefits

Always available

Data Accuracy & Availability

LiveDeltaLake opens up significant new business scenarios always ensuring consistency and accuracy of operation.

Always available

Continuous Analytics

LiveDeltaLake ensures Databricks users maintain consistent business insights when deploying across regions or across cloud environments.

Always available

Business Continuity

Reductions in development time, administrative overhead and network bandwidth usage our multisite solutions pay for themselves.

WANdisco LiveDeltaLake Use Cases

Cross-region Databricks

Run Databricks workspaces in different cloud regions against the same data, with active/active replication. Overcome shortages of compute capacity, or improve resiliency at scale by leveraging other cloud regions.

Replicate data across regions

  • Any Azure region with Databricks
  • Any AWS region with Databricks
Data from Hive to Delta Lake

Hadoop/Hive to Databricks with Live Analytics

Cross-storage Migration

Remove the limitations of your current storage service by migrating to a new storage platform without disrupting your users or analytic operations. Migrate existing data at scale with a single click, and maintain consistency for changing data at the same time.

Migrate data across cloud environments

  • ADLS Gen 1 and ADLS Gen 2
  • ADLS and S3

Cross-storage Databricks Continuous Replication

Access all your analytics data from any cloud region or storage service. Replicate changes made to analytics data for Databricks in any location or storage platform with guaranteed consistency using WANdisco LiveDeltaLake. Continue to use any of multiple storage services (e.g. ADLS Gen 1 and ADLS Gen2, or ADLS and S3) during operation or migration by applying WANdisco's high-performance coordination engine to keep your data accessible, accurate and consistent.

Replicate data across cloud environments

  • Azure: WASB, ADLS Gen 1, ADLS Gen 2
  • AWS: S3
Data from Hive to Delta Lake

LiveDeltaLake Data Migration on Azure between ADLS Gen1 and Gen2

WANdisco LiveDeltaLake provides continuous, consistent replication of analytics data across Managed Delta Lake on Databricks allowing the customer to leverage different cloud regions, storage systems or cloud vendors like Azure or AWS. In this demonstration, WANdisco's Paul Scott-Murphy migrates data from ADLS Gen1 to ADLS Gen2 storage while continuing to use the ADLS Gen1 environment.

 

Have more than 100TB on-premises?
We will move the first 5TB for free!

Jumpstart your data migration with WANdisco & Databricks.

See offer

GARTNER REPORT: "Liberate Applications for Migration by Disentangling Data"

How can data and analytics leaders resolve data entanglement during cloud migrations?

Get the Report
Liberate Applications for Migration by Disentangling Data

Get Started

Schedule a 1-on-1 consultation to see how we can help your enterprise.

Get Started

Email an expert

keyboard_arrow_down

Talk to us about making data movement reliable without downtime.

We use cookies to personalize content and to analyze our traffic. Please decide if you are willing to accept cookies from our website.