Connect to Fivetran
Fivetran automated data integration adapts as schemas and APIs change, ensuring reliable data access and simplified analysis with ready-to-query schemas.
You can integrate your Databricks SQL warehouses (formerly Databricks SQL endpoints) and Azure Databricks clusters with Fivetran. The Fivetran integration with Azure Databricks helps you centralize data from disparate data sources into Delta Lake.
Connect to Fivetran manually
Before you connect manually
Before you connect to Fivetran manually, you must have the following:
A cluster or SQL warehouse in your Azure Databricks workspace.
The connection details for your cluster or SQL warehouse, specifically the Server Hostname, Port, and HTTP Path values.
An Azure Databricks personal access token. To create a personal access token, follow the steps in Azure Databricks personal access tokens for workspace users.
Note
As a security best practice, when you authenticate with automated tools, systems, scripts, and apps, Databricks recommends that you use personal access tokens belonging to service principals instead of workspace users. To create tokens for service principals, see Manage tokens for a service principal.
Manual steps
To connect to Fivetran manually, do the following:
Sign in to your Fivetran account, or create a new Fivetran account, at https://fivetran.com/login.
Important
If you sign in to your organization's Fivetran account, a Choose Destination page may display, listing one or more existing destination entries with the Databricks logo. These entries might contain connection details for compute resources in workspaces that are separate from yours. If you still want to reuse one of these connections, and you trust the compute resource and have access to it, choose that destination and then skip ahead to next steps. Otherwise, choose any available destination to get past this page.
In your Dashboard page in Fivetran, click the Destinations tab.
Click Add Destination.
Enter a Destination name and click Add.
On the Fivetran is modern ELT page, click Set up a connector.
Click a data source, and then click Next.
Follow the on-screen instructions in the Setup Guide in Fivetran to finish setting up the connector.
Click Save & Test.
After the test succeeds, click Continue.
On the Select your data's destination page, click Databricks on Azure.
Click Continue Setup.
Complete the on-screen instructions in Fivetran to enter the connection details for your existing Azure Databricks compute resource, specifically the Server Hostname and HTTP Path field values, and the token that you generated earlier.
Click Save & Test.
After the test succeeeds, click Continue.
Continue to next steps.
Additional resources
Explore one or more of the following resources on the Fivetran website: