Setting up a Self-Hosted Integration Runtime in ADF is essential for organizations that need to move data securely between on-premises environments and the cloud. The SHIR acts as a bridge, enabling ADF to access data on servers, private networks, or virtual machines that aren’t directly accessible from Azure. This guide outlines a step-by-step approach to setting up SHIR, ensuring a secure and seamless data integration experience.
Step 1: Creating the Self-Hosted Integration Runtime in ADF
Begin by logging into your Azure portal and opening your Azure Data Factory instance.
In the ADF Studio, click on the Manage tab located on the left-hand panel.
Under the Connections section, select Integration runtimes. Click the + New button to create a new integration runtime.
A wizard will appear—choose Self-Hosted, then click Continue. Assign a descriptive name to your runtime, such as OnPrem-IR or DataGateway-IR, making it easier to identify, especially when managing multiple runtimes.
Upon creation, Azure will generate an authentication key unique to your runtime. This key is crucial for registering your SHIR with ADF during installation. Copy the key from the portal or download it securely as a text file. Safeguard this key, as it allows ADF to authenticate your machine and establish a secure link.
Step 2: Downloading the Integration Runtime Installer
After setting up your Self-Hosted Integration Runtime in ADF portal, you’ll be prompted to download the Integration Runtime installer.
Click the Download button to get the official package directly from Microsoft. The installer is lightweight and compatible with any supported Windows machine that can access both the internet and your on-premises data sources. Before installing, ensure that your machine meets these prerequisites:
- Windows Server 2012 R2 or later (or Windows 10/11 for testing)
- .NET Framework 4.7.2 or newer
- Reliable internet connectivity
- Administrative rights to install software
Downloading directly from the Azure portal guarantees you have the latest, most compatible version of the Integration Runtime.
Step 3: Installing and Registering the Integration Runtime
Once downloaded, run the installer on your on-premises machine. The setup wizard will walk you through the installation process. You may accept the default installation path or specify a custom location according to your organization’s policies.
Upon successful installation, the Integration Runtime Configuration Manager will launch automatically. Here, you’ll need to register this runtime with Azure Data Factory.
Return to the ADF portal, copy the authentication key you saved earlier, and paste it into the registration field within the Configuration Manager. Click Register.
If registration is successful, the Configuration Manager will indicate that the runtime is now connected to your Azure Data Factory environment. This establishes a secure communication channel between your on-premises infrastructure and Azure, enabling data movement as required.
Step 4: Verifying Successful Setup
Go back to the ADF portal, navigate to Integration runtimes under the Manage section, and confirm that your new Self-Hosted IR is listed and its status shows Online. If the status is Offline, check the following:
- The Integration Runtime service is running on the machine
- The server has an active internet connection
- Firewall or proxy settings are not blocking outbound connections to Azure
When the configuration is correct, the runtime status updates to Online, confirming a successful installation. Your SHIR is now ready to facilitate secure data transfers between on-premises sources—like SQL Server, file shares, or SAP systems—and the cloud.
Conclusion
Deploying a Self-Hosted Integration Runtime in ADF is a critical step for hybrid data integration. By creating the IR, downloading and installing the software, registering with the authentication key, and verifying its connection, you ensure secure, reliable, and scalable data movement. This process empowers organizations to leverage the flexibility of Azure Data Factory while maintaining control and security over their on-premises data assets.
Watch the full video here: