12,169 questions with Azure Data Factory tags

Sort by: Updated
1 answer

Not able to create ADF due regional constraint in student free tier account

Not able to create Data Factory due to the below error-

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,169 questions
asked 2025-08-10T05:47:26.1366667+00:00
#AVINASH CHAURASIYA# 0 Reputation points
commented 2026-06-12T14:40:32.3866667+00:00
SukritaMadhi-3206 0 Reputation points
3 answers

Azure Data Factory Private endpoint for Portal Endpoint

Hi Team, We are looking for recommendations and best practices around configuring the portal private endpoint for Azure Data Factory in a multi-VNET environment. Current setup: We have multiple ADF instances owned by separate teams. Each ADF has its…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,169 questions
asked 2026-06-05T12:04:07.2533333+00:00
Sumit Gaur 455 Reputation points
answered 2026-06-11T05:05:54.5533333+00:00
Smaran Thoomu 35,375 Reputation points Microsoft External Staff Moderator
2 answers

Azure Data Factory Copy activity failing due DNS resolution issue

We have a Data Factory in which our Data Engineers have created a copy activity to pull data from a SQL server which is hosted inside a Azure VM and this VM also act as a SHIR and the target is a storage account and we the same VM as the SHIR. The VM and…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,169 questions
asked 2026-06-05T12:43:11.58+00:00
Sahil Chaudhry 20 Reputation points
commented 2026-06-11T03:05:25.4766667+00:00
Pilladi Padma Sai Manisha 9,945 Reputation points Microsoft External Staff Moderator
2 answers

Azure Data Factory Dataverse to SQL - Timeout failures when creating table.

I'm getting repeated and consistent timeout failures during the DataverseToSQL pipeline step of the following guide. The process fails due to a timeout when attempting to create a table on the SQL server. What can I do to resolve this? …

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,169 questions
asked 2026-06-08T14:11:03.27+00:00
Jordan Fulford 1 Reputation point
commented 2026-06-11T03:04:53.8633333+00:00
Pilladi Padma Sai Manisha 9,945 Reputation points Microsoft External Staff Moderator
2 answers

Autoupdate on SHIR seems to have re-nabled and forced a restart of the SHIR service

On April 27th we had an issue with batch jobs that caused delays on key business process, which drew quite a bit of attention. After some initial investigation it was found that the overnight jobs failed because the SHIR they were running on had the SHIR…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,169 questions
asked 2026-05-21T13:05:18.35+00:00
Marsden, Padraic 0 Reputation points
answered 2026-06-10T18:12:00.2366667+00:00
Manoj Kumar Boyini 16,725 Reputation points Microsoft External Staff Moderator
1 answer

Timestamp being logged incorrectly some of the time.

I have an ADF pipeline that starts by writing utcnow to a string pipeline variable, then performs operations with assorted casts to different form factors with formatdatetime, including several script blocks that log to a snowflake log table, all based…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,169 questions
asked 2026-05-05T19:57:37.6533333+00:00
Greg R 0 Reputation points
commented 2026-06-10T17:38:19.7633333+00:00
SAI JAGADEESH KUDIPUDI 3,385 Reputation points Microsoft External Staff Moderator
3 answers One of the answers was accepted by the question author.

Data factory - Azure Key Vault (Preview) Activity - bug?

The Azure Key Vault Activity in data factory (in preview) does not do anything - settings tab just says azure-key-vault-activity-settings works! Is this expected?

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,169 questions
asked 2026-06-04T08:40:23.46+00:00
Oliver Mills 40 Reputation points
accepted 2026-06-10T09:34:47.3833333+00:00
Oliver Mills 40 Reputation points
1 answer

Any changes happened in the backend of Parse JSON Mapping data flow in ADF in Feb Week 2

Hi All, Is anyone else faced an issue with Json array not being parsed correctly in the ADF Mapping data flows. Earlier the string worked fined and able to parse the columns but it now shows Null Json Array is like [{"abc":"def",…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,169 questions
asked 2026-05-26T17:18:58.1433333+00:00
Piyush Jain 0 Reputation points
commented 2026-06-10T04:12:02.1333333+00:00
Pilladi Padma Sai Manisha 9,945 Reputation points Microsoft External Staff Moderator
1 answer

How to break ForEach loop in ADF

Hi everyone, I have a ForEach activity containing a Copy Data task. The Problem: By default, if one iteration fails, the ForEach continues to trigger all other iterations. In my case, if the first one fails, the following ones are guaranteed to fail as…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,169 questions
asked 2026-05-05T15:10:56.3066667+00:00
Fasd 0 Reputation points
commented 2026-06-09T10:16:05.9766667+00:00
SAI JAGADEESH KUDIPUDI 3,385 Reputation points Microsoft External Staff Moderator
1 answer One of the answers was accepted by the question author.

Schema Enforcement Strategy for Salesforce to Blob to Data Flow Pipelines

We have a common Azure Data Factory pipeline that extracts Salesforce data via SOQL, stages it as JSON in Blob Storage, and then loads it through Mapping Data Flows. We observed a case where a field such as BillingPostalCode was interpreted as integer…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,169 questions
asked 2026-06-08T15:49:39.93+00:00
Bilesh Ganguly 20 Reputation points
accepted 2026-06-08T18:07:11.16+00:00
Bilesh Ganguly 20 Reputation points
1 answer

Can a single ADF pipeline trigger multiple Azure ML pipelines in parallel when their inputs and outputs are independent?

I have an Azure Data Factory pipeline that orchestrates a multi-stage classification workflow. Right now every activity is chained one after another with success dependencies, so the whole pipeline runs strictly sequentially and takes a long time…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,169 questions
asked 2026-06-04T19:08:41.69+00:00
Inkey IT User 1 20 Reputation points
commented 2026-06-08T16:48:05.27+00:00
SAI JAGADEESH KUDIPUDI 3,385 Reputation points Microsoft External Staff Moderator
2 answers

Azure Data Factory: Inquiry on New Undocumented Property 'trustModeClaimForMi'

It looks like PG added a new undocumented property on data factory resource properties: "trustModeClaimForMi": { "value": "Enabled", "editable": true } Any ideas about this and any ETA when…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,169 questions
asked 2025-08-08T09:06:38.5766667+00:00
Janne Kujanpää 266 Reputation points
commented 2026-06-05T12:19:22.6+00:00
Janne Kujanpää 266 Reputation points
3 answers

How to copy data from google secops platform using ADF

Hi there, How to copy data from google secops platform using ADF Thanks & Best regards, zmsoft

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,169 questions
asked 2026-05-21T07:27:05.67+00:00
zmsoft 755 Reputation points
commented 2026-06-04T14:27:58.75+00:00
Pilladi Padma Sai Manisha 9,945 Reputation points Microsoft External Staff Moderator
4 answers

Some of the CDS connection copy activities in the Azure Data Factory pipelines have been stuck in the queue for a long time.

Today, the copy activities using the CDS connection have been stuck in the queue for a long time. Previously, these activities used to complete within minutes, but today they have been in the queue state for 3–4 hours.

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,169 questions
asked 2026-05-29T11:04:18.1833333+00:00
Dharma Teja Mukka 0 Reputation points Microsoft Employee
answered 2026-06-04T05:52:37.65+00:00
Dharma Teja Mukka (HCL AMERICA INC) 0 Reputation points Microsoft External Staff
2 answers One of the answers was accepted by the question author.

ADF Pipeline issues [Sev 2 ] [MAQ Software] - [ADF Pipeline Execution Delay – Pipelines Persistently Queued During Refresh Window]

Issue Description: We are currently facing an issue where multiple ADF pipelines are remaining in the Queued state for an extended duration during 5/29 refresh process. Pipelines that normally complete within a few minutes are now queued for more than 2…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,169 questions
asked 2026-05-29T14:41:08.0133333+00:00
Shruti Rastogi (Maq LLC) 20 Reputation points Microsoft External Staff
accepted 2026-06-03T06:54:22.42+00:00
Shruti Rastogi (Maq LLC) 20 Reputation points Microsoft External Staff
2 answers

Storage firewall blocking Snowflake stage access for ADF Oracle to Snowflake pipeline

Hi Azure Team, Our ADF pipeline (Oracle to Snowflake) is failing during Snowflake load with stage access error. Observed error: Operation on target Oracle to Snowflake_2024_v1 failed with SnowflakeOperationError. Failure using stage area. Status Code:…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,169 questions
asked 2026-06-01T09:32:54.8766667+00:00
Vashishtha, Kritika 0 Reputation points
answered 2026-06-02T20:41:47.4066667+00:00
Manoj Kumar Boyini 16,725 Reputation points Microsoft External Staff Moderator
2 answers

Data from FoxPro Onprem server to ADLS

Hi Team, We are using FoxPro 9.0 x3 server in our organization that has some logs with emaint data. I would like to know if there is any way I can download or import the data (.dbf files) to ADLS in Azure using the ADF. Fyi, I have server name and…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,169 questions
asked 2026-05-19T14:20:26.71+00:00
Nalini Bhavaraju 190 Reputation points
commented 2026-05-29T17:30:49.0733333+00:00
Nalini Bhavaraju 190 Reputation points
2 answers

Azure Data Factory PostgreSqlV2 connector incorrectly serializing DATE columns as internal .NET type name

We are experiencing a sudden issue with an Azure Data Factory pipeline that extracts data from a PostgreSQL source and writes to Parquet files. Since yesterday, the pipeline has started failing without any deployment or configuration changes on our…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,169 questions
asked 2026-05-20T08:58:19.4366667+00:00
djemtc 0 Reputation points
commented 2026-05-27T10:45:18.9133333+00:00
Pilladi Padma Sai Manisha 9,945 Reputation points Microsoft External Staff Moderator
0 answers

Join: Microsoft Azure Q&A Champions Program

The Microsoft Azure Q&A Champions Program recognizes and empowers a global community of internal and external Azure experts who help customers succeed by providing high-quality, trusted answers on Microsoft Q&A. The program scales expert led…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,169 questions
asked 2026-05-25T23:37:24.3633333+00:00
Ashley Swearingen 0 Reputation points Microsoft External Staff Moderator
answered 2026-05-25T23:37:45.3633333+00:00

AI answer

2 answers

Quote character and escape character in ADF

Hi, We need to load data from delimited file in storage account to table in dedicated sql pool.. All the record values are enclosed with double quotes (" " ) and column delimiter is pipe (|) For example :- …

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,169 questions
asked 2023-02-23T05:02:01.5533333+00:00
M, Murugeswari (Cognizant) 461 Reputation points
commented 2026-05-25T14:14:21.7+00:00
Jinka Chandra Kiran 0 Reputation points