Your HTTP linked service should use anonymous authentication and a parameter for passing in a dynamic URL. The sink components are not discussed in this post, additional detail and examples of Azure Data Lake Gen2 connectors can be found here.
FILR FACTORY FULL
Have full control of all site collections Read and write items in all site collectionsĬreate, edit, and delete items and lists in all site collections Based on requirements, the user assigned managed identity can be assigned the following rights. It’s not possible to assign Graph API access rights to a user assigned managed identity in the Azure Portal. Grant Graph API Access Rights to the User Assigned Managed Identity
FILR FACTORY DOWNLOAD
Therefore, we can use an anonymous HTTP connection to complete the download in the copy activity. In contrast, the Microsoft Graph API short-lived pre-authenticated download URLs ( do not require an Authorization header to download a file.
As a result, a bearer token must be obtained and used in the copy activity. The HTTP connector doesn’t support managed identity authentication. When using the SharePoint v1 API an Authorization header is required. As a result, we can cut out the work of setting up service principals, managing those service principal credentials in Azure Key Vault and obtaining those service principal credentials at Azure Data Factory runtime.Ĭopy activities in both the SharePoint v1 and v2 APIs are executed using an HTTP connector. The biggest benefit to this approach is that there is no need to obtain and pass around a bearer token.
The recommendation from Microsoft is that all SharePoint API calls use the SharePoint Online v2 API (Microsoft Graph API) instead. Why use the Microsoft Graph API over the SharePoint APIĪ lot of existing documentation, including the official ADF documentation, references the SharePoint v1 API, but the v1 API is now considered legacy.
FILR FACTORY HOW TO
In this post we’re discussing how to copy files from SharePoint Online using Azure Data Factory, the Microsoft Graph API and managed identity authentication. Azure Data Factory, graph api, managed identity, sharepoint Copy Files from SharePoint Online using Azure Data Factory and the Microsoft Graph API