How to Monitor AzureDataFactory pipelines through .net code - azure

I have multiple pipelines in adf. How to monitor them using Program, to get the status of all the pipelines. The difficulty I am facing, I am not sure where to find the applicationID and authenticationKey for that DataFactory.

You will have to generate the application ID and application key by creating a new application in Azure active directory. Once created then you have to assign the role to that app.
you can go through following link to get generate the application id and application key: Create azure active directory application
For monitoring, there are various ways to monitor the pipeline by using the the powershell script, .NET SDK or Azure portal.
Please check the following link to monitor pipeline using .NET SDK:Monitor and manage ADF v1
Hope this helps,
Jai

Related

How to backup azure logic apps?

Is there any way to backup Azure logic app like Azure app service using azure powershell or from Azure portal?
You can use Visual studio plugin to design Logic apps and commit them from there directly to Azure devops. This way you can build & test locally and deploy once ready with code commit.
Refer following two articles for details
Automate Logic apps deployment using #Azure resource manager
https://learn.microsoft.com/en-us/azure/logic-apps/logic-apps-azure-resource-manager-templates-overview
& how to design logic apps using visual studio:
https://learn.microsoft.com/en-us/azure/logic-apps/manage-logic-apps-with-visual-studio
You can also use this Logic Apps ARM Template Creator powerShell script for easy repo storage (backup) and deploy from DevOps:
https://github.com/jeffhollan/LogicAppTemplateCreator

Adding pipeline trigger from separate project in azure

I have two projects in azure, need to trigger pipeline from pipeline in the another project. I installed the extension 'triggers azure devops pipeline' from marketplace.
Please help me with configuring this extension in the yaml file
[Please see the screenshot of my yaml file and extension]: https://i.stack.imgur.com/RGOJ4.png
The azure devops service connection dropdown of the 'triggers azure devops pipeline' extension is not displaying any value
According to your screenshot , it seems that you haven't created a Azure Devops API service connection.
You could navigate to Project Settings -> Service connections and create a Azure Devops API service connection.
Note: the Personal Access Token needs the following rights:
1.Triggering a Release: Release – Read, write & execute – Build Read & Execute
2.Triggering a Build: Build Read & Execute
Then you could get the Azure Devops Service Connection in the target task.
For more information, you could refer to the introduction of the extension.
Hope this helps.

Deploy azure data factory v2 app

I'm trying to find any way to publish my console app (.net) written for azure data factory v2.
But could not find any solution.
More details would be really appreciated but if you mean that you are using the .NET SDK to create ADF V2 objects, my understanding is that there is no such thing as publish compared to the new User Interface in the portal where you create/edit the objects first and then you click on publish.
if you use the library they get automatically uploaded to ADF V2 and you can easily test that now with the new UI.
It would be useful to have a bit more info on your context. You're talking about running a custom activity from an Azure Batch account? What did you try already?
When running a custom activity, you'll have to upload your executable + depedencies to an Azure storage account. Create a blob container and copy the files there. Then you'll have to configure the activity to use this storage account and the point it to the right container.
If you're asking for a deployment like a right-click -> deploy option, it doesn't exist. I've automated my deployments using PowerShell, using Set-AzureStorageBlobContent to write the files to the Storage account.

How to invoke exe file through Azure Data Factory?

We have one windows application installed in Azure VM. We want to execute that application using Azure so that we will be able to monitor execution of this application using Azure portal.
Is there any way to invoke an executable present in one Azure VM using Azure Data Factory pipeline or some other service present in Azure?
What does the exe do? Is it a console app?
Generally, I think it's possible.
This can be achieved by using ADF Custom Activity. You may rewrite your app as a custom activity, which will be run in Azure Batch VMs.
If your app can't be run in Azure Batch, you will have to enable something like PowerShell remoting, so that exe can be launched remotely. Caveat is, even in this case, you will still need a Custom Activity / Azure Batch as invoker, since ADF Pipeline itself can't do remote call or run custom code.
Hope this will help.

Continuous deployment from Visual Studio Team Services to Azure App Service

I'm trying to automatically deploy from Team Services (was Visual Studio Online) after a successful build a C# program to an azure app service without success.
I can only do it to a cloud service (classic) rather app service.
I've seen that I could plug Team Services directly to the app service with "deployment source" (I did tried so far because both tenant, Team Services & Azure one are different and requires some effort)
but wouldn't it break the normal release / test process from Team Services?
I can only find little information over internet regarding these topics ...
Any help would be appreciated.
You can also add a FTP Upload task in your build definition to publish the output to Azure App Service via FTP Method.
To publish to an Azure App Service, you need to use either of the following Agent tasks:
Here is a walkthrough: https://www.visualstudio.com/en-us/docs/build/apps/aspnet/aspnet4-to-azure
When making a new build definition, it is easiest to choose the Deployment -> Azure WebApp option.

Resources