I am using repos for Azure DevOps to connect Azure databricks to my respositories in DevOps. I need to pull automatically from Azure DevOps pipelines. For that I tried using databricks API to pull, but referring to this link there is no method for pulling.
Following the instruction and looking at swagger the only methods available are:
Is there a way to pull via API or CLI or any other way programmatically? If yes, how?
You need to use PATCH endpoint as described in documentation. It will Updates the repo to the given branch (or tag) - if you already on the given branch, then it will pull the latest changes. You can also use databricks-cli for that, like, it's shown in the following demo.
Related
I have a newly created ADF and I will have to configure the repository with the ADF. I have almost 100 count pipelines, their related datasets, linked services, triggers in the repository. How can I load all the pipelines and their respective into the ADF. Once I configure the git with the ADF I am unable to see the pipelines. Any thoughts?
Did you select the below option when configuring the repo?
If yes double check the Root folder path. If it's not set accurately you will not be able to see pipelines, dataset etc.
I followed the steps below to configure GitHub repo in ADF. Please make sure you also followed the same steps.
Enter name of GitHub repository owner. After this you will be redirected to login page of GitHub.
Authoring directly with the Data Factory service is disabled in the
Azure Data Factory UX when a Git repository is configured. Changes
made via PowerShell or an SDK are published directly to the Data
Factory service, and are not entered into Git.
Select your repository and fill required details.
You will get all Pipelines and Datasets as shown in below screenshot.
For more information follow GitHub integration best practices
We configured Azure Api Management and as part of it the Azure Repository where it should sync its configuration to.
Unfortunately we selected the wrong repository. Now we are unable to switch the Repository as any option for doing it is missing in the Api Management.How to change the repository in Api Management?Thanks for any advise
It was a misunderstanding on my part. Everything works as described in the Microsoft documentation. I meant the repository of Apim is the one we have to set up in Git/Tfs, which is of course not so. Apim has its own repository and we can use for example powershell to read the data from that repository and upload it to our own repository or vice versa.
I've been looking around for a while now but I can't seem to find a way to get push messages from the azure devops team for their release notes regarding the azure devops service. I would like to be able to incorporate the changes/release notes into a teams channel (the app). I was surprised by a change to the GET git repo list api url. Which broke some stuff.
I can't really find any way to subscribe to changes to their service, other then to watch the ms-documentation github repo.
What are the ways in which you make sure you are not surprised by breaking changes?
Testing this API: Repositories - List, we can still retrieve git repositories under this project.
In addition, sprint-184-update for Azure DevOps service brings new feature: Disable a repository.
And by reference to this doc: Build Azure Repos Git or TFS Git repositories, Azure DevOps enables some limitation to Azure Pipelines regarding to Azure Repos Git repository like Limit job authorization scope to referenced Azure DevOps repositories. Please check it.
Update>>This API: GET https://dev.azure.com/{organization}/{project}/_apis/git/repositories?api-version=6.1-preview.1 does the same thing to retrieve git repositories.
And Azure DevOps service doesn't provide notifications about repositories changes(Add, Delete), see: Supported subscriptions for details. Also currently official released APIs list here: Azure DevOps Services REST API Reference.
BTW, you can create a new suggestion ticket here. The product group will review these tickets regularly, and consider take it as roadmap.
Is it possible to create automatic pull requests against a specific branch on Azure Repos as PR triggers do not work in Azure Repos. I am new to working with Azure repos and any help would be appreciated. Thank you.
There is no way to directly do it on Azure Devops, but you can use Create Pull Request extension to create Pull Request whenever you do a build.
I have created Azure Data Factory with Copy Activity using C# and Azure SDK.
How can deploy it using CI/CD ?
Any URL or link will help
Data Factory continuous integration and delivery is now possible with directly through the web user interface using ARM Templates or even Git (Github or Azure DevOps).
Just click on "Set up Code Repository" and follow the steps.
Check the following link for more information, including a video demostration: https://aka.ms/azfr/401/02
One idea that I got from Microsoft was that using the same Azure SDK you could deserialize the objects and save down the JSON files following the official directory structure into your local GitHub/Git working directory
In other words you would have to mimic what the UI Save All/Save button does from the portal.
Then using Git bash, you can just commit and push to your working branch (i.e. develop) and from the UI you can just publish (this will create an adf_publish release branch with the ARM objects)
Official reference for CI using VSTS and the UI Publish feature: https://learn.microsoft.com/en-us/azure/data-factory/continuous-integration-deployment
Unfortunately, CI/CD for ADF is not very intuitive at first glance.
Check out this blog post where I'm describing what/how/why step by step:
Deployment of Azure Data Factory with Azure DevOps
Let me know if you have any questions or concerns and finally - if that works for you.
Good luck!
My resources on how to enable CI/CD using Azure DevOps and Data Factory comes from the Microsoft site below:
Continuous integration and delivery (CI/CD) in Azure Data Factory
I am still new to DevOps and CI/CD, but I do know that other departments had this set up and it looks to be working for them.