I am trying to configure a Release Pipeline to use a repo hosted in a publicly exposed GitHub Enterprise instance but I am unable to access the Service Connection to the GitHub Enterprise repo.
I can setup a Service Connection to the Github Enterprise repo and verify the same but this connection is not available when adding an artifact to the Release Pipeline. I can add it to a Build Pipeline but not a Release Pipeline. In my case I need to deploy a Azure Resource using an ARM Template which is in the git repo and hence there is no "build" step involved and thus there is no need to create a Build Pipeline. I am using the "Azure Resource Group Deployment" task.
I have been able to setup and execute a Release Pipeline against a git repo hosted within the same Azure DevOps project very easily and expected to use the GitHub Enterprise hosted git repo just as easily.
Release pipeline doesn't support GHE yet. As a workaround, you can create a Build Definition that can connect to GHE and produce and artifact. Release pipeline can consume the artifact from the build pipeline.
Related
im trying to deploy some synapse artifacts to a synapse workspace with devops repo integration via a python runbook. By using the azure-synapse-artifacts library of the python azure sdk the artifacts are published directly to the live mode of the synapse workspace. Is there any way to deploy artifacts to a devops repo branch for synapse? Didnt find any devops repo apis or libaries, just for the direct integration of git.
We can use CICD in this case, as this process will help to move entities from one environment to others, and for this we need to configure our synapse work space as source in GIT.
Below are few straight steps we can follow:
Set up Azure Synapse workspace and configure pipeline in Azure Devops.
Under staging while creating DevOps project, we can select Add Artifacts and select GIT.
Configure the workflow file and add workflow.
You can refer to MS Docs for detailed explanation of each step in achieving this task
I am looking for a sample ARM template which can setup my Azure DevOps repository into Azure Databricks. This will help me deploy my Master branch directly on ADB workspace.
I tried to do manually on portal and it works, but the repos path for the notebooks shows my email_id, which is not good in Production.
I want to configure through a Powershell OR an ARM template while creating Databricks. The same problem I am facing on Azure dataFactory as well.
Please help me resolve it.
It's not possible as of today - there is no API for creating a checkout. It will be possible only when Databricks Repos will start to provide corresponding API for creating the checkouts of repositories, not only "Update checkout" API that is available right now.
If you're concerned with the checkout created in your own folder, you can just create a Folder inside Repos, call it like "Production", and then do checkout inside that folder (pictures are taken from my demo of Repos with Azure DevOps):
To deploy Notebooks from your master branch to another workspace, I would recommend to trigger a deployment pipeline from the master branch onto the target databricks worskpace.
That way, no need to setup Repos in the target environment.
You use Repos in your development workspace (with your email in path)
You commit to the branch you work on and eventually merge / PR to master
Once on Master branch, a DevOps pipeline is triggered and deploys the notebook to your target workspace on the path you want
Boss wants me to set up a pipeline in Azure Devops to our Gitlab repos. I have a few questions:
Do I set it up under "Git other"? Should I mirror the repositories into Azure Devops?
I am supposed to set it up with a docker image, do I need to use docker hub?
I've never set up a pipeline and I am just a lost intern, thanks for any advice.
Do I set it up under "Git other"?
Yes, you could use the Git other to create a Service connections for the
GitLab. And there is an extension GitLab Integration for Azure Pipelines,
which could be able to download the sources from a GitLab repository (using
clone command) and use downloaded sources in Azure Pipelines.
Should I mirror the repositories into Azure Devops?
If you have no plans to migrate gitlab repo to azure devops repo, you do not need to mirror the repositories into Azure Devops. Besides, just as LJ said, since the YAML structure does not support for Gitlab at this moment, we could not use YAML structure with Gitlab repo.
I am supposed to set it up with a docker image, do I need to use
docker hub?
This is a matter of taste. In addition to dikcer hub, you can also use Azure Container Registry.
Do I set it up under "Git other"? Should I mirror the repositories into Azure Devops?
If you want to set up the pipeline using the YAML structure and have all the features that Azure DevOps provides, you have to mirror the repository since it's not possible yet to use the YAML file to run pipelines directly from GitLab and Git other connection has some limitations.
I am supposed to set it up with a docker image, do I need to use docker hub?
For the pipeline environment, you can use VM Images provided by Azure.
I've gotten the capability about "deploy the build artifacts to on-premise server". But I am not sure if Azure pipeline can connect to Bitbucket to fetch the code then do the build.
Yes, try to add a new service connection and grant permission for your pipelines.
Here is how you can connect it:
From this point, you should be able to create your pipelines from the code on bitbucket.
Azure DevOps Pipeline : How to release Project binary file into Azure.
How can I deploy project binary files into server using Azure Pipeline, don't want to release project full source code?
You would do something like this.
create a deployment group
create a build, configure it
create a release, configure it (get artifacts from build, deploy to deployment group)
These are the steps you need to perform. link has more information on this matter