Azure Databricks SCIM provisioning with Private Link configured - azure

I have Azure Databricks workspace hidden inside VNET and configured with Private Link, following instruction from Microsoft.
Now I'm trying to do SCIM provisioning with this workspace and I'm getting following error.
When I tried with workspace without Private Link then everything works fine.
Is there any solution to use SCIM provisioning with workspace which has Azure Private Link configured?

Azure AD's SaaS Application SCIM provisioning service requires internet-accessible endpoints. Your usage of the Private Link feature isn't going to play nicely with that, given the endpoint isn't internet accessible.
This feature may help, though: https://learn.microsoft.com/en-us/azure/active-directory/app-provisioning/on-premises-scim-provisioning
In a nutshell, it allows you to do SCIM provisioning via an agent (hosted on a server that IS internet accessible), which can then talk to other non-internet accessible servers on the same network. You'll have to use the generic SCIM provisioning features here and may need to customize some attribute mappings as a result, as the Databricks-tailored gallery app is only available for internet-facing instances of Databricks at this time. Beyond that, I think the on-premises provisioning feature should help here.

One option could be to set publicNetworkAccess to true to be able to access the control plane both publicly and via private endpoint. I guess the provisioning service would be able to talk to the Databricks control plane that way.
Now the downside is that, well, your control plane could be accessed publicly. But you could mitigate that by imposing a conditional access policy in your Azure AD tenant to force all authentication callbacks to originate from your own VNets.

Related

Programmatically create a service SAS token for Storage Account in Azure

From the Azure portal I would like to programmatically and periodically create a service SAS token. Once a token has been created it should expire in one week and a new token also valid for one week will be created and so on. I was reading this article https://learn.microsoft.com/it-it/azure/storage/blobs/sas-service-create?tabs=dotnet but I am not very sure about where that code should run, in a Azure VM? I can't give internet access to the VM
The code from the article can be run from any compute service.
If that is the sole purpose of the compute resource, I would pick Logic Apps to have everything managed for you; it may have a connector to do it or you can embed some JavaScript.
Should that not be sufficient, I would use an Azure Function.
You can also use a VM if that is more suitable and restrict/block its internet access.
If you need to restrict internet access, you must be sure your blob storage is reachable, your options are:
Open whichever firewall/NSG to that storage account
Using service endpoints, service endpoint policies
Project a Private Link endpoint into the VNET from the storage

Not Getting option to change to manual SCIM Provisioning

How I can change the option of scim provisioning from automatic to manual in Azure ?
It is enabled only when there is no automatic Azure AD provision connector available
Manual provisioning means there is no automatic Azure AD provisioning
connector for the app yet. User accounts must be created manually, for
example by adding users directly into the app's administrative portal,
or uploading a spreadsheet with user account detail. Consult the
documentation provided by the app, or contact the app developer to
determine what mechanisms are available.

Azure Private Link - delete private link does not appear to work properly

I am working with the Private Link preview feature. I was able to get it configured properly and working as expected over an ExpressRoute circuit. I then needed to move it to another subnet as the subnet it was on required a Microsoft Storage endpoint.
Since service endpoints and private links cannot exist on the same subnet I decided to delete the private link and set up the service endpoint. The private link seemed to delete successfully and no longer showed in the portal.
The problem is when I went to set up the service endpoint Azure thinks there are still private links configured on the subnet and the creation of the service endpoint fails. Anyone seen this before and/or how to fix?
I also face the same issue that it seems currently it's impossible to restore the subnet to enable service endpoints once you have started a private link to an Azure service like storage account in the same subnet even I have removed the private links, private DNS zone, storage account, etc.
You could request a feedback to improve this product as the Azure private link is in preview.
Important
This public preview is provided without a service level agreement and
should not be used for production workloads. Certain features may not
be supported, may have constrained capabilities, or may not be
available in all Azure locations. See the Supplemental Terms of Use
for Microsoft Azure Previews for details. For known limitations, see
Private Endpoint and Private Link Service.
Update
I have contacted MSFT PG, they said that
This is a known limitation documented here, they are working on removing limitation by the end of October.

Disabling Azure Active Directory RBAC in Azure Kubernetes Service

Is it possible to temporarily disable Azure Active Directory RBAC in Azure Kubernetes Service? The reason I ask is because we are unable to set up automated tasks (like continuous integration) because authenticating against kubectl now requires human intervention to complete device code auth - I have another post here regarding that. Perhaps even just disabling Kubernetes RBAC will bypass the need to authenticate with AD? I would do this until a solution to the issue is available.
Although there is no document exactly say that you cannot disable the RBAC of an existing AKS cluster. But it shows that enabling role-based access control (RBAC) on existing clusters isn't supported at this time. In my opinion, it also means that you cannot disable the RBAC on existing AKS cluster. And it seems there is no way to achieve it, no matter Azure CLI, PowerShell or REST API.
I think the RBAC is a setting for AKS cluster and it could not be changed after it created now. We can expect that it could be changed in the future. Hope this will help you.

Is there any instace profile available in Azure like in AWS

An instance profile is a container for an IAM role that you can use to pass role information to an EC2 instance when the instance starts.
http://docs.aws.amazon.com/IAM/latest/UserGuide/id_roles_use_switch-role-ec2_instance-profiles.html
A mechanism very similar to AWS instance profiles is Managed Service Identity (MSI) for Azure, which was announced in September 2017, though at the time of this writing, it is still in preview. I didn't try it out yet, but it does work the same way as instance profiles on AWS do, by automatically authenticating the VM to a meta-data service and allowing you to query for additional credentials without having to hardcode it into your code or image.
Azure also supports IAM.
Microsoft Azure identity and access management solutions help IT protect access to applications and
resources across the corporate data center and into the cloud. This enables additional levels of validation,
such as multifactor authentication and conditional access policies. Monitoring suspicious activity through
advanced security reporting, auditing and alerting helps mitigate potential security issues.
More detailed information please refer to this link.
Update:
You do have the ability to create Signed Access Signatures for all three Windows Azure Storage services (BLOBs, Queues and Tables) as well as for Windows Azure Service Bus Brokered Messages (Queues, Topics & Subscriptions). I have a similar question with you, maybe you could check.
I found Azure is not support instance profile like aws.
If bind a role to instance on aws, aws system will generate a temporary api access token and write to metadata server.
Aws sdk will auto fetch access token from metadata server, so a service that uses aws sdk does not need to configure sdk's access token.
But Azure's IAM and SAS(shared access signature) and metadata server, is not support mechanism like above.

Resources