How do you delete a pipeline trigger in Azure Synapse Analytics with the UI?
What's the problem?
I currently can't publish my workspace changes. I get the following error:
TestTrigger1
Trigger 'TestTrigger1' cannot be activated and contain no pipelines
This is correct. I disconnected TestTrigger1 to try a different trigger. However now I can't publish and I can't delete the trigger in the UI either.
In Data Factory, there is a UI option in the bottom left of the pipelines screen to delete. See this blog post.
However in ASA, there is no UI option for managing triggers and I can't find one.
How do I delete this trigger so I can republish?
In Azure Synapse, you can see all the triggers under the Integration section under the Manage tab. If you have right permissions you should be able to see the delete button wHen you hover your mouse overt the trigger you want to delete.
Related
I´ve created an Azure Synapse Analytics Pipeline that must be triggered by the creation of a file within a Azure Gen2 storage account.
Somehow the blob creation event (i.e. when I upload the file in the corresponding container and folder) doesn´t fire anything and the pipeline does not start. I´ve registered the Microsoft.EventGrid and Microsoft.Synapse resource providers in the subscription, as suggested by the Microsoft official documentation.
Am I missing anything? As far as I know, and according to the Microsoft documentation and the many tutorials I've read, I don´t need any Event Topic/Event subscription...
Can you please check the content type of the file :
usually when that is blank, event trigger is not initiated
I tried to reproduce your scenario in my environment, and it works for me (i.e., when I upload the file in the corresponding container and folder). Let me share my implementation and then you can compare with yours.
This is the setup for the trigger
The trigger is firing as expected.
Files uploaded date time
Trigger firing date time
I still didn´t figure out what is not working, so I implemented a workaround: a simple ADF pipeline looping for files in the landing zone. The pipeline is associated with a normal schedule trigger (it runs 3 times a day) and it calls in turn the pipeline I originally wanted to be triggered by the file creation trigger.
I want to have a control in Azure regarding new and deleted items
I need a query to know "who" and "when" a resource is created or deleted in Azure
Is this possible? How can I do this query?
I need a query to know "who" and "when" a resource is created or
deleted in Azure
Is this possible? How can I do this query?
Whenever a resource is created or deleted, information about that operation is stored in Azure Activity Logs. You should be able to find the information by querying that.
Another alternative would be to make use of Azure Event Grid and subscribe to Subscription Events. You can subscribe to Microsoft.Resources.ResourceWriteSuccess (for creation/updation of resources) and Microsoft.Resources.ResourceDeleteSuccess (for resource deletion) events and take action on these events in near real time.
Within the Azure Portal, you can view these types of events from the past 90 days in the Activity Log blade.
For access to events occurring more than 90 days in the past, you need to pre-emptively set up log archival as detailed in the Export the Azure Activity Log article.
If you are planning to use the export Activity Log feature, please make sure you use the new diagnostic setting feature on Azure subscription to export Activity Logs. This feature offers multiple improvements over the old features such as Logprofiles or the Activity Log solution (Log Analytics).
https://learn.microsoft.com/en-us/azure/azure-monitor/platform/activity-log-collect
https://learn.microsoft.com/en-us/azure/azure-monitor/platform/diagnostic-settings-template
I have to create a Logic App using the Event Grid, so whenever a new file is created/uploaded in our General Purpose V2 Storage Account it should post a message in slack. This is how it currently looks like.
However, once one file is created/uploaded nothing shows up in slack. There aren't any runs in the "Runs history" and trying to press the button to "Run Trigger" causes the this error.
I also tried to create the Grid Topic and use the Event Grid Subscription for it, yet I got the same error.
Does anyone knows how to solve this problem?
There is no problem with your trigger from your picture. There aren't any runs in the Runs history, this means your trigger is not triggered.
Note:When a resource event occurs this trigger could only be triggered by the blob file modification including creating blob and renaming. If your action is the container modification, it won't trigger it. And you could check the See trigger history.
And about your trigger error Failed to start a logic app run, this is because you run the trigger in the portal, the expression #triggerBody() will be null it won't trigger the flow.
Then I test with different storage account and different logic app ,all of them could be triggered.
Hope this could help you, if you still have other questions,please let me know.
Register EventGrid as a Resource Provider in your Subscription.
Usecase: Trigger Azure Function only for predefined Azure activity logs.
I tried to configure Azure Activity logs and Export to Event Hub, but it won't allow Filter set on it. As per Azure document, the filter settings do not have an impact on export settings.
My usecase is to trigger an Azure Function only for a specific set of activity logs (say VM, VNet, NSG Create/Delete/Modify). What other Azure services can I use to accomplish this?
One option, but with some constraints, is to create Alerts at Resource Group level or even for specific resources. Alerts provide some flexibility in filtering specific events for which you would want to trigger an Action, say an Azure Func in your case.
I was thinking Azure Logic Apps would do this as well. However, to my surprise I could not find an option to add Activity Log as a trigger. Probably, it would come in the future. As Azure is updated quite frequently, keep checking every now and then to see if you get any new options to do this.
I can successfully save my logs to Table store for a continuous WebJob, following these instructions:
https://azure.microsoft.com/en-us/documentation/articles/web-sites-enable-diagnostic-log/
However, if I make the WebJob scheduled (runs once every 5 mins), the logs do not show up in Table store. Is this a known limitation (and if so, why?), or does anyone know a way to make it work?
Note: I can see the logs in the Azure Portal, so I know the job runs correctly -- I just want to save these to a WADLogsTable.
Thanks!
Maybe your problem is related to this. Compress in a .zip the Release folder of your web job and then go to your azure webpage, click web jobs and add. Set your schedule in the menu that shows when you press add, you can change it later in your azure web job schedule menu.