I have a URl like this : wss://**** and i have a token for this URL. I need to copy files from this location using data factory.
I could not find any activity which could be used for this and how i create linked service for the connection. I tried using Web activity but it allows only HTTP or HTTPS.
Any leads would be helpful. Thanks.
As far as I know, Azure Data Factory doesn't support web socket secure link by now. This is all connectors that Azure Data Factory supports. And there is no connector for web socket secure link.
Related
We are generating an extract file in Data Factory(blob) that we need to upload to a SharePoint location. Is there any service available in azure to do this activity?
We were able to do this via Logic Apps.
since your source is blob and destination s sharepoint , HTTP is not available as a sink in ADF . SO unfortunately you cannot use the REST API and also there is no direct connector to sharepoint.
So you can use Logic app or Azure function for the copy task from blob to sharepoint
I'd like to know if it is possible to get data from Google (e.g. Google Analytics) and Facebook by using Azure Data Factory v1 and the supported OData connector.
Any suggests to me? Thanks
I think this would depend on: could you get the odata service url and authentication?
Is it possible to expose an Azure Data Lake Store via OData? The main goal is consume this service in Salesforce (via Salesforce Connect).
If so, should it take place through Azure Data Factory?
Update
A little bit more of context:
We have historical data stored in Azure Data Lake Storage (ADLS) that we want to expose via OData (to be visualised in Salesforce via Salesforce Connect / External objects). After digging into the issue and potential solutions, we don't think ADLS is the right service to be used in this particular case. Instead, we'll might need to configure a Data Factory pipeline to copy the data we are interested in to a SQL Database and read the data from there via a simple ASP.Net application using Entity Data Model and WCF Data Services Entity Framework Provider (got some insights from this website).
I don't think OData has a connector for ADLS. However, given OData is basically a REST API, you could probably build an OData API over the existing ADLS REST APIs if they are not providing what you need. I am not sure how ADF would come into this picture?
Maybe it would be useful if you tell us what you want to achieve?
I have a SFTP server. I have my files uploaded there. I want to use azure data factory to connect with the SFTP server and read the files from the SFTP server and save them in the Azure Blob storage.
Is there a way to perform this using azure pipeline/activity configuration?
ADF has recently Added SFTP Support.Refer
https://learn.microsoft.com/en-us/azure/data-factory/data-factory-sftp-connector
EDIT
Data Factory now has native support for sftp.
It doesn't appear that Data factory supports sftp natively, however:
If you need to move data to/from a data store that Copy Activity
doesn't support, use a custom activity in Data Factory with your own
logic for copying/moving data. For details on creating and using a
custom activity, see Use custom activities in an Azure Data Factory
pipeline.
Also, Azure Logic Apps do support sftp natively which you could use to drop into blob storage, however I'm guessing (I'm soon to find out) that you'll loose the knowledge that the sftp server failing is a route cause when monitoring the factory.
SFTP planned feature in the azure feedback portal, if it is important to you I would recommend voting it up.
Is there any data source URL for Document Db to the Azure ML Data reader?
when i try to give the following URL
https://DBName.documents.azure.com:443/
It is asking for authorization
Does anyone tried giving document DB URL in Azure ML Portal(Reader Module)?
Thanks In Advance
Document DB is not supported out of the box by Azure Machine Learning currently.
I think the easiest current work around would be creating a web endpoint that provides all of the data. If it is very large data, maybe and endpoint that can provide subsets your webserver can support. This is a work around as AzureML does support web endpoints to query data from. You can add query support to your .net endpoints.