Connect to SAP BW via Open Hub with Azure Data Factory - azure

I’m trying to load SAP BW data into Azure Data Lake with ADF, I have:
• Installed Self-hosted IR (using my laptop for testing purpose)
• Installed SAP Connector for Microsoft .NET 3.0
As per https://learn.microsoft.com/en-us/azure/data-factory/load-sap-bw-data
Discussed with someone from SAP team and stuck on setting up the RFC:
• Authorization for Remote Function Calls (RFC) and SAP BW.
I have setup a linked service in ADF (with all creds) and got this error:
Get or create destination CLIENT=;SYSNR=;ASHOST= failed.
LOCATION CPIC (TCP/IP) on local host WIN-NXOLX5J0FI with Unicode ERROR partner '' not reached TIME Wed May 20 10:38:42 2020
RELEASE 721 COMPONENT NI (network interface) VERSION 40 RC -10 MODULE nixxi.cpp LINE 3289 DETAIL NiPConnect2: SYSTEM CALL connect ERRNO 10060 ERRNO TEXT WSAETIMEDOUT: Connection timed out COUNTER 2 RETURN CODE: 20 Activity ID: a969876f-cddd-4626-ae2c-5c529f8ae6d9.
Any suggestions are welcome, thank you in advance.

Related

FileSync local endpoint offline

I have 3 servers (one of them with Windows Server 2012 R2 and 2 with Windows Server 2019) and I use Azure FileSync to sync files between them.
Since a few days I have a problem, the 2012 R2 server is appearing offline in the azure portal (it shows "no activity"). I tried the Test-StorageSyncNetworkConnectivity cmdlet and it fails with the following message:
Discovery service connectivity result:
Result: Success
HostUri: unknown
HostIPv4Addr: Fail. DNS name does not exist. Resolution through GetAddrInfo failed with error: 11001
HostIPv6Addr: Fail. DNS name does not exist. Resolution through GetAddrInfo failed with error: 11001
Management service connectivity result:
Result: Fail. Failed to run test
HostUri: unknown
HostIPv4Addr: Fail. DNS name does not exist. Resolution through GetAddrInfo failed with error: 11001
HostIPv6Addr: Fail. DNS name does not exist. Resolution through GetAddrInfo failed with error: 11001
HostNetworkLatency [min,avg,max]: Network Latency Request Failed.
Monitoring service connectivity result:
Result: No response from monitoring agent process.
HostUri: unknown
HostIPsAddr: IPv4 and Ipv6 addresses do not exist
ServerEndpoint: faf66731-1e22-47eb-93eb-b8d3331f0de2
SyncServiceResult:
SyncServiceHostUri:
SyncServiceHostIPsAddr: IPv4 and Ipv6 addresses do not exist
SyncServiceHostNetworkLatency: Request Failed.
ServerEndpoint: 80f3bb96-463b-4f86-9e26-8dcf0c92f915
SyncServiceResult:
SyncServiceHostUri:
SyncServiceHostIPsAddr: IPv4 and Ipv6 addresses do not exist
SyncServiceHostNetworkLatency: Request Failed.
ServerEndpoint: b9a874b4-7acd-4174-b5e8-26ac23c84c7e
SyncServiceResult:
SyncServiceHostUri:
SyncServiceHostIPsAddr: IPv4 and Ipv6 addresses do not exist
SyncServiceHostNetworkLatency: Request Failed.
Remediation Steps
For Azure File Sync to work correctly, you will need to configure your servers to communicate with multiple Azure servic
es
Refer the following public document for details on proxy settings or firewall settings for Azure File Sync - https://aka
.ms/AFS/ProxyAndFirewall
If you have configured a private endpoint refer the following public document for configuring private endpoint for Azure
File Sync - https://aka.ms/AFS/PrivateEndpoint
NetworkTestPassed Report
----------------- ------
False ...
The problem seems to be DNS related, but I tried the Test-NetConnection -ComputerName <remote-host> -Port 443 cmdlet with the correct URLs (taken from https://learn.microsoft.com/it-it/azure/storage/file-sync/file-sync-firewall-and-proxy#test-network-connectivity-to-service-endpoints) and all the endpoints seems to be working fine (the ping is failing but I think that is regular behavior. E.g.:
PS C:\Program Files\Azure\StorageSyncAgent> Test-NetConnection -ComputerName tm-kailani7.one.microsoft.com -Port 443
AVVISO: Ping to tm-kailani7.one.microsoft.com failed -- Status: TimedOut
ComputerName : tm-kailani7.one.microsoft.com
RemoteAddress : 20.38.85.153
RemotePort : 443
InterfaceAlias : Ethernet 2
SourceAddress : 192.168.0.185
PingSucceeded : False
PingReplyDetails (RTT) : 0 ms
TcpTestSucceeded : True
I also tried the FileSyncErrorsReport.ps1 but even that doesn't give me any error:
AVVISO: There are no file sync errors to report. Either the last completed sync session did not have per-item errors or
the ItemResults event log on the server wrapped due to too many per-item errors and the event log no longer contains
errors for this sync group. To learn more, see the Azure File Sync troubleshooting documentation:
https://aka.ms/AFS/FileSyncErrorReport
I think the problem lies with the fact that the AzureStorageSyncMonitor.exe process is not running and if i try to run it manually it just closes itself after a few seconds.
I've got no event ID 9301 (specified here: https://learn.microsoft.com/it-it/azure/storage/file-sync/file-sync-troubleshoot?tabs=portal1%2Cazure-portal#server-endpoint-health) and by searching in the other folder of eventvwr i could only find the event 4104 which shows me some error dated to the last time the server has reached the Azure endpoint:
Querying for new jobs failed.
HttpErrorCode: 0x80C8700C
InternalErrorCode: 0x80C80300
Any help would be greatly appreciated, thank you.
• Kindly please check the event ID 9302 in the ‘FileSync’ telemetry logs under ‘Application and Service Logs’ in the event viewer for the active sync sessions logged every 5 to 10 minutes and check whether it is making any progress as the ‘AzureStorageSyncMonitor.exe’ utility synchronizes the status of the Server endpoint to the storage sync service in the portal.
• You can also check the ‘Perfmon.msc’, i.e., performance counter which is built-in to the Azure File Sync to monitor the sync activity locally on the server.
• Finally, please check the Server’s configured IP address settings too as you are encountering the DNS resolution issue while trying to execute the ‘Test-StorageSyncNetworkConnectivity’ command. In the IP address settings, please check whether the configured DNS server IP addresses (Preferred and Secondary) are configured correct and are reachable.
Also, check the ‘localhosts’ file in the ‘C:\Windows\System32\drivers\etc’ path whether it contains the correct IP address of the server, i.e., Windows Server 2012 R2 and its expected DNS hostname as various services on the server itself including the ‘AzureStorageSyncMonitor’ refer the ‘localhosts’ file for sending DNS requests to the connected/configured external services and for communicating between the internal services also.
• Finally, would suggest you to please disable negative caching on the DNS client, put the suffix with the matching host A record as the last entry in the suffix search list and use the ‘AF_UNSPEC’ for the family and let your code determine the ‘A/AAAA’ results for you.
For more detailed information on this, kindly refer to the below link: -
https://learn.microsoft.com/en-us/troubleshoot/windows-server/networking/getaddrinfo-fails-error-11001-call-af-inet6-family#workaround

Azure Speech SDK connection issue/error in unity

I am using unity 2019.3 and installed latest azure speech SDKas far as I know. I also subscribed to pay as you go plan. Here is the error generated in unity:
CANCELED:
Reason=[Error]
ErrorDetails=[Connection was closed by the remote host. Error code: 1011. Error details: Internal server error. USP state: 3. Received audio size: 0bytes.]
Did you update the subscription info?

Azure IoT SDK C: Error 401 when connecting to Blob Storage

OS and version used: Ubuntu 18.04
SDK version used: Release Dec. 13, 2018
Target: ESP32.
Description of the issue:
I am trying to connect the ESP32 to my Blob storage. I am getting an HTTP error 401 (unauthorized access).
I am using the example: iothub_client_sample_upload_to_blob_mb.
I tried connecting using just the Shared Access Key in my connection string, but this did not work (no connection). After that I generated an SAS token in Azure (Storage Accounts -> -> Shared Access Signature) and plugged that in into my connection string.
My connection string looks like this:
static const char* connectionString = "HostName=<Host name>;DeviceId=<Device ID>;SharedAccessSignature=<inserted here without the "?" at the beginning>";
Q1: Why is there a "?" in front of the token? When I look at the connection string, at SharedAccessSignature=.. I don't see the "?".
I also set up the Endpoint in Azure under IoT Hub -> Upload files.
In the example, I am using the option SET_TRUSTED_CERT_IN_SAMPLES.
Q2: What does that mean? I am not so familiar with basic encryption and should probably read up on that.
Q3: Why am I getting an 401 error? What could be a possible solution?
Log:
Initializing SNTP
ESP platform sntp inited!
Time is not set yet. Connecting to WiFi and getting time over NTP. timeinfo.tm_year:70
Waiting for system time to be set... tm_year:0[times:1]
Starting the IoTHub client sample upload to blob with multiple blocks...
Info: Waiting for TLS connection
Info: Waiting for TLS connection
Info: Waiting for TLS connection
Info: Waiting for TLS connection
Error: Time:Thu Jan 17 22:06:00 2019 File:/home/julian/eclipse-workspace/chaze-esp32/components/esp-azure/azure-iot-sdk-c/iothub_client/src/iothub_client_ll_uploadtoblob.c Func:send_http_request Line:142 HTTP code was 401
Error: Time:Thu Jan 17 22:06:00 2019 File:/home/julian/eclipse-workspace/chaze-esp32/components/esp-azure/azure-iot-sdk-c/iothub_client/src/iothub_client_ll_uploadtoblob.c Func:IoTHubClient_LL_UploadToBlob_step1and2 Line:494 unable to HTTPAPIEX_ExecuteRequest
Error: Time:Thu Jan 17 22:06:00 2019 File:/home/julian/eclipse-workspace/chaze-esp32/components/esp-azure/azure-iot-sdk-c/iothub_client/src/iothub_client_ll_uploadtoblob.c Func:IoTHubClient_LL_UploadMultipleBlocksToBlob_Impl Line:768 error in IoTHubClient_LL_UploadToBlob_step1
Received unexpected result FILE_UPLOAD_ERROR
hello world failed to upload
Press any key to continue
Here is the link to the GitHub Repo.
The example can be found here.
I generated an SAS token in Azure (Storage Accounts -> -> Shared Access Signature) and plugged that in into my connection string. My connection string looks like this:
static const char* connectionString = "HostName=<Host name>;DeviceId=<DeviceID>;SharedAccessSignature=<inserted here without the "?" at the beginning>";
Q1: Why is there a "?" in front of the token? When I look at the connection string, at SharedAccessSignature=.. I don't see the "?".
After registering a device on IoTHub you will need to retrieve it's connection string to use on this example. See here an example on how to register and retrieve the connection string from a device on IoTHub.
I also set up the Endpoint in Azure under IoT Hub -> Upload files. In the example, I am using the option SET_TRUSTED_CERT_IN_SAMPLES.
Q2: What does that mean? I am not so familiar with basic encryption and should probably read up on that.
That Flag is used when compiling the SDK for your device. See the CMake File:
#Conditionally use the SDK trusted certs in the samples
if(${use_sample_trusted_cert})
add_definitions(-DSET_TRUSTED_CERT_IN_SAMPLES)
include_directories(${PROJECT_SOURCE_DIR}/certs)
set(iothub_client_sample_upload_to_blob_mb_c_files ${iothub_client_sample_upload_to_blob_mb_c_files} ${PROJECT_SOURCE_DIR}/certs/certs.c)
endif()
Q3: Why am I getting an 401 error? What could be a possible solution?
Make sure you configure file upload on Azure IoTHub correctly - https://learn.microsoft.com/en-us/azure/iot-hub/iot-hub-devguide-file-upload and use the correct connection string on the sample. Also leverage the ESP8266 sample that should have similar steps as the ESP32 configuration.
To get rid of the 401 error: Use MSFT Baltimore certificate in the code.
To get rid of the panic on the ESP: Look at this GitHub issue.

Azure Machine Learning Workbench hangs while creating new project

I was trying Azure Machine Learning Services following this tutorial (Link). After successfully creating the Azure Machine Learning services accounts, I successfully installed the Workbench on my Windows 10 Laptop (Behind Proxy; Proxy has been configured at the WorkBench). Next, I was trying to create project following this section (Link). Once I click on the Create button, it goes to "Creating" state and stays there for ever. The errors displayed at Errors.log is the following. Any suggestion will be appreciated.
[2018-07-09 09:47:08.437] [ERROR] HttpService - {"event":"HttpService","task":"Failed","data":{"url":"http://localhost:54240/projects/v1.0/create/template","status":500,"statusText":"INKApi Error","jsonError":null,"requestId":null,"sessionType":"Workbench"},"sid":"365395c0-832b-11e8-b4ce-e5d7046c6143"}
[2018-07-09 09:47:08.960] [ERROR] CreateProjectForm - {"event":"CreateProject","task":"Error","data":{"_body":null,"status":500,"ok":false,"statusText":"INKApi Error","headers":{"Date":["Mon"," 09 Jul 2018 04:17:06 GMT"],"Via":["1.1 localhost.localdomain"],"Proxy-Connection":["close"],"Content-Length":["0"],"Content-Type":["text/html"]},"type":2,"url":"http://localhost:54240/projects/v1.0/create/template"},"sid":"365395c0-832b-11e8-b4ce-e5d7046c6143"}
[2018-07-09 09:47:08.963] [FATAL] ExceptionLogger - {"event":"exception","task":"","data":{"message":"Cannot read property 'error' of null","name":"TypeError","stack":"TypeError: Cannot read property 'error' of null\n at SafeSubscriber._error (file:///C:/Users/MyUser/AppData/Local/AmlWorkbench/resources/app.asar/src/App/main.bundle.js:61476:58)\n at SafeSubscriber.__tryOrUnsub (file:///C:/Users/MyUser/AppData/Local/AmlWorkbench/resources/app.asar/src/App/main.bundle.js:212279:20)\n at SafeSubscriber.error (file:///C:/Users/MyUser/AppData/Local/AmlWorkbench/resources/app.asar/src/App/main.bundle.js:212241:30)\n at Subscriber._error (file:///C:/Users/MyUser/AppData/Local/AmlWorkbench/resources/app.asar/src/App/main.bundle.js:212172:30)\n at Subscriber.error (file:///C:/Users/MyUser/AppData/Local/AmlWorkbench/resources/app.asar/src/App/main.bundle.js:212146:22)\n at MergeMapSubscriber.OuterSubscriber.notifyError (file:///C:/Users/MyUser/AppData/Local/AmlWorkbench/resources/app.asar/src/App/main.bundle.js:210968:30)\n at InnerSubscriber._error (file:///C:/Users/MyUser/AppData/Local/AmlWorkbench/resources/app.asar/src/App/main.bundle.js:211072:25)\n at InnerSubscriber.Subscriber.error (file:///C:/Users/MyUser/AppData/Local/AmlWorkbench/resources/app.asar/src/App/main.bundle.js:212146:22)\n at DeferSubscriber.OuterSubscriber.notifyError (file:///C:/Users/MyUser/AppData/Local/AmlWorkbench/resources/app.asar/src/App/main.bundle.js:210968:30)\n at InnerSubscriber._error (file:///C:/Users/MyUser/AppData/Local/AmlWorkbench/resources/app.asar/src/App/main.bundle.js:211072:25)"},"sid":"365395c0-832b-11e8-b4ce-e5d7046c6143"}
It was happening because of the Proxy (although I have configured the Proxy on the Workbench). When I am connected to internet directly, everything works fine (Able to create project, train, compare models etc). However the Workbench should return meaningful error instead of hanging or simply waiting while creating the project.

sitefinity azure deployment cannot connect to database

I'm having trouble getting my new sitefinity deployment to windows azure hosting. On the sitefinity project startup screen I can put in my azure connection string info and it bombs out saying the database type mismatches (mssql instead of azure). I can't find where to change this so I'm unable to get the site to initialize. Am I missing something?
Here is the error:
* There was an error trying to connect to the Database Server:
System.InvalidOperationException: Wrong database backend configuration detected: Connecting to 'Microsoft SQL Azure (RTM) - 11.0.9117.67 Aug 4 2013 23:37:13 Copyright (c) Microsoft Corporation ' but configured for 'mssql'. at OpenAccessRuntime.Relational.sql.MsSqlDriver.customizeForServer(Connection con) at OpenAccessRuntime.Relational.sql.SqlDriver.InitializeFor(ConnectionString connectionString, Boolean noConnect, PropertySet props, DBDriver& driver, Connection& conn, ConnectionPoolType poolType) at OpenAccessRuntime.Relational.RelationalStorageManagerFactory..ctor(StorageManagerFactoryBuilder b) at OpenAccessRuntime.storagemanager.StorageManagerFactoryBuilder.createSmfForURL()
Thanks
You cannot create your project directly on Azure - you should create it locally first.
Then, in the DataConfig.config file you will find the connection string. Make sure you change the dbType from MsSql to SqlAzure.
Also, in the web.config you need to uncomment this:
<!-- Begin telerik section -->
<!--<telerik>
<sitefinity>
<environment platform="WindowsAzure"/>
<sitefinityConfig storageMode="Database" />
</sitefinity>
</telerik>-->
<!-- End telerik section -->
I suggest you use Thunder to deploy your project to Azure:
http://www.sitefinity.com/documentation/documentationarticles/sitefinity-azure-configuration

Resources