AWS Crawler Throwing Connection Error When Glue Connection Test Passes - amazon-rds

I'm hitting an error on AWS and oogle has not been much help thus far. Here is the problem I have. I have setup a connection in Glue to my Oracle RDS. When I test the connection it passes. When I run the Crawler it fails with the following error:
ERROR : Error crawling database my_oracle_db:
SQLException:
SQLState: 08006
Error Code: 17002
Message: IO Error: Invalid connection string format, a valid format is: "host:port:sid"
I have manually altered the JDBC connection string so that the / between port and SID is replaced with : I did test the connection both ways, and the test passed. What could be causing the error to get thrown?

Related

SQLAlchemy / pymysql caching_sha2_password not configured

Bit of a Python newbie, and I have encountered an error message attempting to connect to a MySQL database using SQLAlchemy. I will note, this code works on another Linux server with the same installation (as far as I can tell) as well as a Windows server.
sqlalchemy.exc.OperationalError: (pymysql.err.OperationalError) (2059, "Authentication plugin 'b'caching_sha2_password'' not configured")
A search for that error message on StackOverflow returns no results, and searching on Google... also returned no results.
This is my connection code that is throwing the above error:
connection_string = f"mysql+pymysql://{username}:{password}#{hostname}:{port}/{db}"
connection_args = {'ssl': {'fake_flag_to_enable_tls': True}}
self._conn = create_engine(connection_string, connect_args=connection_args)

While debugging project which has internal dependency on the Azure component , I am getting error related to partition id

The error states that :"Exception User-Unhandled
Microsoft.Azure.EventHubs.Processor.EventProcessorConfigurationException: 'Encountered error while fetching the list of EventHub Partitionids'
Inner Exception
SocketException: A connection attempt failed because the connected party did not properly respond after a va period of time, or established connection failed because connected host has failed to respond."
First time I am not getting this exception after clearing the cache and restarting my laptop . Post that same issue occurs . Is there any way to check on this ?
To resolve this Exception User-Unhandled Microsoft.Azure.EventHubs.Processor.EventProcessorConfigurationException: 'Encountered error while fetching the list of EventHub Partitionids' Inner Exception SocketException: A connection attempt failed because the connected party did not properly respond after a va period of time, or established connection failed because connected host has failed to respond." error, try the following way:
As suggested by MayankBargali, check whether the required port is open or not.
Make sure to open ports 443/5671/5672
You can use the PortQry tool to query your eventhub namespace on these ports to confirm if these are blocked or not.
References: Microsoft.Azure.EventHubs.Processor: Encountered error while fetching the list of EventHub PartitionIds and In Azure Eventhub reciever giving "Encountered error while fetching the list of EventHub PartitionIds" error

nodejs mssql package- how do I tell a sql syntax error from a server error like a timeout?

I am running mssql queries (using the nodejs mssql package) from strings. if the query fails how do I know if its a sql syntax error, or a server error (eg a timeout)? Examples of both types include:
Server error:
query update x set y=1 err: Error: operation timed out for an unknown reason
Syntax error:
if mssql config is wrong: ConnectionError: Login failed for user 'xxx'
query create database Logs err: RequestError: CREATE DATABASE permission denied in database 'master'
query create databbbbbase Logs error: RequestError: Unknown object type 'databbbbbase' used in a CREATE, DROP, or ALTER statement
I am running the queries like this await pool.request().query(querystring) and using a catch block to get the error message.
Can I safely say if mssql error message is just 'Error' not a specific type (eg 'ConnectionError') that I should rerun the query?

'MSSQL' encountered unexpected exception of type 'InvalidOperationException' with HResult 'x80131509' while opening connection

When I am trying to load a query into a tabular dateset (from a devops docker image) I will get the following error:
raise DatasetValidationError(error_message + '\n' + str(e), e)
azureml.data.dataset_error_handling.DatasetValidationError: Cannot load any data from the datastore using the SQL query "<azureml.data.datapath.DataPath object at 0x>". Please make sure the datastore and query is correct.
Error Code: ScriptExecution.DatabaseConnection.Unexpected
Failed Step: 9ad57100-4870-49d2-a32f-1c9c15c244e0
Error Message: ScriptExecutionException was caused by DatabaseConnectionException.
DatabaseConnectionException was caused by UnexpectedException.
'MSSQL' encountered unexpected exception of type 'InvalidOperationException' with HResult 'x80131509' while opening connection.
Internal connection fatal error.
I believe that I have allowed the connection in firewall (I might not have done it quite right).
I don't get the error when I am running it from the notebook (on the compute instance).
Is the code that is running on the compute instance the exact same as the docker image? If so, it's likely that the firewall is causing connectivity issues. One way of checking this is to (be cautious) disable the firewall and see if the connectivity issue is gone.
If you're comfortable sharing the firewall/network configurations, that will also help troubleshoot this.

Database Operation Failed: Azure SQL and Azure Data Factory

Database operation failed on server 'worker.database.windows.net,11146' with SQL Error Number '40197'. Error message from database execution : The service has encountered an error processing your request. Please try again. Error code 4815.
A severe error occurred on the current command. The results, if any, should be discarded..
I'm getting the following error. What does error code 4815 mean? Couldn't find any documentation regarding that error code.
The error 4815 means that the SQL Server engine received an invalid column length from the bcp client for colid. You might want to check the parameters again and try this task again.
Here is some documentation on the error codes. Hope this helps.
https://technet.microsoft.com/en-us/library/cc645613(v=sql.105).aspx

Resources