How to Upgrade Azure Data Explorer Python Plugin Sandbox Anaconda and Python Version? - azure

I'm using the Python Sandbox in Azure Data Explorer to do inference on my data tables.
However, in some of my python code I'll need to upgrade the python() sandbox. (e.g., my models are TensorFlow 2 models instead of TF 1 provided by Py 3.6 and Anaconda 5.2 inside the sandbox).
I was looking online but didn't find any good solution on how to upgradeĀ Azure Data Explorer Python Sandbox Anaconda and Python Version
I've tried to follow the documentation on Azure Data Explorer Python Sandbox Policy, but there's no mention on upgrading the Python and Anaconda version
Another information that I've found is the dependencies versions are shown in the Anaconda page
If anyone knows of a solution or any information to run this python sandbox upgrade that'd be really great
Or if it's not possible can anyone suggest me what other Azure solution I might use to do inference on my data tables?
Thanks and have a great day!

There is a new version based on Python 3.10.8 + latest packages. This version is still in preview, in few weeks it would be GA. Currently this upgrade is not yet self service, you should contact ADX support to perform the upgrade. You can also email me (adieldar#microsoft.com), specifying your cluster name, and I can take it from there.
thanks,
Adi

Related

Mirth 3.11.0 Upgrade on Linux Without GUI

My mirth is running on an AWS EC2 instance. I want to upgrade the version of Mirth Connect running there. I am currently using 3.8.0, which I want to upgrade to version 3.11. However, I haven't found any good instructions or scripts for performing the upgrade that does not involve GUI tools. Does anyone know where I can find such a script or instructions?
In place upgrades are not safe, given enhancements within Mirth Connect itself and JRE. Many changes might have happened across versions 3.9 and 3.10. I suggest getting the appropriate tar.gz file version from the NextGen website then installing version 3.11.0 as a second instance while assigning different HTTP and HTTPS ports. You can then export channels in version 3.8 and do incremental imports to version 3.11.0 while you monitor closely. The command line interface documentation here offers an easier way to handle channel exports and imports.

How to get git commit sha of a package install via pip?

My team and I are using python 3.7.5 and a virtual environments. We are developing and using a fairly informal package. Its an engineering tool and due to the informal and fast pace we arent using a 0.0.0 versioning scheme yet. Hopwever, I would like an easy way to know exactly which version of the tool people are using if they run into issues. And I need a solution that doesn't require manually updating a version number in setuptools because I don't trust my coworkers to do that.
We are using python setuptools and pip to generate wheel files and install the packages into our virtual environments.
My question is: How can I get the commit sha of a particular package that is installed in the virtual environment at run time?
If the solution involves adding some code to embedd that data via setuptools during installation, thats good too.

Is cx_Oracle 5.3 compatible with Oracle client 19.10?

We upgraded our Oracle DB and oracle client from 12.1 to 19.10.
Our application server have below setup
OS is Linux
Python version is 2.7.5 and there is no plan to upgrade the python version yet
cx_Oracle library version is 5.3
A quick test shows the application works fine but I am wondering if I need to upgrade the cx_Oracle library? Does it have a support expiry date? I tried to google it, read the information on its Github page but can't find any statement that answers my question.
This combination hasn't been tested. But since the Oracle Client libraries keep compatibility it is likely to work, subject to whatever underlaying enforced changes have been made to the Oracle libraries, perhaps to drop unsupported TLS versions or whatever has occurred in the 8 years since 12.1 was released that I don't know about. You application testing should be the final confirmation.
You should definitely set a goal to update to Python 3 so you can get the latest cx_Oracle version.

How to install Python 3.8.1 on RHEL 8?

This is really frustrating.
I want to install the latest version of Python (at the time of this issue: Python 3.8.1) on RHEL 8, (RHEL being one of the most widely used distributions of Linux).
I would like to type:
#dnf install python
and have it install the latest version of Python.
I can't do this, and I do not know why.
When I go to python.org and click on 'install for Linux' I get a link to the source code.
There are no instructions there as to what to do with the source code.
I do not understand why this is.
I don't want the source code, I want to install python 3.8.1 executables for my platform (RHEL 8).
I search on how to install python 3.8.1 from source and get a long list of dependencies that I have to install and a long list of steps.
Is this because it is a very rare thing for companies to run Python on Linux?
Can we get together here and make it easy for folks to install Python on Linux?
I'm willing to pay money out of my daily earnings to setup a RHEL 8 repo to get Python 3.8 there if IBM/Redhat is not willing to do this.
Why does the official Python organization hate Linux?
Why does IBM / Redhat hate Python?
Can we bring the two together in peace and harmony so that they just get along?
This is very frustrating, I should be able to knock this task out in a few seconds, and it has turned into hours.
The same amount of hours to figure out how to do this is probably done every day by developers all over the world that want to install/run the latest version of Python on Linux (CentOS / RHEL).
Python 3.8 Application Stream is currently available with RHEL 8.2 beta. Since we support every new version of Python (3 years) that we release, we need to make sure that it's stable before bringing it to RHEL and the many hardware architectures it runs on. This is also important as customers expect technologies to be production grade. This table shows that over the years, we have officially supported more than one Python version simultaneously. You can download RHEL 8.2 beta from here. RHEL 8 was released with 2 versions of Python (2.7 and 3.6) because it's an important technology for us. We've used it ourselves for many years in building RHEL components and, among others in this industry, we had to rebuild it to 3.x (from 2.7).
FYI - new versions of Python and other components are released as Software Collections on RHEL 7, and as Application Streams on RHEL 8. The benefit of these is that the version of Python that's installed will have exactly the same packages and components for each system it's install it on. This simplifies things a lot (as you point out, it's complicated) and minimizes the "it works on my machine" issue.

How do I configure a Python3 interpreter in IntelliJ IDEA

IntelliJ IDEA 16 when you create a virtualenv, you can call it as an SDK and automatically runs and validates language, libraries and everything that you need for that project. This is helpful since the lint and other libraries become available on the IDE.
The Problem:
I have a machine that has 2 python installations (python2 and python3).
I can set up virtual environments in those different versions but when I want to create a project SDK from a virtualenv where python 3 is being use get the message "Cannot Save Settings" "Please specify different sdk name".
The same process that I use to set up the virutalenv on python 2 is the same for python 3 but this error keeps happening.
I would appreciate any help on how to configure that. I have looked all around the web and forums that talk about intelliJ and the SDK configurations but all of them are for python 2.7 and not when you have two python version installed on the same machine and using virutalenvs so set it up.

Resources