I am trying to go through the following tutorial published here but get the error below when I run these lines fo code:
run = exp.submit(est)
run.wait_for_completion(show_output=True)
ERROR:
"message": "Could not import package \"azureml-dataprep\". Please ensure it is installed by running: pip install \"azureml-dataprep[fuse,pandas]\""
However, I have already installed the required packages:
I am running this through Jupyter Notebooks in an Anacoda Python 3.7 environment.
UPDATE
Tried creating a new conda environment as specified here but still get the same error.
conda create -n aml python=3.7.3
After installing all the required packages, I am able to reproduce the exeception by executing the following:
Sorry for this. Take a look at the Jupyter Notebook version of the same tutorial:
https://github.com/Azure/MachineLearningNotebooks/blob/master/how-to-use-azureml/ml-frameworks/tensorflow/deployment/train-hyperparameter-tune-deploy-with-tensorflow/train-hyperparameter-tune-deploy-with-tensorflow.ipynb
When configuring estimator, you need to specify the pip packages u wanna install on the remote compute. In this case, azureml-dataprep[fuse, blob]. Installing the package to your local computer is not useful since the training script is executed on the remote compute target, which doesn't have the required package installed yet.
est = TensorFlow(source_directory=script_folder,
script_params=script_params,
compute_target=compute_target,
entry_script='tf_mnist.py',
use_gpu=True,
pip_packages=['azureml-dataprep[pandas,fuse]'])
Can you pls try the fix and let us know whether it solves your issue :) In the mean time, I will update the public documentation to include pip_packages in estimator config.
Have you gone through the known issues and Troubleshooting page?. It is mentioned as one of the known issue.
Error message: ERROR: No matching distribution found for azureml-dataprep-native
Anaconda's Python 3.7.4 distribution has a bug that breaks azureml-sdk
install. This issue is discussed in this GitHub Issue This can be
worked around by creating a new Conda Environment using this command:
Related
I am building a desktop app using Python and PySimpleGUI. So far, everything works just fine. Whilst I was working at the project, I realized I need to find a way to get the duration of some mp3 files and to display it in a certain way. I discovered mutagen module that is supposed to help me in this sense, I installed, and here the problem arise:
It throws me ModuleNotFoundError: No module named 'mutagen'.
Seeing this, I started to look for the problem, but I couldn't not understand why my interpretor did not find the module even though I Installed it CORRECTLY. (as PyCharm told me)
I have tried the following:
I am using a local virtual environment that has installed the dependecies for the project(and some extra) and I uninstalled and installed the package 3-4 times
I deleted the local virtual environment and I created another one. I installed the packages again and same issue.
I installed a random module (scipy) and I tried to import it somewhere in the project and it thrown me same error, but this time for scipy module
My guess is that I did not configured properly my interpreter, but to be honest, I have no idea what I am doing wrong, because I followed the same steps I've been using for creating a venv with its according interpreter and for other projects, it worked just fine.
Further details:
Using python3.9 base .exe
I installed the packages in two ways: one using the pycharm IDE, and one by running pip3 install mutagen
You may be using a different pip that is not the one that affects the Python you are using. Instead of using
pip install mutagen
Consider using pip as a module of the Python you are using:
python -m pip install mutagen
This way you'll be sure you are working on the same Python.
If you want to continue using plain pip, try which python and which pip to make sure they are referencing the same environment.
I am new to Python and Azure scripting...and Mac (somewhat). I am trying to create a simple python script so I can create a set of Azure resources I use in a project. I followed these directions to set up vscode and I loosely followed these directions to get started with the Azure commands. Loosely, so I could ensure I knew what was happening. I did not pull down the repo. I am getting an Import "azure.common.credentials" could not be resolved error on the following line:
from azure.common.credentials import ServicePrincipalCredentials
In setting up the vscode/python environment, I selected the 3.7.3 interpreter. I did not pull down the github repo or run the pip install -r requirements.txt, again just to make sure I could do this from scratch and understand how these things work together.
When I run pip install azure from the command line it seems to default to the python 2.7 installation on the Mac, which is deprecated but I think required on the Mac.
Do I need to do the pip install azure for 3.7.3? If so how do I do that?
I'm using Windows 7 and am up to date on patches. I was using Python 3.5.2 and wanted to upgrade to 3.6, so I went to the Python site, downloaded 3.6.4.exe for Windows, and ran it. The Python seems to work fine and is 3.6.4, but trying to import any of the packages I was using (pandas, numpy, tensorflow, etc) now gives me ModuleNotFoundError: No module named <whichever module it was>. Also, pip list now shows only pip and setuptools.
It appears to be a known issue, for example this from nearly a year ago, which suggests that I should "uninstall the python bindings and install again", but I can't figure out what that means. Fortunately I can still access 3.5.2 by using py -3.5, and then my imports work. Can anyone tell me how to fix this for 3.6 without having to reinstall all my modules manually?
I was thinking possibly I should have upgraded through pip; it seems like that's possible but maybe a bad idea for some reason? On further investigation it looks like what I should have done was save my requirements with pip freeze > requirements.txt, and then after installing the new Python restore them with pip install -r requirements.txt. Is this right?
Hard to say if you have an install problem, but this is what I would try if I were in your place.
Create a virtual environment as per; docs
c:>c:\Python36\python -m venv c:\path\to\myenv
Activate your virtual environment
C:> \Scripts\activate.bat
Run your application from within your activated environment. Each time you get an import error, do a pip-install from within the active environment. (For your own modules, you may need to modify PYTHONPATH in 'activate.bat')
Once you have your application running again, do your pip freeze > requirements.txt, and keep that with your project.
Each time you run your application, do so from within the activated virtual environment.
This will give you a clean requirements.txt that doesn't include a bunch of junk from other projects. Then, when you go to 3.7, just create the virtualenv and run your requirements.txt and wala!
I suspect your issue is simply not running against the correct interpreter, running from within a virtual environment should at least rule it out.
Now TensorFlow is finally released on Windows, I have been trying to install it for the last 2 days, still no success. Need some help please.
After installing Anaconda 3, I followed the instructions here. But was not able to proceed further beyond activating the environment...
Just sorted things out...what a journey!! The solution is below:
So basically, we need to follow the process here. Also, you may get an error message like this:
Cannot remove entries from nonexistent file c:\users\george.liu\appdata\local\co
ntinuum\anaconda3\lib\site-packages\easy-install.pth
So, you just need to do this instead in Anaconda Prompt:
pip install --upgrade --ignore-installed https://storage.googleapis.com/tensorflow/windows/cpu/tensorflow-0.12.0rc0-cp35-cp35m-win_amd64.whl
This is due to a known bug as explained here.
Then you're all set. Enjoy!!
I'm trying to install pybrain on python 3.2. It says here: https://github.com/pybrain/pybrain/pull/85 that it should work. However it does not for me.
I tried:
$export PYTHONPATH=$PYTHONPATH:'/home/luis/Documents/pybrain/'https://github.com/pybrain/pybrain/pull/85
which works well for python 2.7.
Did somebody get it to work?
After hours of "what the hell?!"s I installed it.
First the installer suggested is not updated for Python3 so I installed Distribute. With that installed I was able to use python setup.py install in the directory where I unrared pybrain. It gave a ton of errors. So I found this article (god bless google translate) and used 2to3 on pybrain directory. After I tried to install it again it gave an error on from string import split so I edited the file and removed that line (it is not needed really) and tried yet another time. This time no errors occurred and I was able to import pybrain without any problems. The same problem with the from string import split occurs in utilities.py again, so edit that line too.
I used 2to3 to turn examples to python3 too. benchmarkplots.py seems to work.
Update:
pybrain now supports python3
Here's how to install if you run into trouble
pip install https://github.com/pybrain/pybrain/archive/0.3.3.zip
Or just grab latest github pybrain release.