Python pip install local on cluster openssl issues - linux

I am trying to get python3 and pip installed as my own user on a cluster.
The make test fails with:
FAILED (failures=1)
test test_dbm_dumb failed
7 tests failed again:
test_dbm_dumb test_import test_mailbox test_os test_pathlib
test_stat test_tarfile
Total duration: 9 min 21 sec
Tests result: FAILURE
make: *** [test] Error 1
THis is some other info that may pertain to the error
INFO: Can't locate Tcl/Tk libs and/or headers
warning: building with the bundled copy of libffi is deprecated on this platform. It will not be distributed with Python 3.7
Python build finished successfully!
The necessary bits to build these optional modules were not found:
_bz2 _curses _curses_panel
_dbm _gdbm _lzma
_sqlite3 _ssl _tkinter
readline
To find the necessary bits, look in setup.py in detect_modules() for the module's name.
The following modules found by detect_modules() in setup.py, have been
built by the Makefile instead, as configured by the Setup files:
atexit pwd time
but I continued on anyways with make install.
It appears there are openSSL issues. Please see below:
-bash-4.2$ python3 get-pip.py --user
pip is configured with locations that require TLS/SSL, however the ssl module in Python is not available.
Could not fetch URL https://pypi.python.org/simple/pip/: There was a problem confirming the ssl certificate: Can't connect to HTTPS URL because the SSL module is not available. - skipping
Requirement already up-to-date: pip in ./tools/python/lib/python3.6/site-packages
Collecting wheel
Could not fetch URL https://pypi.python.org/simple/wheel/: There was a problem confirming the ssl certificate: Can't connect to HTTPS URL because the SSL module is not available. - skipping
Could not find a version that satisfies the requirement wheel (from versions: )
No matching distribution found for wheel
-bash-4.2$ python3 pip
python3: can't open file 'pip': [Errno 2] No such file or directory
-bash-4.2$ ldd /home/CAM/anesta/tools/openssl/lib/libssl.so.1.1
linux-vdso.so.1 => (0x00007ffe1796d000)
libcrypto.so.1.1 => /home/CAM/anesta/tools/openssl/lib/libcrypto.so.1.1 (0x00007fc88093b000)
libdl.so.2 => /usr/lib64/libdl.so.2 (0x00007fc88072b000)
libpthread.so.0 => /usr/lib64/libpthread.so.0 (0x00007fc88050f000)
libc.so.6 => /usr/lib64/libc.so.6 (0x00007fc88014e000)
/lib64/ld-linux-x86-64.so.2 (0x00007fc88102f000)
So it appears openssl is installed. Why does the make test say that is doesn't have ssl? Additionally I have bzip2 installed and python says that is not found too.
There must be something I'm missing here.
Thanks,
Alex
EDIT: no SSL module installed in python
-bash-4.2$ python3 -c "import ssl"
Traceback (most recent call last):
File "<string>", line 1, in <module>
File "/home/CAM/anesta/tools/python/lib/python3.6/ssl.py", line 101, in <module>
import _ssl # if we can't import it, let the error propagate
ModuleNotFoundError: No module named '_ssl'

Related

Why did my pip download both the newest and the older version?

This is my first time to develop a PyPI package and ask a question on StackOverflow...
I'm developing a package named tttk. After I uploaded v1.0.0 and tried to install it, pip told me there's an error in setup.py. Then I changed setup.py, and rebuild, upload v1.0.1. When I try to install it again, the error appears again. I read everything in cmd, then I found that pip downloaded the package of v1.0.0 after it runs the setup.py of v1.0.1.
here's the screenshot of cmd when I tried to install v1.0.1.
I'm just trying to install tttk (the package I uploaded). Why is it soooo hard!?
I retried like this:pip install -v -v -v tttk...
here's everything I found that might be useful:
Skipping link: not a file: https://pypi.org/simple/tkinter/
Given no hashes to check 0 links for project 'tkinter': discarding no candidates
Created temporary directory: C:\Users\Len\AppData\Local\Temp\pip-unpack-sdbco3t1
Looking up "https://files.pythonhosted.org/packages/78/e2/748aaa5d447f3ff3b0e997cbafd8b0f8cead796b059b92514c83d6411f07/tttk-1.0.0.tar.gz" in the cache
Current age based on date: 4074
Ignoring unknown cache-control directive: immutable
Freshness lifetime from max-age: 365000000
The response is "fresh", returning cached response
365000000 > 4074
Using cached tttk-1.0.0.tar.gz (16 kB)
Added tttk from https://files.pythonhosted.org/packages/78/e2/748aaa5d447f3ff3b0e997cbafd8b0f8cead796b059b92514c83d6411f07/tttk-1.0.0.tar.gz to build tracker 'C:\\Users\\Len\\AppData\\Local\\Temp\\pip-build-tracker-6md7cbrk'
Running setup.py (path:C:\Users\Len\AppData\Local\Temp\pip-install-7f41cz28\tttk_c1fc2afbed064900bbc613a248233cca\setup.py) egg_info for package tttk
Created temporary directory: C:\Users\Len\AppData\Local\Temp\pip-pip-egg-info-3e78aanv
Running command python setup.py egg_info
Traceback (most recent call last):
File "<string>", line 36, in <module>
File "<pip-setuptools-caller>", line 34, in <module>
File "C:\Users\Len\AppData\Local\Temp\pip-install-7f41cz28\tttk_c1fc2afbed064900bbc613a248233cca\setup.py", line 4, in <module>
with open("./README.md", "r",encoding='utf-8') as fh:
FileNotFoundError: [Errno 2] No such file or directory: './README.md'
error: subprocess-exited-with-error
× python setup.py egg_info did not run successfully.
│ exit code: 1
╰─> See above for output.
note: This error originates from a subprocess, and is likely not a problem with pip.
full command: 'D:\Python37\python.exe' -c '
exec(compile('"'"''"'"''"'"'
# This is <pip-setuptools-caller> -- a caller that pip uses to run setup.py
...
SOLVED
First, thanks to every reply...
I'm not an English speaker, and I wrote this without any help from translation software, so if you can't understand what I'm talking about, just read the last paragraph to find out the main reason and how did it caused the problem...
Maybe I forgot to write this in my question. In fact, I have already fixed the README.MD not found problem in v1.0.1 (and newer), but v1.0.0 still has this bug. pip downloaded both v1.0.1 and 1.0.0 so this error appears again.
The output in my question is just a part of all of them...
I went to pypi.org and yank every older versions (v1.0.0 and v0.1.0), then retried, and seems pip couldn't find tkinter. And here's what I've got:
screenshot again
The main reason of this problem is I wrote tkinter in requirements.txt (remember this is my first time to develop a PyPI package). pip couldn't found tkinter on its server ,so it tried to install the older version automatically. But the README file not found problem is still exists in the older version, so that's why it failed...

informix DB with RobotFramework

I am trying to connect to informix DB from Robotframework script running on Mac. I have installed Robotframework-Database-Library[1.0.1] from http://franz-see.github.io/Robotframework-Database-Library/.
tried to install Informix DB per https://wiki.python.org/moin/Informix. Ran into issue
error: Can't find esql. Please set INFORMIXDIR correctly.
tried to install mxODBC using python. still running into error
I have installed egenix-mx-base-3.2.9-py2.7_ucs2-macosx-10.5-x86_64-prebuilt as this is precondition. Tried to verify the mx-base using.
$ pip install egenix-mx-base
Requirement already satisfied: egenix-mx-base in /Library/Python/2.7/site-packages.
Then tried to install egenix-mxodbc-3.3.6-py2.7_ucs2-macosx-10.4-fat-prebuilt.
msuresh$ python setup.py install
running install
found usable build data file 'build/build-py2.7_ucs2.pck'
prebuilt archive found: skipping the build process and loading the prebuilt archive
setting platform to 'macosx-10.4-fat'
adjusting distutils platform string from 'macosx-10.13-x86_64' to 'macosx-10.4-fat'
restoring build data from a previous build run
loaded build data for platform 'macosx-10.4-fat'
running install_lib
writing byte-compilation script '/var/folders/dc/nwlkjl0129d3qm1j8m5czmgsnkqkf_/T/tmpRNEu3H.py'
/usr/local/opt/python#2/bin/python2.7 -O /var/folders/dc/nwlkjl0129d3qm1j8m5czmgsnkqkf_/T/tmpRNEu3H.py
removing /var/folders/dc/nwlkjl0129d3qm1j8m5czmgsnkqkf_/T/tmpRNEu3H.py
running install_data
running install_egg_info
Removing /usr/local/lib/python2.7/site-packages/egenix_mxodbc-3.3.6-py2.7.egg-info
Writing /usr/local/lib/python2.7/site-packages/egenix_mxodbc-3.3.6-py2.7.egg-info
But on trying to verify mxodbc --> does through me error.
>>> import mx.ODBC.Manager
Traceback (most recent call last):
File "", line 1, in
File "mx/ODBC/Manager/__init__.py", line 48, in
ImportError: None of the supported ODBC managers unixODBC, iODBC or DataDirect could be imported: dlopen(/usr/local/lib/python2.7/site-packages/mx/ODBC/unixODBC/mxODBC.so, 2): no suitable image found. Did find:
/usr/local/lib/python2.7/site-packages/mx/ODBC/unixODBC/mxODBC.so: no matching architecture in universal wrapper
/usr/local/lib/python2.7/site-packages/mx/ODBC/unixODBC/mxODBC.so: no matching architecture in universal wrapper, dlopen(/usr/local/lib/python2.7/site-packages/mx/ODBC/iODBC/mxODBC.so, 2): no suitable image found. Did find:
/usr/local/lib/python2.7/site-packages/mx/ODBC/iODBC/mxODBC.so: no matching architecture in universal wrapper
/usr/local/lib/python2.7/site-packages/mx/ODBC/iODBC/mxODBC.so: no matching architecture in universal wrapper, No module named DataDirect
.. Any help to get informix connection via Robotframework would be appreciated.
It sounds like you need to download and install the Informix Client SDK from here

python-escpos windows giving "bugtrack_url" error

Trying to install python-escpos library. The instructions say the following:
Ensure the library is installed on ${lib_arch}/${python_ver}/site-packages/escpos
On CLi you must run:
python setup.py build
sudo python setup.py install
What does ${lib_arch}/${python_ver}/ mean? Is it the path such as
\Users\RickT\AppData\Local\Programs\Python\Python36-32\Lib\site-packages\escpos?
When I run python setup.py build, I get the following error:
C:\Users\RickT\AppData\Local\Programs\Python\Python36-32\lib\distutils\dist.py:261: UserWarning: Unknown distribution option: 'bugtrack_url' warnings.warn(msg)Traceback (most recent call last):
File "setup.py", line 140, in <module> 'python-escpos = escpos.cli:main'
As I wrote in the comments you should write which version of the documentation you are using and which version of the codebase you are using.
The "error" considering the bugtrack_url is just a warning because setuptools does not know this token. This should not affect your setup in any way. You probably installed it successfully.
Concerning your question about the path: ${lib_arch}/${python_ver}/site-packages/escpos is more or less non-sense in a Windows-context. This just means your location of the site-packages-directory. So, your assumption is right.
All in all the probably easiest solution for you would be installing with pip. This would simply be - considering you have a working pip - a one-liner:
pip install python-escpos

cx_Oracle: distutils.errors.DistutilsSetupError: cannot locate Oracle include files

I need install cx_Oracle for Python 2.5 on Linux (Linux 2.6.18-371.1.2.el5 i686). I have installed Oracle client 10.2.0.4.
I have tried following:
1. Download cx_Oracle tar.gz from http://sourceforge.net/projects/cx-oracle/files/.
I don't know which of listed version are suitable for python 2.5 and Oracle client 10.2.0.4, so try cx_Oracle-5.1.tar.gz. Unpacked tar,
go to unpacked folder and run python setup.py install. I got error:
Traceback (most recent call last):
File "setup.py", line 187, in <module>
raise DistutilsSetupError("cannot locate Oracle include files")
distutils.errors.DistutilsSetupError: cannot locate Oracle include files
In .bash_profile I have setted oracle path:
export ORACLE_HOME=/usr/oracle/10.2.0.4/client
export PATH=$ORACLE_HOME/bin
export LD_LIBRARY_PATH=$ORACLE_HOME/lib
How fix such error, maybe I need another version of cx_Oracle tar?
Run pip install cx_Oracle. Got error:
Downloading/unpacking cx-Oracle
Cannot fetch index base URL https://pypi.python.org/simple/
Could not find any downloads that satisfy the requirement cx-Oracle
No distributions at all found for cx-Oracle
Could someone advise me right solution?
Update
After suggestion in response I got following error:
...
cx_Oracle.c:496: warning: passing argument 3 of âPyModule_AddIntConstantâ makes integer from pointer without a cast
cx_Oracle.c:497: error: âOCI_UCBTYPE_EXITâ undeclared (first use in this function)
cx_Oracle.c:497: warning: passing argument 3 of âPyModule_AddIntConstantâ makes integer from pointer without a cast
cx_Oracle.c:498: error: âOCI_UCBTYPE_REPLACEâ undeclared (first use in this function)
cx_Oracle.c:498: warning: passing argument 3 of âPyModule_AddIntConstantâ makes integer from pointer without a cast
error: command 'gcc' failed with exit status 1
When you run setup.py it will check for any of these folders on your ORACLE_HOME.
possibleIncludeDirs = ["rdbms/demo", "rdbms/public", "network/public",
"sdk/include"]
Also the instant client sometimes places the include files, such as oci.h, in /usr/include/oracle//client, if there is no 'include' directory under ORACLE_HOME create a symbolic link to it.
sudo ln -s /usr/include/oracle/11.2/client $ORACLE_HOME/include
Looks like you're missing the Client SDK
Make sure you install the instant client sdk for you OS.
http://www.oracle.com/technetwork/database/features/instant-client/index-097480.html
Install oracle_client_basic
oracle-instantclient11.2-basic-11.2.0.4.0-1.x86_64.rpm
Using pip install
python -m pip install cx_Oracle
Adding ldconfig
Find your client location, for example: /u01/app/oracle/product/11.2.0/client_1/lib
vi /etc/ld.so.conf.d/oracle.conf
Add this location into it:
/u01/app/oracle/product/11.2.0/client_1/lib
ldconfig
import cx_oracle
Make sure that you've a client sdk present in your path.
Also I had to do add this to my .bash_rc
export DYLD_LIBRARY_PATH=$ORACLE_HOME
In addition to this, Python 2.7 does not come with Python.h which is available by default in Python 3.4. So I would also suggest to install python-devel package
yum install python-devel
That should resolve the issue.

Using virtualenv with python3 in openSuSE

I am experiencing a problem when using virtualenv in openSuSE 12.3 with Python3:
I installed the python3 and python3-devel packages.
Then I installed the newest distribute and pip and finally virtualenv using pip.
When I try to create a virtualenv I get the following error:
$ virtualenv-3.3 venv01
Using base prefix '/usr'
New python executable in venv01/bin/python3.3
Also creating executable in venv01/bin/python
Installing distribute.........................................................................................................................................................................................................................................................................................................................................................................................................done.
Installing pip....
Complete output from command /home/user/venv01/bin/python3.3 -x /home/user/venv01/bin/easy_install /usr/local/lib/pytho...ort/pip-1.3.1.tar.gz:
/home/user/venv01/bin/python3.3: can't open file '/home/user/venv01/bin/easy_install': [Errno 2] No such file or directory
----------------------------------------
...Installing pip...done.
Traceback (most recent call last):
File "/usr/local/bin/virtualenv-3.3", line 9, in <module>
load_entry_point('virtualenv==1.9.1', 'console_scripts', 'virtualenv-3.3')()
File "/usr/local/lib/python3.3/site-packages/virtualenv.py", line 979, in main
no_pip=options.no_pip)
File "/usr/local/lib/python3.3/site-packages/virtualenv.py", line 1094, in create_environment
install_pip(py_executable, search_dirs=search_dirs, never_download=never_download)
File "/usr/local/lib/python3.3/site-packages/virtualenv.py", line 667, in install_pip
filter_stdout=_filter_setup)
File "/usr/local/lib/python3.3/site-packages/virtualenv.py", line 1057, in call_subprocess
% (cmd_desc, proc.returncode))
OSError: Command /home/user/venv01/bin/python3.3 -x /home/user/venv01/bin/easy_install /usr/local/lib/pytho...ort/pip-1.3.1.tar.gz failed with error code 2
Running it with -vvv yields some interesting output that shows that distribute
is extracted to <venv>/local/lib/python3.3/site-packages/.
I wonder why distribute is not installed into <venv>/lib/python3.3/site-packages/?
Does anyone have an idea why this happens and how I can use virtualenv in
openSuSE without compiling python3 myself?
[now fixed in latest patches from opensuse]
[oh! i just realised you are the same person as the original link. sorry. but i will leave this as it is a top result for google search on this issue (was searching myself for any update) so it may help others.]
this is a known issue, discussed at https://forums.opensuse.org/english/get-technical-help-here/applications/484475-using-virtualenv-python-3-a.html and with an open bug at https://bugzilla.novell.com/show_bug.cgi?id=809831
the only work-around i know of is to install everything yourself. it's not so hard, and i describe what is necessary at http://www.acooke.org/cute/GettingPyt0.html
basically:
install python 3.3 from source (do an "altinstall" to install as /usr/local/bin/python3.3)
fix the lib issue (link lib_dynload from /usr/local/lib64/python3.3 to /usr/local/lib/python3.3)
install distutils
install virtualenv
then you can use python3.3 and virtual-env-3.3 etc as expected.

Resources