Outils pour utilisateurs

Outils du site


blog

Python virtualenv pyvenv pyenv pipenv poetry

pyvenv

Remplacé par python3 -m venv

pyvenv plop
cd plop
source bin/activate
pip install --upgrade pip
#deactivate
pyvenv
cd env/
cd ..
source env/bin/activate
pip install -r requirements.txt 
python3 -m venv plop
source plop/bin/activate

pipenv

Source : http://sametmax.com/pipenv-solution-moderne-pour-remplacer-pip-et-virtualenv/

Préciser la version de Python à utiliser | python2 | --two | | python3 | --three |

Install via PIP

python3 -m pip install pip --upgrade --user
python3 -m pip install pipenv --user

Install via apt

apt-get install pipenv

Exemple

pipenv run python
pipenv shell
pipenv install --dev
# Créer le fichier des dépendances
pipenv lock
 
# Installer toutes les dépendances
pipenv install

Afficher les dépendances

pipenv graph

Chemin du dossier du virtualenv

pipenv --venv
Pb
AttributeError: module 'pip' has no attribute 'get_installed_distributions'
$ pipenv check                                                                                                            
Checking PEP 508 requirements…
Passed!
Checking installed package safety…
An error occurred:
Traceback (most recent call last):
  File "/usr/lib/python3.7/runpy.py", line 193, in _run_module_as_main
    "__main__", mod_spec)
  File "/usr/lib/python3.7/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "/usr/lib/python3/dist-packages/pipenv/patched/safety.zip/__main__.py", line 8, in <module>                                                                     
  File "/usr/lib/python3/dist-packages/pipenv/patched/safety.zip/click/core.py", line 722, in __call__                                                                 
  File "/usr/lib/python3/dist-packages/pipenv/patched/safety.zip/click/core.py", line 697, in main                                                                     
  File "/usr/lib/python3/dist-packages/pipenv/patched/safety.zip/click/core.py", line 1066, in invoke                                                                  
  File "/usr/lib/python3/dist-packages/pipenv/patched/safety.zip/click/core.py", line 895, in invoke                                                                   
  File "/usr/lib/python3/dist-packages/pipenv/patched/safety.zip/click/core.py", line 535, in invoke                                                                   
  File "/usr/lib/python3/dist-packages/pipenv/patched/safety.zip/safety/cli.py", line 52, in check                                                                     
AttributeError: module 'pip' has no attribute 'get_installed_distributions'
Solution
sudo apt-get -y autoremove --purge pipenv python3-virtualenv-clone
$ python3 -m pip install pip --upgrade --user
$ python3 -m pip install pipenv --user
2025/03/24 15:06

Cluster Pacemaker et Corosync partition GFS2

Brouillon

Voir :

Voir aussi :

/sbin/lvmconf --enable-cluster

ou

/etc/lvm/lvm.conf

locking_type = 3
sed -i -e "s/use_lvmetad \= 1/use_lvmetad \= 0/g" /etc/lvm/lvm.conf
systemctl stop lvm2-lvmetad.service
dracut -H -f /boot/initramfs-$(uname -r).img  $(uname -r)
yum install rgmanager lvm2-cluster gfs2-utils
 
mkfs.gfs2 -p lock_dlm -t my_cluster:FSName -j 2 /dev/sdb

-j 2
2 journaux car deux nœuds

Teste

mount -t gfs2 -o locktable="my_cluster:FSName" /dev/sdb /mnt/gfs/
pcs resource create dlm ocf:pacemaker:controld op monitor interval=30s on-fail=fence clone interleave=true ordered=true
 
pcs resource create clvmd ocf:heartbeat:clvm op monitor interval=30s on-fail=fence clone interleave=true ordered=true
 
pcs constraint order start dlm-clone then clvmd-clone
pcs constraint colocation add clvmd-clone with dlm-clone
pcs resource create clusterfs Filesystem device="/dev/vg_data/lv_test1" directory="/mnt/gfs" fstype="gfs2" "options=noatime" \
op monitor interval=10s on-fail=fence clone interleave=true

Pb

Transport endpoint is not connected
mount: mount /dev/sdb on /mnt/gfs failed: Transport endpoint is not connected

Solution

systemctl start dlm
systemctl enable dlm
2025/03/24 15:06

Python tests unitaires

Voir aussi:

Source : http://sametmax.com/un-gros-guide-bien-gras-sur-les-tests-unitaires-en-python-partie-3/

Voir aussi les différents types de test :

  • Tests unitaires (au format unittest ou pytest) : units
  • Tests d’intégration : integration
  • Tests syntaxique : sanity
#pip3 install pytest
apt-get install python3-pytest

Voir aussi : Testinfra

test_plop.py

#! /usr/bin/python3
# coding: utf-8
 
#import pytest
 
from func import plop
 
def test_plop():
    assert foo == bar
pytest-3

Autre

~/swift/.unittests

#!/bin/bash
 
TOP_DIR=$(dirname $(realpath "$0"))
 
cd $TOP_DIR/test/unit
nosetests --exe --with-coverage --cover-package swift --cover-erase --cover-branches --cover-html --cover-html-dir="$TOP_DIR"/cover $@
rvalue=$?
rm -f .coverage
cd -
exit $rvalue
$ dpkg -S /usr/bin/nosetests
python-nose: /usr/bin/nosetests
2025/03/24 15:06

Note Python pip

Voir aussi :

Voir uv : remplace pip, pipx, poetry, pyenv,

Do not run pip install as root (or with sudo)

Installation dans ~/.local/bin/

easy_install --user pip

Liste des “packages” installés dans la sessions de l'utilisateur :

pip freeze --local

Ou

python -m ensurepip

Voir aussi pipreqs

Installer un package depuis un dépôt git

pip install --user git+https://github.com/benoit-intrw/livestreamer

Mise à jour des “packages” locaux

pip install --local -U livestreamer

Installation d'un “package” dans la session de l'utilisateur (pas besoin de droit root) (pas besoin de prendre le risque d’abîmer sa distro)

pip install --user livestreamer

Tous mettre à jour localement

pip freeze --local | grep -v '^\-e' | cut -d = -f 1  | xargs -n1 pip install -U

Source http://stackoverflow.com/questions/2720014/upgrading-all-packages-with-pip

Fichier requirements.txt

env1/bin/pip freeze > requirements.txt
env2/bin/pip install -r requirements.txt

Voir aussi pipreqs

Exemple de fichier requirements.txt

requirements.txt

numpy>=1.15.0
opencv-python>=3.4.2.17
pandas>=0.23.3 --no-binary pandas
Pillow>=5.2.0
tensorflow==1.8.0
tensorflow-gpu==1.8.0

Variable Python - utiliser les dist-packages depuis un environnement virtuel

~/.bashrc

export PYTHONPATH=$PYTHONPATH:/usr/lib/python3/dist-packages/:$HOME/test/lib/python3.5/site-packages/

Utiliser /usr/local

~/.config/pip/pip.conf

[global]
target = /usr/local/lib/python2.7/site-packages

Ou

PIP_TARGET=/usr/local/lib/python2.7/site-packages

~/.bashrc

export PYTHONPATH=$PYTHONPATH:/usr/local/lib/python2.7/site-packages

Exemple de PIP en interne

pip.conf

[global]
timeout = 300
index-url = https://pypi.acme.fr/pypi/+simple/
cert = /etc/ssl/certs/ca-certificates.crt

pip.conf

mkdir -p ~/.pip/ && \
echo "[global]" >> ~/.pip/pip.conf && \
URLPIP="https://artifactory.packages.install-os.acme.local/api/pypi/ext_pypi/simple" && \
echo "index = $URLPIP " >> ~/.pip/pip.conf && \
echo "index-url = $URLPIP " >> ~/.pip/pip.conf && \
echo "cert = /etc/ssl/certs/ca-certificates.crt " >> ~/.pip/pip.conf 

Autres

ssh -R3128:192.168.56.1:3128 user@192.168.205.11
 
export http_proxy=http://127.0.0.1:3128
export https_proxy=http://127.0.0.1:3128
 
python3 -m venv test
cd test
source bin/activate
pip install -U pip
# pip install --use-feature=2020-resolver plop
pip install --no-binary pandas pandas
#deactivate
export PIP_BREAK_SYSTEM_PACKAGES=1

Voir mise_a_jour_repos_git

constraints

You can achieve this with a constraints file. Just put all your constraints into that file:

constraints.txt

google-api-core==1.16.0

Then you can install via:

python -m pip install -c constraints.txt google-cloud-secret-manager

This will try every version of google-cloud-secret-manager, starting from the most recent version, until it finds a version that is compatible with the given constraints.

pipx

python3 -m pip install --user pipx
python3 -m pipx ensurepath
2025/03/24 15:06

Python Pb pip

Erreur - ImportError: cannot import name IncompleteRead

ImportError: cannot import name IncompleteRead
Solution
apt-get remove python-pip
easy_install pip

Erreur 'extras_require' must be a directory whose

Solution
sudo -H pip install --upgrade --ignore-installed pip setuptools

Erreur binary_only = FormatControl(set(), {':all:'})

pip install --upgrade pip
$ pip                      
Traceback (most recent call last):
  File "/usr/bin/pip", line 7, in <module>
    from pip._internal.main import main
  File "/usr/lib/python2.6/site-packages/pip/_internal/main.py", line 13, in <module>
    from pip._internal.cli.autocompletion import autocomplete
  File "/usr/lib/python2.6/site-packages/pip/_internal/cli/autocompletion.py", line 11, in <module>
    from pip._internal.cli.main_parser import create_main_parser
  File "/usr/lib/python2.6/site-packages/pip/_internal/cli/main_parser.py", line 7, in <module>
    from pip._internal.cli import cmdoptions
  File "/usr/lib/python2.6/site-packages/pip/_internal/cli/cmdoptions.py", line 105
    binary_only = FormatControl(set(), {':all:'})
                                               ^
SyntaxError: invalid syntax
Solution

Utiliser une version de pip compatible avec la version de python installé

Exemple pour Python 2.6 (RedHat / CentOS 6)

curl https://bootstrap.pypa.io/2.6/get-pip.py -o get-pip.py
python get-pip.py

Puis

sudo -H pip install --upgrade --ignore-installed pip setuptools

ERROR: XMLRPC request failed

$ pip3 search pulumi
ERROR: XMLRPC request failed [code: -32500]
RuntimeError: PyPI's XMLRPC API is currently disabled due to unmanageable load and will be deprecated in the near future. S
ee https://status.python.org/ for more information

Solution

pip3 install --user pip_search
pip_search pulumi
alias pip='function _pip(){
    if [ $1 = "search" ]; then
        pip_search "$2";
    else pip "$@";
    fi;
};_pip'

Erreur : plop.whl is not a supported wheel on this platform.

Création d'un venv

python3 -m venv plop_venv
cd plop_venv/
source bin/activate
$ python3.6 -m pip install ~/tmp/confluent_kafka-1.7.0-cp36-cp36m-manylinux2010_x86_64.whl
confluent_kafka-1.7.0-cp36-cp36m-manylinux2010_x86_64.whl is not a supported wheel on this platform.

# Logs
pip install /tmp/confluent_kafka-1.7.0-cp36-cp36m-manylinux2010_x86_64.whl --log pip.log
...
pip._vendor.urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='pypi.python.org', port=443): Max retries exceeded with url: /pypi/pip/json (Caused by NewConnectionError('<pip._vendor.urllib3.connection.VerifiedHTTPSConnection object at 0x7f2e0d813c18>: Failed to establish a new connection: [Errno -2] Name or service not known',))
...

Premier pb, le serveur n'a pas accès à Internet. Regardons les dépendance de notre paquet whl. Une fois dézippé la liste des dépendances se trouve ici : confluent_kafka-1.7.0.dist-info/METADATA Dans notre cas, nous n'avons aucune dépendance stricte

mkdir plop
cd plop
unzip -x ../confluent_kafka-1.7.0-cp36-cp36m-manylinux2010_x86_64.whl

grep 'Requires-Dist' confluent_kafka-1.7.0.dist-info/METADATA | grep -v 'extra'
Requires-Dist: futures ; python_version < "3.2"
Requires-Dist: enum34 ; python_version < "3.4"
# Logs sans tentative de connexion à internet
pip install /tmp/confluent_kafka-1.7.0-cp36-cp36m-manylinux2010_x86_64.whl --log pip.log -f ./ --no-deps --no-index

# Sortir du venv
deactivate
Solution

Mettre à jour PIP

pip install /tmp/pip-21.3.1-py3-none-any.whl
pip install /tmp/confluent_kafka-1.7.0-cp36-cp36m-manylinux2010_x86_64.whl
2025/03/24 15:06
blog.txt · Dernière modification : de 127.0.0.1

Donate Powered by PHP Valid HTML5 Valid CSS Driven by DokuWiki