Ubuntu on Blog GoHugo de Fredô : Linux, Proxmox, IA, Trail, Course, Randonnée, Gravel, Ski de Randonnée

Proxmox / Ollama / Open WebUI : Migration OS de la VM

Mon, 02 Jun 2025 00:00:00 +0000

Je suis passé en version “Ubuntu 24.04.2 LTS” (le kernel est 6.8.0-60-generic)

Migration :

Ubuntu 22.04.5 LTS ( kernel : 5.15.0-140-generic ) => Ubuntu 24.04.2 LTS (kernel est 6.8.0-60-generic)
CUDA : 12.8.93 => 12.9
Python : 3.11 => 3.12

Les cartes NVIDIA sont toujours visibles :

+-----------------------------------------------------------------------------------------+
| NVIDIA-SMI 575.51.03              Driver Version: 575.51.03      CUDA Version: 12.9     |
|-----------------------------------------+------------------------+----------------------+
| GPU  Name                 Persistence-M | Bus-Id          Disp.A | Volatile Uncorr. ECC |
| Fan  Temp   Perf          Pwr:Usage/Cap |           Memory-Usage | GPU-Util  Compute M. |
|                                         |                        |               MIG M. |
|=========================================+========================+======================|
|   0  Quadro M5000                   Off |   00000000:00:10.0 Off |                  Off |
| 39%   44C    P8             14W /  150W |       5MiB /   8192MiB |      0%      Default |
|                                         |                        |                  N/A |
+-----------------------------------------+------------------------+----------------------+
|   1  Quadro M4000                   Off |   00000000:00:11.0 Off |                  N/A |
| 49%   48C    P8             14W /  120W |       5MiB /   8192MiB |      0%      Default |
|                                         |                        |                  N/A |
+-----------------------------------------+------------------------+----------------------+

J’ai refait un benchmark :

Ubuntu 24 : Stable diffusion : Problème avec Python 3.12 & torch

Mon, 02 Jun 2025 00:00:00 +0000

Avec Python 3.12.3 :

Python 3.12.3 (main, Feb  4 2025, 14:48:35) [GCC 13.3.0]
Version: v1.10.1
Commit hash: 82a973c04367123ae98bd9abdf80d9eda9b910e2
Installing torch and torchvision
Looking in indexes: https://pypi.org/simple, https://download.pytorch.org/whl/cu121
ERROR: Could not find a version that satisfies the requirement torch==2.1.2 
(from versions: 2.2.0, 2.2.0+cu121, 2.2.1, 2.2.1+cu121, 2.2.2, 2.2.2+cu121, 
2.3.0, 2.3.0+cu121, 2.3.1, 2.3.1+cu121, 2.4.0, 2.4.0+cu121, 2.4.1, 
2.4.1+cu121, 2.5.0, 2.5.0+cu121, 2.5.1, 2.5.1+cu121, 2.6.0, 2.7.0)
ERROR: No matching distribution found for torch==2.1.2

Donc j’utilise Python 3.11 :

# apt-get install python3-setuptools
# apt-get install python3-build
# python3.11 -m pip install --upgrade pip setuptools wheel
# virtualenv -p /usr/bin/python3.11 venv
created virtual environment CPython3.11.12.final.0-64 in 1366ms
  creator CPython3Posix(dest=/home/XXXX/stable-diffusion-webui/venv, clear=False, 
no_vcs_ignore=False, global=False)
  seeder FromAppData(download=False, pip=bundle, setuptools=bundle, wheel=bundle, 
via=copy, app_data_dir=/home/XXXX/.local/share/virtualenv)
    added seed packages: pip==24.0, setuptools==68.1.2, wheel==0.42.0
  activators BashActivator,CShellActivator,FishActivator,NushellActivator,PowerShellActivator,PythonActivator
$ source venv/bin/activate
$ python3.11 -m pip install --upgrade pip setuptools wheel
$ bash webui.sh --api --listen

Tuxedo : Migration vers Ubuntu 24.04.2 LTS et galère ...

Sat, 22 Feb 2025 00:00:00 +0000

J’ai pas la liste complete des actions que j’ai du faire.

Mais j’ai du supprimer “douane” :

dkms remove douane/0.8.2 --all

Sinon j’avais une erreur :

make -j8 KERNELRELEASE=6.8.0-53-generic -C /lib/modules/6.8.0-53-generic/build M=/var/lib/dkms/douane/0.8.2/build...(bad exit status: 2)
ERROR (dkms apport): binary package for douane: 0.8.2 not found
Error! Bad return status for module build on kernel: 6.8.0-53-generic (x86_64)
Consult /var/lib/dkms/douane/0.8.2/build/make.log for more information.
dkms autoinstall on 6.8.0-53-generic/x86_64 succeeded for tuxedo-keyboard virtualbox
dkms autoinstall on 6.8.0-53-generic/x86_64 failed for douane(10)
Error! One or more modules failed to install during autoinstall.

J’ai du supprimer aussi “tuxedo-cc-wmi”, pareil sinon j’avais une erreur :

Mise à jours de Grafana sous Ubuntu

Mon, 26 Feb 2024 00:00:00 +0000

J’ai une version Grafana : v6.7.4 (June 3, 2020) sous Ubuntu. J’ai donc fait une mise à jours vers la version v10.3.3 .

En fait le “apt upgrade” ne fonctionnait pas.

 Le fichier configuré « main/binary-i386/Packages » ne sera pas pris en compte 
car le dépôt « https://apt.grafana.com stable InRelease » 
ne prend pas en charge l'architecture « i386 »

J’ai donc fait :

# apt-get install -y adduser libfontconfig1 musl
# wget https://dl.grafana.com/enterprise/release/grafana-enterprise_10.3.3_amd64.deb
# cp /var/lib/grafana/grafana.db .
# apt-get remove grafana
# sudo snap remove grafana
# sudo dpkg -i grafana-enterprise_10.3.3_amd64.deb
# sudo /bin/systemctl daemon-reload
# sudo /bin/systemctl enable grafana-server
# updatedb
# cp /var/lib/grafana/grafana.db /var/lib/grafana/grafana.db.backup
# cp /root/grafana.db /var/lib/grafana/grafana.db

Je suis passé du port 3000 au port 3001. Le backup de la configuration ( grafana.db ) n’a pas fonctionné …

TUXEDO : Tuxedo Control Center 2.1.1 : Big issue

Wed, 20 Dec 2023 00:00:00 +0000

Now I have always high CPU load (process tccd) and fan at 100% … very good release !

And also impossible to put “Powersave extreme” or “Quiet” … the laptop stop after too hot.

My OS : 22.04.3 LTS (Jammy Jellyfish) .

Logs :

In loops :

$ grep "tccd" /var/log/syslog | tail -f
Dec 20 12:06:47 TUXEDO-Polaris-Intel-Gen3-TGL tccd[1152]: Authorization required, but no authorization protocol specified
Dec 20 12:06:47 TUXEDO-Polaris-Intel-Gen3-TGL tccd[1152]: Can't open display :1
Dec 20 12:06:47 TUXEDO-Polaris-Intel-Gen3-TGL tccd[1152]: Failed executing onWork() => Error: Command failed: export XAUTHORITY=/home/arias/.Xauthority && xrandr -q -display :1 --current
Dec 20 12:06:47 TUXEDO-Polaris-Intel-Gen3-TGL tccd[1152]: Authorization required, but no authorization protocol specified
Dec 20 12:06:47 TUXEDO-Polaris-Intel-Gen3-TGL tccd[1152]: Can't open display :1
Dec 20 12:06:50 TUXEDO-Polaris-Intel-Gen3-TGL tccd[1152]: Authorization required, but no authorization protocol specified
Dec 20 12:06:50 TUXEDO-Polaris-Intel-Gen3-TGL tccd[1152]: Can't open display :1
Dec 20 12:06:50 TUXEDO-Polaris-Intel-Gen3-TGL tccd[1152]: Failed executing onWork() => Error: Command failed: export XAUTHORITY=/home/arias/.Xauthority && xrandr -q -display :1 --current
Dec 20 12:06:50 TUXEDO-Polaris-Intel-Gen3-TGL tccd[1152]: Authorization required, but no authorization protocol specified
Dec 20 12:06:50 TUXEDO-Polaris-Intel-Gen3-TGL tccd[1152]: Can't open display :1

And also :

Ubuntu : ERROR (dkms apport): binary package for evdi: 1.10.1 not found

Tue, 07 Nov 2023 00:00:00 +0000

Dans syslog j’ai l’erreur suivante :

make -j16 KERNELRELEASE=6.5.0-10006-tuxedo all INCLUDEDIR=/lib/modules/6.5.0-10006-tuxedo/build/include KVERSION=6.5.0-10006-tuxedo DKMS_BUILD=1...(bad exit status: 2)
ERROR (dkms apport): binary package for evdi: 1.10.1 not found
Error! Bad return status for module build on kernel: 6.5.0-10006-tuxedo (x86_64)
Consult /var/lib/dkms/evdi/1.10.1/build/make.log for more information.

Quand je regarde le fichier /var/lib/dkms/evdi/1.10.1/build/make.log :

DKMS make.log for evdi-1.10.1 for kernel 6.5.0-10006-tuxedo (x86_64)
mar. 07 nov. 2023 14:00:31 CET
make KBUILD_VERBOSE=1 M=/var/lib/dkms/evdi/1.10.1/build SUBDIRS=/var/lib/dkms/evdi/1.10.1/build SRCROOT=/var/lib/dkms/evdi/1.10.1/build CONFIG_MODULE_SIG= -C /lib/modules/6.5.0-10006-tuxedo/build modules
make[1]: Entering directory '/usr/src/linux-headers-6.5.0-10006-tuxedo'
make --no-print-directory -C /usr/src/linux-headers-6.5.0-10006-tuxedo \
-f /usr/src/linux-headers-6.5.0-10006-tuxedo/Makefile modules
warning: the compiler differs from the one used to build the kernel
  The kernel was built by: x86_64-linux-gnu-gcc-11 (Ubuntu 11.4.0-1ubuntu1~22.04) 11.4.0
  You are using:           gcc-11 (Ubuntu 11.4.0-1ubuntu1~22.04) 11.4.0
make -f ./scripts/Makefile.build obj=/var/lib/dkms/evdi/1.10.1/build need-builtin=1 need-modorder=1
# cmd_mod /var/lib/dkms/evdi/1.10.1/build/evdi.mod

Pour l’instant j’ai pas réussi à fixer le problème.

Ubuntu : ThunderBirds : Plus possible de se connecter à Gmail via IMAP OAuth2

Wed, 20 Sep 2023 00:00:00 +0000

Depuis le 17/09/2023, Thunderbird n’arrive plus à se connecter sur Gmail en IMAP.

Ma configuration :

Ubuntu 22.04.3 LTS (Jammy Jellyfish)

$ sudo snap refresh thunderbird –stable thunderbird 115.2.3-1 from Canonical✓ refreshed

J’ai le même problème avec la version 118 de thunderbird.

J’ai l’erreur :

“400. That’s an error. The server cannot process the request because it is malformed. It should not be retried. That’s all we know.”

J’ai essayé quelques commandes sans succès :

Ubuntu : Module evdi not found in directory for displaylink-driver.service

Thu, 14 Sep 2023 00:00:00 +0000

J’ai vu que j’avais en boucle dans syslog :

sh[30354]: modprobe: FATAL: Module evdi not found in directory /lib/modules/6.2.0-10018-tuxedo
sh[30396]: Kernel preparation unnecessary for this kernel. Skipping...
sh[30396]: Building module:
sh[30396]: cleaning build area...
sh[30396]: make -j16 KERNELRELEASE=6.2.0-10018-tuxedo all INCLUDEDIR=/lib/modules/6.2.0-10018-tuxedo/build/include KVERSION=6.2.0-10018-tuxedo DKMS_BUILD=1...(bad exit status: 2)
sh[31025]: ERROR (dkms apport): binary package for evdi: 1.10.1 not found
sh[31099]: Error! Bad return status for module build on kernel: 6.2.0-10018-tuxedo (x86_64)
sh[31099]: Consult /var/lib/dkms/evdi/1.10.1/build/make.log for more information.
systemd[1]: displaylink-driver.service: Control process exited, code=exited, status=10/n/a
systemd[1]: displaylink-driver.service: Failed with result 'exit-code'.
systemd[1]: Failed to start DisplayLink Driver Service.
systemd[1]: displaylink-driver.service: Consumed 7.320s CPU time.
systemd[1]: displaylink-driver.service: Scheduled restart job, restart counter is at 16.
systemd[1]: Stopped DisplayLink Driver Service.
systemd[1]: displaylink-driver.service: Consumed 7.320s CPU time.
systemd[1]: Starting DisplayLink Driver Service...

J’ai donc essayé manuellement avec plusieurs versions mais sans succès :

Ubuntu : disk-space-saver : Bof ...

Wed, 28 Sep 2022 00:00:00 +0000

J’ai voulu tester disk-space-saver mais il a planté … trop de fichiers.

disk-space-saver
Gtk-Message: 16:51:43.225: Failed to load module "xapp-gtk3-module"
Gtk-Message: 16:51:43.225: Failed to load module "appmenu-gtk-module"
Gtk-Message: 16:51:45.005: GtkDialog mapped without a transient parent.
This is discouraged.

<--- Last few GCs --->

[11047:0xd780080c000]    77004 ms: Scavenge 1885.0 (1950.3) -> 1879.7
(1951.8) MB, 2.6 / 0.0 ms  (average mu = 0.991, current mu = 0.991)
allocation failure;
[11047:0xd780080c000]    77074 ms: Scavenge 1887.0 (1951.9) -> 1881.7
(1953.7) MB, 2.5 / 0.0 ms  (average mu = 0.991, current mu = 0.991)
allocation failure;
[11047:0xd780080c000]    77141 ms: Scavenge 1888.5 (1953.9) -> 1883.0
(1955.1) MB, 2.5 / 0.0 ms  (average mu = 0.991, current mu = 0.991)
allocation failure;

<--- JS stacktrace --->

[11047:0927/165300.472533:ERROR:v8_initializer.cc(714)] V8 process OOM
(Oilpan: Reserving memory.).

Misère.

Thunderbird & Chrome : Erreur Assertion 'GDK_IS_WAYLAND_WINDOW (window)'

Mon, 26 Sep 2022 00:00:00 +0000

Je viens de voir une nouvelle erreur au lancement de Thunderbird à cause de GDK :

[GFX1-]: glxtest: VA-API test failed: failed to initialise VAAPI connection.
[Parent 7820, Main Thread] WARNING: gdk_wayland_window_set_dbus_properties_libgtk_only: assertion 'GDK_IS_WAYLAND_WINDOW (window)' failed: 'glib warning', file /builds/worker/checkouts/gecko/toolkit/xre/nsSigHandlers.cpp:167
(thunderbird-beta:7820): Gdk-CRITICAL **: 08:52:03.518: gdk_wayland_window_set_dbus_properties_libgtk_only: assertion 'GDK_IS_WAYLAND_WINDOW (window)' failed
[Parent 7820, Main Thread] WARNING: gdk_wayland_window_set_dbus_properties_libgtk_only: assertion 'GDK_IS_WAYLAND_WINDOW (window)' failed: 'glib warning', file /builds/worker/checkouts/gecko/toolkit/xre/nsSigHandlers.cpp:167
(thunderbird-beta:7820): Gdk-CRITICAL **: 08:52:03.677: gdk_wayland_window_set_dbus_properties_libgtk_only: assertion 'GDK_IS_WAYLAND_WINDOW (window)' failed
[Parent 7820, Main Thread] WARNING: gdk_wayland_window_set_dbus_properties_libgtk_only: assertion 'GDK_IS_WAYLAND_WINDOW (window)' failed: 'glib warning', file /builds/worker/checkouts/gecko/toolkit/xre/nsSigHandlers.cpp:167
(thunderbird-beta:7820): Gdk-CRITICAL **: 08:52:03.794: gdk_wayland_window_set_dbus_properties_libgtk_only: assertion 'GDK_IS_WAYLAND_WINDOW (window)' failed
[Parent 7820, Main Thread] WARNING: gdk_wayland_window_set_dbus_properties_libgtk_only: assertion 'GDK_IS_WAYLAND_WINDOW (window)' failed: 'glib warning', file /builds/worker/checkouts/gecko/toolkit/xre/nsSigHandlers.cpp:167
(thunderbird-beta:7820): Gdk-CRITICAL **: 08:52:04.091: gdk_wayland_window_set_dbus_properties_libgtk_only: assertion 'GDK_IS_WAYLAND_WINDOW (window)' failed
[Parent 7820, Main Thread] WARNING: gdk_wayland_window_set_dbus_properties_libgtk_only: assertion 'GDK_IS_WAYLAND_WINDOW (window)' failed: 'glib warning', file /builds/worker/checkouts/gecko/toolkit/xre/nsSigHandlers.cpp:167
(thunderbird-beta:7820): Gdk-CRITICAL **: 08:52:04.190: gdk_wayland_window_set_dbus_properties_libgtk_only: assertion 'GDK_IS_WAYLAND_WINDOW (window)' failed
Unsupported modifier, resource creation failed.
XXX: resource creation failed
Unsupported modifier, resource creation failed.
XXX: resource creation failed
Unsupported modifier, resource creation failed.
XXX: resource creation failed
Unsupported modifier, resource creation failed.
XXX: resource creation failed

Visiblement l’erreur est liée en GDK et j’ai la même sous Chrome :

Slack sous Ubuntu : CPU & RAM max par moment

Sat, 24 Sep 2022 00:00:00 +0000

Visiblement il y a un bug … Slack essaye d’avoir accès a un fichier de logs, dont il n’a plus accès. Il tourne donc en boucle et par la même occasion il sature de logs syslog.

Misère.

Dans syslog en boucle:

Sep 23 07:47:19 XXXXXX kernel: [1541572.057366] audit: type=1400 audit(1663912039.268:1467395959):
apparmor="DENIED" operation="rename_src" profile="snap.slack.slack"
name="/home/XXXXX/snap/slack/64/.config/Slack/logs/default/webapp-console1.log"
pid=18282 comm="slack" requested_mask="wd" denied_mask="wd" fsuid=1000
ouid=1000

Quand je regarde la fin du fichier sur Slack :

tail -f /home/XXXXX/snap/slack/64/.config/Slack/logs/default/webapp-console1.log
[09/05/22, 11:39:35:001] info: [CHECK-UNREADS] (TJ5HTNKGB) Checking unreads after unread line became visible
[09/05/22, 11:39:35:001] info: [CHECK-UNREADS] (TJ5HTNKGB) Not marking C020NGCFJ7R because last_read >= latest && channel is read
[09/05/22, 11:39:37:301] info: Breadcrumb: ui.click: div.c-message__reply_bar_description > span.c-message__reply_bar_view_thread
[09/05/22, 11:39:37:320] info: [ROUTES] [ROUTE_FLEX_THREAD] navigateToRoute called with reason workspace-store/setSecondaryView
[09/05/22, 11:39:37:320] info: [ROUTES] [ROUTE_FLEX_THREAD] Attempting to navigate to new route {"teamId":"TJ5HTNKGB","entityId":"C020NGCFJ7R","memberId":"UKJ6492EP","threadId":"C020NGCFJ7R-1662365958.376179"}
[09/05/22, 11:39:37:320] info: [ROUTES] [ROUTE_FLEX_THREAD] About to run notifyRouteWillNavigateListeners to determine shouldNavigate
[09/05/22, 11:39:37:320] info: [ROUTES] [ROUTE_FLEX_THREAD] notifyRouteWillNavigateListeners finished, shouldNavigate is true
[09/05/22, 11:39:37:322] info: [HISTORY-NAVIGATION] Adding route to the history stack
[09/05/22, 11:39:37:322] info: [ROUTES] [ROUTE_FLEX_THREAD] Navigated to new route
[09/05/22, 11:39:37:340] info: [API-Q] (TJ5HTNKGB) e5b6d985-1662370777.339 conversations.replies called with reason: history-api/fetchReplies

Ubuntu 22.04.1 : GCC 11 ( -fcommon ) : Issue ... Multiple definition of.

Mon, 05 Sep 2022 00:00:00 +0000

Avec GCC 11 on a changer la valeur par défaut.

GCC 11 : -fno-common (Release note : https://gcc.gnu.org/gcc-11/changes.html )
GCC 10 : -fcommon

Donc pour supprimer les problèmes (de facon rapide) il suffit d’ajouter la directive -fcommon. La solution idéale est de revoir le code … et surtout les .h.

Misère.

Pour information Ubuntu 22.04.1 utilise gcc 11.2.0-19 .

La doc : https://gcc.gnu.org/onlinedocs/gcc/Code-Gen-Options.html

-fcommon

In C code, this option controls the placement of global variables defined without an initializer, known as tentative definitions in the C standard. Tentative definitions are distinct from declarations of a variable with the extern keyword, which do not allocate storage.

Humhub v1.11.1 : Migration de php 7.3 vers php 7.4

Wed, 11 May 2022 00:00:00 +0000

J’ai du faire un update de PHP afn de pouvoir mettre la dernière version de Humhub :

sudo apt -y install lsb-release apt-transport-https ca-certificates 
sudo wget -O /etc/apt/trusted.gpg.d/php.gpg https://packages.sury.org/php/apt.gpg
echo "deb https://packages.sury.org/php/ $(lsb_release -sc) main" | sudo tee /etc/apt/sources.list.d/php.list
sudo apt update
sudo apt -y install php7.4

Ma release de Debian :

# cat /etc/os-release 
PRETTY_NAME="Debian GNU/Linux 10 (buster)"
NAME="Debian GNU/Linux"
VERSION_ID="10"
VERSION="10 (buster)"
VERSION_CODENAME=buster
ID=debian
HOME_URL="https://www.debian.org/"
SUPPORT_URL="https://www.debian.org/support"
BUG_REPORT_URL="https://bugs.debian.org/"
# php -v
PHP 7.4.29 (cli) (built: Apr 22 2022 06:44:32) ( NTS )
Copyright (c) The PHP Group
Zend Engine v3.4.0, Copyright (c) Zend Technologies
    with Zend OPcache v7.4.29, Copyright (c), by Zend Technologies

La seconde étape :

Ubuntu 20.04 : Thunderbirds impossible d'enregistrer un fichier

Wed, 11 May 2022 00:00:00 +0000

Il était impossible d’ouvrir un dossier ou d’enregistrer un fichier, j’‘ai donc vu qu’il manquait un package :

$ sudo apt-get install xdg-desktop-portal-gtk
...
Les paquets supplémentaires suivants seront installés :
  xdg-desktop-portal
Les NOUVEAUX paquets suivants seront installés :
  xdg-desktop-portal xdg-desktop-portal-gtk
...

Je pense qu’il manque donc une dépendence entre Thunderbirds et xdg-desktop-portal.

A suivre.

Migration d’un fichier PST (Outlook) vers Thunderbird Linux

Tue, 04 Jan 2022 00:00:00 +0000

Etape 1 : Mettre en place le bon soft :

# sudo apt-get -y install pst-utils

Etape 2 : Conversion :

# readpst -u backup-2021.pst
# find out -type d | tac | grep -v '^out$' | xargs -d '\n' -I{} mv {} {}.sbd
# find out -name mbox -type f | xargs -d '\n' -I{} echo '"{}" "{}"' | sed -e 's/\.sbd\/mbox"$/"/' | xargs -L 1 mv
# find out -empty -type d | xargs -d '\n' rmdir
# find out -type d | egrep '*.sbd' | sed 's/.\{4\}$//' | xargs -d '\n' touch
# mv out/Boîte\ de\ réception.sbd/ ../snap/thunderbird/common/.thunderbird/zy3zk9ms.default/Mail/Local\ Folders/.
# touch ../snap/thunderbird/common/.thunderbird/zy3zk9ms.default/Mail/Local\ Folders/Boîte\ de\ réception
# touch ../snap/thunderbird/common/.thunderbird/zy3zk9ms.default/Mail/Local\ Folders/Boîte\ de\ réception.msf

A noter que le ID : zy3zk9ms n’est pas le même suivant les installations. Et aussi j’ai une installation sous snap, donc le répertoire n’est pas standard.

TUXEDO InfinityBook Pro 14 v5 : Suppression de la batterie

Thu, 26 Aug 2021 00:00:00 +0000

J’ai donc contacté le support suite au gonflement de ma batterie, et le support m’a indiqué qu’il fallait la supprimé afin d’éviter des risques d’explosions . J’ai donc supprimé la batterie.

Le support m’a donc donné le lien suivant : https://www.tuxedocomputers.com/en/Infos/Help-Support/Frequently-asked-questions/Instructions-for-opening-the-device.tuxedo#

Il y a donc une vidéo pour expliquer comment ouvrir le portable :

C’est pas trop complexe à faire.

Ubuntu : Snap : Skype : DENIED : profile="snap.skype.skype" name="/sys/devices/*"

Fri, 20 Aug 2021 00:00:00 +0000

Je viens de voir l’erreur en boucle sur mon Ubuntu :

$ dmesg | grep skype | grep "DENIED" | awk '{print $7 " " $8}' | tail
profile="snap.skype.skype" name="/sys/devices/virtual/net/tap0/speed"
profile="snap.skype.skype" name="/sys/devices/virtual/net/virbr0/speed"
profile="snap.skype.skype" name="/sys/devices/virtual/net/virbr0-nic/speed"
profile="snap.skype.skype" name="/sys/devices/virtual/net/anbox0/speed"
profile="snap.skype.skype" name="/sys/devices/virtual/net/vmnet1/speed"
profile="snap.skype.skype" name="/sys/devices/virtual/net/lo/speed"
profile="snap.skype.skype" name="/sys/devices/pci0000:00/0000:00:1d.0/0000:3b:00.1/net/enp59s0f1/speed"
profile="snap.skype.skype" name="/sys/devices/pci0000:00/0000:00:1d.1/0000:40:00.0/net/wlp64s0/speed"
profile="snap.skype.skype" name="/sys/devices/virtual/net/tap0/speed"
profile="snap.skype.skype" name="/sys/devices/virtual/net/virbr0/speed"

$ snap info skype
name:      skype
summary:   One Skype for all your devices. New features. New look. All Skype.
publisher: Skype✓
store-url: https://snapcraft.io/skype
contact:   https://www.skype.com/
license:   unset
description: |
  Skype keeps the world talking. Say “hello” with an instant message, voice or video call – all for
  free. Skype is available on phones, tablets, PCs, Macs and Linux.
  
  • Video calls – Don’t just hear the cheers, see it! Get together with 1 or 49 of your friends and
  family on a video call. Watch everyone’s smiles and cries when you tell them “We’re engaged!!!"
  
  • Chat – Reach people instantly. Send messages to your friends, liven up conversations with
  emoticons and Mojis, or create a group chat to make weekend plans with up to 300 people.
  
  • Share – Do more together. Easily share your screen, photos, videos, documents, and files with
  your family and friends. Unlike email, Skype will transfer up to 300MB per file.
  
  • Voice calls – Camera shy? Make voice calls to anyone on Skype. You can also call mobile and
  landlines at low rates.
  
  Microsoft Services Agreement - https://go.microsoft.com/fwlink/?linkid=2097426
commands:
  - skype
snap-id:      QRDEfjn4WJYnm0FzDKwqqRZZI77awQEV
tracking:     latest/stable
refresh-date: 8 days ago, at 11:59 CEST
channels:
  latest/stable:     8.75.0.140 2021-08-12 (183) 145MB -
  latest/candidate:  ↑                                 
  latest/beta:       ↑                                 
  latest/edge:       ↑                                 
  insider/stable:    8.76.76.70 2021-08-20 (184) 145MB -
  insider/candidate: ↑                                 
  insider/beta:      ↑                                 
  insider/edge:      ↑                                 
installed:           8.75.0.140            (183) 145MB -

J’ai donc ajouté les droits via l’interface :

Ubuntu : VMware player : Suppression ... "userif-3: sent link up event"

Fri, 20 Aug 2021 00:00:00 +0000

J’avais le problème de reset en boucle du soft …

$ dmesg | grep "userif-3" | tail
[169428.735247] userif-3: sent link down event.
[169428.735249] userif-3: sent link up event.
[169429.165362] userif-3: sent link down event.
[169429.165368] userif-3: sent link up event.
[169489.672222] userif-3: sent link down event.
[169489.672228] userif-3: sent link up event.
[169550.238633] userif-3: sent link down event.
[169550.238634] userif-3: sent link up event.
[169581.257563] userif-3: sent link down event.
[169581.257565] userif-3: sent link up event.

J’ai mis la dernière version mais le problème était persitant … j’ai donc supprimé

TUXEDO InfinityBook Pro 14 v5 : Batterie qui gonfle après un an et demi

Thu, 19 Aug 2021 00:00:00 +0000

Finalement j’ai mon premier problème sur le TUXEDO InfinityBook Pro 14 v5, la batterie qui gonfle. Je vais voir si le support prend en charge le changement de batterie.

Les seules informations que j’ai :


$ acpi -ib
Battery 0: Full, 100%
Battery 0: design capacity 3200 mAh, last full capacity 2706 mAh = 84%
$ upower -e
/org/freedesktop/UPower/devices/line_power_AC
/org/freedesktop/UPower/devices/battery_BAT0
/org/freedesktop/UPower/devices/DisplayDevice
$ upower -i /org/freedesktop/UPower/devices/battery_BAT0
  native-path:          BAT0
  vendor:               Notebook
  model:                BAT
  serial:               0001
  power supply:         yes
  updated:              jeu. 19 août 2021 09:03:13 (34 seconds ago)
  has history:          yes
  has statistics:       yes
  battery
    present:             yes
    rechargeable:        yes
    state:               fully-charged
    warning-level:       none
    energy:              30,8484 Wh
    energy-empty:        0 Wh
    energy-full:         31,0194 Wh
    energy-full-design:  36,48 Wh
    energy-rate:         0,0329604 W
    voltage:             12,935 V
    percentage:          100%
    capacity:            84,4062%
    technology:          lithium-ion
    icon-name:          'battery-full-charged-symbolic'

/sys/class/power_supply/BAT0$ cat cycle_count 
0

C’est dommage de rien avoir sur le nombre de cycle …Pour ce qui est des informations dmidecode … Misère

Ubuntu : Pour la recherche de photos en double findimagedupes

Mon, 08 Mar 2021 00:00:00 +0000

L’utilitaire est simple d’utilisation :

findimagedupes -R Nextcloud/Photos/

Le plus important c’est le paramètre -t qui permet d’indiquer le pourcentage de similitude. Par défaut c’est 90% , je conseille de mettre 98%.

Il faut le faire ne deux étapes, première étape :

fdupes -r Nextcloud/Photos/

Pour supprimer les fichiers 100% identiques, le logiciel est bien plus rapide. Ensuite on peut utiliser findimagedupes

Les sources : https://gitlab.com/opennota/findimagedupes

Ubuntu : Menages dans le répertoire photo de NextCloud

Thu, 04 Feb 2021 00:00:00 +0000

Voici mes commandes pour le ménage dans les photos:

1- Suppression des doublons :

# du -sh Photos/
85G	Photos/
# fdupes -r -d -f Photos/

2- Classement par date :

# sortphotos -r . . --sort %Y/%m/%d

3- Compression :

# find Photos/ -iname '*.jpg' -exec mogrify \{} -verbose -resize 1920x1080\> \{} \;

4- Resynchornisation avec Digikam (le seul bon outils pour les photos sous Ubuntu).

Ubuntu : Recherche de virus avec Clamscan

Tue, 02 Feb 2021 00:00:00 +0000

Voici la commande que j’utilise pour la recherche de virus sous Ubuntu :

# clamscan -avr  | tee clamscan.log
...
----------- SCAN SUMMARY -----------
Known viruses: 8689881
Engine version: 0.102.4
Scanned directories: 89434
Scanned files: 694669
Infected files: 7
Total errors: 4
Data scanned: 301849.41 MB
Data read: 449682.82 MB (ratio 0.67:1)
Time: 28236.392 sec (470 m 36 s)

Ensuite je fais :

$ grep FOUND clamscan.log
...OpenOffice 4.1.5 (fr) Installation Files/setup.exe: Win.Virus.Expiro-9820425-0 FOUND
...OpenOffice 4.1.5 (fr) Installation Files/setup.exe!(0): Win.Virus.Expiro-9820425-0 FOUND

TUXEDO InfinityBook Pro 14 v5 : Migration de Ubuntu 18.04 vers Ubuntu 20.04

Thu, 28 Jan 2021 00:00:00 +0000

Avant la migration j’avais ceci comme kernel:

Linux CYBERNEURONES 5.4.0-64-generic #72~18.04.1-Ubuntu SMP Fri Jan 15 14:06:34 UTC 2021 x86_64 x86_64 x86_64 GNU/Linux

Début de la migration vers 10h18:

$ head /var/log/dist-upgrade/main.log
2021-01-28 10:18:23,079 INFO Using config files '['./DistUpgrade.cfg.bionic', '/etc/update-manager/release-upgrades.d/opera-stable.cfg']'
2021-01-28 10:18:23,079 INFO uname information: 'Linux CYBERNEURONES 5.4.0-64-generic #72~18.04.1-Ubuntu SMP Fri Jan 15 14:06:34 UTC 2021 x86_64'
2021-01-28 10:18:23,604 INFO apt version: '1.6.12ubuntu0.2'
2021-01-28 10:18:23,604 INFO python version: '3.6.9 (default, Oct  8 2020, 12:12:24) 
[GCC 8.4.0]'
2021-01-28 10:18:23,609 INFO release-upgrader version '20.04.29' started
2021-01-28 10:18:23,670 INFO locale: 'fr_FR' 'UTF-8'
2021-01-28 10:18:23,857 DEBUG Using 'DistUpgradeViewGtk3' view
2021-01-28 10:18:23,900 DEBUG enable dpkg --force-overwrite
2021-01-28 10:18:23,915 DEBUG creating statefile: '/var/log/dist-upgrade/apt-clone_system_state.tar.gz'

Fin de l’installation vers 13h18:

Ubuntu : Crash de update-manager

Thu, 28 Jan 2021 00:00:00 +0000

J’avais donc des crash de update-manage, j’ai donc utilisé plusieurs méthodes vu sur Google.

Voici le crash que j’avais :

$ update-manager 
Traceback (most recent call last):
  File "/usr/bin/update-manager", line 28, in 
    import gi
  File "/usr/lib/python3/dist-packages/gi/__init__.py", line 42, in 
    from . import _gi
ImportError: cannot import name '_gi' from partially initialized module 'gi' (most likely due to a circular import) (/usr/lib/python3/dist-packages/gi/__init__.py)

$ cd /usr/lib/python3/dist-packages/gi/
/usr/lib/python3/dist-packages/gi$ ls *.so
_gi_cairo.cpython-36m-x86_64-linux-gnu.so
_gi.cpython-36m-x86_64-linux-gnu.so
_gi.cpython-37m-x86_64-linux-gnu.so

Solution 1 :

$ sudo apt-get install --reinstall dbus python-dbus python3-dbus

=> Echec.

Ubuntu 20.04 & VirtualBox 6.1 : Creation d'une VM MacOS Catalina

Thu, 28 Jan 2021 00:00:00 +0000

Suite à l’update en version Ubuntu 20.04 j’ai essayé de faire une nouvelle tentative ! Ma précédente tentative (11/03/2020 ) : https://www.cyber-neurones.org/2020/03/script-de-creation-automatiquement-dune-machine-virtuelle-de-macos-pour-virtualbox-echec-pour-moi/

Mes versions :

$ vboxmanage --version
6.1.16_Ubuntur140961
$ cat /etc/os-release 
NAME="Ubuntu"
VERSION="20.04.1 LTS (Focal Fossa)"
ID=ubuntu
ID_LIKE=debian
PRETTY_NAME="Ubuntu 20.04.1 LTS"
VERSION_ID="20.04"
HOME_URL="https://www.ubuntu.com/"
SUPPORT_URL="https://help.ubuntu.com/"
BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
VERSION_CODENAME=focal
UBUNTU_CODENAME=focal

Il faut mettre le pack extension pour que cela fonctionne : [https://download.virtualbox.org/virtualbox/6.1.16/ .](https://download.virtualbox.org/virtualbox/6.1.16/ .)

Lancement du script :

$ ./macos-guest-virtualbox.sh
Waiting for the VirtualBox GUI to shut off.
Please wait
Catalina_BaseSystem.vdi successfully detached from
the virtual machine and released from VirtualBox Manager.

stage: create_target_virtual_disk
Creating target system virtual disk image for "macOS"
0%...10%...20%...30%...40%...50%...60%...70%...80%...90%...100%
Medium created. UUID: 10868994-4a31-4af9-bc2d-0130f283870d

stage: populate_macos_target_disk

Creating VirtualBox 6 virtual ISO containing macOS Terminal scripts
for partitioning and populating the target virtual disk.

The VM will boot from the populated installer base system virtual disk.

Attempting automated recognition of virtual machine graphical user interface.
Please wait
The second open Terminal in the virtual machine copies EFI and NVRAM files
to the target EFI system partition when the installer finishes preparing.

After the installer finishes preparing and the EFI and NVRAM files are copied,
macOS will install and boot up when booting the target disk.

Please wait

For further information, such as applying EFI and NVRAM variables to enable
iMessage connectivity, see the documentation with the following command:

./macos-guest-virtualbox.sh documentation | less -R

That's it! Enjoy your virtual machine.

stage: prompt_delete_temporary_files
Temporary files may be deleted when the virtual machine is powered off
and without a suspended state by executing the following command at the script's
working directory:

./macos-guest-virtualbox.sh prompt_delete_temporary_files

Push-button installer of macOS on VirtualBox

This script installs only open-source software and unmodified Apple binaries,
and requires about 50GB of available storage, of which 25GB are for temporary
installation files that may be deleted when the script is finished.

The script interacts with the virtual machine twice, please do not interact
with the virtual machine manually before the script is finished.

Documentation about optional configuration, iCloud and iMessage connectivity,
resuming the script by stages, and other topics can be viewed with the
following command:

  ./macos-guest-virtualbox.sh documentation | less -R

Press enter to review the script configuration

vm_name="macOS"
macOS_release_name="Catalina"    # install "HighSierra" "Mojave" "Catalina"
storage_size=80000               # VM disk image size in MB. minimum 22000
storage_format="vdi"             # VM disk image file format, "vdi" or "vmdk"
cpu_count=2                      # VM CPU cores, minimum 2
memory_size=4096                 # VM RAM in MB, minimum 2048
gpu_vram=128                     # VM video RAM in MB, minimum 34, maximum 128
resolution="1280x800"            # VM display resolution

These values may be customized as described in the documentation.

Press enter to continue, CTRL-C to exit

Catalina selected to be downloaded and installed

stage: prompt_delete_existing_vm

stage: create_vm

stage: check_default_virtual_machine

Checking that VirtualBox starts the virtual machine without errors.

Checking that VirtualBox uses hardware-supported virtualization.

stage: prepare_macos_installation_files

Downloading Apple macOS Catalina software update catalog
Catalina_sucatalog                       100%[===============================================================================>]   6,52M  1,82MB/s    in 3,6s    
Trying to find macOS Catalina InstallAssistant download URL
Catalina_sucatalog_00_InstallAssistantAu 100%[===============================================================================>]  40,05K  --.-KB/s    in 0,03s   
Found download URL: http://swcdn.apple.com/content/downloads/26/37/001-68446/r1dbqtmf3mtpikjnd04cq31p4jk91dceh8/

Downloading macOS installation files from swcdn.apple.com
Catalina_BaseSystem.chunklist            100%[===============================================================================>]   1,97K  --.-KB/s    in 0s      
Catalina_InstallInfo.plist               100%[===============================================================================>]   1,55K  --.-KB/s    in 0s      
Catalina_AppleDiagnostics.dmg            100%[===============================================================================>]   3,00M  1,64MB/s    in 1,8s    
Catalina_AppleDiagnostics.chunklist      100%[===============================================================================>]     328  --.-KB/s    in 0s      
Catalina_BaseSystem.dmg                  100%[===============================================================================>] 475,53M  1,09MB/s    in 5m 47s  
Catalina_InstallESDDmg.pkg               100%[===============================================================================>]   7,21G  1,84MB/s    in 78m 9s  

Splitting the several-GB InstallESDDmg.pkg into 1GB parts because
VirtualBox hasn't implemented UDF/HFS VISO support yet and macOS
doesn't support ISO 9660 Level 3 with files larger than 2GB.
creating file 'Catalina_InstallESD.part00'
creating file 'Catalina_InstallESD.part01'
creating file 'Catalina_InstallESD.part02'
creating file 'Catalina_InstallESD.part03'
creating file 'Catalina_InstallESD.part04'
creating file 'Catalina_InstallESD.part05'
creating file 'Catalina_InstallESD.part06'
creating file 'Catalina_InstallESD.part07'

Downloading open-source APFS EFI drivers used for VirtualBox 6.0 and 5.2
...even though VirtualBox version 6.1 or higher is detected.
AppleSupport-v2.0.4-RELEASE.zip          100%[===============================================================================>]  42,20K  --.-KB/s    in 0,1s    
Archive:  AppleSupport-v2.0.4-RELEASE.zip
  inflating: ApfsDriverLoader.efi    
  inflating: AppleImageLoader.efi    
  inflating: AppleUiSupport.efi      

stage: create_nvram_files

stage: create_macos_installation_files_viso
Creating EFI startup script

Creating VirtualBox 6 virtual ISO containing the
installation files from swcdn.apple.com

stage: configure_vm

stage: populate_basesystem_virtual_disk
Converting BaseSystem.dmg to BaseSystem.img

dmg2img v1.6.7 (c) vu1tur (to@vu1tur.eu.org)

Catalina_BaseSystem.dmg --> Catalina_BaseSystem.img

decompressing:
opening partition 0 ...             100.00%  ok
opening partition 1 ...             100.00%  ok
opening partition 2 ...             100.00%  ok
opening partition 3 ...             100.00%  ok
opening partition 4 ...             100.00%  ok
opening partition 5 ...             100.00%  ok
opening partition 6 ...             100.00%  ok
opening partition 7 ...             100.00%  ok

Archive successfully decompressed as Catalina_BaseSystem.img
Converting from raw image file="Catalina_BaseSystem.img" to file="Catalina_BaseSystem.vdi"...
Creating dynamic image with size 2138558464 bytes (2040MB)...

stage: create_bootable_installer_virtual_disk
Creating Catalina installation media virtual disk image.
0%...10%...20%...30%...40%...50%...60%...70%...80%...90%...100%
Medium created. UUID: 73d5bc4e-a63c-4ad0-b10e-897beb33428e

stage: populate_bootable_installer_virtual_disk

Creating VirtualBox 6 virtual ISO containing macOS Terminal script
for partitioning and populating the bootable installer virtual disk.

Starting virtual machine "macOS".
This should take a couple of minutes. If booting fails, exit the script by
pressing CTRL-C then see the documentation for information about applying
different CPU profiles in the section CPU profiles and CPUID settings.

Until the script completes, please do not manually interact with
the virtual machine.

Please press enter as directed.

Press enter when the Language window is ready.

Ensuite :

Migration d'un fichier PST (Outlook) vers Thunderbird Linux

Mon, 04 Jan 2021 00:00:00 +0000

J’ai suivi le tutorial : https://www.flawlessrhetoric.com/Using-libpst-to-convert-PST-to-MBOX,-and-understanding-Thunderbird%27s-folder-structure

J’ai donc fait :

$ readpst -u backup.pst
$ mv Outlook\ Data\ File/ out
$ find out -type d | tac | grep -v '^out$' | xargs -d '\n' -I{} mv {} {}.sbd
$ find out -name mbox -type f | xargs -d '\n' -I{} echo '"{}" "{}"' | sed -e 's/\.sbd\/mbox"$/"/' | xargs -L 1 mv
$ find out -empty -type d | xargs -d '\n' rmdir
rmdir: missing operand
Try 'rmdir --help' for more information.
$ find out -type d | egrep '*.sbd' | sed 's/.\{4\}$//' | xargs -d '\n' touch
$ du -sh *
4,1G	backup.pst
3,3G	out

je ne suis pas sur et certain d’avoir tout mes emails …vu que j’utilise snap le chemin est : /home/login/snap/thunderbird/common/.thunderbird/ID.default/Mail/Local Folders/

Ubuntu : Itunes via Wine : rien de bon ...

Tue, 13 Oct 2020 00:00:00 +0000

J’ai essayé l’installation de iTunes avec Wine sous Ubuntu.

Les versions :

Ubuntu : 18.04.4 LTS (Bionic Beaver)
Wine : wine –version : wine-3.0 (Ubuntu 3.0-1ubuntu1)
iTunes : https://www.apple.com/fr/itunes/

J’ai eu une seule erreur, c’est lors de l’installation des fonts. Pour la fixer j’ai du faire la modification du checkum. L’erreur c’était : sha256sum mismatch! Rename .cache/winetricks/PowerPointViewer/PowerPointViewer.exe and try again.

sudo sed -i -e s/249473568eba7a1e4f95498acba594e0f42e6581add4dead70c1dfb908a09423/e17cb384eeac4caf08a4f5d4bceb9697fff83fa942d2a3d9ad0294a9b1774390/g /usr/bin/winetricks

L’installation des fonts :

sudo apt install winetricks
winetricks allfonts

Sachant que l’installation suivante permet d’eviter des problèmes de checksum :

(Draft) Ubuntu, Jupyter Notebook, Python3, Tensorflow, OpenCV : Comptage des cyclistes avec yolo model et floutage des visages

Mon, 12 Oct 2020 00:00:00 +0000

J’ai enfin mon process complet, pour compter les cyclistes et flouter les visages dans la vidéo :

Etape 1 : Faire la vidéo avec la GoPRO.

Le résultat est un MP4.
La taille : 91 Mo

Metadata:
major_brand : mp42
minor_version : 0
compatible_brands: mp42isomavc1
creation_time : 2020-10-04T13:52:54.000000Z
encoder : HandBrake 0.9.8 2012071800
Duration: 00:01:51.44, start: 0.000000, bitrate: 6813 kb/s
Stream #0:0(und): Video: h264 (Main) (avc1 / 0x31637661), yuv420p(tv, bt709), 1280x720 [SAR 1:1 DAR 16:9], 6810 kb/s, 23.98 fps, 23.98 tbr, 90k tbn, 180k tbc (default)
Metadata:
creation_time : 2020-10-04T13:52:54.000000Z
encoder : JVT/AVC Coding

Etape 2 : Passer Jupyter Notebook, Python3, Tensorflow, OpenCV.

Python facetool : Modification d'un visage par une image dans un MP4.

Mon, 12 Oct 2020 00:00:00 +0000

J’ai téléchargé https://github.com/hay/facetool afin de faire la modification des visages via une commande du type :

./facetool.py swap -i smiley.jpg -t output-bicyle.mp4 -o swap-bicyle.mp4

D’abord j’ai eu un premier problème que j’ai fixé ainsi : cd /usr/lib/python3/dist-packages sudo cp apt_pkg.cpython-36m-x86_64-linux-gnu.so apt_pkg.so

Et maintenant j’ai un bug dans le programme :

No faces found, could not swap (Faceswapping smiley.jpg on head-tmp-jdrmcn3j/2357.jpg, saving to out-tmp-jdrmcn3j/2357.jpg)
100%|███████████████████████████████████████████████████████████████████▉| 2671/2672 [25:15<00:00, 2.30it/s]
No faces found, could not swap (Faceswapping smiley.jpg on head-tmp-jdrmcn3j/1180.jpg, saving to out-tmp-jdrmcn3j/1180.jpg)
Traceback (most recent call last):
File "./facetool.py", line 591, in <module>
main(args)
File "./facetool.py", line 565, in main
swapper.swap_image_to_video(args.target, args.input, args.output)
File "./github/facetool/facetool/swapper.py", line 206, in swap_image_to_video
combineframes(self.tempdirs.out, out)
File "./github/facetool/facetool/media.py", line 49, in combineframes
first_file = list(glob(f"{inp}/*"))[0]
IndexError: list index out of range

Bref j’ai l’impression que cela ne détecte aucun visage :

(Draft) Ubuntu, Jupyter Notebook, Python3, Tensorflow, OpenCV : Comptage des cyclistes avec yolo model

Sun, 11 Oct 2020 00:00:00 +0000

J’ai donc pris “Yolo V3”, c’est le modèle le plus fiable. Et j’ai modifier les sources de tracking-yolo-model afin de compter seulement les cyclistes.

Je mets des ID (que j’ai remplacé par Num) seulement sur les cyclistes :

Le source est donc :

(H, W) = (None, None) # input image height and width for the network
writer = None
bicycle = 0
while(True):

ok, image = cap.read()

if not ok:
print("Cannot read the video feed.")
break

if W is None or H is None: (H, W) = image.shape[:2]

blob = cv.dnn.blobFromImage(image, 1 / 255.0, (416, 416), swapRB=True, crop=False)
net.setInput(blob)
detections_layer = net.forward(layer_names) # detect objects using object detection model

detections_bbox = [] # bounding box for detections

boxes, confidences, classIDs = [], [], []
for out in detections_layer:
for detection in out:
scores = detection[5:]
classID = np.argmax(scores)
confidence = scores[classID]

if confidence > yolomodel['confidence_threshold']:
box = detection[0:4] * np.array([W, H, W, H])
(centerX, centerY, width, height) = box.astype("int")
x = int(centerX - (width / 2))
y = int(centerY - (height / 2))

boxes.append([x, y, int(width), int(height)])
confidences.append(float(confidence))
classIDs.append(classID)

idxs = cv.dnn.NMSBoxes(boxes, confidences, yolomodel["confidence_threshold"], yolomodel["threshold"])

if len(idxs)>0:
for i in idxs.flatten():
(x, y) = (boxes[i][0], boxes[i][1])
(w, h) = (boxes[i][2], boxes[i][3])
if (labels[classIDs[i]] == 'bicycle'):
detections_bbox.append((x, y, x+w, y+h))
clr = [int(c) for c in bbox_colors[classIDs[i]]]
cv.rectangle(image, (x, y), (x+w, y+h), clr, 2)
cv.putText(image, "{}: {:.4f}".format(labels[classIDs[i]], confidences[i]),
(x, y-5), cv.FONT_HERSHEY_SIMPLEX, 0.5, clr, 2)

objects = tracker.update(detections_bbox) # update tracker based on the newly detected objects

for (objectID, centroid) in objects.items():
text = "Num {}".format(objectID)
if (int(format(objectID)) > bicycle):
bicycle = int(format(objectID))
text2 = "Total %d "%(bicycle+1)
cv.putText(image, text, (centroid[0] - 10, centroid[1] - 10), cv.FONT_HERSHEY_SIMPLEX,
0.5, (0, 255, 0), 2)
cv.circle(image, (centroid[0], centroid[1]), 4, (0, 255, 0), -1)
cv.putText(image, text2, (30, 30), cv.FONT_HERSHEY_SIMPLEX,
1, (0, 0, 255), 3)

cv.imshow("image", image)

if cv.waitKey(1) & 0xFF == ord('q'):
break

if writer is None:
fourcc = cv.VideoWriter_fourcc(*"MJPG")
writer = cv.VideoWriter("output-bicyle.avi", fourcc, 30, (W, H), True)
writer.write(image)
writer.release()
cap.release()
cv.destroyWindow("image")

Cette fois je compte en double des cyclistes, je pense qu’avec plus d’images par seconde je n’aurai pas eu le problème. J’ai un total de 280 cyclistes.

Ubuntu : Merge de 4 MP4 en screen split avec Kdenlive

Tue, 06 Oct 2020 00:00:00 +0000

Le logiciel Kdenlive est l’équivalent de iMovie ( voir même mieux ) pour mon comparatif d’algo j’ai pu mettre les 4 vidéos sur une même vidéo :

Source.
Algo : ssd_mobilenet_v2_coco_2018_03_29
Algo : Yolo V3
Algo : Caffe Model.

Il n’y a pas a dire c’est YOLO qui est largement devant !

A suivre.

(Draft) Ubuntu, Jupyter Notebook, Python3, Tensorflow, OpenCV : Comptage des cyclistes

Mon, 05 Oct 2020 00:00:00 +0000

J’essaye donc un cinquième projet : https://github.com/adipandas/multi-object-tracker . Un peu complexe a installer mais vu que j’avais déjà fait le gros du travail dans mes précédents post :

https://www.cyber-neurones.org/2020/10/draft-ubuntu-jupyter-notebook-python3-tensorflow-opencv-comptage-des-cyclistes/ : (Draft) Ubuntu, Jupyter Notebook, Python3, Tensorflow, OpenCV : Comptage des cyclistes
https://www.cyber-neurones.org/2020/10/draft-ubuntu-jupyter-notebook-python3-tensorflow-opencv-detection-des-cyclistes-et-des-casques/ : (Draft) Ubuntu, Jupyter Notebook, Python3, Tensorflow, OpenCV : Détection des cyclistes et des casques

Ce projet est bien interessant car il fonctionne avec ssd_mobilenet_v2_coco_2018_03_29 . Alors que dans le précédent j’étais avec la version ssd_mobilenet_v1_coco .

(Draft) Ubuntu, Jupyter Notebook, Python3, Tensorflow, OpenCV : Comptage des cyclistes

Mon, 05 Oct 2020 00:00:00 +0000

J’ai essayé un nouveau projet sur Github pour le comptage des cyclistes : https://github.com/ahmetozlu/tensorflow_object_counting_api .

J’ai du modifier le code pour utiliser TensorFlow : 2.3.1 .

 
 - tf.GraphDef => tf.compat.v1.GraphDef
 - tf.gfile.GFile => tf.compat.v2.io.gfile.GFile
 - tf.Session => tf.compat.v1.Session

Ensuite j’ai du adapter le programme à ma vidéo, j’ai adapté les programmes : vehicle_counting.py & real_time_couting_target_object.py . Le but était de positionner la ligne de comptage par rapport à la dimension de ma vidéo ( roi = 900 / 1280 ).

(Draft) Ubuntu, Jupyter Notebook, Python3, Tensorflow, OpenCV : Détection des cyclistes et des casques

Thu, 01 Oct 2020 00:00:00 +0000

Je fais un petit brouillon de mon installation :

Ubuntu 18.04.4 LTS
Kernel 5.4.0-42-generic (uname -a)
Python 3.6.9 (python3 –version)
Jupyter Notebook 6.1.4
OpenCV : 3.2.0

ii  libopencv-calib3d3.2:amd64         3.2.0+dfsg-4ubuntu0.1   amd64        computer vision Camera Calibration library
ii  libopencv-contrib3.2:amd64         3.2.0+dfsg-4ubuntu0.1   amd64        computer vision contrlib library
ii  libopencv-core3.2:amd64            3.2.0+dfsg-4ubuntu0.1   amd64        computer vision core library
ii  libopencv-features2d3.2:amd64      3.2.0+dfsg-4ubuntu0.1   amd64        computer vision Feature Detection and Descriptor Extraction library
ii  libopencv-flann3.2:amd64           3.2.0+dfsg-4ubuntu0.1   amd64        computer vision Clustering and Search in Multi-Dimensional spaces library
ii  libopencv-highgui3.2:amd64                    3.2.0+dfsg-4ubuntu0.1   amd64        computer vision High-level GUI and Media I/O library
ii  libopencv-imgcodecs3.2:amd64                  3.2.0+dfsg-4ubuntu0.1   amd64        computer vision Image Codecs library
ii  libopencv-imgproc3.2:amd64                    3.2.0+dfsg-4ubuntu0.1   amd64        computer vision Image Processing library
ii  libopencv-ml3.2:amd64                         3.2.0+dfsg-4ubuntu0.1   amd64        computer vision Machine Learning library
ii  libopencv-objdetect3.2:amd64                  3.2.0+dfsg-4ubuntu0.1   amd64        computer vision Object Detection library
ii  libopencv-photo3.2:amd64                      3.2.0+dfsg-4ubuntu0.1   amd64        computer vision computational photography library
ii  libopencv-shape3.2:amd64                      3.2.0+dfsg-4ubuntu0.1   amd64        computer vision shape descriptors and matchers library
ii  libopencv-stitching3.2:amd64      3.2.0+dfsg-4ubuntu0.1   amd64        computer vision image stitching library
ii  libopencv-superres3.2:amd64       3.2.0+dfsg-4ubuntu0.1   amd64        computer vision Super Resolution library
ii  libopencv-video3.2:amd64          3.2.0+dfsg-4ubuntu0.1   amd64        computer vision Video analysis library
ii  libopencv-videoio3.2:amd64        3.2.0+dfsg-4ubuntu0.1   amd64        computer vision Video I/O library
ii  libopencv-videostab3.2:amd64      3.2.0+dfsg-4ubuntu0.1   amd64        computer vision video stabilization library
ii  libopencv-viz3.2:amd64            3.2.0+dfsg-4ubuntu0.1   amd64        computer vision 3D data visualization library

TensorFlow : 1.14.0 ( python3 -c ‘import tensorflow as tf; print(tf.__version__)’ )
TensorFlow : 2.3.1 :

pip3 show tensorflow
Name: tensorflow
Version: 2.3.1
Summary: TensorFlow is an open source machine learning framework for everyone.
Home-page: https://www.tensorflow.org/
Author: Google Inc.
Author-email: packages@tensorflow.org
License: Apache 2.0
Location: /home/arias/.local/lib/python3.8/site-packages
Requires: tensorboard, gast, protobuf, termcolor, absl-py, numpy, tensorflow-estimator, opt-einsum, wheel, astunparse, h5py, google-pasta, wrapt, grpcio, six, keras-preprocessing
Required-by:

Les projet github utilisés :

git clone https://github.com/iamprahladsinghnegi/automaticDetectionOfBikeRiderDrivingWithoutHelmet.git 
cd automaticDetectionOfBikeRiderDrivingWithoutHelmet
git clone https://github.com/tensorflow/models 
cp -r inference_graph/ models/research/object_detection/.
cp -r test1.jpg output.jpg models/research/object_detection/.
cp -r training/ models/research/object_detection/
cp automaticDetectionOfBikeRiderDrivingWithoutHelmet.ipynb models/research/object_detection/.

Installation (dans le désordre):

sudo apt-get -y install python3python-pip python-dev
sudo -H pip3 install jupyter
pip3 install numpy
sudo apt-get install python3-google-apputils
sudo apt install python3-tensorflow
pip3 install tensorflow-cpu
python3 -m pip install tensorflow
python3 -m pip install utils
sudo apt  install protobuf-compiler
python3 -m pip install matplotlib

Important :

Une fois que l’on a les deux projets il faut faire la commande ( dans automaticDetectionOfBikeRiderDrivingWithoutHelmet/models/research/ ):

IBM VPN : How to check the status under Ubuntu ?

Fri, 25 Sep 2020 00:00:00 +0000

Here my script (CheckVPN.sh) to check the status of VPN with logs in syslog :

# cat ./CheckVPN.sh 

grep "naclient_poll" /var/log/syslog* | sed 's/:/ /1' | awk '{print $2 " " $3 " " $4 " " $10}' | sort > /tmp/naclient_poll.txt

filename='/tmp/naclient_poll.txt'
n=1
m=0
previous_state=0
while read line; do
	state=`echo $line | awk '{print $4}'`  
	if [ $previous_state = $state ] 
		then
			#echo "Line No. $n $state : $line"
			m=$((m+1))
		else
	        	echo "Line No. $n $state (new state) $m : $line"
			if [ $previous_state = 1 ]
				then
					echo " Network is down"
			fi
			if [ $state = 1 ]
                                then
                                        echo " Network is up"
                        fi
			previous_state=${state}
			m=0
	fi
	n=$((n+1))
done < $filename

Ubuntu 18 : Slack vs Teams ( CPU et Memory )

Mon, 11 May 2020 00:00:00 +0000

J’ai fait un petit script :

#!/bin/bash    
psrecord --interval 1 --duration 300 --plot slack-tail.png  $(pgrep slack | tail -n 1) &
P1=$!
psrecord --interval 1 --duration 300 --plot teams-tail.png  $(pgrep teams | tail -n 1) &
P2=$!
psrecord --interval 1 --duration 300 --plot slack-head.png  $(pgrep slack | head -n 1) &
P3=$!
psrecord --interval 1 --duration 300 --plot teams-head.png  $(pgrep teams | head -n 1) &
P4=$!
wait $P1 $P2 $P3 $P4 
echo 'Done'

Résultat rapide (car seulement sur 300 secondes ) :

Ubuntu : ntfsfix ( chkdsk sous Windows) pour fixer les problèmes NFTS sous Ubuntu.

Wed, 06 May 2020 00:00:00 +0000

Voici un petit exemple pour fixer les problèmes NTFS sous Ubuntu :

$ sudo mount /dev/sdc2 /media/usb-drive/
$MFTMirr does not match $MFT (record 0).
Failed to mount '/dev/sdc2': Input/output error
NTFS is either inconsistent, or there is a hardware fault, or it's a
SoftRAID/FakeRAID hardware. In the first case run chkdsk /f on Windows
then reboot into Windows twice. The usage of the /f parameter is very
important! If the device is a SoftRAID/FakeRAID then first activate
it and mount a different device under the /dev/mapper/ directory, (e.g.
/dev/mapper/nvidia_eahaabcc1). Please see the 'dmraid' documentation
for more details.

$ sudo ntfsfix /dev/sdc2
Mounting volume... $MFTMirr does not match $MFT (record 0).
FAILED
Attempting to correct errors... 
Processing $MFT and $MFTMirr...
Reading $MFT... OK
Reading $MFTMirr... OK
Comparing $MFTMirr to $MFT... FAILED
Correcting differences in $MFTMirr record 0...OK
Processing of $MFT and $MFTMirr completed successfully.
Setting required flags on partition... OK
Going to empty the journal ($LogFile)... OK
Checking the alternate boot sector... OK
NTFS volume version is 3.1.
NTFS partition /dev/sdc2 was processed successfully.
$ sudo mount /dev/sdc2 /media/usb-drive/
$

Installation de Darling sous Ubuntu afin de lancer des logiciels MacOS

Wed, 22 Apr 2020 00:00:00 +0000

Quelques informations sur mon système :

$ uname -r
5.3.0-40-generic
$ gcc -v
Using built-in specs.
COLLECT_GCC=gcc
COLLECT_LTO_WRAPPER=/usr/lib/gcc/x86_64-linux-gnu/7/lto-wrapper
OFFLOAD_TARGET_NAMES=nvptx-none
OFFLOAD_TARGET_DEFAULT=1
Target: x86_64-linux-gnu
Configured with: ../src/configure -v --with-pkgversion='Ubuntu 7.4.0-1ubuntu1~18.04.1' --with-bugurl=file:///usr/share/doc/gcc-7/README.Bugs --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++ --prefix=/usr --with-gcc-major-version-only --program-suffix=-7 --program-prefix=x86_64-linux-gnu- --enable-shared --enable-linker-build-id --libexecdir=/usr/lib --without-included-gettext --enable-threads=posix --libdir=/usr/lib --enable-nls --with-sysroot=/ --enable-clocale=gnu --enable-libstdcxx-debug --enable-libstdcxx-time=yes --with-default-libstdcxx-abi=new --enable-gnu-unique-object --disable-vtable-verify --enable-libmpx --enable-plugin --enable-default-pie --with-system-zlib --with-target-system-zlib --enable-objc-gc=auto --enable-multiarch --disable-werror --with-arch-32=i686 --with-abi=m64 --with-multilib-list=m32,m64,mx32 --enable-multilib --with-tune=generic --enable-offload-targets=nvptx-none --without-cuda-driver --enable-checking=release --build=x86_64-linux-gnu --host=x86_64-linux-gnu --target=x86_64-linux-gnu
Thread model: posix
gcc version 7.4.0 (Ubuntu 7.4.0-1ubuntu1~18.04.1)

La première étape de l’installation :

Internet Explorer sous Ubuntu 18.04 , c’est possible ? (en mode virtualbox et non libvrt)

Tue, 21 Apr 2020 00:00:00 +0000

Je fais donc suite à mon précédent article : https://www.cyber-neurones.org/2020/04/internet-explorer-sous-ubuntu-18-04-cest-possible-jai-pas-reussi/ . J’ai fixé un des problème ici : https://www.cyber-neurones.org/2020/04/ubuntu-18-issue-lvm2-lvmetad-service-unit-lvm2-lvmetad-socket-is-masked/ .

Maintenant j’essaye en mode virtualbox :

$ vagrant box add windows/win10-edge 'MSEdge - Win10.box'
==> box: Box file was not detected as metadata. Adding it directly...
==> box: Adding box 'windows/win10-edge' (v0) for provider: 
    box: Unpacking necessary files from: file:///datadisk/Vagrant/MSEdge%20-%20Win10.box
    box: Progress: 0% (Rate: 0/s, Estimated time remaini    box: Progress: 4% (Rate: 341M/s, Estimated time rema    box: Progress: 12% (Rate: 525M/s, Estimated time rem    box: Progress: 20% (Rate: 524M/s, Estimated time rem    box: Progress: 27% (Rate: 524M/s, Estimated time rem    box: Progress: 35% (Rate: 523M/s, Estimated time rem    box: Progress: 43% (Rate: 523M/s, Estimated time rem    box: Progress: 50% (Rate: 523M/s, Estimated time rem    box: Progress: 58% (Rate: 523M/s, Estimated time rem    box: Progress: 66% (Rate: 523M/s, Estimated time rem    box: Progress: 73% (Rate: 521M/s, Estimated time rem    box: Progress: 81% (Rate: 522M/s, Estimated time rem    box: Progress: 88% (Rate: 521M/s, Estimated time rem    box: Progress: 96% (Rate: 520M/s, Estimated time rem==> box: Successfully added box 'windows/win10-edge' (v0) for 'virtualbox'!

$ vagrant up --no-destroy-on-error
Bringing machine 'default' up with 'virtualbox' provider...
==> default: Importing base box 'windows/win10-edge'...
==> default: Matching MAC address for NAT networking...
==> default: Setting the name of the VM: Vagrant_default_1587474217541_88035
Vagrant is currently configured to create VirtualBox synced folders with
the `SharedFoldersEnableSymlinksCreate` option enabled. If the Vagrant
guest is not trusted, you may want to disable this option. For more
information on this option, please refer to the VirtualBox manual:

  https://www.virtualbox.org/manual/ch04.html#sharedfolders

This option can be disabled globally with an environment variable:

  VAGRANT_DISABLE_VBOXSYMLINKCREATE=1

or on a per folder basis within the Vagrantfile:

  config.vm.synced_folder '/host/path', '/guest/path', SharedFoldersEnableSymlinksCreate: false
==> default: Clearing any previously set network interfaces...
==> default: Preparing network interfaces based on configuration...
    default: Adapter 1: nat
==> default: Forwarding ports...
    default: 22 (guest) => 2222 (host) (adapter 1)
==> default: Booting VM...
==> default: Waiting for machine to boot. This may take a few minutes...
    default: SSH address: 127.0.0.1:2222
    default: SSH username: ....
    default: SSH auth method: password

Ensuite il faut lancer VirtualBox :

Ubuntu 18 : Issue : lvm2-lvmetad.service: Unit lvm2-lvmetad.socket is masked.

Tue, 14 Apr 2020 00:00:00 +0000

L’erreur complète que j’avais :

Paramétrage de lvm2 (2.02.176-4.1ubuntu3.18.04.2) ...
update-initramfs: deferring update (trigger activated)
insserv: warning: script 'douane' missing LSB tags and overrides
insserv: warning: script 'douane' missing LSB tags and overrides
Failed to restart lvm2-lvmetad.service: Unit lvm2-lvmetad.socket is masked.
invoke-rc.d: initscript lvm2-lvmetad, action "restart" failed.
● lvm2-lvmetad.service - LVM2 metadata daemon
   Loaded: loaded (/lib/systemd/system/lvm2-lvmetad.service; static; vendor preset: enabled)
   Active: inactive (dead)
     Docs: man:lvmetad(8)
dpkg: erreur de traitement du paquet lvm2 (--configure) :
 installed lvm2 package post-installation script subprocess returned error exit status 1
dpkg: des problèmes de dépendances empêchent la configuration de libguestfs0:amd64 :
 libguestfs0:amd64 dépend de lvm2 ; cependant :
 Le paquet lvm2 n'est pas encore configuré.

Pour fixer le problème j’ai du faire :

ENEDIS : Migration des données pour une utilisation dans Mariadb / Grafana (fait en Python)

Mon, 13 Apr 2020 00:00:00 +0000

Je viens de faire un nouveau programme en Python afin de mettre les données de ENEDIS sur MariaDB & Python. Pour avoir les données de ENEDIS il faut aller sur https://mon-compte-particulier.enedis.fr/home-connectee/ et se faire un compte. Puis relier ce compte à la facture EDF … Je vais pas vous mentir c’est un peu de parcours du combattant. J’ai du faire appel à plusieurs fois au support afin que le lien puisse se faire. Misère.

Slack : Migration des données de connexion vers MariaDB pour une utilisation dans Grafana

Wed, 08 Apr 2020 00:00:00 +0000

Pour utiliser le script il faut:

MariaDB
Python
Grafana.

Slack permet le téléchargement d’un fichier CSV ( access_logs.csv ), dont les données sont les suivantes :

Date Accessed,
User Agent - Simple,
User Agent - Full,
IP Address,
Number of Logins,
Last Date Accessed

Petit rappel sur l’ajout d’une database et d’un utilisateur :

$ sudo mysql -u root

MariaDB [(none)]> create database SLACK;

MariaDB [(none)]> CREATE USER 'slack'@'localhost' IDENTIFIED BY 'slack';

MariaDB [(none)]> GRANT ALL PRIVILEGES ON SLACK.* TO 'slack'@'localhost';

MariaDB [(none)]> FLUSH PRIVILEGES;

MariaDB [(none)]> \quit
Bye

Petit rappel aussi en python pour télécharger une classe non disponible :

Installation Citrix Workspace sous Ubuntu 18

Tue, 07 Apr 2020 00:00:00 +0000

La première étape est le téléchargement du soft sur : https://www.citrix.com/downloads/workspace-app/linux/workspace-app-for-linux-latest.html .

Le lien direct : https://downloads.citrix.com/16914/icaclient_19.12.0.19_amd64.deb

$ sudo dpkg -i icaclient_19.12.0.19_amd64.deb 

Sélection du paquet icaclient précédemment désélectionné.
(Lecture de la base de données... 370627 fichiers et répertoires déjà installés.)
Préparation du dépaquetage de icaclient_19.12.0.19_amd64.deb ...
Dépaquetage de icaclient (19.12.0.19) ...
Paramétrage de icaclient (19.12.0.19) ...
Traitement des actions différées (« triggers ») pour gnome-menus (3.13.3-11ubuntu1.1) ...
Traitement des actions différées (« triggers ») pour bamfdaemon (0.5.3+18.04.20180207.2-0ubuntu1) ...
Rebuilding /usr/share/applications/bamf-2.index...
Traitement des actions différées (« triggers ») pour desktop-file-utils (0.23-1ubuntu3.18.04.2) ...
Traitement des actions différées (« triggers ») pour mime-support (3.60ubuntu1) ...

$ sudo cp /usr/share/ca-certificates/mozilla/*.crt /opt/Citrix/ICAClient/keystore/cacerts/

Ensuite il faut faire la congiguration via :

Internet Explorer sous Ubuntu 18.04 , c'est possible ? J'ai pas réussi ...

Tue, 07 Apr 2020 00:00:00 +0000

Ma version de Ubuntu :

$ cat /etc/*release | grep "DISTRIB"
DISTRIB_ID=Ubuntu
DISTRIB_RELEASE=18.04
DISTRIB_CODENAME=bionic
DISTRIB_DESCRIPTION="Ubuntu 18.04.4 LTS"

Je vais donc faire un petit test, d’abord l’installation de de virtualbox 5 à la palce de virtualbox 6.1 . Et ensuite l’installation de vagrant :

$ sudo apt-get install virtualbox
Lecture des listes de paquets... Fait
Construction de l'arbre des dépendances       
Lecture des informations d'état... Fait
Les paquets suivants ont été installés automatiquement et ne sont plus nécessaires :
  gconf-service gconf-service-backend gconf2 gconf2-common libappindicator1 libcurl3-nss libdbusmenu-gtk4 libfwup1 libgconf-2-4 libindicator7
Veuillez utiliser « sudo apt autoremove » pour les supprimer.
Les paquets supplémentaires suivants seront installés : 
  libgsoap-2.8.60 libvncserver1 virtualbox-dkms virtualbox-qt
Paquets suggérés :
  vde2 virtualbox-guest-additions-iso
Les paquets suivants seront ENLEVÉS :
  virtualbox-6.1
Les NOUVEAUX paquets suivants seront installés :
  libgsoap-2.8.60 libvncserver1 virtualbox virtualbox-dkms virtualbox-qt
0 mis à jour, 5 nouvellement installés, 1 à enlever et 0 non mis à jour.
...
$ sudo apt-get install vagrant
Lecture des listes de paquets... Fait
Construction de l'arbre des dépendances       
Lecture des informations d'état... Fait
Les paquets suivants ont été installés automatiquement et ne sont plus nécessaires :
  gconf-service gconf-service-backend gconf2 gconf2-common libappindicator1 libcurl3-nss libdbusmenu-gtk4 libfwup1 libgconf-2-4 libindicator7
Veuillez utiliser « sudo apt autoremove » pour les supprimer.
Les paquets supplémentaires suivants seront installés : 
  augeas-lenses bsdtar cpu-checker cryptsetup cryptsetup-bin db-util db5.3-util dmeventd extlinux hfsplus ipxe-qemu ipxe-qemu-256k-compat-efi-roms keyutils
  ldmtool libafflib0v5 libarchive-tools libaugeas0 libbfio1 libcacard0 libconfig9 libdevmapper-event1.02.1 libewf2 libfdt1 libguestfs-hfsplus libguestfs-perl
  libguestfs-reiserfs libguestfs-tools libguestfs-xfs libguestfs0 libhfsp0 libhivex0 libintl-perl libintl-xs-perl libiscsi7 libldm-1.0-0 liblvm2app2.2
  liblvm2cmd2.02 libnfsidmap2 librbd1 librdmacm1 libsodium-dev libspice-server1 libstring-shellquote-perl libsys-virt-perl libtirpc1 libtsk13
  libusbredirparser1 libvirt0 libwin-hivex-perl libxen-4.9 libxenstore3.0 libxml-xpath-perl lsscsi lvm2 lzop mdadm msr-tools mtools nfs-common
  nfs-kernel-server osinfo-db qemu-block-extra qemu-system-common qemu-system-x86 qemu-utils reiserfsprogs rpcbind ruby-bcrypt-pbkdf ruby-blankslate
  ruby-builder ruby-childprocess ruby-domain-name ruby-erubis ruby-excon ruby-ffi ruby-fog-core ruby-fog-json ruby-fog-libvirt ruby-fog-xml ruby-formatador
  ruby-http-cookie ruby-i18n ruby-json ruby-libvirt ruby-listen ruby-log4r ruby-mime-types ruby-mime-types-data ruby-multi-json ruby-net-scp ruby-net-sftp
  ruby-net-ssh ruby-netrc ruby-nokogiri ruby-oj ruby-pkg-config ruby-rb-inotify ruby-rbnacl ruby-rest-client ruby-sqlite3 ruby-unf ruby-unf-ext scrub seabios
  sgabios sharutils sleuthkit supermin syslinux syslinux-common vagrant-libvirt xfsprogs zerofree
Paquets suggérés :
  augeas-doc augeas-tools libguestfs-gfs2 libguestfs-jfs libguestfs-nilfs libguestfs-rescue libguestfs-rsync libguestfs-zfs thin-provisioning-tools
  dracut-core floppyd open-iscsi watchdog vde2 ovmf ruby-builder-doc ruby-activesupport sharutils-doc autopsy mac-robber xfsdump quota
Les NOUVEAUX paquets suivants seront installés :
  augeas-lenses bsdtar cpu-checker cryptsetup cryptsetup-bin db-util db5.3-util dmeventd extlinux hfsplus ipxe-qemu ipxe-qemu-256k-compat-efi-roms keyutils
  ldmtool libafflib0v5 libarchive-tools libaugeas0 libbfio1 libcacard0 libconfig9 libdevmapper-event1.02.1 libewf2 libfdt1 libguestfs-hfsplus libguestfs-perl
  libguestfs-reiserfs libguestfs-tools libguestfs-xfs libguestfs0 libhfsp0 libhivex0 libintl-perl libintl-xs-perl libiscsi7 libldm-1.0-0 liblvm2app2.2
  liblvm2cmd2.02 libnfsidmap2 librbd1 librdmacm1 libsodium-dev libspice-server1 libstring-shellquote-perl libsys-virt-perl libtirpc1 libtsk13
  libusbredirparser1 libvirt0 libwin-hivex-perl libxen-4.9 libxenstore3.0 libxml-xpath-perl lsscsi lvm2 lzop mdadm msr-tools mtools nfs-common
  nfs-kernel-server osinfo-db qemu-block-extra qemu-system-common qemu-system-x86 qemu-utils reiserfsprogs rpcbind ruby-bcrypt-pbkdf ruby-blankslate
  ruby-builder ruby-childprocess ruby-domain-name ruby-erubis ruby-excon ruby-ffi ruby-fog-core ruby-fog-json ruby-fog-libvirt ruby-fog-xml ruby-formatador
  ruby-http-cookie ruby-i18n ruby-json ruby-libvirt ruby-listen ruby-log4r ruby-mime-types ruby-mime-types-data ruby-multi-json ruby-net-scp ruby-net-sftp
  ruby-net-ssh ruby-netrc ruby-nokogiri ruby-oj ruby-pkg-config ruby-rb-inotify ruby-rbnacl ruby-rest-client ruby-sqlite3 ruby-unf ruby-unf-ext scrub seabios
  sgabios sharutils sleuthkit supermin syslinux syslinux-common vagrant vagrant-libvirt xfsprogs zerofree
0 mis à jour, 114 nouvellement installés, 0 à enlever et 0 non mis à jour.
Il est nécessaire de prendre 30,5 Mo dans les archives.

Ensuite téléchargement de la VM our Valgrant : https://developer.microsoft.com/en-us/microsoft-edge/tools/vms/

Twitter Analytics : Migration des données vers MariaDB pour une utilisation dans Grafana

Wed, 01 Apr 2020 00:00:00 +0000

Les prérequis :

Python : Je fais du python3.
MariaDB
Grafana : J’utilise la version 5.0.0.
Linux : J’utilise Ubuntu 18

Voici donc ce que j’ai fait pour avoir mes données sous Grafana.

Etape 1 :

Je vais sur Twitter Analytics : https://analytics.twitter.com/about et je télécharge les fichiers CSV (By Tweet, et non By Day). Normalement j’ai un fichier CSV par mois.

Etape 2 :

Je concatène tous les fichiers CSV dans un seul fichier en supprimant les entetes :

Twitter Analytics : Migration des données vers MariaDB pour une utilisation dans Grafana (Version 2)

Wed, 01 Apr 2020 00:00:00 +0000

J’ai fait une version 2 qui permet de voir l’intéraction avec les utilisateurs : les sources sont disponibles ici : https://github.com/farias06/Grafana/blob/master/Twitter_CSV_insert_v2.py )

import csv
from datetime import datetime
import mysql.connector
import re
from mysql.connector import errorcode
from mysql.connector import (connection)

cnx = connection.MySQLConnection(user='twitter', password='twitter',
                                 host='127.0.0.1',
                                 database='TWITTERS')
cursor = cnx.cursor();
now = datetime.now().date();

#cursor.execute("DROP TABLE TWITTER;");
#cursor.execute("CREATE TABLE TWITTER (IDENTIFIANT varchar(30) UNIQUE,PERMALIEN varchar(200),TEXTE varchar(500),DATE datetime,IMPRESSION float,ENGAGEMENT float,TAUX_ENGAGEMENT float, RETWEET float,REPONSE float, JAIME float, CLIC_PROFIL float, CLIC_URL float, CLIC_HASTAG float, OUVERTURE_DETAIL float, CLIC_PERMALIEN float, OUVERTURE_APP int, INSTALL_APP int, ABONNEMENT int, EMAIL_TWEET int, COMPOSER_NUMERO int, VUE_MEDIA int, ENGAGEMENT_MEDIA int);");
#cursor.execute("CREATE TABLE TWITTER_USER (USER varchar(20),IDENTIFIANT varchar(30), DATE datetime, PRIMARY KEY (USER,IDENTIFIANT));");
cursor.execute("DELETE FROM TWITTER_USER")
cursor.execute("DELETE FROM TWITTER");
cnx.commit();

with open('input.csv', 'r') as csvfile:
    reader = csv.reader(csvfile, quotechar='"')
    for row in reader:
        MyDate=row[3].replace(" +0000", ":00")
        MyTexte=row[2].replace("'", " ")
        MyTexte=MyTexte.replace(",", " ")
        MyC4=row[4].replace("Infinity", "0")
        MyC5=row[5].replace("Infinity", "0")
        MyC6=row[6].replace("Infinity", "0")
        MyC6=MyC6.replace("NaN", "0")
        MyC7=row[7].replace("Infinity", "0")
        User = re.findall(r'(?<=\W)[@]\S*', MyTexte)
        for MyUser in User:
            try :
                cursor.execute("INSERT INTO TWITTER_USER (IDENTIFIANT,USER,DATE) VALUES ('"+row[0]+"','"+MyUser+"','"+MyDate+"');");
            except mysql.connector.Error as err:
                print("Something went wrong: {}".format(err))
                if err.errno == errorcode.ER_BAD_TABLE_ERROR:
                    print("Creating table TWITTER_USER")
                else:
                    None
        try :
            cursor.execute("INSERT INTO TWITTER (IDENTIFIANT,PERMALIEN,TEXTE,DATE,IMPRESSION,ENGAGEMENT,TAUX_ENGAGEMENT,RETWEET,REPONSE, JAIME, CLIC_PROFIL, CLIC_URL, CLIC_HASTAG, OUVERTURE_DETAIL, CLIC_PERMALIEN, OUVERTURE_APP, INSTALL_APP, ABONNEMENT, EMAIL_TWEET, COMPOSER_NUMERO, VUE_MEDIA, ENGAGEMENT_MEDIA) VALUES ('"+row[0]+"', '"+row[1]+"', '"+MyTexte+"','"+MyDate+"', "+MyC4+", "+MyC5+", "+MyC6+", "+MyC7+", "+row[8]+","+row[9]+", "+row[10]+", "+row[11]+","+row[12]+","+row[13]+","+row[14]+","+row[15]+","+row[16]+","+row[17]+","+row[18]+","+row[19]+","+row[20]+","+row[21]+");");
        except mysql.connector.Error as err:
            print("Something went wrong: {}".format(err))
            if err.errno == errorcode.ER_BAD_TABLE_ERROR:
                print("Creating table TWITTER")
            else:
                None

cnx.commit();
cursor.close();
cnx.close();

Il faut donc faire la requête suivante :

Ubuntu 18 : Installation d’un client OneDrive avec OneDrive Free Client

Wed, 01 Apr 2020 00:00:00 +0000

Le projet est disponible ici : https://github.com/skilion/onedrive .

Voici les phases de l’installation :

$ sudo apt install libcurl4-openssl-dev
...
$ sudo apt install libsqlite3-dev
...
$ sudo snap install --classic dmd && sudo snap install --classic dub
...
$ git clone https://github.com/skilion/onedrive.git
...
$ cd onedrive/
...
$ make
echo v1.1.3 >version
dmd -g -ofonedrive -O -L-lcurl -L-lsqlite3 -L-ldl -J. src/config.d src/itemdb.d src/log.d src/main.d src/monitor.d src/onedrive.d src/qxor.d src/selective.d src/sqlite.d src/sync.d src/upload.d src/util.d
src/sqlite.d(142): Deprecation: foreach: loop index implicitly converted from size_t to int
sed "s|@PREFIX@|/usr/local|g" onedrive.service.in > onedrive.service
$ sudo make install
...
$ mkdir -p ~/.config/onedrive
...
$ cp ./config ~/.config/onedrive/config
...

Ensuite il suffit de lancer onedrive :

Ubuntu 18 : Installation d'un client NextCloud avec Flatpak

Tue, 31 Mar 2020 00:00:00 +0000

Les commandes pour l’installation :

$ sudo apt install flatpak
Lecture des listes de paquets... Fait
Construction de l'arbre des dépendances       
Lecture des informations d'état... Fait
Les paquets supplémentaires suivants seront installés : 
  libostree-1-1 xdg-desktop-portal xdg-desktop-portal-gtk
Les NOUVEAUX paquets suivants seront installés :
  flatpak libostree-1-1 xdg-desktop-portal xdg-desktop-portal-gtk
0 mis à jour, 4 nouvellement installés, 0 à enlever et 13 non mis à jour.
Il est nécessaire de prendre 1 313 ko dans les archives.
Après cette opération, 5 898 ko d'espace disque supplémentaires seront utilisés.
Souhaitez-vous continuer ? [O/n] O
...
$ flatpak remote-add --if-not-exists flathub https://flathub.org/repo/flathub.flatpakrepo

$ flatpak install flathub org.nextcloud.Nextcloud
Required runtime for org.nextcloud.Nextcloud/x86_64/stable (runtime/org.kde.Platform/x86_64/5.12) found in remote flathub
Do you want to install it? [y/n]: y
Installing in system:
org.kde.Platform/x86_64/5.12                       flathub 8337138165ca
org.freedesktop.Platform.VAAPI.Intel/x86_64/18.08  flathub 227f12933709
org.freedesktop.Platform.html5-codecs/x86_64/18.08 flathub b7006caaf6a7
org.kde.Platform.Locale/x86_64/5.12                flathub b76e501f9811
org.nextcloud.Nextcloud/x86_64/stable              flathub 4755c241adb7
  permissions: ipc, network, wayland, x11, dri
  file access: host, xdg-config/kdeglobals:ro, xdg-run/Nextcloud:create, xdg-run/dconf, ~/.config/dconf:ro
  dbus access: com.canonical.AppMenu.Registrar, org.freedesktop.Notifications, org.freedesktop.secrets, org.kde.StatusNotifierWatcher
org.nextcloud.Nextcloud.Locale/x86_64/stable       flathub f098e4785813
Is this ok [y/n]: y
Installing: org.kde.Platform/x86_64/5.12 from flathub
[####################] 1415 metadata, 27766 content objects fetched; 404772 KiB transferred in 128 seconds
Now at 8337138165ca.
Installing: org.freedesktop.Platform.VAAPI.Intel/x86_64/18.08 from flathub
[####################] 4 metadata, 2 content objects fetched; 1783 KiB transferred in 0 seconds
Now at 227f12933709.
Installing: org.freedesktop.Platform.html5-codecs/x86_64/18.08 from flathub
[####################] 22 metadata, 127 content objects fetched; 3111 KiB transferred in 1 seconds
Now at b7006caaf6a7.
Installing: org.kde.Platform.Locale/x86_64/5.12 from flathub
[####################] 33 metadata, 196 content objects fetched; 5085 KiB transferred in 1 seconds
Now at b76e501f9811.
Installing: org.nextcloud.Nextcloud/x86_64/stable from flathub
[####################] 78 metadata, 221 content objects fetched; 4049 KiB transferred in 2 seconds
Now at 4755c241adb7.
Installing: org.nextcloud.Nextcloud.Locale/x86_64/stable from flathub
[####################] 7 metadata, 2 content objects fetched; 5 KiB transferred in 0 seconds
Now at f098e4785813.

$ flatpak run org.nextcloud.Nextcloud
Gtk-Message: 14:04:44.389: Failed to load module "canberra-gtk-module"
Gtk-Message: 14:04:44.389: Failed to load module "canberra-gtk-module"

On a donc la fenetre suivante qui s’ouvre, et il suffit de faire la configuration :

CPU : Comment faire la mesure via un script crontab ?

Sun, 22 Mar 2020 00:00:00 +0000

Je ne sais pas comment faire la mesure via un script sur la crontab … Les données que j’ai sont différentes du CPU History sur Ubuntu. Actuellement j’utilise :

"grep 'cpu ' /proc/stat | awk '{usage=($2+$4)*100/($2+$4+$5)"

mais j’ai aussi essayé avec le découpage dans top :

top -bn1 | grep "Cpu(s)" | \
           sed "s/.*, *\([0-9.]*\)%* id.*/\1/" | \
           awk '{print 100 - $1"%"}'

UPDATE C’est bon j’ai trouvé la bonne commande pour avoir le CPU usage : CPU_USAGE=$(awk ‘{u=$2+$4; t=$2+$4+$5; if (NR==1){u1=u; t1=t;} else print ($2+$4-u1) * 100 / (t-t1) “%”; }’ <(grep ‘cpu ’ /proc/stat) <(sleep 1;grep ‘cpu ’ /proc/stat))

Tuxedo Computer : Script bash pour comprendre pourquoi le bruit du ventilateur

Sat, 21 Mar 2020 00:00:00 +0000

Voici donc le script que j’ai fait :

#!/bin/bash

#
# MariaDB [mysql]> create database CPU;
# Query OK, 1 row affected (0.00 sec)

# MariaDB [(none)]> CREATE USER 'arias'@'localhost' IDENTIFIED BY 'arias';
# Query OK, 0 rows affected (0.00 sec)

# MariaDB [(none)]> GRANT USAGE ON *.* TO 'arias'@'localhost' IDENTIFIED BY 'arias';
# Query OK, 0 rows affected (0.00 sec)

# MariaDB [(none)]>  GRANT ALL privileges ON CPU.* TO 'arias'@'localhost';
# Query OK, 0 rows affected (0.00 sec)

# MariaDB [(none)]> FLUSH PRIVILEGES;
# Query OK, 0 rows affected (0.00 sec)
#
#
#mysql -u root -e "CREATE DATABASE CPU;"
#mysql -u root -e "USE CPU; CREATE TABLE information (date datetime, cpu float, fanId int, rawFanDuty int, fanDuty float, remoteTemp int, localTemp int);"

CPU_USAGE=$(awk '{u=$2+$4; t=$2+$4+$5; if (NR==1){u1=u; t1=t;} else print ($2+$4-u1) * 100 / (t-t1) "%"; }' <(grep 'cpu ' /proc/stat) <(sleep 1;grep 'cpu ' /proc/stat))
DATE=$(date "+%Y-%m-%d %H:%M:%S")
CPU_USAGE_2=$(echo $CPU_USAGE | sed 's/%//g' )
/usr/bin/tuxedofancontrol --show > /tmp/tuxedofancontrol.out
FANID=$(cat /tmp/tuxedofancontrol.out | grep "fanId" | awk '{print $2}' | sed 's/,//g') 
RAWFANDUTY=$(cat /tmp/tuxedofancontrol.out | grep "rawFanDuty" | awk  '{print $2}' | sed 's/,//g' )
FANDUTY=$(cat /tmp/tuxedofancontrol.out | grep "fanDuty" | awk '{print $2}' | sed 's/,//g')
REMOTETEMP=$(cat /tmp/tuxedofancontrol.out | grep "remoteTemp:" | awk '{print $2}' | sed 's/,//g')
LOCALTEMP=$(cat /tmp/tuxedofancontrol.out | grep "localTemp:" | awk '{print $2}' | sed 's/,//g' )

if [ ! -z $FANID ]
then
        SQL="USE CPU; INSERT INTO information (date, cpu, fanId, rawFanDuty, fanDuty, remoteTemp, localTemp) VALUES ('$DATE',$CPU_USAGE_2,$FANID,$RAWFANDUTY,$FANDUTY,$REMOTETEMP,$LOCALTEMP);"
else
        SQL="USE CPU; INSERT INTO information (date, cpu) VALUES ('$DATE',$CPU_USAGE_2);"
fi

echo $SQL > /tmp/lastsql.out
mysql -u root -e "$SQL"

C’est assez simple, je prends la date et l’utilisation du CPU. Et aussi je note toutes les informations de tuxedofancontrol. J’ai mis le script toutes les 2 minutes dans ma crontab, ensuite je ferai un script pour Grafana.

Rechercher les doubons d'images de facon rapide

Fri, 20 Mar 2020 00:00:00 +0000

Avant d’utiliser Digikam, il est plus facile de supprimer les images identiques via un simple script :

find Images/  -type f -exec md5sum '{}' ';' | sort | uniq --all-repeated=separate -w 15 > dupes.txt

awk '/^$/{getline;print;}' dupes.txt | awk '{print $2 " " $3 " " $4}' | xargs gvfs-trash {}

Il est aussi possible d’utiliser :

fdupes -rSm Images

L’option -d permet la suppression.

Ensuite on peut utiliser Digikam, qui lui permet de reconnaitre des images identiques mais n’ayant pas la même taille.

Thunderbird mbox to ( Influxdb, Postgresql, mysql ) to Grafana in Python

Thu, 19 Mar 2020 00:00:00 +0000

J’ai amélorié ( voir : https://www.cyber-neurones.org/2020/03/thunderbird-mbox-to-influxdb-and-postgresql-to-grafana-in-python/ ) le programme afin d’injecter sur MySQL ( MariaDB en vérité ). Le plus facile a manipuler sur Grafana c’est MariaDB.

Pour se connecter de Grafana à MariaDB :

Les requêtes SQL pour Grafana :

Par jours :

SELECT
UNIX_TIMESTAMP(date) AS time_sec,
domain as ‘metric’,
count(domain) as value
FROM thunderbird
WHERE
$__timeFilter(date)
GROUP BY DAY(date),MONTH(date),YEAR(date)
ORDER BY date

Par mois :

SELECT
UNIX_TIMESTAMP(date) AS time_sec,
domain as ‘metric’,
count(domain) as value
FROM thunderbird
WHERE
$__timeFilter(date)
GROUP BY MONTH(date),YEAR(date)
ORDER BY date

Par années :

SELECT
UNIX_TIMESTAMP(date) AS time_sec,
domain as ‘metric’,
count(domain) as value
FROM thunderbird
WHERE
$__timeFilter(date)
GROUP BY YEAR(date)
ORDER BY date

Les sources du programme :

( Source sur : https://github.com/farias06/Python/blob/master/parse_email_v2.py )

Thunderbird mbox to Influxdb and Postgresql to Grafana in Python

Tue, 17 Mar 2020 00:00:00 +0000

J’ai donc fait un programme en python afin de faire un export des données de Thunderbird ( fichier mbox contenant les emails) vers Influxdb et Postgresql (dans un premier temps).

Le but du programme est de maitriser le python afin de faire ensuite des exports vers Grafana. Sur mes exemples j’ai mis en login/password arias/arias (je sais c’est pas secure mais c’est un exemple …).

Configuration GRAFANA:

Le programme :

( Source disponible ici : https://github.com/farias06/Python/blob/master/parse_email.py )

Garmin Forerunner sous Ubuntu 18 : Echec !

Wed, 11 Mar 2020 00:00:00 +0000

J’ai donc installé le soft :

$ uname -r
5.3.0-40-generic
$ sudo apt-get install garmin-forerunner-tools
...
$  sudo dpkg-query -l | grep garmin-forerunner-tools 
ii  garmin-forerunner-tools                       0.10repacked-10                                 amd64        retrieve data from Garmin Forerunner/Edge GPS devices

Ensuite j’ai connecté ma montre :

$ lsusb 
Bus 004 Device 001: ID 1d6b:0003 Linux Foundation 3.0 root hub
Bus 003 Device 001: ID 1d6b:0002 Linux Foundation 2.0 root hub
Bus 002 Device 001: ID 1d6b:0003 Linux Foundation 3.0 root hub
Bus 001 Device 003: ID 04f2:b649 Chicony Electronics Co., Ltd 
Bus 001 Device 009: ID 091e:4c29 Garmin International 
Bus 001 Device 004: ID 8087:0025 Intel Corp. 
Bus 001 Device 006: ID 062a:4106 Creative Labs 
Bus 001 Device 001: ID 1d6b:0002 Linux Foundation 2.0 root hub

Par contre les commandes ne fonctionnent pas :

Pas de panique Débian est très fiable.

Wed, 11 Mar 2020 00:00:00 +0000

Michel, je te sais tout patraque depuis que tu as vu une série d’articles indiquant que Débian avait plus de faille que Windows:

https://www.techradar.com/news/windows-10-isnt-the-most-vulnerable-operating-system-its-actually-linux : Windows 10 isn’t the most vulnerable operating system – it’s actually Linux.
https://thebestvpn.com/vulnerability-alerts/ : Vulnerability Alerts.
https://securite.developpez.com/actu/296323/Durant-la-derniere-decennie-Windows-10-a-eu-moins-de-vulnerabilites-que-Linux-macOS-X-et-Android-selon-une-etude/ : Durant la dernière décennie, Windows 10 a eu moins de vulnérabilités que Linux, MacOS X et Android.
https://www.linux.com/news/debian-linux-was-the-most-vulnerable-operating-system-in-the-last-20-years/ :Debian Linux Was The Most Vulnerable Operating System In The Last 20 Years.
https://news.softpedia.com/news/debian-linux-was-the-most-vulnerable-operating-system-in-the-last-20-years-529387.shtml : Debian Linux Was the Most Vulnerable Operating System in the Last 20 Years

La liste des failles de Débian est ici : https://www.cvedetails.com/vendor/23/Debian.html .

Script de création automatiquement d'une machine virtuelle de MacOS pour VirtualBox : Echec pour moi !

Wed, 11 Mar 2020 00:00:00 +0000

J’ai donc testé le script suivant : https://github.com/myspaghetti/macos-guest-virtualbox : macos-guest-virtualbox . Le but du script est de faire une machine Virtuel sous Ubuntu. A noter que le déroulement du script est très long, je pense qu’il faut compter 4 heures.

Voici tous le process d’installation :

# wget -q https://www.virtualbox.org/download/oracle_vbox_2016.asc -O- | sudo apt-key add -

# wget -q https://www.virtualbox.org/download/oracle_vbox.asc -O- | sudo apt-key add -

# sudo add-apt-repository "deb http://download.virtualbox.org/virtualbox/debian bionic contrib" 

# sudo apt update

# sudo apt install virtualbox-6.1 virtualbox-dkms

# sudo apt install libcanberra-gtk-module libcanberra-gtk3-module

# sudo apt-get install dmg2img

Il est impératif d’avoir une version de virtualbox > 6.1. Par défaut sur Ubuntu on a la version 5.0 …

Ubuntu 18 : Pourquoi autant de SWAP ?

Wed, 11 Mar 2020 00:00:00 +0000

Je ne comprends pas pourquoi j’ai autant de SWAP avec ma configuration de swappiness :

$ swapon -s
Filename				Type		Size	Used	Priority
/dev/sda3                              	partition	8388604	924672	-2
$ cat /proc/sys/vm/swappiness
1
$ cat /proc/sys/vm/vfs_cache_pressure
100
$ getconf PAGESIZE
4096
$ cat /etc/os-release | grep "PRETTY_NAME"
PRETTY_NAME="Ubuntu 18.04.3 LTS"
$ free -m
              total        used        free      shared  buff/cache   available
Mem:          64081        4045        8756         506       51279       58818
Swap:          8191         903        7288

Quand je regarde la documentation, vu que j’ai 64 Go de RAM je ne devrais pas avoir de SWAP :

Digikam : sqlite3 lecture des tables afin de supprimer les images similaires

Thu, 30 Jan 2020 00:00:00 +0000

J’ai fait une petite lecture des tables de Dikikam afin de faire un export des images similaires avec un taux à 1.0 :

$ sqlite3 
SQLite version 3.22.0 2018-01-22 18:45:57
Enter ".help" for usage hints.
Connected to a transient in-memory database.
Use ".open FILENAME" to reopen on a persistent database.
sqlite> .open similarity.db
sqlite> .tables
ImageHaarMatrix     ImageSimilarity     SimilaritySettings
sqlite> .schema ImageSimilarity
CREATE TABLE ImageSimilarity
                    (imageid1 INTEGER NOT NULL,
                    imageid2 INTEGER NOT NULL,
                    algorithm INTEGER,
                    value DOUBLE,
                    CONSTRAINT Similar UNIQUE(imageid1, imageid2, algorithm));
sqlite> .schema ImageHaarMatrix
CREATE TABLE ImageHaarMatrix
                    (imageid INTEGER PRIMARY KEY,
                    modificationDate DATETIME,
                    uniqueHash TEXT,
                    matrix BLOB);
CREATE TRIGGER delete_similarities DELETE ON ImageHaarMatrix
                    BEGIN
                        DELETE FROM ImageSimilarity
                            WHERE ( ImageSimilarity.imageid1=OLD.imageid OR ImageSimilarity.imageid2=OLD.imageid )
                              AND ( ImageSimilarity.algorithm=1 );
                    END;
sqlite> .schema SimilaritySettings
CREATE TABLE SimilaritySettings
                    (keyword TEXT NOT NULL UNIQUE,
                    value TEXT);
sqlite> .open digikam4.db
sqlite> .tables
AlbumRoots          ImageHistory        ImageRelations      Settings          
Albums              ImageInformation    ImageTagProperties  TagProperties     
DownloadHistory     ImageMetadata       ImageTags           Tags              
ImageComments       ImagePositions      Images              TagsTree          
ImageCopyright      ImageProperties     Searches            VideoMetadata     
sqlite> .schema Images
CREATE TABLE Images
                    (id INTEGER PRIMARY KEY,
                    album INTEGER,
                    name TEXT NOT NULL,
                    status INTEGER NOT NULL,
                    category INTEGER NOT NULL,
                    modificationDate DATETIME,
                    fileSize INTEGER,
                    uniqueHash TEXT,
                    manualOrder INTEGER,
                    UNIQUE (album, name));
CREATE INDEX dir_index  ON Images (album);
CREATE INDEX hash_index ON Images (uniqueHash);
CREATE INDEX image_name_index ON Images (name);
CREATE TRIGGER delete_image DELETE ON Images
                    BEGIN
                        DELETE FROM ImageTags          WHERE imageid=OLD.id;
                        DELETE From ImageInformation   WHERE imageid=OLD.id;
                        DELETE From ImageMetadata      WHERE imageid=OLD.id;
                        DELETE From VideoMetadata      WHERE imageid=OLD.id;
                        DELETE From ImagePositions     WHERE imageid=OLD.id;
                        DELETE From ImageComments      WHERE imageid=OLD.id;
                        DELETE From ImageCopyright     WHERE imageid=OLD.id;
                        DELETE From ImageProperties    WHERE imageid=OLD.id;
                        DELETE From ImageHistory       WHERE imageid=OLD.id;
                        DELETE FROM ImageRelations     WHERE subject=OLD.id OR object=OLD.id;
                        DELETE FROM ImageTagProperties WHERE imageid=OLD.id;
                        UPDATE Albums SET icon=null    WHERE icon=OLD.id;
                        UPDATE Tags SET icon=null      WHERE icon=OLD.id;
                    END;
sqlite>  .schema ImageInformation
CREATE TABLE ImageInformation
                    (imageid INTEGER PRIMARY KEY,
                    rating INTEGER,
                    creationDate DATETIME,
                    digitizationDate DATETIME,
                    orientation INTEGER,
                    width INTEGER,
                    height INTEGER,
                    format TEXT,
                    colorDepth INTEGER,
                    colorModel INTEGER);
CREATE INDEX creationdate_index ON ImageInformation (creationDate);
sqlite> .schema Albums
CREATE TABLE Albums
                    (id INTEGER PRIMARY KEY,
                    albumRoot INTEGER NOT NULL,
                    relativePath TEXT NOT NULL,
                    date DATE,
                    caption TEXT,
                    collection TEXT,
                    icon INTEGER,
                    UNIQUE(albumRoot, relativePath));
CREATE TRIGGER delete_album DELETE ON Albums
                BEGIN
                    DELETE FROM Images
                    WHERE Images.album = OLD.id;
                END;
sqlite> attach 'digikam4.db' as db1;
sqlite> attach 'similarity.db' as db2;
sqlite> select count(*) from db1.Images as A, db2.ImageSimilarity as B, db1.Albums as C where B.imageid2 = A.id and B.algorithm = 1.0 and A.album = C.id;
36796
sqlite> select relativePath || '/' || name from db1.Images as A, db2.ImageSimilarity as B, db1.Albums as C where B.imageid2 = A.id and B.algorithm = 1.0 and A.album = C.id group by relativePath;
...
sqlite> .output file_duplicate.txt
sqlite> select '.' || relativePath || '/' || name from db1.Images as A, db2.ImageSimilarity as B, db1.Albums as C where B.imageid2 = A.id and B.algorithm = 1.0 and A.album = C.id group by relativePath;

sqlite> select count(*) from db1.Images as A, db2.ImageSimilarity as B, db1.Albums as C where B.imageid2 = A.id and A.album = C.id and relativePath = '/2019/11/28';
654
sqlite> select count(*) from db1.Images as A, db2.ImageSimilarity as B, db1.Albums as C where B.imageid1 = A.id and A.album = C.id and relativePath = '/2019/11/28';
2545
sqlite> .output file_duplicate_2.txt
sqlite> select '.' || relativePath || '/' || name from db1.Images as A, db2.ImageSimilarity as B, db1.Albums as C where B.imageid2 = A.id and B.algorithm > 0.96 and A.album = C.id;
sqlite> .output file_duplicate_3.txt
sqlite> select '.' || relativePath || '/' || name from db1.Images as A, db2.ImageSimilarity as B, db1.Albums as C where B.imageid1 = A.id and B.algorithm > 0.96 and A.album = C.id;
sqlite> .quit

Ensuite pour la suppression j’ai fait :

Ubuntu : Compression et dimenssion des photos

Thu, 30 Jan 2020 00:00:00 +0000

Sous Mac OS j’avais fait plusieurs articles …Mais sous Ubuntu c’est plus simple, voici les commandes que j’utilise :

$ du -sh Images/
$ find Images/ -iname '*.jpg' -exec mogrify \{} -verbose -resize 1920x1080\> \{} \;
$

Je considère que la résolution max est 1920x1080 (on peut aussi prendre 2048x1536). Il est vivement conseillé d’avoir un backup avant de lancer les commandes. Et je vous conseille cette lecture : https://fr.wikipedia.org/wiki/Impression_photo_num%C3%A9rique

A noter aussi que je déplace toutes les vidéos avant de lancer la commandes :

Changer la date de modification et de création de photo avec exiftool

Tue, 28 Jan 2020 00:00:00 +0000

Suite à la compression via Digikam, toutes les nouvelles images compressées ont eu une mauvaise date. Ce qui donne sur le timeline ceci :

Le pic de 2019, n’a pas lieu d’être … j’ai donc essayer de lancer une ligne de commande pour changer la date de modification et de création des images.

$ time exiftool -v -r "-filemodifydate<datetimeoriginal" "-filecreateddate<datetimeoriginal" Images/
...
 3214 directories scanned
119812 image files updated
15783 image files unchanged
  203 files weren't updated due to errors

real	22m59,695s
user	22m0,499s
sys	0m21,394s

Ensuite j’ai refait un scan avec Digikam : Je n’ai pas remarqué de changement sur la courbe … misère.

TUXEDO InfinityBook Pro 14 v5 : Benchmark with sysbench

Tue, 28 Jan 2020 00:00:00 +0000

Quelques informations sur le portable :

$ uname -a
Linux CYBERNEURONES 5.0.0-37-generic #40~18.04.1-Ubuntu SMP Thu Nov 14 12:06:39 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux
$ sudo lshw 
cyberneurones           
    description: Notebook
    product: TUXEDO (Not Applicable)
    vendor: TUXEDO
    version: Not Applicable
    serial: Not Applicable
    width: 64 bits
    capabilities: smbios-3.2 dmi-3.2 smp vsyscall32
    configuration: boot=normal chassis=notebook family=Not Applicable sku=Not Applicable uuid=94DE4CEE-9B10-5742-BC5A-76E9661D41DC
  *-core
       description: Motherboard
       product: N141CU
       vendor: TUXEDO
       physical id: 0
       version: Not Applicable
       serial: Not Applicable
       slot: Not Applicable
     *-firmware
          description: BIOS
          vendor: INSYDE Corp.
          physical id: 0
          version: 1.07.04RTR1
          date: 10/02/2019
          size: 128KiB
          capacity: 11MiB
          capabilities: pci upgrade shadowing cdboot bootselect edd int9keyboard int10video acpi usb biosbootspecification uefi
     *-cpu
          description: CPU
          product: Intel(R) Core(TM) i5-10210U CPU @ 1.60GHz
          vendor: Intel Corp.
          physical id: 4
          bus info: cpu@0
          version: Intel(R) Core(TM) i5-10210U CPU @ 1.60GHz
          serial: To Be Filled By O.E.M.
          slot: U3E1
          size: 1900MHz
          capacity: 4200MHz
          width: 64 bits
          clock: 100MHz
          capabilities: x86-64 fpu fpu_exception wp vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp constant_tsc art arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf tsc_known_freq pni pclmulqdq dtes64 monitor ds_cpl vmx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb invpcid_single ssbd ibrs ibpb stibp ibrs_enhanced tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 avx2 smep bmi2 erms invpcid mpx rdseed adx smap clflushopt intel_pt xsaveopt xsavec xgetbv1 xsaves dtherm ida arat pln pts hwp hwp_notify hwp_act_window hwp_epp md_clear flush_l1d arch_capabilities cpufreq
          configuration: cores=4 enabledcores=4 threads=8
        *-cache:0
             description: L1 cache
             physical id: 5
             slot: L1 Cache
             size: 256KiB
             capacity: 256KiB
             capabilities: synchronous internal write-back unified
             configuration: level=1
        *-cache:1
             description: L2 cache
             physical id: 6
             slot: L2 Cache
             size: 1MiB
             capacity: 1MiB
             capabilities: synchronous internal write-back unified
             configuration: level=2
        *-cache:2
             description: L3 cache
             physical id: 7
             slot: L3 Cache
             size: 6MiB
             capacity: 6MiB
             capabilities: synchronous internal write-back unified
             configuration: level=3
     *-memory
          description: System Memory
          physical id: 19
          slot: System board or motherboard
          size: 64GiB
        *-bank:0
             description: SODIMM DDR4 Synchronous 2667 MHz (0,4 ns)
             product: M471A4G43MB1-CTD
             vendor: Samsung
             physical id: 0
             serial: 03A85A99
             slot: ChannelA-DIMM0
             size: 32GiB
             width: 64 bits
             clock: 2667MHz (0.4ns)
        *-bank:1
             description: SODIMM DDR4 Synchronous 2667 MHz (0,4 ns)
             product: M471A4G43MB1-CTD
             vendor: Samsung
             physical id: 1
             serial: 03A85BD7
             slot: ChannelB-DIMM0
             size: 32GiB
             width: 64 bits
             clock: 2667MHz (0.4ns)
     *-pci
          description: Host bridge
          product: Intel Corporation
          vendor: Intel Corporation
          physical id: 100
          bus info: pci@0000:00:00.0
          version: 0c
          width: 32 bits
          clock: 33MHz
        *-display
             description: VGA compatible controller
             product: Intel Corporation
             vendor: Intel Corporation
             physical id: 2
             bus info: pci@0000:00:02.0
             logical name: /dev/fb0
             version: 02
             width: 64 bits
             clock: 33MHz
             capabilities: pciexpress msi pm vga_controller bus_master cap_list rom fb
             configuration: depth=32 driver=i915 latency=0 mode=1920x1080 visual=truecolor xres=1920 yres=1080
             resources: iomemory:600-5ff iomemory:400-3ff irq:158 memory:6024000000-6024ffffff memory:4000000000-400fffffff ioport:5000(size=64) memory:c0000-dffff
        *-generic UNCLAIMED
             description: Signal processing controller
             product: Intel Corporation
             vendor: Intel Corporation
             physical id: 12
             bus info: pci@0000:00:12.0
             version: 00
             width: 64 bits
             clock: 33MHz
             capabilities: pm msi bus_master cap_list
             configuration: latency=0
             resources: iomemory:600-5ff memory:6025109000-6025109fff
        *-usb
             description: USB controller
             product: Intel Corporation
             vendor: Intel Corporation
             physical id: 14
             bus info: pci@0000:00:14.0
             version: 00
             width: 64 bits
             clock: 33MHz
             capabilities: pm msi xhci bus_master cap_list
             configuration: driver=xhci_hcd latency=0
             resources: irq:126 memory:96100000-9610ffff
           *-usbhost:0
                product: xHCI Host Controller
                vendor: Linux 5.0.0-37-generic xhci-hcd
                physical id: 0
                bus info: usb@1
                logical name: usb1
                version: 5.00
                capabilities: usb-2.00
                configuration: driver=hub slots=12 speed=480Mbit/s
              *-usb:0
                   description: Mouse
                   product: 2.4G Wireless Mouse
                   vendor: MOSART Semi.
                   physical id: 1
                   bus info: usb@1:1
                   version: 1.00
                   capabilities: usb-1.10
                   configuration: driver=usbhid maxpower=100mA speed=12Mbit/s
              *-usb:1
                   description: Video
                   product: Chicony USB2.0 Camera
                   vendor: Sonix Technology Co., Ltd.
                   physical id: 7
                   bus info: usb@1:7
                   version: 54.03
                   capabilities: usb-2.00
                   configuration: driver=uvcvideo maxpower=500mA speed=480Mbit/s
              *-usb:2
                   description: Bluetooth wireless interface
                   vendor: Intel Corp.
                   physical id: a
                   bus info: usb@1:a
                   version: 0.02
                   capabilities: bluetooth usb-2.00
                   configuration: driver=btusb maxpower=100mA speed=12Mbit/s
           *-usbhost:1
                product: xHCI Host Controller
                vendor: Linux 5.0.0-37-generic xhci-hcd
                physical id: 1
                bus info: usb@2
                logical name: usb2
                version: 5.00
                capabilities: usb-3.10
                configuration: driver=hub slots=6 speed=10000Mbit/s
        *-memory UNCLAIMED
             description: RAM memory
             product: Intel Corporation
             vendor: Intel Corporation
             physical id: 14.2
             bus info: pci@0000:00:14.2
             version: 00
             width: 64 bits
             clock: 33MHz (30.3ns)
             capabilities: pm bus_master cap_list
             configuration: latency=0
             resources: iomemory:600-5ff iomemory:600-5ff memory:6025104000-6025105fff memory:6025108000-6025108fff
        *-communication
             description: Communication controller
             product: Intel Corporation
             vendor: Intel Corporation
             physical id: 16
             bus info: pci@0000:00:16.0
             version: 00
             width: 64 bits
             clock: 33MHz
             capabilities: pm msi bus_master cap_list
             configuration: driver=mei_me latency=0
             resources: iomemory:600-5ff irq:147 memory:6025107000-6025107fff
        *-storage
             description: SATA controller
             product: Intel Corporation
             vendor: Intel Corporation
             physical id: 17
             bus info: pci@0000:00:17.0
             version: 00
             width: 32 bits
             clock: 66MHz
             capabilities: storage msi pm ahci_1.0 bus_master cap_list
             configuration: driver=ahci latency=0
             resources: irq:128 memory:96110000-96111fff memory:96114000-961140ff ioport:5080(size=8) ioport:5088(size=4) ioport:5060(size=32) memory:96113000-961137ff
        *-pci:0
             description: PCI bridge
             product: Intel Corporation
             vendor: Intel Corporation
             physical id: 1c
             bus info: pci@0000:00:1c.0
             version: f0
             width: 32 bits
             clock: 33MHz
             capabilities: pci pciexpress msi pm normal_decode bus_master cap_list
             configuration: driver=pcieport
             resources: irq:122 ioport:6000(size=8192) memory:80000000-960fffff ioport:6000000000(size=570425344)
           *-pci
                description: PCI bridge
                product: JHL7540 Thunderbolt 3 Bridge [Titan Ridge 2C 2018]
                vendor: Intel Corporation
                physical id: 0
                bus info: pci@0000:01:00.0
                version: 06
                width: 32 bits
                clock: 33MHz
                capabilities: pci pm msi pciexpress normal_decode bus_master cap_list
                configuration: driver=pcieport
                resources: irq:16 ioport:6000(size=4096) memory:80000000-960fffff ioport:6000000000(size=570425344)
              *-pci:0
                   description: PCI bridge
                   product: JHL7540 Thunderbolt 3 Bridge [Titan Ridge 2C 2018]
                   vendor: Intel Corporation
                   physical id: 0
                   bus info: pci@0000:02:00.0
                   version: 06
                   width: 32 bits
                   clock: 33MHz
                   capabilities: pci pm msi pciexpress normal_decode bus_master cap_list
                   configuration: driver=pcieport
                   resources: irq:16 memory:96000000-960fffff
                 *-generic
                      description: System peripheral
                      product: JHL7540 Thunderbolt 3 NHI [Titan Ridge 2C 2018]
                      vendor: Intel Corporation
                      physical id: 0
                      bus info: pci@0000:03:00.0
                      version: 06
                      width: 32 bits
                      clock: 33MHz
                      capabilities: pm msi pciexpress msix bus_master cap_list
                      configuration: driver=thunderbolt latency=0
                      resources: irq:16 memory:96000000-9603ffff memory:96040000-96040fff
              *-pci:1
                   description: PCI bridge
                   product: JHL7540 Thunderbolt 3 Bridge [Titan Ridge 2C 2018]
                   vendor: Intel Corporation
                   physical id: 1
                   bus info: pci@0000:02:01.0
                   version: 06
                   width: 32 bits
                   clock: 33MHz
                   capabilities: pci pm msi pciexpress normal_decode bus_master cap_list
                   configuration: driver=pcieport
                   resources: irq:125 ioport:6000(size=4096) memory:80000000-95efffff ioport:6000000000(size=570425344)
              *-pci:2
                   description: PCI bridge
                   product: JHL7540 Thunderbolt 3 Bridge [Titan Ridge 2C 2018]
                   vendor: Intel Corporation
                   physical id: 2
                   bus info: pci@0000:02:02.0
                   version: 06
                   width: 32 bits
                   clock: 33MHz
                   capabilities: pci pm msi pciexpress normal_decode bus_master cap_list
                   configuration: driver=pcieport
                   resources: irq:18 memory:95f00000-95ffffff
                 *-usb
                      description: USB controller
                      product: JHL7540 Thunderbolt 3 USB Controller [Titan Ridge 2C 2018]
                      vendor: Intel Corporation
                      physical id: 0
                      bus info: pci@0000:3a:00.0
                      version: 06
                      width: 32 bits
                      clock: 33MHz
                      capabilities: pm msi pciexpress xhci cap_list
                      configuration: driver=xhci_hcd latency=0
                      resources: irq:127 memory:95f00000-95f0ffff
                    *-usbhost:0
                         product: xHCI Host Controller
                         vendor: Linux 5.0.0-37-generic xhci-hcd
                         physical id: 0
                         bus info: usb@3
                         logical name: usb3
                         version: 5.00
                         capabilities: usb-2.00
                         configuration: driver=hub slots=2 speed=480Mbit/s
                    *-usbhost:1
                         product: xHCI Host Controller
                         vendor: Linux 5.0.0-37-generic xhci-hcd
                         physical id: 1
                         bus info: usb@4
                         logical name: usb4
                         version: 5.00
                         capabilities: usb-3.10
                         configuration: driver=hub slots=2 speed=10000Mbit/s
        *-pci:1
             description: PCI bridge
             product: Intel Corporation
             vendor: Intel Corporation
             physical id: 1d
             bus info: pci@0000:00:1d.0
             version: f0
             width: 32 bits
             clock: 33MHz
             capabilities: pci pciexpress msi pm normal_decode bus_master cap_list
             configuration: driver=pcieport
             resources: irq:123 ioport:4000(size=4096) memory:98000000-98ffffff ioport:6022000000(size=16777216)
           *-generic
                description: Unassigned class
                product: RTL8411B PCI Express Card Reader
                vendor: Realtek Semiconductor Co., Ltd.
                physical id: 0
                bus info: pci@0000:3b:00.0
                version: 01
                width: 32 bits
                clock: 33MHz
                capabilities: pm msi pciexpress msix vpd bus_master cap_list rom
                configuration: driver=rtsx_pci latency=0
                resources: irq:129 memory:98005000-98005fff memory:98010000-9801ffff
           *-network
                description: Ethernet interface
                product: RTL8111/8168/8411 PCI Express Gigabit Ethernet Controller
                vendor: Realtek Semiconductor Co., Ltd.
                physical id: 0.1
                bus info: pci@0000:3b:00.1
                logical name: enp59s0f1
                version: 12
                serial: 80:fa:5b:74:b7:7c
                width: 64 bits
                clock: 33MHz
                capabilities: pm msi pciexpress msix vpd bus_master cap_list ethernet physical
                configuration: broadcast=yes driver=r8169 latency=0 multicast=yes
                resources: irq:16 ioport:4000(size=256) memory:98004000-98004fff memory:98000000-98003fff
        *-pci:2
             description: PCI bridge
             product: Intel Corporation
             vendor: Intel Corporation
             physical id: 1d.1
             bus info: pci@0000:00:1d.1
             version: f0
             width: 32 bits
             clock: 33MHz
             capabilities: pci pciexpress msi pm normal_decode bus_master cap_list
             configuration: driver=pcieport
             resources: irq:124 ioport:3000(size=4096) memory:97000000-97ffffff ioport:6023000000(size=16777216)
           *-network
                description: Wireless interface
                product: Wireless-AC 9260
                vendor: Intel Corporation
                physical id: 0
                bus info: pci@0000:40:00.0
                logical name: wlp64s0
                version: 29
                serial: 28:7f:cf:f8:c9:15
                width: 64 bits
                clock: 33MHz
                capabilities: pm msi pciexpress msix bus_master cap_list ethernet physical wireless
                configuration: broadcast=yes driver=iwlwifi driverversion=5.0.0-37-generic firmware=43.95eb4e97.0 ip=192.168.1.27 latency=0 link=yes multicast=yes wireless=IEEE 802.11
                resources: irq:17 memory:97000000-97003fff
        *-isa
             description: ISA bridge
             product: Intel Corporation
             vendor: Intel Corporation
             physical id: 1f
             bus info: pci@0000:00:1f.0
             version: 00
             width: 32 bits
             clock: 33MHz
             capabilities: isa bus_master
             configuration: latency=0
        *-multimedia
             description: Audio device
             product: Intel Corporation
             vendor: Intel Corporation
             physical id: 1f.3
             bus info: pci@0000:00:1f.3
             version: 00
             width: 64 bits
             clock: 33MHz
             capabilities: pm msi bus_master cap_list
             configuration: driver=snd_hda_intel latency=32
             resources: iomemory:600-5ff iomemory:600-5ff irq:159 memory:6025100000-6025103fff memory:6025000000-60250fffff
        *-serial:0 UNCLAIMED
             description: SMBus
             product: Intel Corporation
             vendor: Intel Corporation
             physical id: 1f.4
             bus info: pci@0000:00:1f.4
             version: 00
             width: 64 bits
             clock: 33MHz
             configuration: latency=0
             resources: iomemory:600-5ff memory:6025106000-60251060ff ioport:5040(size=32)
        *-serial:1 UNCLAIMED
             description: Serial bus controller
             product: Intel Corporation
             vendor: Intel Corporation
             physical id: 1f.5
             bus info: pci@0000:00:1f.5
             version: 00
             width: 32 bits
             clock: 33MHz
             capabilities: bus_master
             configuration: latency=0
             resources: memory:fe010000-fe010fff
     *-scsi:0
          physical id: 1
          logical name: scsi0
          capabilities: emulated
        *-disk
             description: ATA Disk
             product: Samsung SSD 860
             physical id: 0.0.0
             bus info: scsi@0:0.0.0
             logical name: /dev/sda
             version: 3B6Q
             serial: S3Z6NB0M604825B
             size: 931GiB (1TB)
             capabilities: gpt-1.00 partitioned partitioned:gpt
             configuration: ansiversion=5 guid=e090b914-8dfe-459e-93e3-e00d603dd0f8 logicalsectorsize=512 sectorsize=512
           *-volume:0 UNCLAIMED
                description: Windows FAT volume
                vendor: mkfs.fat
                physical id: 1
                bus info: scsi@0:0.0.0,1
                version: FAT32
                serial: 809b-b879
                size: 510MiB
                capacity: 511MiB
                capabilities: fat initialized
                configuration: FATs=2 filesystem=fat name=primary
           *-volume:1
                description: EXT4 volume
                vendor: Linux
                physical id: 2
                bus info: scsi@0:0.0.0,2
                logical name: /dev/sda2
                logical name: /
                version: 1.0
                serial: 3c3ae400-eaf9-4fec-bcd1-312dd83a63e6
                size: 923GiB
                capabilities: journaled extended_attributes large_files huge_files dir_nlink recover 64bit extents ext4 ext2 initialized
                configuration: created=2020-01-17 14:35:05 filesystem=ext4 lastmountpoint=/ modified=2020-01-28 18:09:49 mount.fstype=ext4 mount.options=rw,relatime mounted=2020-01-28 18:09:49 name=primary state=mounted
           *-volume:2
                description: Linux swap volume
                vendor: Linux
                physical id: 3
                bus info: scsi@0:0.0.0,3
                logical name: /dev/sda3
                version: 1
                serial: bd14c8a4-753d-4279-937d-a9523a0361ef
                size: 8190MiB
                capacity: 8191MiB
                capabilities: nofs swap initialized
                configuration: filesystem=swap name=primary pagesize=4095
     *-scsi:1
          physical id: 2
          logical name: scsi2
          capabilities: emulated
        *-disk
             description: ATA Disk
             product: Samsung SSD 860
             physical id: 0.0.0
             bus info: scsi@2:0.0.0
             logical name: /dev/sdb
             version: 3B6Q
             serial: S4HCNF0MA01654F
             size: 931GiB (1TB)
             capabilities: gpt-1.00 partitioned partitioned:gpt
             configuration: ansiversion=5 guid=26fd567d-c830-4580-a985-464b04124354 logicalsectorsize=512 sectorsize=512
           *-volume
                description: EXT4 volume
                vendor: Linux
                physical id: 1
                bus info: scsi@2:0.0.0,1
                logical name: /dev/sdb1
                logical name: /datadisk
                version: 1.0
                serial: 790ca774-8f7e-41f2-815d-f492467c4f13
                size: 931GiB
                capacity: 931GiB
                capabilities: journaled extended_attributes large_files huge_files dir_nlink recover 64bit extents ext4 ext2 initialized
                configuration: created=2020-01-17 14:35:10 filesystem=ext4 lastmountpoint=/datadisk modified=2020-01-28 18:09:50 mount.fstype=ext4 mount.options=rw,relatime mounted=2020-01-28 18:09:50 name=primary state=mounted

Voici les quelques tests que j’ai lancé :

Migration MacOS vers Ubuntu : alternative à Lulu de Ojective-See

Sat, 25 Jan 2020 00:00:00 +0000

J’ai souvent parlé de Lulu, un outil indispendable quand on travaille sous MacOS :

Pour l’instant sous Ubuntu, j’ai installé Douane et GUFW Firewall … c’est pas idéal, mais pour un début c’est pas mal.

Disons que Douane indique seulement le soft qui essaye de se connecter, il manque l’IP et le port. Mais il est possible d’avoir les informations dans les logs.

Ubuntu 18.04.3 : Digikam : error while loading shared libraries: libQt5Sql.so.5

Thu, 23 Jan 2020 00:00:00 +0000

Voici l’erreur en question :

cp: cannot stat '/snap/digikam/6/kf5/usr/share/mime': No such file or directory
Directory '/root/snap/digikam/6/.local/share/mime/packages' does not exist!
ERROR: update-mime-database /root/snap/digikam/6/.local/share/mime exited abnormally with status 1
/snap/digikam/6/usr/bin/digikam: error while loading shared libraries: libQt5Sql.so.5: cannot open shared object file: No such file or directory

Voici les informations de mon système :

arias@CYBERNEURONES:~$ sudo locate libQt5Sql.so.5
/snap/kde-frameworks-5-core18/32/usr/lib/x86_64-linux-gnu/libQt5Sql.so.5
/snap/kde-frameworks-5-core18/32/usr/lib/x86_64-linux-gnu/libQt5Sql.so.5.12
/snap/kde-frameworks-5-core18/32/usr/lib/x86_64-linux-gnu/libQt5Sql.so.5.12.3
/usr/lib/x86_64-linux-gnu/libQt5Sql.so.5
/usr/lib/x86_64-linux-gnu/libQt5Sql.so.5.9
/usr/lib/x86_64-linux-gnu/libQt5Sql.so.5.9.5
arias@CYBERNEURONES:~$ ldd /snap/digikam/6/usr/bin/digikam 
/snap/digikam/6/usr/bin/digikam: /usr/lib/x86_64-linux-gnu/libQt5Core.so.5: version `Qt_5.12' not found (required by /snap/digikam/6/usr/bin/digikam)
	linux-vdso.so.1 (0x00007ffd447d5000)
	libdigikamcore.so.6.4.0 => not found
	libdigikamdatabase.so.6.4.0 => not found
	libdigikamgui.so.6.4.0 => not found
	libQt5Sql.so.5 => /usr/lib/x86_64-linux-gnu/libQt5Sql.so.5 (0x00007f400a869000)
	libKF5I18n.so.5 => /usr/lib/x86_64-linux-gnu/libKF5I18n.so.5 (0x00007f400a61b000)
	libKF5CoreAddons.so.5 => /usr/lib/x86_64-linux-gnu/libKF5CoreAddons.so.5 (0x00007f400a389000)
	libKF5ConfigCore.so.5 => /usr/lib/x86_64-linux-gnu/libKF5ConfigCore.so.5 (0x00007f400a12e000)
	libQt5Widgets.so.5 => /usr/lib/x86_64-linux-gnu/libQt5Widgets.so.5 (0x00007f40098e7000)
	libQt5Gui.so.5 => /usr/lib/x86_64-linux-gnu/libQt5Gui.so.5 (0x00007f400917e000)
	libQt5Core.so.5 => /usr/lib/x86_64-linux-gnu/libQt5Core.so.5 (0x00007f4008a33000)
	libstdc++.so.6 => /usr/lib/x86_64-linux-gnu/libstdc++.so.6 (0x00007f40086aa000)
	libgcc_s.so.1 => /lib/x86_64-linux-gnu/libgcc_s.so.1 (0x00007f4008492000)
	libc.so.6 => /lib/x86_64-linux-gnu/libc.so.6 (0x00007f40080a1000)
	libfam.so.0 => /usr/lib/x86_64-linux-gnu/libfam.so.0 (0x00007f4007e98000)
	libpthread.so.0 => /lib/x86_64-linux-gnu/libpthread.so.0 (0x00007f4007c79000)
	libm.so.6 => /lib/x86_64-linux-gnu/libm.so.6 (0x00007f40078db000)
	libGL.so.1 => /usr/lib/x86_64-linux-gnu/libGL.so.1 (0x00007f400764f000)
	libpng16.so.16 => /usr/lib/x86_64-linux-gnu/libpng16.so.16 (0x00007f400741d000)
	libharfbuzz.so.0 => /usr/lib/x86_64-linux-gnu/libharfbuzz.so.0 (0x00007f400717f000)
	libz.so.1 => /lib/x86_64-linux-gnu/libz.so.1 (0x00007f4006f62000)
	libicui18n.so.60 => /usr/lib/x86_64-linux-gnu/libicui18n.so.60 (0x00007f4006ac1000)
	libicuuc.so.60 => /usr/lib/x86_64-linux-gnu/libicuuc.so.60 (0x00007f400670a000)
	libdouble-conversion.so.1 => /usr/lib/x86_64-linux-gnu/libdouble-conversion.so.1 (0x00007f40064f9000)
	libdl.so.2 => /lib/x86_64-linux-gnu/libdl.so.2 (0x00007f40062f5000)
	libglib-2.0.so.0 => /usr/lib/x86_64-linux-gnu/libglib-2.0.so.0 (0x00007f4005fde000)
	/lib64/ld-linux-x86-64.so.2 (0x00007f400acc0000)
	libGLX.so.0 => /usr/lib/x86_64-linux-gnu/libGLX.so.0 (0x00007f4005dad000)
	libGLdispatch.so.0 => /usr/lib/x86_64-linux-gnu/libGLdispatch.so.0 (0x00007f4005af7000)
	libfreetype.so.6 => /usr/lib/x86_64-linux-gnu/libfreetype.so.6 (0x00007f4005843000)
	libgraphite2.so.3 => /usr/lib/x86_64-linux-gnu/libgraphite2.so.3 (0x00007f4005616000)
	libicudata.so.60 => /usr/lib/x86_64-linux-gnu/libicudata.so.60 (0x00007f4003a6d000)
	libpcre.so.3 => /lib/x86_64-linux-gnu/libpcre.so.3 (0x00007f40037fb000)
	libX11.so.6 => /usr/lib/x86_64-linux-gnu/libX11.so.6 (0x00007f40034c3000)
	libxcb.so.1 => /usr/lib/x86_64-linux-gnu/libxcb.so.1 (0x00007f400329b000)
	libXau.so.6 => /usr/lib/x86_64-linux-gnu/libXau.so.6 (0x00007f4003097000)
	libXdmcp.so.6 => /usr/lib/x86_64-linux-gnu/libXdmcp.so.6 (0x00007f4002e91000)
	libbsd.so.0 => /lib/x86_64-linux-gnu/libbsd.so.0 (0x00007f4002c7c000)
	librt.so.1 => /lib/x86_64-linux-gnu/librt.so.1 (0x00007f4002a74000)
arias@CYBERNEURONES:~$ ls -l /usr/lib/x86_64-linux-gnu/libQt5Sql.so.5
lrwxrwxrwx 1 root root 18 oct.  30 22:00 /usr/lib/x86_64-linux-gnu/libQt5Sql.so.5 -> libQt5Sql.so.5.9.5

La correction à faire :

Jenkins & Confluence : Pour l'instant cela ne fonctionne pas

Fri, 12 Apr 2019 00:00:00 +0000

Ce qui est dommage c’est que le plugin n’indique pas quel est l’erreur … il y a seulement une exception sur un pointeur NULL. ( https://wiki.jenkins.io/display/JENKINS/Confluence+Publisher+Plugin )

ERROR: Build step failed with exception
java.lang.NullPointerException
       at rocks.inspectit.releaseplugin.releasenotes.ConfluenceReleaseNotesPublisher.perform(ConfluenceReleaseNotesPublisher.java:99)
       at hudson.tasks.BuildStepMonitor$3.perform(BuildStepMonitor.java:45)
       at hudson.model.AbstractBuild$AbstractBuildExecution.perform(AbstractBuild.java:741)
       at hudson.model.Build$BuildExecution.build(Build.java:206)
       at hudson.model.Build$BuildExecution.doRun(Build.java:163)
       at hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:504)
       at hudson.model.Run.execute(Run.java:1818)
       at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43)
       at hudson.model.ResourceController.execute(ResourceController.java:97)
       at hudson.model.Executor.run(Executor.java:429)
Build step 'Publish Release Notes on Confluence' marked build as failure

Misère.

Développement en C sous Linux : pthread et la fonction sleep().

Wed, 17 Oct 2018 00:00:00 +0000

Un petit exemple vaut mieux que de grands discours, voici le source en C :

#include 
#include 
#include 
#include <sys/time.h>
#include <sys/types.h>
#include 
static long debut = 0;
void* longue_pause(void* a){
        pid_t t = getpid();
        printf("pid = %d\n",(int)t);
        printf("thread longue_pause %d debut : %ld\n",(int)pthread_self(),time(0)-debut);
        sleep(10);
        printf("thread longue_pause %d fin : %ld\n",(int)pthread_self(),time(0)-debut);
}
void* petites_pauses(void* a){
	int i = 0;
        pid_t t = getpid();
        printf("pid = %d\n",t);
        printf("thread petites_pauses %d debut : %ld \n",(int)pthread_self(), time(0)-debut);
        for(; i < 10 ;++i){
                printf("thread petites_pauses %d en cours : %ld \n",(int)pthread_self(), time(0)-debut);
                sleep(1);
        }
}
int main(){
        pthread_t longue;
        pthread_t petit1;
        pthread_t petit2;
        debut = time(0);
        pthread_create(&longue,NULL,longue_pause,NULL);
        pthread_create(&petit1,NULL,petites_pauses,NULL);
        pthread_create(&petit2,NULL,petites_pauses,NULL);
	sleep(8);
	printf("Debut join: %ld\n",time(0)-debut);
        pthread_join(longue,NULL);
        printf("fin long : %ld\n",time(0)-debut); 
        pthread_join(petit1,NULL);
	printf("fin petit1 : %ld\n",time(0)-debut);	
        pthread_join(petit2,NULL);
	printf("fin petit2 : %ld\n",time(0)-debut);
}

Pour la compilation :

Ubuntu : Connaitre la version en ligne de commande .

Tue, 11 Sep 2018 00:00:00 +0000

Voici les différentes méthodes :

Méthode n°1 : Fichiers /etc/*-release.
$ cat /etc/*-release
DISTRIB_ID=Ubuntu
DISTRIB_RELEASE=16.04
DISTRIB_CODENAME=xenial
DISTRIB_DESCRIPTION="Ubuntu 16.04.4 LTS"
NAME="Ubuntu"
VERSION="16.04.4 LTS (Xenial Xerus)"
ID=ubuntu
ID_LIKE=debian
PRETTY_NAME="Ubuntu 16.04.4 LTS"
VERSION_ID="16.04"
HOME_URL="http://www.ubuntu.com/"
SUPPORT_URL="http://help.ubuntu.com/"
BUG_REPORT_URL="http://bugs.launchpad.net/ubuntu/"
VERSION_CODENAME=xenial
UBUNTU_CODENAME=xenial
Ubuntu 16.04.4 LTS
 
==> Méthode n°2 : Commande lsb_release . 
 
$ lsb_release -a
No LSB modules are available.
Distributor ID:    Ubuntu
Description:    Ubuntu 16.04.4 LTS
Release:    16.04
Codename:    xenial
 
==> Méthode n°3 : Commande hostnamectl
 
$ hostnamectl
   Static hostname: My-VirtualBox
         Icon name: computer-vm
           Chassis: vm
        Machine ID: 8b7b98b57a954b118f5f8edc0359cde5
           Boot ID: d7bc2ea1c813409490604e757cf6483c
    Virtualization: oracle
  Operating System: Ubuntu 16.04.4 LTS
            Kernel: Linux 4.15.0-33-generic
      Architecture: x86-64
 
==> Méthode n°4 : Fichier /etc/issue
   
$ cat /etc/issue
Ubuntu 16.04.4 LTS \n \l
 
==> Methode n°5 : Commande uname.
 
$ uname -a
Linux My-VirtualBox 4.15.0-33-generic #36~16.04.1-Ubuntu SMP Wed Aug 15 17:21:05 UTC 2018 x86_64 x86_64 x86_64 GNU/Linux
 
==> Methode n°6 : Fichier /proc/version
 
$ cat /proc/version
Linux version 4.15.0-33-generic (buildd@lgw01-amd64-010) (gcc version 5.4.0 20160609 (Ubuntu 5.4.0-6ubuntu1~16.04.10)) #36~16.04.1-Ubuntu SMP Wed Aug 15 17:21:05 UTC 2018

==> Methode n°6 : Python car il n'y que cela de vrai ... Misère

python -c 'import distro; distro.linux_distribution()'

ou

python -c 'import sys; print(sys.version)'

ou

python -c 'import plateform; platform.linux_distribution()'

Pour information, les mêmes commandes sous une ancienne Fédora 17 :

Ubuntu : NetworkManager & Avahi ... la misère .

Tue, 11 Sep 2018 00:00:00 +0000

Pour installer le réseau sous Ubuntu, il n’est pas rare que je supprime les services NetworkManager & Avahi qui par moment apportent plus de problème que de service.

Les services que je stoppe :

$ systemctl disable avahi-daemon.socket

$ systemctl disable avahi-daemon.service

$ systemctl disable NetworkManager.service

Les fichiers que je modifie :

Dans /etc/systemd/resolved.conf  je modifie DNSSEC.

$ cat /etc/systemd/resolved.conf 
#  This file is part of systemd.
#
#  systemd is free software; you can redistribute it and/or modify it
#  under the terms of the GNU Lesser General Public License as published by
#  the Free Software Foundation; either version 2.1 of the License, or
#  (at your option) any later version.
#
# Entries in this file show the compile time defaults.
# You can change settings by editing this file.
# Defaults can be restored by simply deleting this file.
#
# See resolved.conf(5) for details

[Resolve]
#DNS=
#FallbackDNS=8.8.8.8 8.8.4.4 2001:4860:4860::8888 2001:4860:4860::8844
#Domains=
#LLMNR=yes
DNSSEC=off

 Le fichier par /etc/network/interfaces défaut : 

$ cat /etc/network/interfaces
# interfaces(5) file used by ifup(8) and ifdown(8)
auto lo
iface lo inet loopback

 J'ajoute dans ce fichier ma carte réseau 

$ reboot

Voici la configuration hard & soft :

Ubuntu : Gnome-terminal ne se lance plus !

Mon, 12 Mar 2018 00:00:00 +0000

En fait c’est suite à la mise à jour de python que j’ai eu le problème … je ne pensais pas que c’était du python. Cela commence a être envahissant ce Python …. Pour que cela retombe en marche j’ai fait :

cd /usr/lib/python3/dist-packages/gi/
sudo cp _gi.cpython-35m-x86_64-linux-gnu.so _gi.cpython-36m-x86_64-linux-gnu.so
sudo cp _gi_cairo.cpython-35m-x86_64-linux-gnu.so _gi_cairo.cpython-36m-x86_64-linux-gnu.so

Dans les logs j’avais cette erreur :

ImportError: cannot import name '_gi'

Misère.