genmon wont start

[hacs-home-assistant-plugin-github]

Checklist

• I made sure that there are no existing issues or discussions - open issues,closed issues,open discussion, closed discussion - which may answer my question or that I could contribute my information to.
• I have read the Known Issues Wiki Page and my question / issue is not listed.
• I have provided the version of the software and the operating system in my post.
• If I have an issue with genmon not communicating with the controller, I have read and followed the serial troubleshooting guide.
• I have included the generator make and model in my submission.

Version

Version V1.18.18, raspbian 12

Have you submitted your log files from the About page? Note that outbound email must be working for logs to be submitted.

I have submitted logs

What is/are your question(s)?

After a reboot, genmon fails to start using /opt/genmon/startgenmon.sh start
When I run it manually, I get:

[genmon] root:/opt/genmon>  /opt/genmon/startgenmon.sh start
using binary: /opt/genmon/genenv/bin/python
Starting genmon python scripts
Warning: required library pyserial not installed. Attempting to install....
Starting....
Starting /opt/genmon/genmon.py
Stopping genserv.py
Starting /opt/genmon/genserv.py
Starting /opt/genmon/addon/genmqtt.py

but nothing is running.

genmon.log shows:

2025-01-07 15:18:40,338 : Selected Controller: generac_evo_nexus
2025-01-07 15:18:40,807 : GenMon Loaded for site: Generac 24KW using python 3.11: VEnv: False
2025-01-07 15:28:26,585 : Generator Monitor Shutdown

genloader.log shows:

2025-01-07 15:28:34,038 : Warning: required library pyserial not installed. Attempting to install....
2025-01-07 15:28:50,893 : Error in IsRunning: PID still exists but it's a zombie (pid=8243, name='python'): mysupport.py:563
2025-01-07 15:28:51,992 : Error in IsRunning: PID still exists but it's a zombie (pid=8243, name='python'): mysupport.py:563
2025-01-07 15:28:53,103 : Error in IsRunning: PID still exists but it's a zombie (pid=8243, name='python'): mysupport.py:563
2025-01-07 15:28:54,215 : Error in IsRunning: PID still exists but it's a zombie (pid=8243, name='python'): mysupport.py:563
2025-01-07 15:28:55,326 : Error in IsRunning: PID still exists but it's a zombie (pid=8243, name='python'): mysupport.py:563

genmqtt.log shows:
2025-01-07 15:29:06,288 : Error: Connect : [Errno 111] Connection refused : myclient.py:58

genserv.log shows:

2025-01-07 15:28:58,040 : Starting /opt/genmon/genserv.py, Port:8000, Secure HTTP: False, SelfSignedCert: True
2025-01-07 15:29:07,053 : Error: Connect : [Errno 111] Connection refused : myclient.py:58

But, if I run them manually, they all work...

python3 genmon.py &
python3 /opt/genmon/addon/genmqtt.py &
python3 genserv.py &

I have no idea what happened. Just a reboot as far as I know. Any help on getting this fixed would be appreciated.

Additional information

No response

[jgyates]

A few comments:

1. I generally don't support older versions and you are using version 1.18.18 which is from 2023. I would use the latest version which is 1.19.05.
2. the logs state you are missing pyserial. This is the python serial module which is installed when you run the installation script.
3. you don't mention if this is an existing installation that once worked or a new install. Starting with debian 12 the python environment is a uses a managed environment so if you have recently updated to debian 12 or attempted to migrate and existing install, you need to run the setup program again as a managed python environment requires using virtual python environments, which the install script will detect and create the needed environment.
4. Since pyserial is missing, I assume you have not run the install script. this is the procedure for installing genmon: https://github.com/jgyates/genmon/wiki/3.3--Setup-genmon-software. If you skip any steps it will not work as expected. Install the software with git, then run the installation script. You can still install in the opt directory.
5. you mentioned that you submitted logs in your initial post. I assume this was a mistake as I have not received any logs.

Let me know if you have any questions.

[hacs-home-assistant-plugin-github]

This was an existing installation that had been running for well over a year without really any attention given to it. It just ran solid... kudos to you for that!

The logs I was referring to are the ones pasted in my post. If there are additional logs I should submit, please let me know which ones are needed.

It tells me I need pyserial, but it won't install it. I've tried running genmonmaint.sh -i and it tells me it's setting up the virtual environment and everything is "satisfied". -r tells me the environment is externally managed and exits.

If I try to install pyserial manually, I get:

[genmon] root:/opt/genmon> apt install python3-pyserial
Reading package lists... Done
Building dependency tree... Done
Reading state information... Done
E: Unable to locate package python3-pyserial

If I try pip3 install pyserial, it tells me it's externally managed:

[genmon] root:/opt/genmon> pip3 install pyserial
error: externally-managed-environment

× This environment is externally managed
╰─> To install Python packages system-wide, try apt install
    python3-xyz, where xyz is the package you are trying to
    install.

    If you wish to install a non-Debian-packaged Python package,
    create a virtual environment using python3 -m venv path/to/venv.
    Then use path/to/venv/bin/python and path/to/venv/bin/pip. Make
    sure you have python3-full installed.

    For more information visit http://rptl.io/venv

note: If you believe this is a mistake, please contact your Python installation or OS distribution provider. You can override this, at the risk of breaking your Python installation or OS, by passing --break-system-packages.
hint: See PEP 668 for the detailed specification.

What's odd is that everything is working apparently without pyserial.

I'd be ok going to the latest version, but I don't want to lose my configuration and with things so screwy, I'm worried the update would fail and leave me in worse shape.

.

[jgyates]

since you are in a managed python environment you will need to do this to try to install/reinstall pyserial

 cd /opt/genmon
 source ./genenv/bin/activate

From here you should see your prompt change to include the name of the virtual environment (genenv).

You can show the python packages installed in the virtual environment:

sudo ./genenv/bin/pip3 freeze

Next install pyserial

 sudo ./genenv/bin/pip3 install pyserial 

You can exit the virtual environment by typing:

 deactivate

If you are only missing pyserail then that should fix the issue . If you are missing more then it is probably best to run the install again.

If you are missing a ./genmon/genenv directory then you virtual environment is gone and running the install script again should fix this.

Just guesses but a SD card starting to lose some data may be the issue, unless something else decided to use the genmon virtual enviroment and delete one of the python libraries. In a normal manage python installation each app has it's own envirment which means that each app has it's own set of libraries. Why you are missing pyserial is sort of strange.

this wiki entry has more info on the managed enviroment: https://github.com/jgyates/genmon/wiki/Appendix-S---Working-in-a-Managed-Python-Environment

Let me know if you have any questions.

[hacs-home-assistant-plugin-github]

It looks like pyserial was installed, but something was wrong with it....

(genenv) [genmon] root:/opt/genmon> ./genenv/bin/pip3 freeze|grep serial
pyserial==3.5

(genenv) [genmon] root:/opt/genmon> ./genenv/bin/pip3 install pyserial
Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple
Requirement already satisfied: pyserial in ./genenv/lib/python3.11/site-packages (3.5)

So I removed it and then reinstalled it....
(genenv) [genmon] root:/opt/genmon> ./genenv/bin/pip3 uninstall pyserial
Found existing installation: pyserial 3.5
Uninstalling pyserial-3.5:
Would remove:
/opt/genmon/genenv/bin/pyserial-miniterm
/opt/genmon/genenv/bin/pyserial-ports
/opt/genmon/genenv/lib/python3.11/site-packages/pyserial-3.5.dist-info/*
/opt/genmon/genenv/lib/python3.11/site-packages/serial/*
Proceed (Y/n)? y
Successfully uninstalled pyserial-3.5

(genenv) [genmon] root:/opt/genmon> ./genenv/bin/pip3 install pyserial
Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple
Collecting pyserial
Using cached https://www.piwheels.org/simple/pyserial/pyserial-3.5-py2.py3-none-any.whl (90 kB)
Installing collected packages: pyserial
Successfully installed pyserial-3.5
(genenv) [genmon] root:/opt/genmon> deactivate

And now everything starts up as expected. Thank you so much for your quick help! I'll work on getting upgraded to the latest version now.

.

[jgyates]

Thanks for letting me know the fix. I am glad is is working.

[hacs-home-assistant-plugin-github]

PS -- Your hunch was right... my SD card was going bad. Thanks again!

[hacs-home-assistant-plugin-github]

Sorry to bug you, but same issue when upgrading to 1.19.05.... kinda. This time, instead of complaining about pyserial, the problem is pyopenssl:

[genmon] root:/root> /bin/bash /opt/genmon/startgenmon.sh start
using binary: /opt/genmon/genenv/bin/python
Starting genmon python scripts
Warning: required library pyopenssl not installed. Attempting to install....
Starting....
Starting /opt/genmon/genmon.py
Stopping genserv.py
Starting /opt/genmon/genserv.py
Starting /opt/genmon/addon/genmqtt.py

But genmon.py never starts and the others time out when they cant connect.

genloader.log shows:
2025-01-08 03:06:55,333 : Warning: required library pyopenssl not installed. Attempting to install....

./genenv/bin/pip3 freeze shows that pyopenssl is installed:
pyOpenSSL==24.3.0

I have tried uninstalling cryptography and pyopenssl and reinstalling them both and the installs seem to run clean:
(genenv) [genmon] root:/opt/genmon> pip3 install cryptography
Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple
Requirement already satisfied: cryptography in ./genenv/lib/python3.11/site-packages (44.0.0)
Requirement already satisfied: cffi>=1.12 in ./genenv/lib/python3.11/site-packages (from cryptography) (1.17.1)
Requirement already satisfied: pycparser in ./genenv/lib/python3.11/site-packages (from cffi>=1.12->cryptography) (2.22)

(genenv) [genmon] root:/opt/genmon> pip3 install pyopenssl
Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple
Requirement already satisfied: pyopenssl in ./genenv/lib/python3.11/site-packages (24.3.0)
Requirement already satisfied: cryptography<45,>=41.0.5 in ./genenv/lib/python3.11/site-packages (from pyopenssl) (44.0.0)
Requirement already satisfied: cffi>=1.12 in ./genenv/lib/python3.11/site-packages (from cryptography<45,>=41.0.5->pyopenssl) (1.17.1)
Requirement already satisfied: pycparser in ./genenv/lib/python3.11/site-packages (from cffi>=1.12->cryptography<45,>=41.0.5->pyopenssl) (2.22)

I can see the pyopenssl files in the directory structure, so they are definitely there but for some reason startgenmon.sh cant find it.

(genenv) [genmon] root:/opt/genmon> find . -iname ssl
./genenv/lib/python3.11/site-packages/urllib3/util/ssltransport.py
./genenv/lib/python3.11/site-packages/urllib3/util/pycache/ssl_match_hostname.cpython-311.pyc
./genenv/lib/python3.11/site-packages/urllib3/util/pycache/ssltransport.cpython-311.pyc
./genenv/lib/python3.11/site-packages/urllib3/util/pycache/ssl_.cpython-311.pyc
./genenv/lib/python3.11/site-packages/urllib3/util/ssl_match_hostname.py
./genenv/lib/python3.11/site-packages/urllib3/util/ssl_.py
./genenv/lib/python3.11/site-packages/urllib3/contrib/pyopenssl.py
./genenv/lib/python3.11/site-packages/urllib3/contrib/pycache/pyopenssl.cpython-311.pyc
./genenv/lib/python3.11/site-packages/OpenSSL
./genenv/lib/python3.11/site-packages/OpenSSL/SSL.py
./genenv/lib/python3.11/site-packages/OpenSSL/pycache/SSL.cpython-311.pyc
./genenv/lib/python3.11/site-packages/rust/cryptography-openssl
./genenv/lib/python3.11/site-packages/cryptography/hazmat/backends/openssl
./genenv/lib/python3.11/site-packages/cryptography/hazmat/bindings/openssl
./genenv/lib/python3.11/site-packages/cryptography/hazmat/bindings/_rust/_openssl.pyi
./genenv/lib/python3.11/site-packages/cryptography/hazmat/bindings/_rust/openssl
./genenv/lib/python3.11/site-packages/pip/_vendor/urllib3/util/ssltransport.py
./genenv/lib/python3.11/site-packages/pip/_vendor/urllib3/util/pycache/ssl_match_hostname.cpython-311.pyc
./genenv/lib/python3.11/site-packages/pip/_vendor/urllib3/util/pycache/ssltransport.cpython-311.pyc
./genenv/lib/python3.11/site-packages/pip/vendor/urllib3/util/pycache/ssl.cpython-311.pyc
./genenv/lib/python3.11/site-packages/pip/_vendor/urllib3/util/ssl_match_hostname.py
./genenv/lib/python3.11/site-packages/pip/vendor/urllib3/util/ssl.py
./genenv/lib/python3.11/site-packages/pip/_vendor/urllib3/contrib/pyopenssl.py
./genenv/lib/python3.11/site-packages/pip/_vendor/urllib3/contrib/pycache/pyopenssl.cpython-311.pyc
./genenv/lib/python3.11/site-packages/pip/_vendor/truststore/pycache/_openssl.cpython-311.pyc
./genenv/lib/python3.11/site-packages/pip/_vendor/truststore/pycache/_ssl_constants.cpython-311.pyc
./genenv/lib/python3.11/site-packages/pip/_vendor/truststore/_ssl_constants.py
./genenv/lib/python3.11/site-packages/pip/_vendor/truststore/_openssl.py
./genenv/lib/python3.11/site-packages/pyOpenSSL-24.3.0.dist-info

And, as before, if I start the processes manually (ie. python3 xxx) everything works ok.

This is a fresh install using a new git pull and a new SD card.

What am I missing?

Thanks again!

[hacs-home-assistant-plugin-github]

Found it! I saw another post from someone else (#1162 (comment))

The fix was:
apt install libssl1.1

[jgyates]

I am glad it is working for you. Alternatively you could of solved this with this command:

 cd genmon
 ./startgenmon.sh -r

this will refresh the python libraries with the versions specified in the requirements.txt file. A while back the install script set the version of pyopenssl to 24.1.0 which should avoid the issue you ran into. Your approach should work fine as well.