Skip to content

add documentation for pydefix in virtualenv#365

Open
glesur wants to merge 2 commits intodevelopfrom
docPyBind11
Open

add documentation for pydefix in virtualenv#365
glesur wants to merge 2 commits intodevelopfrom
docPyBind11

Conversation

@glesur
Copy link
Contributor

@glesur glesur commented Mar 10, 2026

No description provided.

@glesur glesur added the doc label for documentation related things to be done label Mar 10, 2026
The fix is to force the following environement variables (replace XX by your python version) before launching Idefix:

```bash
export PYTHONPATH=$VIRTUAL_ENV/lib/python3.XX/site-packages:$PYTHONPATH
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This has much more consequences and can easily create a worse situation for a user, especially if they see the export as a suggestion to hardcode this line into a .bashrc or similar config file.
I'd strongly advise against this.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I don't see where it says this should be in .bashrc. My question would be: do you have a better proposition?

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

to be more constructive, I would suggest making pydefix a proper Python package if it makes sense (and it doesn't, there is a bigger problem to address here)

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I don't see where it says this should be in .bashrc.

I'm just saying this is typically where export statements from documentation / modifications to PYTHONPATH end up, and it's never1 the right solution.

Footnotes

  1. from the limited scope of my own experience

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

the problem is not due to pydefix (a c++ class in idefix), but to pybind11, which is already a python package. On Idefix startup, pybind11 does not necessarily pick up the python interpreter from the current venv.

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

What are the commands which are failing to reproduce with Idefix ?

I wanted to make a ticket for pybind11 but when trying to make a basic reproducer outside for them it looks to work on my setup ?

In the mean time, what I would export is the exact value taken by the python command :

export PYTHONPATH=$(python3 -c "import sys; print(':'.join(x for x in sys.path if x))")

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

also python3 isn't defined in all envs. I suspect at least some users might follow the documentation to the literal letter and turn out even more confused as a result.
It's becoming abundantly clear to me that trying to work around the problem may be more work than fixing it upstream.

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Agree.
What is the way to reproduce the problem with Idefix before I make a detailed ticket to pybind11 ?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I've added a patch to #367 in order to detect the virtual env at the cmake stage and hard code it in the executable, so that PYTHONPATH is not needed on startup. I'll keep you posted if this works.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Steps to reproduce:
in test/IO/pydefix
create a venv with python_requirements.txt
configure, compile and launch idefix. On my side, it uses the system's python, and fail to find matplotlib (required by the test), because pybind11 doesn't use the venv

@neutrinoceros neutrinoceros self-requested a review March 10, 2026 15:39
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

doc label for documentation related things to be done

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants