Not able to use pipeViewer due to 'extract_value' not defined error

[shubham-bhawalkar]

Hi guys,

I see a bunch of open issues on the pipeViewer but wasn't obvious to me if any of them directly relate to what error I'm seeing in trying to use it. I'm using a Mac M1. Note that I'm able to build the core example just fine, with all the commands to run it as well. Just the pipeViewer is causing me pain. Would appreciate it if someone could help me out here :) [ Also please let me know if I should use some other way/forum to bring forth such issues]

I'm trying to build the pipeViewer tool after building Helios on the CoreExample on a fresh clone of map, and a fresh #build of Sparta. Not sure if I missed something, but in trying to follow the steps I'm running into this issue, here's the output after running the Argos.py command

(sparta) Shubhams-MacBook-Pro:CoreModel shubham$ $HOME/map/helios/pipeViewer/pipe_view/argos.py \ -l $HOME/map/sparta/example/CoreModel/cpu_layout.alf \ -d my_pipeout

INFO: looking for /Users/shubham/anaconda3/envs/sparta/bin/transactionsearch transaction search initialized: you will be able to use search. Using: /Users/shubham/anaconda3/envs/sparta/bin/transactionsearch Traceback (most recent call last): File "/Users/shubham/map/helios/pipeViewer/pipe_view/argos.py", line 45, in <module> from pipe_view.model.workspace import Workspace # noqa: E402 File "/Users/shubham/anaconda3/envs/sparta/lib/python3.10/site-packages/pipe_view/model/workspace.py", line 15, in <module> from ..gui.layout_frame import Layout_Frame File "/Users/shubham/anaconda3/envs/sparta/lib/python3.10/site-packages/pipe_view/gui/layout_frame.py", line 17, in <module> from .layout_canvas import Layout_Canvas File "/Users/shubham/anaconda3/envs/sparta/lib/python3.10/site-packages/pipe_view/gui/layout_canvas.py", line 27, in <module> from .. import core File "pipe_view/core/src/core.pyx", line 11, in init pipe_view.core NameError: name 'extract_value' is not defined

[klingaard]

What version of cython do you have installed? I had the same problem. You'll need to make sure you have cython v0.29 installed.

[klingaard]

Appreciate the details! Can you tell me the distro you're using? For example, on Ubuntu:

lsb_release -a
No LSB modules are available.
Distributor ID:	Ubuntu
Description:	Ubuntu 22.04.3 LTS
Release:	22.04
Codename:	jammy

[kennethpinzon]

Thanks Knute for checking on this, using Debian 10:

Distributor ID: Debian
Description:    Debian GNU/Linux 10 (buster)
Release:        10
Codename:       buster

[klingaard]

Thanks! I'll try to reproduce this error after the holidays.

[timsnyder]

Hi @kennethpinzon when you say

render_recipe_for_platform.sh using linux_64_.yaml didnt work

Can you elaborate on what happened? This may need to become a separate ticket. I don't remember us doing any regression testing of hellos in the CI. I don't know if the recipe for the conda env even includes the requirements for helios/argos.

Looking again, at

#
#  BUILD MAP/HELIOS
#
################################################################################
pushd helios
mkdir -p release
pushd release
cmake -DCMAKE_BUILD_TYPE=Release \
      -DCMAKE_INSTALL_PREFIX:PATH="$PREFIX" \
      "${CMAKE_PLATFORM_FLAGS[@]}" \
      ..
cmake --build . -j "$CPU_COUNT" || cmake --build . -v
popd
popd

guess we build helios so the requirements should be in there. I'm still interested in what you ran into with the script.

[kennethpinzon]

Hi Tim, thanks for trying to help.
Answering your questions:

1. Since I am not much familiar with conda I couldnt debug much what is going on. After running the conda render ```
   command, the rendered_recipe is empty:

$ conda render -m .ci_support/linux_64_.yaml --file rendered_recipe.UCK2e8 conda.recipe
$ cat rendered_recipe.UCK2e8
$

2. After running
   $ cmake -DCMAKE_BUILD_TYPE=Release -DCMAKE_INSTALL_PREFIX:PATH="$PREFIX" "${CMAKE_PLATFORM_FLAGS[@]}" ..
   Output:

-- Looking for a built version of sparta in the source tree at /usr/local/tools/riscv/map2/helios/pipeViewer/../../sparta
-- HDF5 CXX compiler wrapper is unable to compile a minimal HDF5 program.
-- RapidJSON found. Headers: /home/xxx/mambaforge/envs/riscv_perf_model2/include
-- Configuring done
CMake Warning at pipeViewer/transactionsearch/CMakeLists.txt:6 (add_executable):
  Cannot generate a safe runtime search path for target transactionsearch
  because files in some directories may conflict with libraries in implicit
  directories:

    runtime library [libsqlite3.so.0] in /home/xxx/mambaforge/envs/riscv_perf_model2/lib may be hidden by files in:
      /usr/lib/x86_64-linux-gnu

  Some of these libraries may not be found correctly.


CMake Warning at pipeViewer/argos_dumper/CMakeLists.txt:9 (add_executable):
  Cannot generate a safe runtime search path for target Argos_dumper because
  files in some directories may conflict with libraries in implicit
  directories:

    runtime library [libsqlite3.so.0] in /home/xxx/mambaforge/envs/riscv_perf_model2/lib may be hidden by files in:
      /usr/lib/x86_64-linux-gnu

  Some of these libraries may not be found correctly.


CMake Warning at pipeViewer/argos_dumper/DatabaseDump/CMakeLists.txt:6 (add_executable):
  Cannot generate a safe runtime search path for target DBDumper because
  files in some directories may conflict with libraries in implicit
  directories:

    runtime library [libsqlite3.so.0] in /home/xxx/mambaforge/envs/riscv_perf_model2/lib may be hidden by files in:
      /usr/lib/x86_64-linux-gnu

  Some of these libraries may not be found correctly.

$ cmake --build . -j "$CPU_COUNT" || cmake --build . -v

[ 14%] Building pipeViwer and its dependencies
[ 28%] Linking CXX executable transactionsearch
[ 42%] Linking CXX executable DBDumper
[ 57%] Linking CXX executable Argos_dumper
/home/xxx/mambaforge/envs/riscv_perf_model2/lib/python3.10/site-packages/setuptools/_distutils/extension.py:134: UserWarning: Unknown Extension options: 'pyrex_gdb'
  warnings.warn(msg)
/home/xxx/mambaforge/envs/riscv_perf_model2/lib/python3.10/site-packages/setuptools/__init__.py:80: _DeprecatedInstaller: setuptools.installer and fetch_build_eggs are deprecated.
!!

        ********************************************************************************
        Requirements should be satisfied by a PEP 517 installer.
        If you are using pip, you can try `pip install --use-pep517`.
        ********************************************************************************

!!
  dist.fetch_build_eggs(dist.setup_requires)
[ 71%] Built target DBDumper
running build_ext
[ 85%] Built target transactionsearch
[ 85%] Built target pipeView
[100%] Built target Argos_dumper

[kennethpinzon]

Just curious if someone could have replicated the issue or have any hints

[klingaard]

Specifically, which issue are you seeing? If it's the missing extract_value problem, it's related to the version of cython -- it must be v0.29.

Are you having a different issue?

[kennethpinzon]

Thanks Knute. Once I tried to use the pipeviewer (after solving the Cython issue) there is a segment-fault (gtk2 installed)

$python $MAP_BASE/helios/pipeViewer/pipe_view/argos.py -d pipeout_1K -l ../layouts/small_core.alf
INFO: looking for  /home/xxx/mambaforge/envs/riscv_perf_model2/bin/transactionsearch
transaction search initialized: you will be able to use search.
Using: /home/xxx/mambaforge/envs/riscv_perf_model2/bin/transactionsearch
INFO:root:Constructing layout "../layouts/small_core.alf"
Constructing layout "../layouts/small_core.alf"
INFO:root:Layout loaded with 208 elements in 0.14158296585083008s
Layout loaded with 208 elements in 0.14158296585083008s

(argos.py:11173): GLib-GIO-CRITICAL **: 23:11:00.305: g_loadable_icon_load: assertion 'G_IS_LOADABLE_ICON (icon)' failed

(argos.py:11173): Gtk-WARNING **: 23:11:00.305: Error loading theme icon 'gtk-cancel' for stock: Failed to load icon

(argos.py:11173): Gtk-CRITICAL **: 23:11:00.305: render_fallback_image: assertion 'pixbuf != NULL' failed

(argos.py:11173): GLib-GObject-CRITICAL **: 23:11:00.305: g_object_ref: assertion 'G_IS_OBJECT (object)' failed

(argos.py:11173): GLib-GIO-CRITICAL **: 23:11:00.516: g_loadable_icon_load: assertion 'G_IS_LOADABLE_ICON (icon)' failed

.
.
.
Segmentation fault

[klingaard]

I've run into that seg fault before... trying to remember the issue. Just to make sure, did you try these tricks?

cd map/helios/pipeViewer
git clean -Xdf
cd ../release
make

[kennethpinzon]

Yes, I applied those and solved my cython issue but now I get the seg fault

[knute-mips]

Remove this file and try again:

rm ~/.config/argos/config.json 

[kennethpinzon]

After deleting ~/.config/argos/config.json, same behaviour. And once I run
$python MAP_BASE/helios/pipeViewer/pipe_view/argos.py -d pipeout_1K -l ../layouts/small_core.alf
the file ~/.config/argos/config.json gets created again

[knute-mips]

Correct, it will be created again, but hopefully the seg fault is no longer an issue. If it still is seg faulting, please fire up a gdb on it and show me the stack.

[kennethpinzon]

Deleting the json file didn't work. I am getting tangled by a dailyjob-related project, expecting to get back in few days to dive in this issue. In the meantime, hints are welcome.

[klingaard]

This is now fixed in #494