Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

performance report not rendering correctly on 2021.07.0 #5097

Closed
d-v-b opened this issue Jul 20, 2021 · 6 comments
Closed

performance report not rendering correctly on 2021.07.0 #5097

d-v-b opened this issue Jul 20, 2021 · 6 comments
Labels
diagnostics needs info Needs further information from the user

Comments

@d-v-b
Copy link
Member

d-v-b commented Jul 20, 2021

When I use the performance_report context manager on distributed==2021.07.0, Only the summary tab and the scheduler logs render correctly. Everything else (e.g., task stream, etc) fails to render. Performance reports render properly for me on distributed==2021.06.0.

By way of illustration, here's what the task stream looks like on 2021.07.0:

image

@gjoseph92
Copy link
Collaborator

If you could upload your HTML files for 2021.06.0 and 2021.07.0 as a gist, that might be helpful in diagnosing the problem.

@jakirkham
Copy link
Member

Second Gabe on uploading the report that has issues to a Gist. Also could you please include your install environment (conda list or pip list would work)?

@d-v-b
Copy link
Member Author

d-v-b commented Jul 20, 2021

yeah sorry for the sparse report ... here's conda list

I put the performance reports on s3:
2021.06.0
2021.07.0

_libgcc_mutex             0.1                 conda_forge    conda-forge
_openmp_mutex             4.5                       1_gnu    conda-forge
aiobotocore               1.3.3                    pypi_0    pypi
aiohttp                   3.7.4.post0              pypi_0    pypi
aioitertools              0.7.1                    pypi_0    pypi
appdirs                   1.4.4              pyh9f0ad1d_0    conda-forge
asciitree                 0.3.3                    pypi_0    pypi
async-timeout             3.0.1                    pypi_0    pypi
atk-1.0                   2.36.0               h3371d22_4    conda-forge
attrs                     21.2.0             pyhd8ed1ab_0    conda-forge
backcall                  0.2.0                    pypi_0    pypi
backoff                   1.11.1                   pypi_0    pypi
black                     20.8b1                   pypi_0    pypi
bokeh                     2.3.3                    pypi_0    pypi
botocore                  1.20.106                 pypi_0    pypi
brotlipy                  0.7.0           py39h3811e60_1001    conda-forge
ca-certificates           2021.5.30            ha878542_0    conda-forge
cachecontrol              0.12.6                     py_0    conda-forge
cachy                     0.3.0                      py_0    conda-forge
cairo                     1.16.0            h6cf1ce9_1008    conda-forge
certifi                   2021.5.30        py39hf3d152e_0    conda-forge
cffi                      1.14.5           py39he32792d_0    conda-forge
chardet                   4.0.0            py39hf3d152e_1    conda-forge
cleo                      0.8.1              pyh9f0ad1d_1    conda-forge
click                     8.0.1                    pypi_0    pypi
clikit                    0.6.2              pyh9f0ad1d_0    conda-forge
cloudpickle               1.6.0                    pypi_0    pypi
crashtest                 0.3.0                      py_0    conda-forge
cryptography              3.4.7            py39hbca0aa6_0    conda-forge
dacite                    1.6.0                    pypi_0    pypi
dask                      2021.7.0                 pypi_0    pypi
dask-janelia              0.1.4                    pypi_0    pypi
dask-jobqueue             0.7.2                    pypi_0    pypi
dbus                      1.13.6               h48d8840_2    conda-forge
debugpy                   1.3.0                    pypi_0    pypi
decorator                 5.0.9                    pypi_0    pypi
distlib                   0.3.2              pyhd8ed1ab_0    conda-forge
distributed               2021.7.0                 pypi_0    pypi
expat                     2.4.1                h9c3ff4c_0    conda-forge
fasteners                 0.16.3                   pypi_0    pypi
fibsem-tools              0.2.5                    pypi_0    pypi
filelock                  3.0.12             pyh9f0ad1d_0    conda-forge
font-ttf-dejavu-sans-mono 2.37                 hab24e00_0    conda-forge
font-ttf-inconsolata      3.000                h77eed37_0    conda-forge
font-ttf-source-code-pro  2.038                h77eed37_0    conda-forge
font-ttf-ubuntu           0.83                 hab24e00_0    conda-forge
fontconfig                2.13.1            hba837de_1005    conda-forge
fonts-conda-ecosystem     1                             0    conda-forge
fonts-conda-forge         1                             0    conda-forge
freetype                  2.10.4               h0708190_1    conda-forge
fribidi                   1.0.10               h36c2ea0_0    conda-forge
fsspec                    2021.6.0+105.g576008f          pypi_0    pypi
gdk-pixbuf                2.42.6               h04a7f16_0    conda-forge
gettext                   0.19.8.1          h0b5b191_1005    conda-forge
giflib                    5.2.1                h36c2ea0_2    conda-forge
glib                      2.68.3               h9c3ff4c_0    conda-forge
glib-tools                2.68.3               h9c3ff4c_0    conda-forge
graphite2                 1.3.13            h58526e2_1001    conda-forge
graphviz                  2.47.3               h85b4f2f_0    conda-forge
gtk2                      2.24.33              h539f30e_1    conda-forge
gts                       0.7.6                h64030ff_2    conda-forge
h5py                      3.3.0                    pypi_0    pypi
harfbuzz                  2.8.1                h83ec7ef_0    conda-forge
heapdict                  1.0.1                    pypi_0    pypi
html5lib                  1.1                pyh9f0ad1d_0    conda-forge
icu                       68.1                 h58526e2_0    conda-forge
idna                      3.2                      pypi_0    pypi
importlib_metadata        1.7.0                hd8ed1ab_1    conda-forge
iniconfig                 1.1.1                    pypi_0    pypi
ipykernel                 6.0.1                    pypi_0    pypi
ipython                   7.25.0                   pypi_0    pypi
ipython-genutils          0.2.0                    pypi_0    pypi
jbig                      2.1               h7f98852_2003    conda-forge
jedi                      0.18.0                   pypi_0    pypi
jeepney                   0.6.0              pyhd8ed1ab_0    conda-forge
jinja2                    3.0.1                    pypi_0    pypi
jmespath                  0.10.0                   pypi_0    pypi
jpeg                      9d                   h36c2ea0_0    conda-forge
jsonschema                3.2.0              pyhd8ed1ab_3    conda-forge
jupyter-client            6.1.12                   pypi_0    pypi
jupyter-core              4.7.1                    pypi_0    pypi
keyring                   21.2.1           py39hf3d152e_0    conda-forge
ld_impl_linux-64          2.35.1               hea4e1c9_2    conda-forge
lerc                      2.2.1                h9c3ff4c_0    conda-forge
libdeflate                1.7                  h7f98852_5    conda-forge
libffi                    3.3                  h58526e2_2    conda-forge
libgcc-ng                 9.3.0               h2828fa1_19    conda-forge
libgd                     2.3.2                h78a0170_0    conda-forge
libglib                   2.68.3               h3e27bee_0    conda-forge
libgomp                   9.3.0               h2828fa1_19    conda-forge
libiconv                  1.16                 h516909a_0    conda-forge
libpng                    1.6.37               h21135ba_2    conda-forge
librsvg                   2.50.7               hc3c00ef_0    conda-forge
libstdcxx-ng              9.3.0               h6de172a_19    conda-forge
libtiff                   4.3.0                hf544144_1    conda-forge
libtool                   2.4.6             h58526e2_1007    conda-forge
libuuid                   2.32.1            h7f98852_1000    conda-forge
libwebp                   1.2.0                h3452ae3_0    conda-forge
libwebp-base              1.2.0                h7f98852_2    conda-forge
libxcb                    1.13              h7f98852_1003    conda-forge
libxml2                   2.9.12               h72842e0_0    conda-forge
locket                    0.2.1                    pypi_0    pypi
lockfile                  0.12.2                     py_1    conda-forge
lz4-c                     1.9.3                h9c3ff4c_0    conda-forge
markupsafe                2.0.1                    pypi_0    pypi
matplotlib-inline         0.1.2                    pypi_0    pypi
mrcfile                   1.3.0                    pypi_0    pypi
msgpack-python            1.0.2            py39h1a9c180_1    conda-forge
multidict                 5.1.0                    pypi_0    pypi
mypy                      0.790                    pypi_0    pypi
mypy-extensions           0.4.3                    pypi_0    pypi
ncurses                   6.2                  h58526e2_4    conda-forge
numcodecs                 0.8.0                    pypi_0    pypi
numpy                     1.21.0                   pypi_0    pypi
openssl                   1.1.1k               h7f98852_0    conda-forge
packaging                 21.0                     pypi_0    pypi
pandas                    1.3.0                    pypi_0    pypi
pango                     1.48.5               hb8ff022_0    conda-forge
parso                     0.8.2                    pypi_0    pypi
partd                     1.2.0                    pypi_0    pypi
pastel                    0.2.0                      py_0    conda-forge
pathspec                  0.8.1                    pypi_0    pypi
pcre                      8.45                 h9c3ff4c_0    conda-forge
pexpect                   4.8.0              pyh9f0ad1d_2    conda-forge
pickleshare               0.7.5                    pypi_0    pypi
pillow                    8.3.1                    pypi_0    pypi
pip                       21.1.2             pyhd8ed1ab_0    conda-forge
pixman                    0.40.0               h36c2ea0_0    conda-forge
pkginfo                   1.7.0              pyhd8ed1ab_0    conda-forge
pluggy                    0.13.1                   pypi_0    pypi
poetry                    1.1.6            py39hf3d152e_0    conda-forge
poetry-core               1.0.3              pyhd8ed1ab_0    conda-forge
prompt-toolkit            3.0.19                   pypi_0    pypi
psutil                    5.8.0                    pypi_0    pypi
pthread-stubs             0.4               h36c2ea0_1001    conda-forge
ptyprocess                0.7.0              pyhd3deb0d_0    conda-forge
py                        1.10.0                   pypi_0    pypi
pycparser                 2.20               pyh9f0ad1d_2    conda-forge
pydantic                  1.8.2                    pypi_0    pypi
pygments                  2.9.0                    pypi_0    pypi
pygraphviz                1.7              py39h78163bd_0    conda-forge
pylev                     1.3.0                      py_0    conda-forge
pyopenssl                 20.0.1             pyhd8ed1ab_0    conda-forge
pyparsing                 2.4.7              pyh9f0ad1d_0    conda-forge
pyrsistent                0.14.11          py39h3811e60_2    conda-forge
pysocks                   1.7.1            py39hf3d152e_3    conda-forge
pytest                    6.2.4                    pypi_0    pypi
python                    3.9.4           hffdb5ce_0_cpython    conda-forge
python-dateutil           2.8.2                    pypi_0    pypi
python_abi                3.9                      1_cp39    conda-forge
pytz                      2021.1                   pypi_0    pypi
pyyaml                    5.4.1                    pypi_0    pypi
pyzmq                     22.1.0                   pypi_0    pypi
readline                  8.1                  h46c0cb4_0    conda-forge
regex                     2021.7.6                 pypi_0    pypi
requests                  2.25.1             pyhd3deb0d_0    conda-forge
requests-toolbelt         0.9.1                      py_0    conda-forge
s3fs                      2021.7.0                 pypi_0    pypi
scipy                     1.6.1                    pypi_0    pypi
secretstorage             3.3.1            py39hf3d152e_0    conda-forge
setuptools                49.6.0           py39hf3d152e_3    conda-forge
shellingham               1.4.0              pyh44b312d_0    conda-forge
six                       1.16.0             pyh6c4a22f_0    conda-forge
sortedcontainers          2.4.0                    pypi_0    pypi
sqlite                    3.35.5               h74cdb3f_0    conda-forge
tblib                     1.7.0                    pypi_0    pypi
tensorstore               0.1.12                   pypi_0    pypi
tinybrain                 1.2.1                    pypi_0    pypi
tk                        8.6.10               h21135ba_1    conda-forge
toml                      0.10.2                   pypi_0    pypi
tomlkit                   0.7.2            py39hf3d152e_0    conda-forge
toolz                     0.11.1                   pypi_0    pypi
tornado                   6.1                      pypi_0    pypi
traitlets                 5.0.5                    pypi_0    pypi
typed-ast                 1.4.3                    pypi_0    pypi
typing-extensions         3.10.0.0                 pypi_0    pypi
tzdata                    2021a                he74cb21_0    conda-forge
urllib3                   1.26.6                   pypi_0    pypi
virtualenv                20.4.7           py39hf3d152e_0    conda-forge
wcwidth                   0.2.5                    pypi_0    pypi
webencodings              0.5.1                      py_1    conda-forge
wheel                     0.36.2             pyhd3deb0d_0    conda-forge
wrapt                     1.12.1                   pypi_0    pypi
xarray                    0.18.2                   pypi_0    pypi
xarray-multiscale         0.2.2                    pypi_0    pypi
xorg-kbproto              1.0.7             h7f98852_1002    conda-forge
xorg-libice               1.0.10               h7f98852_0    conda-forge
xorg-libsm                1.2.3             hd9c2040_1000    conda-forge
xorg-libx11               1.7.2                h7f98852_0    conda-forge
xorg-libxau               1.0.9                h7f98852_0    conda-forge
xorg-libxdmcp             1.1.3                h7f98852_0    conda-forge
xorg-libxext              1.3.4                h7f98852_1    conda-forge
xorg-libxrender           0.9.10            h7f98852_1003    conda-forge
xorg-renderproto          0.11.1            h7f98852_1002    conda-forge
xorg-xextproto            7.3.0             h7f98852_1002    conda-forge
xorg-xproto               7.0.31            h7f98852_1007    conda-forge
xz                        5.2.5                h516909a_1    conda-forge
yarl                      1.6.3                    pypi_0    pypi
zarr                      2.6.2.dev125             pypi_0    pypi
zict                      2.0.0                    pypi_0    pypi
zlib                      1.2.11            h516909a_1010    conda-forge
zstd                      1.5.0                ha95c52a_0    conda-forge

@ncclementi
Copy link
Member

@d-v-b Do you still have this problem on 2021.07.2 I've just tried this snippet with 2021.07.2 and have no problems rendering.

from dask.distributed import Client, performance_report
import dask.array as da
client= Client()

with performance_report(filename="test.html"):
    x = da.random.random((10_000, 10_000), chunks=(1_000, 1_000))
    result = (x + x.T).mean(axis=0).mean()
    result.compute()

perf_report

@jrbourbeau
Copy link
Member

Just checking in here, @d-v-b is this still an issue? Are you able to reproduce with the latest bokeh + distributed releases?

@jrbourbeau jrbourbeau added the needs info Needs further information from the user label Oct 7, 2021
@d-v-b
Copy link
Member Author

d-v-b commented Oct 8, 2021

Yep, I think this is fixed! Closing.

@d-v-b d-v-b closed this as completed Oct 8, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
diagnostics needs info Needs further information from the user
Projects
None yet
Development

No branches or pull requests

5 participants