Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[BUG]: DFPRollingWindowStage emits only last batch #674

Closed
2 tasks done
efajardo-nv opened this issue Feb 7, 2023 · 0 comments · Fixed by #683
Closed
2 tasks done

[BUG]: DFPRollingWindowStage emits only last batch #674

efajardo-nv opened this issue Feb 7, 2023 · 0 comments · Fixed by #683
Assignees
@efajardo-nv
Labels
bug Something isn't working

Comments

@efajardo-nv
Copy link
Contributor

efajardo-nv commented Feb 7, 2023 •
edited
Loading

Version

23.01

Which installation method(s) does this occur on?

Docker

Describe the bug.

When setting min_history larger than incoming batch size, the expectation is that the stage will cache rows from incoming batches (for a user) until min_history is met. However, we are seeing that only rows from last batch are being emitted to next stage.

For example, the Azure training example reads in a total of 3239 rows. If we set min_history to 3000, the stage should emit at least 3000 rows for preprocessing/training. Instead, it emits only the 107 rows from the last batch.

Minimum reproducible example

Set min_history=3000 for DFPRollingWindowStage in dfp_azure_pipeline.py.

min_history=3000 if is_training else 1,

Follow instructions to run Azure training example.

Relevant log output

Rolling window complete for generic_user in 21.89 ms. Input: 107 rows from 2022-08-27 00:06:18.712616+00:00 to 2022-08-27 23:49:42.173263+00:00. Output: 107 rows from 2022-08-27 00:06:18.712616+00:00 to 2022-08-27 23:49:42.173263+00:00                                      
Preprocessed 107 data for logs in 2022-08-27 00:06:18.712616+00:00 to 2022-08-27 23:49:42.173263+00:00 in 484.33971405029297 ms
Training AE model for user: 'generic_user'...                       
Training AE model for user: 'generic_user'... Complete.
ML Flow model upload complete: generic_user:DFP-azure-generic_user:1
Input data rate[Complete]: 3239 messages [00:00, 4587.13 messages/s]
Training rate[Complete]: 107 messages [00:06, 17.24 messages/s]

Full env printout

Click here to see environment details
 **git***
 commit 778eba23d511b75bb2b3d01ce82eca34cb18b950 (HEAD -> branch-23.03, upstream/branch-23.03)
 Author: David Gardner <96306125+dagardner-nv@users.noreply.github.com>
 Date:   Mon Feb 6 14:47:46 2023 -0800
 
 Table locking & column preallocation (#586)
 
 * Builds on changes in #427
 * Adds a `PreallocatorMixin` which when added to a stage performs pre-allocation. This should be added to the first stage in a pipeline which emits a DataFrame or MessageMeta in a pipeline.
 * Morpheus' TypeId enum exposed to the Python API, allowing stages to define types for columns needing pre-allocation
 * `MutableTableInfo` exposed to Python via a context manager to be used in `with` blocks
 * `type_util` (`Dtype`) and `type_util_detail` (`DataType`) merged into a new compilation unit `dtype` fixes #490
 
 
 fixes #456
 
 Authors:
 - David Gardner (https://github.com/dagardner-nv)
 - Michael Demoret (https://github.com/mdemoret-nv)
 
 Approvers:
 - Michael Demoret (https://github.com/mdemoret-nv)
 
 URL: https://github.com/nv-morpheus/Morpheus/pull/586
 **git submodules***
 145069979b10c90f12116f1984a124b02be664e9 external/morpheus-visualizations (v23.01.00a-3-g1450699)
 6e1d4e62e8ad36a3ff45652f4d1aa03810de3751 external/utilities (v23.01.00~1^2)
 
 ***OS Information***
 DISTRIB_ID=Ubuntu
 DISTRIB_RELEASE=20.04
 DISTRIB_CODENAME=focal
 DISTRIB_DESCRIPTION="Ubuntu 20.04.5 LTS"
 NAME="Ubuntu"
 VERSION="20.04.5 LTS (Focal Fossa)"
 ID=ubuntu
 ID_LIKE=debian
 PRETTY_NAME="Ubuntu 20.04.5 LTS"
 VERSION_ID="20.04"
 HOME_URL="https://www.ubuntu.com/"
 SUPPORT_URL="https://help.ubuntu.com/"
 BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
 PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
 VERSION_CODENAME=focal
 UBUNTU_CODENAME=focal
 Linux EFAJARDO-DT 5.4.0-137-generic #154~18.04.1-Ubuntu SMP Tue Jan 10 16:58:20 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux
 
 ***GPU Information***
 Tue Feb  7 15:46:18 2023
 +-----------------------------------------------------------------------------+
 | NVIDIA-SMI 525.85.12    Driver Version: 525.85.12    CUDA Version: 12.0     |
 |-------------------------------+----------------------+----------------------+
 | GPU  Name        Persistence-M| Bus-Id        Disp.A | Volatile Uncorr. ECC |
 | Fan  Temp  Perf  Pwr:Usage/Cap|         Memory-Usage | GPU-Util  Compute M. |
 |                               |                      |               MIG M. |
 |===============================+======================+======================|
 |   0  Quadro RTX 8000     On   | 00000000:15:00.0 Off |                  Off |
 | 33%   35C    P8    24W / 260W |     10MiB / 49152MiB |      0%      Default |
 |                               |                      |                  N/A |
 +-------------------------------+----------------------+----------------------+
 
 +-----------------------------------------------------------------------------+
 | Processes:                                                                  |
 |  GPU   GI   CI        PID   Type   Process name                  GPU Memory |
 |        ID   ID                                                   Usage      |
 |=============================================================================|
 +-----------------------------------------------------------------------------+
 
 ***CPU***
 Architecture:                    x86_64
 CPU op-mode(s):                  32-bit, 64-bit
 Byte Order:                      Little Endian
 Address sizes:                   46 bits physical, 48 bits virtual
 CPU(s):                          12
 On-line CPU(s) list:             0-11
 Thread(s) per core:              2
 Core(s) per socket:              6
 Socket(s):                       1
 NUMA node(s):                    1
 Vendor ID:                       GenuineIntel
 CPU family:                      6
 Model:                           85
 Model name:                      Intel(R) Xeon(R) Gold 6128 CPU @ 3.40GHz
 Stepping:                        4
 CPU MHz:                         1200.211
 CPU max MHz:                     3700.0000
 CPU min MHz:                     1200.0000
 BogoMIPS:                        6800.00
 Virtualization:                  VT-x
 L1d cache:                       192 KiB
 L1i cache:                       192 KiB
 L2 cache:                        6 MiB
 L3 cache:                        19.3 MiB
 NUMA node0 CPU(s):               0-11
 Vulnerability Itlb multihit:     KVM: Vulnerable
 Vulnerability L1tf:              Mitigation; PTE Inversion
 Vulnerability Mds:               Mitigation; Clear CPU buffers; SMT vulnerable
 Vulnerability Meltdown:          Mitigation; PTI
 Vulnerability Mmio stale data:   Mitigation; Clear CPU buffers; SMT vulnerable
 Vulnerability Retbleed:          Mitigation; IBRS
 Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl and seccomp
 Vulnerability Spectre v1:        Mitigation; usercopy/swapgs barriers and __user pointer sanitization
 Vulnerability Spectre v2:        Mitigation; IBRS, IBPB conditional, RSB filling, PBRSB-eIBRS Not affected
 Vulnerability Srbds:             Not affected
 Vulnerability Tsx async abort:   Mitigation; Clear CPU buffers; SMT vulnerable
 Flags:                           fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc art arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 invpcid_single pti intel_ppin ssbd mba ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm mpx rdt_a avx512f avx512dq rdseed adx smap clflushopt clwb intel_pt avx512cd avx512bw avx512vl xsaveopt xsavec xgetbv1 xsaves cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts hwp hwp_act_window hwp_epp hwp_pkg_req pku ospke md_clear flush_l1d arch_capabilities
 
 ***CMake***
 /opt/conda/envs/morpheus/bin/cmake
 cmake version 3.24.3
 
 CMake suite maintained and supported by Kitware (kitware.com/cmake).
 
 ***g++***
 /usr/bin/g++
 g++ (Ubuntu 9.4.0-1ubuntu1~20.04.1) 9.4.0
 Copyright (C) 2019 Free Software Foundation, Inc.
 This is free software; see the source for copying conditions.  There is NO
 warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.
 
 
 ***nvcc***
 /opt/conda/envs/morpheus/bin/nvcc
 nvcc: NVIDIA (R) Cuda compiler driver
 Copyright (c) 2005-2021 NVIDIA Corporation
 Built on Thu_Nov_18_09:45:30_PST_2021
 Cuda compilation tools, release 11.5, V11.5.119
 Build cuda_11.5.r11.5/compiler.30672275_0
 
 ***Python***
 /opt/conda/envs/morpheus/bin/python
 Python 3.8.15
 
 ***Environment Variables***
 PATH                            : /root/.vscode-server/bin/5235c6bb189b60b01b1f49062f4ffa42384f8c91/bin/remote-cli:/opt/conda/envs/morpheus/bin:/opt/conda/condabin:/opt/conda/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
 LD_LIBRARY_PATH                 : /usr/local/nvidia/lib:/usr/local/nvidia/lib64
 NUMBAPRO_NVVM                   :
 NUMBAPRO_LIBDEVICE              :
 CONDA_PREFIX                    : /opt/conda/envs/morpheus
 PYTHON_PATH                     :
 
 ***conda packages***
 /opt/conda/condabin/conda
 # packages in environment at /opt/conda/envs/morpheus:
 #
 # Name                    Version                   Build  Channel
 _libgcc_mutex             0.1                 conda_forge    conda-forge
 _openmp_mutex             4.5                       2_gnu    conda-forge
 _sysroot_linux-64_curr_repodata_hack 3                   h5bd9786_13    conda-forge
 aiobotocore               2.4.2                    pypi_0    pypi
 aiohttp                   3.8.3                    pypi_0    pypi
 aioitertools              0.11.0                   pypi_0    pypi
 aiosignal                 1.3.1                    pypi_0    pypi
 alabaster                 0.7.13             pyhd8ed1ab_0    conda-forge
 alembic                   1.9.1              pyhd8ed1ab_0    conda-forge
 anyio                     3.6.2                    pypi_0    pypi
 appdirs                   1.4.4              pyh9f0ad1d_0    conda-forge
 argon2-cffi               21.3.0                   pypi_0    pypi
 argon2-cffi-bindings      21.2.0                   pypi_0    pypi
 arrow                     1.2.3                    pypi_0    pypi
 arrow-cpp                 9.0.0           py38ha31b012_2_cuda    conda-forge
 asn1crypto                1.5.1              pyhd8ed1ab_0    conda-forge
 asttokens                 2.2.1                    pypi_0    pypi
 async-timeout             4.0.2                    pypi_0    pypi
 atk-1.0                   2.38.0               hd4edc92_1    conda-forge
 attrs                     22.2.0             pyh71513ae_0    conda-forge
 autoconf                  2.69            pl5321hd708f79_11    conda-forge
 automake                  1.16.5          pl5321ha770c72_0    conda-forge
 aws-c-cal                 0.5.11               h95a6274_0    conda-forge
 aws-c-common              0.6.2                h7f98852_0    conda-forge
 aws-c-event-stream        0.2.7               h3541f99_13    conda-forge
 aws-c-io                  0.10.5               hfb6a706_0    conda-forge
 aws-checksums             0.1.11               ha31a3da_7    conda-forge
 aws-sdk-cpp               1.8.186              hecaee15_4    conda-forge
 babel                     2.11.0             pyhd8ed1ab_0    conda-forge
 backcall                  0.2.0                    pypi_0    pypi
 beautifulsoup4            4.11.2                   pypi_0    pypi
 benchmark                 1.6.1                h9c3ff4c_0    conda-forge
 binutils_impl_linux-64    2.36.1               h193b22a_2    conda-forge
 binutils_linux-64         2.36                hf3e587d_10    conda-forge
 bleach                    6.0.0                    pypi_0    pypi
 blinker                   1.5                pyhd8ed1ab_0    conda-forge
 boost-cpp                 1.74.0               h6cacc03_7    conda-forge
 botocore                  1.27.59                  pypi_0    pypi
 brotli                    1.0.9                    pypi_0    pypi
 brotlipy                  0.7.0           py38h0a891b7_1005    conda-forge
 bzip2                     1.0.8                h7f98852_4    conda-forge
 c-ares                    1.18.1               h7f98852_0    conda-forge
 ca-certificates           2022.12.7            ha878542_0    conda-forge
 cachetools                5.0.0              pyhd8ed1ab_0    conda-forge
 cairo                     1.16.0            ha12eb4b_1010    conda-forge
 ccache                    4.7.3                h2599c5e_0    conda-forge
 certifi                   2022.12.7          pyhd8ed1ab_0    conda-forge
 cffi                      1.15.1           py38h4a40e3a_3    conda-forge
 charset-normalizer        2.1.1              pyhd8ed1ab_0    conda-forge
 clang                     14.0.6               ha770c72_0    conda-forge
 clang-14                  14.0.6          default_h2e3cab8_0    conda-forge
 clang-format              14.0.6          default_h2e3cab8_0    conda-forge
 clang-format-14           14.0.6          default_h2e3cab8_0    conda-forge
 clang-tools               14.0.6          default_h2e3cab8_0    conda-forge
 clangdev                  14.0.6          default_h2e3cab8_0    conda-forge
 clangxx                   14.0.6          default_ha074a59_0    conda-forge
 click                     8.1.3           unix_pyhd8ed1ab_2    conda-forge
 cloudpickle               2.2.1              pyhd8ed1ab_0    conda-forge
 cmake                     3.24.3               h816a3e0_0    conda-forge
 colorama                  0.4.6              pyhd8ed1ab_0    conda-forge
 comm                      0.1.2                    pypi_0    pypi
 configargparse            1.5.3              pyhd8ed1ab_0    conda-forge
 configparser              5.3.0              pyhd8ed1ab_0    conda-forge
 contourpy                 1.0.7                    pypi_0    pypi
 coverage                  7.1.0            py38h1de0b5d_0    conda-forge
 cryptography              39.0.0           py38h1724139_0    conda-forge
 cubinlinker               0.2.2            py38h7144610_0    rapidsai
 cuda-nvml-dev             11.5.50              h511b398_0    nvidia/label/cuda-11.5.2
 cuda-python               11.7.0           py38h3fd9d12_0    nvidia
 cudatoolkit               11.5.1               hcf5317a_9    nvidia
 cudf                      22.10.00        cuda_11_py38_g8ffe375d85_0    rapidsai
 cupy                      9.5.0            py38h7818112_1    conda-forge
 curl                      7.87.0               h6312ad2_0    conda-forge
 cycler                    0.11.0                   pypi_0    pypi
 cyrus-sasl                2.1.27               h957375c_6    conda-forge
 cython                    0.29.24          py38h709712a_1    conda-forge
 cytoolz                   0.12.0           py38h0a891b7_1    conda-forge
 dask-core                 2023.1.1           pyhd8ed1ab_0    conda-forge
 databricks-cli            0.17.4             pyhd8ed1ab_0    conda-forge
 datacompy                 0.8.4              pyhd8ed1ab_0    conda-forge
 debugpy                   1.6.6                    pypi_0    pypi
 decorator                 5.1.1                    pypi_0    pypi
 defusedxml                0.7.1                    pypi_0    pypi
 dfencoder                 0.0.37                   pypi_0    pypi
 dill                      0.3.6                    pypi_0    pypi
 distributed               2023.1.1           pyhd8ed1ab_0    conda-forge
 distro                    1.8.0              pyhd8ed1ab_0    conda-forge
 dlpack                    0.5                  h9c3ff4c_0    conda-forge
 docker-compose            1.29.2           py38h578d9bd_2    conda-forge
 docker-py                 5.0.3            py38h578d9bd_2    conda-forge
 docker-pycreds            0.4.0                      py_0    conda-forge
 dockerpty                 0.4.1                      py_0    conda-forge
 docopt                    0.6.2                      py_1    conda-forge
 docutils                  0.19                     pypi_0    pypi
 entrypoints               0.4                pyhd8ed1ab_0    conda-forge
 exceptiongroup            1.1.0              pyhd8ed1ab_0    conda-forge
 executing                 1.2.0                    pypi_0    pypi
 expat                     2.5.0                h27087fc_0    conda-forge
 faker                     12.3.0             pyhd8ed1ab_0    conda-forge
 fastavro                  1.7.1            py38h1de0b5d_0    conda-forge
 fastjsonschema            2.16.2                   pypi_0    pypi
 fastrlock                 0.8              py38hfa26641_3    conda-forge
 flake8                    6.0.0              pyhd8ed1ab_0    conda-forge
 flask                     2.2.2              pyhd8ed1ab_0    conda-forge
 flatbuffers               2.0.8                hcb278e6_1    conda-forge
 font-ttf-dejavu-sans-mono 2.37                 hab24e00_0    conda-forge
 font-ttf-inconsolata      3.000                h77eed37_0    conda-forge
 font-ttf-source-code-pro  2.038                h77eed37_0    conda-forge
 font-ttf-ubuntu           0.83                 hab24e00_0    conda-forge
 fontconfig                2.14.2               h14ed4e7_0    conda-forge
 fonts-conda-ecosystem     1                             0    conda-forge
 fonts-conda-forge         1                             0    conda-forge
 fonttools                 4.38.0                   pypi_0    pypi
 fqdn                      1.5.1                    pypi_0    pypi
 freetype                  2.12.1               hca18f0e_1    conda-forge
 fribidi                   1.0.10               h36c2ea0_0    conda-forge
 frozenlist                1.3.3                    pypi_0    pypi
 fsspec                    2023.1.0           pyhd8ed1ab_0    conda-forge
 gcc_impl_linux-64         11.2.0              h82a94d6_16    conda-forge
 gcc_linux-64              11.2.0              h39a9532_10    conda-forge
 gdk-pixbuf                2.42.8               hff1cb4f_1    conda-forge
 gettext                   0.21.1               h27087fc_0    conda-forge
 gevent                    22.10.2                  pypi_0    pypi
 geventhttpclient          2.0.8                    pypi_0    pypi
 gflags                    2.2.2             he1b5a44_1004    conda-forge
 giflib                    5.2.1                h36c2ea0_2    conda-forge
 git                       2.39.1          pl5321ha3eba64_0    conda-forge
 git-lfs                   3.2.0                ha770c72_0    conda-forge
 gitdb                     4.0.10             pyhd8ed1ab_0    conda-forge
 gitpython                 3.1.30             pyhd8ed1ab_0    conda-forge
 glog                      0.6.0                h6f12383_0    conda-forge
 gmock                     1.10.0               h4bd325d_7    conda-forge
 gputil                    1.4.0              pyh9f0ad1d_0    conda-forge
 graphite2                 1.3.13            h58526e2_1001    conda-forge
 graphviz                  4.0.0                h5abf519_0    conda-forge
 greenlet                  2.0.2            py38h8dc9893_0    conda-forge
 grpc-cpp                  1.46.4               hbad87ad_7    conda-forge
 grpcio                    1.46.4           py38h5b6373e_7    conda-forge
 gtest                     1.10.0               h4bd325d_7    conda-forge
 gtk2                      2.24.33              h90689f9_2    conda-forge
 gts                       0.7.6                h64030ff_2    conda-forge
 gunicorn                  20.1.0           py38h578d9bd_3    conda-forge
 gxx_impl_linux-64         11.2.0              h82a94d6_16    conda-forge
 gxx_linux-64              11.2.0              hacbe6df_10    conda-forge
 harfbuzz                  4.2.0                h40b6f09_0    conda-forge
 heapdict                  1.0.1                      py_0    conda-forge
 icu                       69.1                 h9c3ff4c_0    conda-forge
 idna                      3.4                pyhd8ed1ab_0    conda-forge
 imagesize                 1.4.1              pyhd8ed1ab_0    conda-forge
 importlib-metadata        5.2.0              pyha770c72_0    conda-forge
 importlib_resources       5.10.2             pyhd8ed1ab_0    conda-forge
 include-what-you-use      0.18                 h27087fc_0    conda-forge
 iniconfig                 2.0.0              pyhd8ed1ab_0    conda-forge
 ipykernel                 6.20.2                   pypi_0    pypi
 ipython                   8.9.0                    pypi_0    pypi
 ipython-genutils          0.2.0                    pypi_0    pypi
 ipywidgets                8.0.4                    pypi_0    pypi
 isoduration               20.11.0                  pypi_0    pypi
 isort                     5.12.0             pyhd8ed1ab_1    conda-forge
 itsdangerous              2.1.2              pyhd8ed1ab_0    conda-forge
 jedi                      0.18.2                   pypi_0    pypi
 jinja2                    3.1.2              pyhd8ed1ab_1    conda-forge
 jmespath                  1.0.1                    pypi_0    pypi
 joblib                    1.2.0                    pypi_0    pypi
 jpeg                      9e                   h166bdaf_2    conda-forge
 json5                     0.9.11                   pypi_0    pypi
 jsonpointer               2.3                      pypi_0    pypi
 jsonschema                4.17.3                   pypi_0    pypi
 jupyter-client            8.0.2                    pypi_0    pypi
 jupyter-core              4.12.0                   pypi_0    pypi
 jupyter-events            0.6.3                    pypi_0    pypi
 jupyter-server            2.1.0                    pypi_0    pypi
 jupyter-server-terminals  0.4.4                    pypi_0    pypi
 jupyterlab                3.5.3                    pypi_0    pypi
 jupyterlab-pygments       0.2.2                    pypi_0    pypi
 jupyterlab-server         2.19.0                   pypi_0    pypi
 jupyterlab-widgets        3.0.5                    pypi_0    pypi
 kernel-headers_linux-64   3.10.0              h4a8ded7_13    conda-forge
 keyutils                  1.6.1                h166bdaf_0    conda-forge
 kiwisolver                1.4.4                    pypi_0    pypi
 krb5                      1.20.1               hf9c8cef_0    conda-forge
 ld_impl_linux-64          2.36.1               hea4e1c9_2    conda-forge
 lerc                      4.0.0                h27087fc_0    conda-forge
 libabseil                 20220623.0      cxx17_h05df665_6    conda-forge
 libblas                   3.9.0           16_linux64_openblas    conda-forge
 libbrotlicommon           1.0.9                h166bdaf_8    conda-forge
 libbrotlidec              1.0.9                h166bdaf_8    conda-forge
 libbrotlienc              1.0.9                h166bdaf_8    conda-forge
 libcblas                  3.9.0           16_linux64_openblas    conda-forge
 libclang                  14.0.6          default_h2e3cab8_0    conda-forge
 libclang-cpp              14.0.6          default_h2e3cab8_0    conda-forge
 libclang-cpp14            14.0.6          default_h2e3cab8_0    conda-forge
 libclang13                14.0.6          default_h3a83d3e_0    conda-forge
 libcrc32c                 1.1.2                h9c3ff4c_0    conda-forge
 libcudf                   22.10.00        cuda11_g8ffe375d85_0    rapidsai
 libcurl                   7.87.0               h6312ad2_0    conda-forge
 libdeflate                1.14                 h166bdaf_0    conda-forge
 libedit                   3.1.20191231         he28a2e2_2    conda-forge
 libev                     4.33                 h516909a_1    conda-forge
 libevent                  2.1.10               h9b69904_4    conda-forge
 libffi                    3.4.2                h7f98852_5    conda-forge
 libgcc-devel_linux-64     11.2.0              h0952999_16    conda-forge
 libgcc-ng                 12.2.0              h65d4601_19    conda-forge
 libgcrypt                 1.10.1               h166bdaf_0    conda-forge
 libgd                     2.3.3                h283352f_2    conda-forge
 libgfortran-ng            12.2.0              h69a702a_19    conda-forge
 libgfortran5              12.2.0              h337968e_19    conda-forge
 libglib                   2.74.1               h606061b_1    conda-forge
 libgomp                   12.2.0              h65d4601_19    conda-forge
 libgoogle-cloud           2.1.0                hf2e47f9_1    conda-forge
 libgpg-error              1.46                 h620e276_0    conda-forge
 libgsasl                  1.8.0                         2    conda-forge
 libhiredis                1.0.2                h2cc385e_0    conda-forge
 libhwloc                  2.5.0                h6746aa3_0    conda-forge
 libiconv                  1.17                 h166bdaf_0    conda-forge
 liblapack                 3.9.0           16_linux64_openblas    conda-forge
 libllvm11                 11.1.0               he0ac6c6_5    conda-forge
 libllvm14                 14.0.6               he0ac6c6_1    conda-forge
 libmrc                    23.01.00        cuda_11.4_hdd10789_0    nvidia
 libnghttp2                1.51.0               hdcd2b5c_0    conda-forge
 libnsl                    2.0.0                h7f98852_0    conda-forge
 libntlm                   1.4               h7f98852_1002    conda-forge
 libopenblas               0.3.21          pthreads_h78a6416_3    conda-forge
 libpng                    1.6.39               h753d276_0    conda-forge
 libprotobuf               3.20.2               h6239696_0    conda-forge
 librdkafka                1.7.0                hc49e61c_1    conda-forge
 librmm                    22.10.01        cuda11_gd98b8719_0    rapidsai
 librsvg                   2.54.4               h7abd40a_0    conda-forge
 libsanitizer              11.2.0              he4da1e4_16    conda-forge
 libsqlite                 3.40.0               h753d276_0    conda-forge
 libssh2                   1.10.0               haa6b8db_3    conda-forge
 libstdcxx-devel_linux-64  11.2.0              h0952999_16    conda-forge
 libstdcxx-ng              12.2.0              h46fd767_19    conda-forge
 libthrift                 0.16.0               h491838f_2    conda-forge
 libtiff                   4.4.0                h82bc61c_5    conda-forge
 libtool                   2.4.7                h27087fc_0    conda-forge
 libutf8proc               2.8.0                h166bdaf_0    conda-forge
 libuuid                   2.32.1            h7f98852_1000    conda-forge
 libuv                     1.43.0               h7f98852_0    conda-forge
 libwebp                   1.2.4                h522a892_0    conda-forge
 libwebp-base              1.2.4                h166bdaf_0    conda-forge
 libxcb                    1.13              h7f98852_1004    conda-forge
 libxml2                   2.9.14               haae042b_4    conda-forge
 libzlib                   1.2.13               h166bdaf_4    conda-forge
 llvm-tools                14.0.6               he0ac6c6_1    conda-forge
 llvmdev                   14.0.6               he0ac6c6_1    conda-forge
 llvmlite                  0.39.1           py38h38d86a4_1    conda-forge
 locket                    1.0.0              pyhd8ed1ab_0    conda-forge
 lz4-c                     1.9.3                h9c3ff4c_1    conda-forge
 m4                        1.4.18            h516909a_1001    conda-forge
 mako                      1.2.4              pyhd8ed1ab_0    conda-forge
 markdown-it-py            2.1.0              pyhd8ed1ab_0    conda-forge
 markupsafe                2.1.2            py38h1de0b5d_0    conda-forge
 matplotlib                3.6.3                    pypi_0    pypi
 matplotlib-inline         0.1.6                    pypi_0    pypi
 mccabe                    0.7.0              pyhd8ed1ab_0    conda-forge
 mdit-py-plugins           0.3.3              pyhd8ed1ab_0    conda-forge
 mdurl                     0.1.0              pyhd8ed1ab_0    conda-forge
 mistune                   2.0.4                    pypi_0    pypi
 mlflow                    1.30.0           py38he918c71_0    conda-forge
 morpheus                  23.3.0a0+10.g778eba23.dirty          pypi_0    pypi
 mrc                       23.01.00        cuda_11.4_py38_h0593196_0    nvidia
 msgpack-python            1.0.4            py38h43d8883_1    conda-forge
 multidict                 6.0.4                    pypi_0    pypi
 myst-parser               0.17.0             pyhd8ed1ab_0    conda-forge
 nbclassic                 0.5.1                    pypi_0    pypi
 nbclient                  0.7.2                    pypi_0    pypi
 nbconvert                 7.2.9                    pypi_0    pypi
 nbformat                  5.7.3                    pypi_0    pypi
 ncurses                   6.3                  h27087fc_1    conda-forge
 nest-asyncio              1.5.6                    pypi_0    pypi
 networkx                  2.8.8              pyhd8ed1ab_0    conda-forge
 ninja                     1.10.2               h4bd325d_1    conda-forge
 nlohmann_json             3.9.1                h9c3ff4c_1    conda-forge
 nodejs                    17.4.0               h8ca31f7_0    conda-forge
 notebook                  6.5.2                    pypi_0    pypi
 notebook-shim             0.2.2                    pypi_0    pypi
 numba                     0.56.4           py38h9a4aae9_0    conda-forge
 numpy                     1.23.5           py38h7042d01_0    conda-forge
 numpydoc                  1.4.0              pyhd8ed1ab_1    conda-forge
 nvcc_linux-64             11.5                h44f499b_22    conda-forge
 nvidia-pyindex            1.0.9                    pypi_0    pypi
 nvtx                      0.2.3            py38h0a891b7_2    conda-forge
 oauthlib                  3.2.2              pyhd8ed1ab_0    conda-forge
 openssl                   1.1.1s               h0b41bf4_1    conda-forge
 orc                       1.7.6                h6c59b99_0    conda-forge
 ordered-set               4.1.0              pyhd8ed1ab_0    conda-forge
 packaging                 21.3               pyhd8ed1ab_0    conda-forge
 pandas                    1.3.5            py38h43a58ef_0    conda-forge
 pandocfilters             1.5.0                    pypi_0    pypi
 pango                     1.50.7               hbd2fdc8_0    conda-forge
 parquet-cpp               1.5.1                         2    conda-forge
 parso                     0.8.3                    pypi_0    pypi
 partd                     1.3.0              pyhd8ed1ab_0    conda-forge
 pcre2                     10.40                hc3806b6_0    conda-forge
 perl                      5.32.1          2_h7f98852_perl5    conda-forge
 pexpect                   4.8.0                    pypi_0    pypi
 pickleshare               0.7.5                    pypi_0    pypi
 pillow                    9.4.0                    pypi_0    pypi
 pip                       23.0               pyhd8ed1ab_0    conda-forge
 pixman                    0.40.0               h36c2ea0_0    conda-forge
 pkg-config                0.29.2            h36c2ea0_1008    conda-forge
 pkgutil-resolve-name      1.3.10                   pypi_0    pypi
 pluggy                    1.0.0              pyhd8ed1ab_5    conda-forge
 pooch                     1.6.0              pyhd8ed1ab_0    conda-forge
 prometheus_client         0.16.0             pyhd8ed1ab_0    conda-forge
 prometheus_flask_exporter 0.21.0             pyhd8ed1ab_0    conda-forge
 prompt-toolkit            3.0.36                   pypi_0    pypi
 protobuf                  3.20.2           py38hfa26641_1    conda-forge
 psutil                    5.9.4            py38h0a891b7_0    conda-forge
 pthread-stubs             0.4               h36c2ea0_1001    conda-forge
 ptxcompiler               0.7.0            py38h241159d_3    conda-forge
 ptyprocess                0.7.0                    pypi_0    pypi
 pure-eval                 0.2.2                    pypi_0    pypi
 py-cpuinfo                9.0.0              pyhd8ed1ab_0    conda-forge
 pyarrow                   9.0.0           py38hb328d0c_2_cuda    conda-forge
 pybind11-stubgen          0.10.5             pyhd8ed1ab_0    conda-forge
 pycodestyle               2.10.0             pyhd8ed1ab_0    conda-forge
 pycparser                 2.21               pyhd8ed1ab_0    conda-forge
 pydot                     1.4.2            py38h578d9bd_3    conda-forge
 pyflakes                  3.0.1              pyhd8ed1ab_0    conda-forge
 pygments                  2.14.0             pyhd8ed1ab_0    conda-forge
 pyjwt                     2.6.0              pyhd8ed1ab_0    conda-forge
 pyopenssl                 23.0.0             pyhd8ed1ab_0    conda-forge
 pyparsing                 3.0.9              pyhd8ed1ab_0    conda-forge
 pyrsistent                0.19.3           py38h1de0b5d_0    conda-forge
 pysocks                   1.7.1              pyha2e5f31_6    conda-forge
 pytest                    7.2.1              pyhd8ed1ab_0    conda-forge
 pytest-benchmark          4.0.0              pyhd8ed1ab_0    conda-forge
 pytest-cov                4.0.0              pyhd8ed1ab_0    conda-forge
 python                    3.8.15          h257c98d_0_cpython    conda-forge
 python-confluent-kafka    1.7.0            py38h497a2fe_2    conda-forge
 python-dateutil           2.8.2              pyhd8ed1ab_0    conda-forge
 python-dotenv             0.21.1             pyhd8ed1ab_0    conda-forge
 python-graphviz           0.20.1             pyh22cad53_0    conda-forge
 python-json-logger        2.0.4                    pypi_0    pypi
 python-rapidjson          1.9                      pypi_0    pypi
 python_abi                3.8                      3_cp38    conda-forge
 pytz                      2022.7.1           pyhd8ed1ab_0    conda-forge
 pyyaml                    5.4.1            py38h0a891b7_4    conda-forge
 pyzmq                     25.0.0                   pypi_0    pypi
 querystring_parser        1.2.4                      py_0    conda-forge
 rapidjson                 1.1.0             he1b5a44_1002    conda-forge
 re2                       2022.06.01           h27087fc_1    conda-forge
 readline                  8.1.2                h0f457ee_0    conda-forge
 requests                  2.28.2             pyhd8ed1ab_0    conda-forge
 rfc3339-validator         0.1.4                    pypi_0    pypi
 rfc3986-validator         0.1.1                    pypi_0    pypi
 rhash                     1.4.3                h166bdaf_0    conda-forge
 rmm                       22.10.00        cuda11_py38_g9d5a8c37_0    rapidsai
 s2n                       1.0.10               h9b69904_0    conda-forge
 s3fs                      2023.1.0                 pypi_0    pypi
 scikit-build              0.13.1             pyhca92ed8_0    conda-forge
 scikit-learn              0.23.1                   pypi_0    pypi
 scipy                     1.10.0           py38h10c12cc_0    conda-forge
 sed                       4.8                  he412f7d_0    conda-forge
 send2trash                1.8.0                    pypi_0    pypi
 setuptools                59.8.0           py38h578d9bd_1    conda-forge
 six                       1.16.0             pyh6c4a22f_0    conda-forge
 smmap                     3.0.5              pyh44b312d_0    conda-forge
 snappy                    1.1.9                hbd366e4_2    conda-forge
 sniffio                   1.3.0                    pypi_0    pypi
 snowballstemmer           2.2.0              pyhd8ed1ab_0    conda-forge
 sortedcontainers          2.4.0              pyhd8ed1ab_0    conda-forge
 soupsieve                 2.3.2.post1              pypi_0    pypi
 spdlog                    1.8.5                h4bd325d_1    conda-forge
 sphinx                    4.5.0              pyh6c4a22f_0    conda-forge
 sphinx_rtd_theme          1.1.1              pyha770c72_1    conda-forge
 sphinxcontrib-applehelp   1.0.4              pyhd8ed1ab_0    conda-forge
 sphinxcontrib-devhelp     1.0.2                      py_0    conda-forge
 sphinxcontrib-htmlhelp    2.0.0              pyhd8ed1ab_0    conda-forge
 sphinxcontrib-jsmath      1.0.1                      py_0    conda-forge
 sphinxcontrib-qthelp      1.0.3                      py_0    conda-forge
 sphinxcontrib-serializinghtml 1.1.5              pyhd8ed1ab_2    conda-forge
 sqlalchemy                1.4.46           py38h1de0b5d_0    conda-forge
 sqlparse                  0.4.3              pyhd8ed1ab_0    conda-forge
 stack-data                0.6.2                    pypi_0    pypi
 sysroot_linux-64          2.17                h4a8ded7_13    conda-forge
 tabulate                  0.9.0              pyhd8ed1ab_1    conda-forge
 tblib                     1.7.0              pyhd8ed1ab_0    conda-forge
 tensorboardx              2.5                      pypi_0    pypi
 terminado                 0.17.1                   pypi_0    pypi
 texttable                 1.6.7              pyhd8ed1ab_0    conda-forge
 threadpoolctl             3.1.0                    pypi_0    pypi
 tinycss2                  1.2.1                    pypi_0    pypi
 tk                        8.6.12               h27826a3_0    conda-forge
 toml                      0.10.2             pyhd8ed1ab_0    conda-forge
 tomli                     2.0.1              pyhd8ed1ab_0    conda-forge
 toolz                     0.12.0             pyhd8ed1ab_0    conda-forge
 torch                     1.13.1+cu116             pypi_0    pypi
 tornado                   6.2              py38h0a891b7_1    conda-forge
 tqdm                      4.64.1             pyhd8ed1ab_0    conda-forge
 traitlets                 5.9.0                    pypi_0    pypi
 tritonclient              2.17.0                   pypi_0    pypi
 typing-extensions         4.4.0                hd8ed1ab_0    conda-forge
 typing_extensions         4.4.0              pyha770c72_0    conda-forge
 typing_utils              0.1.0              pyhd8ed1ab_0    conda-forge
 ucx                       1.13.1               h538f049_1    conda-forge
 uri-template              1.2.0                    pypi_0    pypi
 urllib3                   1.26.14            pyhd8ed1ab_0    conda-forge
 watchdog                  2.1.9            py38h578d9bd_1    conda-forge
 wcwidth                   0.2.6                    pypi_0    pypi
 webcolors                 1.12                     pypi_0    pypi
 webencodings              0.5.1                    pypi_0    pypi
 websocket-client          0.57.0           py38h578d9bd_6    conda-forge
 websockets                10.4                     pypi_0    pypi
 werkzeug                  2.2.2              pyhd8ed1ab_0    conda-forge
 wheel                     0.38.4             pyhd8ed1ab_0    conda-forge
 widgetsnbextension        4.0.5                    pypi_0    pypi
 wrapt                     1.14.1                   pypi_0    pypi
 xorg-kbproto              1.0.7             h7f98852_1002    conda-forge
 xorg-libice               1.0.10               h7f98852_0    conda-forge
 xorg-libsm                1.2.3             hd9c2040_1000    conda-forge
 xorg-libx11               1.7.2                h7f98852_0    conda-forge
 xorg-libxau               1.0.9                h7f98852_0    conda-forge
 xorg-libxdmcp             1.1.3                h7f98852_0    conda-forge
 xorg-libxext              1.3.4                h7f98852_1    conda-forge
 xorg-libxrender           0.9.10            h7f98852_1003    conda-forge
 xorg-renderproto          0.11.1            h7f98852_1002    conda-forge
 xorg-xextproto            7.3.0             h7f98852_1002    conda-forge
 xorg-xproto               7.0.31            h7f98852_1007    conda-forge
 xz                        5.2.6                h166bdaf_0    conda-forge
 yaml                      0.2.5                h7f98852_2    conda-forge
 yapf                      0.32.0             pyhd8ed1ab_0    conda-forge
 yarl                      1.8.2                    pypi_0    pypi
 zict                      2.2.0              pyhd8ed1ab_0    conda-forge
 zipp                      3.12.0             pyhd8ed1ab_0    conda-forge
 zlib                      1.2.13               h166bdaf_4    conda-forge
 zope-event                4.6                      pypi_0    pypi
 zope-interface            5.5.2                    pypi_0    pypi
 zstd                      1.5.2                h3eb15da_6    conda-forge

Code of Conduct

  • I agree to follow Morpheus' Code of Conduct
  • I have searched the open bugs and have found no duplicates for this bug report
@efajardo-nv efajardo-nv added the bug Something isn't working label Feb 7, 2023
@efajardo-nv efajardo-nv self-assigned this Feb 7, 2023
@efajardo-nv efajardo-nv mentioned this issue Feb 9, 2023
Merged
@mdemoret-nv mdemoret-nv mentioned this issue Feb 9, 2023
Closed
2 tasks
@ghost ghost closed this as completed in #683 Feb 9, 2023
ghost pushed a commit that referenced this issue Feb 9, 2023
@efajardo-nv
Update DFPRollingWindowStage to emit correct window (#683)
b46bf72 
DFPRollingWindowStage was only emitting last batch once `min_history` was met. This PR updates the stage to emit all accumulated rows meeting configured window history requirements.

Fixes #674

Authors:
  - Eli Fajardo (https://github.com/efajardo-nv)

Approvers:
  - Michael Demoret (https://github.com/mdemoret-nv)

URL: #683
jjacobelli pushed a commit to jjacobelli/Morpheus that referenced this issue Mar 7, 2023
@efajardo-nv @jjacobelli
Update DFPRollingWindowStage to emit correct window (nv-morpheus#683)
fe57121 
DFPRollingWindowStage was only emitting last batch once `min_history` was met. This PR updates the stage to emit all accumulated rows meeting configured window history requirements.

Fixes nv-morpheus#674

Authors:
  - Eli Fajardo (https://github.com/efajardo-nv)

Approvers:
  - Michael Demoret (https://github.com/mdemoret-nv)

URL: nv-morpheus#683
This issue was closed.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@efajardo-nv efajardo-nv

Labels
bug Something isn't working
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Update DFPRollingWindowStage to emit correct window efajardo-nv/Morpheus
1 participant
@efajardo-nv