Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Test][Possible flaky test] QEMU timeout on zephyr test_relay #8842

Closed
mehrdadh opened this issue Aug 25, 2021 · 3 comments
Closed

[Test][Possible flaky test] QEMU timeout on zephyr test_relay #8842

mehrdadh opened this issue Aug 25, 2021 · 3 comments
Labels
needs-triage PRs or issues that need to be investigated by maintainers to find the right assignees to address it

Comments

@mehrdadh
Copy link
Member

https://ci.tlcpack.ai/blue/organizations/jenkins/tvm/detail/PR-8822/4/pipeline/#step-203-log-1971

=================================== FAILURES ===================================
____________________________ test_relay[mps2_an521] ____________________________
temp_dir = <tvm.contrib.utils.TempDirectory object at 0x7f67f6c28518>
platform = 'mps2_an521', west_cmd = 'west', tvm_debug = False
    @tvm.testing.requires_micro

    def test_relay(temp_dir, platform, west_cmd, tvm_debug):

        """Testing a simple relay graph"""
        model, zephyr_board = PLATFORMS[platform]
        build_config = {"debug": tvm_debug}
        shape = (10,)
        dtype = "int8"
        # Construct Relay program.
        x = relay.var("x", relay.TensorType(shape=shape, dtype=dtype))
        xx = relay.multiply(x, x)
        z = relay.add(xx, relay.const(np.ones(shape=shape, dtype=dtype)))
        func = relay.Function([x], z)
        ir_mod = tvm.IRModule.from_expr(func)
        target = tvm.target.target.micro(model)

        with tvm.transform.PassContext(opt_level=3, config={"tir.disable_vectorize": True}):

            mod = tvm.relay.build(ir_mod, target=target)
        with _make_session(temp_dir, zephyr_board, west_cmd, mod, build_config) as session:

            graph_mod = tvm.micro.create_local_graph_executor(

>               mod.get_graph_json(), session.get_system_lib(), session.device
            )
tests/micro/zephyr/test_zephyr.py:216: 
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 
python/tvm/micro/session.py:88: in get_system_lib
    return self._rpc.get_function("runtime.SystemLib")()
python/tvm/rpc/client.py:73: in get_function
    return self._sess.get_function(name)
python/tvm/runtime/module.py:87: in get_function
    self.handle, c_str(name), ctypes.c_int(query_imports), ctypes.byref(ret_handle)
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 
ret = -1
    def check_call(ret):
        """Check the return value of C API call
        This function will raise exception when error occurs.
        Wrap every API call with this function
        Parameters
        ----------
        ret : int
            return value from API calls
        """
        if ret != 0:
>           raise get_last_ffi_error()

Maybe we need to increase the timeout.

@tmoreau89
Copy link
Contributor

Thanks for starting this issue @mehrdadh. For reference this happened in this PR. The issue was circumvented by re-triggering CI. Changes are likely unrelated to QEMU or uTVM altogether.

@mehrdadh
Copy link
Member Author

this test is temporary disabled: #8927

@areusch areusch added the needs-triage PRs or issues that need to be investigated by maintainers to find the right assignees to address it label Oct 19, 2022
@Lunderberg
Copy link
Contributor

Test re-enabled in #11362, and running.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
needs-triage PRs or issues that need to be investigated by maintainers to find the right assignees to address it
Projects
None yet
Development

No branches or pull requests

4 participants