Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Long running issue with ingress #12

Open
TrekkieCoder opened this issue Nov 28, 2024 · 0 comments
Open

Long running issue with ingress #12

TrekkieCoder opened this issue Nov 28, 2024 · 0 comments

Comments

@TrekkieCoder
Copy link
Collaborator

TrekkieCoder commented Nov 28, 2024

Running ingress for very long run > 10 days, there was an issue where threads seem to get blocked on read syscall. The backtrace of thread in question :

[Switching to thread 11 (Thread 0x7cc576000700 (LWP 22))]
#0  __libc_read (nbytes=5, buf=0x7cc54804fcc3, fd=13) at ../sysdeps/unix/sysv/linux/read.c:26
26      ../sysdeps/unix/sysv/linux/read.c: No such file or directory.
(gdb) bt
#0  __libc_read (nbytes=5, buf=0x7cc54804fcc3, fd=13) at ../sysdeps/unix/sysv/linux/read.c:26
#1  __libc_read (fd=13, buf=0x7cc54804fcc3, nbytes=5) at ../sysdeps/unix/sysv/linux/read.c:24
#2  0x00007cc5d219b531 in sock_read () from /usr/lib64/libcrypto.so.3
#3  0x00007cc5d218e72f in bread_conv () from /usr/lib64/libcrypto.so.3
#4  0x00007cc5d218c477 in BIO_read () from /usr/lib64/libcrypto.so.3
#5  0x00007cc5d269d523 in tls_default_read_n () from /usr/lib64/libssl.so.3
#6  0x00007cc5d269d8b1 in tls_get_more_records () from /usr/lib64/libssl.so.3
#7  0x00007cc5d269c72a in tls_read_record () from /usr/lib64/libssl.so.3
#8  0x00007cc5d2694fe5 in ssl3_read_bytes () from /usr/lib64/libssl.so.3
#9  0x00007cc5d26baf07 in tls_get_message_header () from /usr/lib64/libssl.so.3
#10 0x00007cc5d26ae1c3 in state_machine () from /usr/lib64/libssl.so.3
#11 0x00007cc5d26404ba in SSL_do_handshake () from /usr/lib64/libssl.so.3
#12 0x0000000001999bef in proxy_ssl_accept (ssl=0x7cc5480380e0, fd=13) at sockproxy.c:1735
#13 0x000000000199a9af in proxy_notifier (fd=14, type=(unknown: 0), priv=0x7cc530055170) at sockproxy.c:2038
#14 0x000000000199c092 in notify_run (ctx=0x7cc580a00010, thread=2) at notify.c:471
#15 0x000000000199c114 in notify_run_worker (arg=0x7cc560000e50) at notify.c:487
#16 0x00007cc5d205d609 in start_thread (arg=<optimized out>) at pthread_create.c:477
#17 0x00007cc5d1f80353 in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
TrekkieCoder added a commit to loxilb-io/loxilb-ebpf that referenced this issue Nov 28, 2024
TrekkieCoder added a commit to TrekkieCoder/loxilb that referenced this issue Nov 28, 2024
UltraInstinct14 added a commit to loxilb-io/loxilb that referenced this issue Nov 28, 2024
loxilb-io/loxilb-ingress#12 Fixed potential issue resulting from non-blocking read
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant