Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Pino fails to flush on process exit when lots of data #2054

Closed
erezarnon opened this issue Oct 4, 2024 · 2 comments · Fixed by pinojs/pino-pretty#533
Closed

Pino fails to flush on process exit when lots of data #2054

erezarnon opened this issue Oct 4, 2024 · 2 comments · Fixed by pinojs/pino-pretty#533

Comments

@erezarnon
Copy link

erezarnon commented Oct 4, 2024

It doesn't happen every time, but very often if you run the below, This is a test error, won't get logged. Interestingly, it's only reproducible with the pino-pretty target (not sure if I should file it there).

import pino from 'pino';

const logger = pino({
  transport: {
    target: 'pino-pretty',
  },
});

function main() {
  const longString = 'x'.repeat(100000);
  logger.error(longString);
  throw new Error('This is a test error');
}

if (require.main === module) {
  try {
    main();
  } catch (e) {
    logger.error(e.message);
  }
}
@jsumners
Copy link
Member

Transports are executed in a separate thread. Worker threads get destroyed at

pino/lib/transport.js

Lines 32 to 55 in 7cff45a

process.on('exit', onExit)
function onReady () {
process.removeListener('exit', onExit)
stream.unref()
if (workerOpts.autoEnd !== false) {
setupOnExit(stream)
}
}
function onExit () {
/* istanbul ignore next */
if (stream.closed) {
return
}
stream.flushSync()
// Apparently there is a very sporadic race condition
// that in certain OS would prevent the messages to be flushed
// because the thread might not have been created still.
// Unfortunately we need to sleep(100) in this case.
sleep(100)
stream.end()
}

I suspect the thread is destroyed before logger.error is fired.

Copy link

This issue has been automatically locked since there has not been any recent activity after it was closed. Please open a new issue for related bugs.

@github-actions github-actions bot locked as resolved and limited conversation to collaborators Nov 15, 2024
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants