Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Memory problem with large tables #261

Closed
adlcadn opened this issue Feb 15, 2023 · 3 comments
Closed

Memory problem with large tables #261

adlcadn opened this issue Feb 15, 2023 · 3 comments

Comments

@adlcadn
Copy link

adlcadn commented Feb 15, 2023

I was using version 2.9 for a long time without any problems, but since the switch to version 2.10 several large tables (> 100,000 rows or 1 Gb) backups do not end sometimes with an indication of lack of memory:
Allowed memory size of 536870912 bytes exhausted (tried to allocate 4096 bytes) in /var/app/current/vendor/ifsnop/mysqldump-php/src/Ifsnop/Mysqldump/Mysqldump.php(1158)
Sometimes with a crash without any error message.
After multiple tests by trying to change for example the 'net_buffer_length' parameter without success, I went back to version 2.9 and everything is back in order.
I invite you to look at this issue.

@ifsnop
Copy link
Owner

ifsnop commented Feb 16, 2023 via email

@adlcadn
Copy link
Author

adlcadn commented Feb 17, 2023

Hello,

I had already tried this possibility and I just tested it again with
extended-insert' => false
but without success: the process does not end and does not produce an error message.

The same backup with V2.9 and extended-insert = true of 1013966 rows in made in 12.8 secs.

@ifsnop
Copy link
Owner

ifsnop commented Mar 18, 2023

When mergin #200, the use of MYSQL_ATTR_USE_BUFFERED_QUERY was dropped. So queries results were stored in memory, instead of being pulled row by row from database. I will upload a fix now.

@ifsnop ifsnop closed this as completed in ec6a777 Mar 18, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants