why there is no the "binlogs" directory after milvus-backup #38279
Replies: 6 comments 12 replies
-
Maybe there are errors during the backup creation. |
Beta Was this translation helpful? Give feedback.
-
this is check output: |
Beta Was this translation helpful? Give feedback.
-
when i run the backup command(milvus-backup create),this is just only the meta directory [root@ceph02 mytest_bak_20241206]# pwd |
Beta Was this translation helpful? Give feedback.
-
I also encountered a similar problem when using backup. After the backup was completed, the target minio only had a meta directory and no binlogs directory. I confirmed that there was a files directory in the source minio and it was not empty. When backing up, I turned on the debug log. There was no error information in the log, and there was a log of successful data copying, but the data was not actually in the target minio. [2024/12/17 15:42:32.339 +08:00] [DEBUG] [storage/copier.go:260] [copyRemote] [srcBucket=a-bucket] [destBucket=a-bucket] [key=files/insert_log/454216323608928169/454216323608928170/454216323608928261/102/454216323608928265] [destKey=backup/backup_test2/binlogs/insert_log/454216323608928169/454216323608928170/454216323608928261/454216323608928261/102/454216323608928265] |
Beta Was this translation helpful? Give feedback.
-
我的minio源地址和目标地址配置如下,meta数据同步过去了,说明minio的连通性是没问题的 #Backup storage configs, the storage you want to put the backup data 并且backup日志也显示已经从源地址成功拷贝到目标minio地址了,但目标地址的minio却根本没有binlogs这个路径 所以很疑惑中间哪里出了问题,或者是有什么配置没有配对? |
Beta Was this translation helpful? Give feedback.
-
|
Beta Was this translation helpful? Give feedback.
-
i backup milvus in k8s:
/opt/milvus_backup/milvus-backup create -n mytest_bak_20241206 -d mvsdb_ai --config=/opt/milvus_backup/conf/backup.yaml
and i can not see the "binlogs" directory in the minio backup directory
[root@ceph02 mytest_bak_20241206]# pwd
/data/minio/data/a-bucket/backup/mytest_bak_20241206
[root@ceph02 mytest_bak_20241206]# ls
meta
just only the meta directory,so i can not restore the database.
error just as flowing:
[2024/12/06 15:18:27.962 +08:00] [INFO] [core/backup_impl_restore_backup.go:746] ["execute bulk insert"] [db=mvsdb_ai] [collection=tb_01] [partition=_default] [files="[backup/mytest_bak_20241206/binlogs/delta_log/454414172884218510/454414172884218511/454414172884221072]"] [endTime=454418600420704258]
[2024/12/06 15:18:27.987 +08:00] [ERROR] [core/backup_impl_restore_backup.go:760] ["fail to bulk insert"] [db=mvsdb_ai] [collectionName=tb_01] [partitionName=_default] [files="[backup/mytest_bak_20241206/binlogs/delta_log/454414172884218510/454414172884218511/454414172884221072]"] [error="no binlog to import, input=[paths:"backup/mytest_bak_20241206/binlogs/delta_log/454414172884218510/454414172884218511/454414172884221072"]: importing data failed"] [errorVerbose="no binlog to import, input=[paths:"backup/mytest_bak_20241206/binlogs/delta_log/454414172884218510/454414172884218511/454414172884221072"]: importing data failed\n(1) attached stack trace\n -- stack trace:\n | github.com/milvus-io/milvus-sdk-go/v2/client.handleRespStatus\n | \t/home/runner/go/pkg/mod/github.com/wayblink/milvus-sdk-go/v2@v2.3.0-beta4.0.20240814024750-1d41342d2c27/client/collection.go:39\n | github.com/milvus-io/milvus-sdk-go/v2/client.(*GrpcClient).BulkInsert\n | \t/home/runner/go/pkg/mod/github.com/wayblink/milvus-sdk-go/v2@v2.3.0-beta4.0.20240814024750-1d41342d2c27/client/insert.go:416\n | github.com/zilliztech/milvus-backup/core.(*MilvusClient).BulkInsert\n | \t/home/runner/work/milvus-backup/milvus-backup/core/milvus_sdk_wrapper.go:124\n | github.com/zilliztech/milvus-backup/core.(*BackupContext).executeBulkInsert\n | \t/home/runner/work/milvus-backup/milvus-backup/core/backup_impl_restore_backup.go:757\n | github.com/zilliztech/milvus-backup/core.(*BackupContext).executeRestoreCollectionTask.func3\n | \t/home/runner/work/milvus-backup/milvus-backup/core/backup_impl_restore_backup.go:591\n | github.com/zilliztech/milvus-backup/core.(*BackupContext).executeRestoreCollectionTask.func8\n | \t/home/runner/work/milvus-backup/milvus-backup/core/backup_impl_restore_backup.go:710\n | github.com/zilliztech/milvus-backup/internal/common.(*WorkerPool).work.func1\n | \t/home/runner/work/milvus-backup/milvus-backup/internal/common/workerpool.go:70\n | golang.org/x/sync/errgroup.(*Group).Go.func1\n | \t/home/runner/go/pkg/mod/golang.org/x/sync@v0.3.0/errgroup/errgroup.go:75\n | runtime.goexit\n | \t/opt/hostedtoolcache/go/1.18.10/x64/src/runtime/asm_amd64.s:1571\nWraps: (2) no binlog to import, input=[paths:"backup/mytest_bak_20241206/binlogs/delta_log/454414172884218510/454414172884218511/454414172884221072"]: importing data failed\nError types: (1) *withstack.withStack (2) *errutil.leafError"] [stack="github.com/zilliztech/milvus-backup/core.(*BackupContext).executeBulkInsert\n\t/home/runner/work/milvus-backup/milvus-backup/core/backup_impl_restore_backup.go:760\ngithub.com/zilliztech/milvus-backup/core.(*BackupContext).executeRestoreCollectionTask.func3\n\t/home/runner/work/milvus-backup/milvus-backup/core/backup_impl_restore_backup.go:591\ngithub.com/zilliztech/milvus-backup/core.(*BackupContext).executeRestoreCollectionTask.func8\n\t/home/runner/work/milvus-backup/milvus-backup/core/backup_impl_restore_backup.go:710\ngithub.com/zilliztech/milvus-backup/internal/common.(*WorkerPool).work.func1\n\t/home/runner/work/milvus-backup/milvus-backup/internal/common/workerpool.go:70\ngolang.org/x/sync/errgroup.(*Group).Go.func1\n\t/home/runner/go/pkg/mod/golang.org/x/sync@v0.3.0/errgroup/errgroup.go:75"]
[2024/12/06 15:18:27.988 +08:00] [ERROR] [core/backup_impl_restore_backup.go:710] ["fail to bulk insert to partition"] [backup_db_name=mvsdb_ai] [backup_collection_name=mvsdb_ai] [target_db_name=mvsdb_ai] [target_collection_name=tb_01] [skipDiskQuotaCheck=false] [partition=_default] [error="no binlog to import, input=[paths:"backup/mytest_bak_20241206/binlogs/delta_log/454414172884218510/454414172884218511/454414172884221072"]: importing data failed"] [errorVerbose="no binlog to import, input=[paths:"backup/mytest_bak_20241206/binlogs/delta_log/454414172884218510/454414172884218511/454414172884221072"]: importing data failed\n(1) attached stack trace\n -- stack trace:\n | github.com/milvus-io/milvus-sdk-go/v2/client.handleRespStatus\n | \t/home/runner/go/pkg/mod/github.com/wayblink/milvus-sdk-go/v2@v2.3.0-beta4.0.20240814024750-1d41342d2c27/client/collection.go:39\n | github.com/milvus-io/milvus-sdk-go/v2/client.(*GrpcClient).BulkInsert\n | \t/home/runner/go/pkg/mod/github.com/wayblink/milvus-sdk-go/v2@v2.3.0-beta4.0.20240814024750-1d41342d2c27/client/insert.go:416\n | github.com/zilliztech/milvus-backup/core.(*MilvusClient).BulkInsert\n | \t/home/runner/work/milvus-backup/milvus-backup/core/milvus_sdk_wrapper.go:124\n | github.com/zilliztech/milvus-backup/core.(*BackupContext).executeBulkInsert\n | \t/home/runner/work/milvus-backup/milvus-backup/core/backup_impl_restore_backup.go:757\n | github.com/zilliztech/milvus-backup/core.(*BackupContext).executeRestoreCollectionTask.func3\n | \t/home/runner/work/milvus-backup/milvus-backup/core/backup_impl_restore_backup.go:591\n | github.com/zilliztech/milvus-backup/core.(*BackupContext).executeRestoreCollectionTask.func8\n | \t/home/runner/work/milvus-backup/milvus-backup/core/backup_impl_restore_backup.go:710\n | github.com/zilliztech/milvus-backup/internal/common.(*WorkerPool).work.func1\n | \t/home/runner/work/milvus-backup/milvus-backup/internal/common/workerpool.go:70\n | golang.org/x/sync/errgroup.(*Group).Go.func1\n | \t/home/runner/go/pkg/mod/golang.org/x/sync@v0.3.0/errgroup/errgroup.go:75\n | runtime.goexit\n | \t/opt/hostedtoolcache/go/1.18.10/x64/src/runtime/asm_amd64.s:1571\nWraps: (2) no binlog to import, input=[paths:"backup/mytest_bak_20241206/binlogs/delta_log/454414172884218510/454414172884218511/454414172884221072"]: importing data failed\nError types: (1) *withstack.withStack (2) *errutil.leafError"] [stack="github.com/zilliztech/milvus-backup/core.(*BackupContext).executeRestoreCollectionTask.func8\n\t/home/runner/work/milvus-backup/milvus-backup/core/backup_impl_restore_backup.go:710\ngithub.com/zilliztech/milvus-backup/internal/common.(*WorkerPool).work.func1\n\t/home/runner/work/milvus-backup/milvus-backup/internal/common/workerpool.go:70\ngolang.org/x/sync/errgroup.(*Group).Go.func1\n\t/home/runner/go/pkg/mod/golang.org/x/sync@v0.3.0/errgroup/errgroup.go:75"]
[2024/12/06 15:18:27.988 +08:00] [ERROR] [core/backup_impl_restore_backup.go:359] ["executeRestoreCollectionTask failed"] [TargetDBName=mvsdb_ai] [TargetCollectionName=tb_01] [error="no binlog to import, input=[paths:"backup/mytest_bak_20241206/binlogs/delta_log/454414172884218510/454414172884218511/454414172884221072"]: importing data failed"] [errorVerbose="no binlog to import, input=[paths:"backup/mytest_bak_20241206/binlogs/delta_log/454414172884218510/454414172884218511/454414172884221072"]: importing data failed\n(1) attached stack trace\n -- stack trace:\n | github.com/milvus-io/milvus-sdk-go/v2/client.handleRespStatus\n | \t/home/runner/go/pkg/mod/github.com/wayblink/milvus-sdk-go/v2@v2.3.0-beta4.0.20240814024750-1d41342d2c27/client/collection.go:39\n | github.com/milvus-io/milvus-sdk-go/v2/client.(*GrpcClient).BulkInsert\n | \t/home/runner/go/pkg/mod/github.com/wayblink/milvus-sdk-go/v2@v2.3.0-beta4.0.20240814024750-1d41342d2c27/client/insert.go:416\n | github.com/zilliztech/milvus-backup/core.(*MilvusClient).BulkInsert\n | \t/home/runner/work/milvus-backup/milvus-backup/core/milvus_sdk_wrapper.go:124\n | github.com/zilliztech/milvus-backup/core.(*BackupContext).executeBulkInsert\n | \t/home/runner/work/milvus-backup/milvus-backup/core/backup_impl_restore_backup.go:757\n | github.com/zilliztech/milvus-backup/core.(*BackupContext).executeRestoreCollectionTask.func3\n | \t/home/runner/work/milvus-backup/milvus-backup/core/backup_impl_restore_backup.go:591\n | github.com/zilliztech/milvus-backup/core.(*BackupContext).executeRestoreCollectionTask.func8\n | \t/home/runner/work/milvus-backup/milvus-backup/core/backup_impl_restore_backup.go:710\n | github.com/zilliztech/milvus-backup/internal/common.(*WorkerPool).work.func1\n | \t/home/runner/work/milvus-backup/milvus-backup/internal/common/workerpool.go:70\n | golang.org/x/sync/errgroup.(*Group).Go.func1\n | \t/home/runner/go/pkg/mod/golang.org/x/sync@v0.3.0/errgroup/errgroup.go:75\n | runtime.goexit\n | \t/opt/hostedtoolcache/go/1.18.10/x64/src/runtime/asm_amd64.s:1571\nWraps: (2) no binlog to import, input=[paths:"backup/mytest_bak_20241206/binlogs/delta_log/454414172884218510/454414172884218511/454414172884221072"]: importing data failed\nError types: (1) *withstack.withStack (2) *errutil.leafError"] [stack="github.com/zilliztech/milvus-backup/core.(*BackupContext).executeRestoreBackupTask.func1\n\t/home/runner/work/milvus-backup/milvus-backup/core/backup_impl_restore_backup.go:359\ngithub.com/zilliztech/milvus-backup/internal/common.(*WorkerPool).work.func1\n\t/home/runner/work/milvus-backup/milvus-backup/internal/common/workerpool.go:70\ngolang.org/x/sync/errgroup.(*Group).Go.func1\n\t/home/runner/go/pkg/mod/golang.org/x/sync@v0.3.0/errgroup/errgroup.go:75"]
[2024/12/06 15:18:27.989 +08:00] [ERROR] [core/backup_impl_restore_backup.go:323] ["execute restore collection fail"] [backupId=0f2600ae-b3a2-11ef-8f0b-52540025e7a3] [error="workerpool: execute job no binlog to import, input=[paths:"backup/mytest_bak_20241206/binlogs/delta_log/454414172884218510/454414172884218511/454414172884221072"]: importing data failed"] [stack="github.com/zilliztech/milvus-backup/core.(*BackupContext).RestoreBackup\n\t/home/runner/work/milvus-backup/milvus-backup/core/backup_impl_restore_backup.go:323\ngithub.com/zilliztech/milvus-backup/cmd.glob..func7\n\t/home/runner/work/milvus-backup/milvus-backup/cmd/restore.go:83\ngithub.com/spf13/cobra.(*Command).execute\n\t/home/runner/go/pkg/mod/github.com/spf13/cobra@v1.5.0/command.go:876\ngithub.com/spf13/cobra.(*Command).ExecuteC\n\t/home/runner/go/pkg/mod/github.com/spf13/cobra@v1.5.0/command.go:990\ngithub.com/spf13/cobra.(*Command).Execute\n\t/home/runner/go/pkg/mod/github.com/spf13/cobra@v1.5.0/command.go:918\ngithub.com/zilliztech/milvus-backup/cmd.Execute\n\t/home/runner/work/milvus-backup/milvus-backup/cmd/root.go:35\nmain.main\n\t/home/runner/work/milvus-backup/milvus-backup/main.go:24\nruntime.main\n\t/opt/hostedtoolcache/go/1.18.10/x64/src/runtime/proc.go:250"]
workerpool: execute job no binlog to import, input=[paths:"backup/mytest_bak_20241206/binlogs/delta_log/454414172884218510/454414172884218511/454414172884221072"]: importing data failed
duration:6 s
Beta Was this translation helpful? Give feedback.
All reactions