geaflow api实现2度遍历,图数据checkpoint问题 #452
Unanswered
zhaojunnana
asked this question in
Q&A
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
geaflow版本0.5
求助:图数据16分片,存储rocksdb hdfs,k8s方式16*2并发运行。我以api的方式实现2度遍历,k8s的worker节点上rocksdb图数据分片都正常存在,但当进行checkpoint时候发现有节点数据未上传到hdfs,日志上也没看见触发checkpoint,请问下可能是什么原因导致的?
构图:
计算中的数据存储逻辑:
图中缺少的3、6分片,任务后面持续跑的话,也会出现,但是并不是每次应该触发checkpoint时都会存储Beta Was this translation helpful? Give feedback.
All reactions