Add getRetainedBytes to Vader Writers

Summary: Expose retained bytes method for Vader writers. This will be used to keep track of the maximum amount of memory consumed by the writers when creating synthetic metalake updates [[here]](https://fburl.com/code/vi67aqad) and [[here]](https://fburl.com/code/dyxc40n1). Reviewed By: sdruzkin Differential Revision: D66686627
facebookincubator · Dec 27, 2024 · 7fbe64e · 7fbe64e
1 parent fae485b
commit 7fbe64e
Show file tree

Hide file tree

Showing 2 changed files with 6 additions and 0 deletions.
diff --git a/dwio/nimble/velox/VeloxWriter.cpp b/dwio/nimble/velox/VeloxWriter.cpp
@@ -868,4 +868,8 @@ VeloxWriter::RunStats VeloxWriter::getRunStats() const {
       .inputBufferReallocItemCount =
           context_->inputBufferGrowthStats.itemCount};
 }
+
+int64_t VeloxWriter::getPeakMemoryUsage() const {
+  return writerMemoryPool_->peakBytes();
+}
 } // namespace facebook::nimble
diff --git a/dwio/nimble/velox/VeloxWriter.h b/dwio/nimble/velox/VeloxWriter.h
@@ -68,6 +68,8 @@ class VeloxWriter {
 
   RunStats getRunStats() const;
 
+  int64_t getPeakMemoryUsage() const;
+
  private:
   std::shared_ptr<const velox::dwio::common::TypeWithId> schema_;
   std::unique_ptr<velox::WriteFile> file_;