Skip to content

Commit 6541206

Browse files
committed
fix: Add filesystem kwargs when read prev_table on FileRetrievalJob (#3490)
Signed-off-by: hyeongseok.yoo <goodseog.yoo@navercorp.com>
1 parent 3249b97 commit 6541206

File tree

1 file changed

+3
-1
lines changed
  • sdk/python/feast/infra/offline_stores

1 file changed

+3
-1
lines changed

sdk/python/feast/infra/offline_stores/file.py

+3-1
Original file line numberDiff line numberDiff line change
@@ -453,7 +453,9 @@ def offline_write_batch(
453453
filesystem, path = FileSource.create_filesystem_and_path(
454454
file_options.uri, file_options.s3_endpoint_override
455455
)
456-
prev_table = pyarrow.parquet.read_table(path, memory_map=True)
456+
prev_table = pyarrow.parquet.read_table(
457+
path, filesystem=filesystem, memory_map=True
458+
)
457459
if table.schema != prev_table.schema:
458460
table = table.cast(prev_table.schema)
459461
new_table = pyarrow.concat_tables([table, prev_table])

0 commit comments

Comments
 (0)