Skip to content

Optional flag to decompress file without having 'gz' extention #165

@gurupritmukhraiya

Description

@gurupritmukhraiya

We are using S3 input plugin to pull data from S3, we are using kinesis firehose to push data to S3, which does not adds 'gz' extension to the files, but data is in zipped format.

S3 input plugin is pulling data from S3 it can only decompress the data which has gz as extension since while code walk through we we notice there is a condition checking 'gz' as extension then only it decompress the file data.

We do not want to maintain the custom plugin at our end just for small change.

I just wanted to ask can we add a flag over there, which can be set as configuration and used with that condition, so that even files which use can set intentionally to decompress files does not have 'gz' extension or with any extension.

Can you provide such feature as same plugin or can we contribute to this input plugin, if yes how and what is the process for the same?

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions