Can Cribl Stream read AWS S3 tags?
Can Cribl Stream read AWS S3 tags? I know there are multiple places where you can add tags to parts of the stream, such as in the Source or in a Pipeline, but I want my stream to be able to read the tags that are assigned via S3 in order to filter them. If that's not possible, would I be able to call a Lambda function and use that to manage the tags instead?
Best Answer
-
@Aaron Hornbuckle I don't think we're going to be able to read S3 tags today. You'll either need to use a Lambda to enrich them before sending to Cribl, or we'll need to look at adding something to support this.
1
Answers
-
Looking at the documentation for S3, in the optional settings, it references tags.
https://docs.cribl.io/stream/sources-s3/#optionalsettings1 -
Thank you for your reply, Tony! Just to clarify, I did see that in the documentation. I just wanted to verify that that tagging feature enables reading of tags preexisting on data coming in from the source, and not just adding a new tag to the data. IE I add tags to data in S3 and then that tagging feature in Cribl allows me to read/filter/group.
0 -
@Tony Reinke - Cribl those "tags" in Cribl are for organization of config items in the UI and won't work for this use case.
0 -
@Aaron Hornbuckle I don't think we're going to be able to read S3 tags today. You'll either need to use a Lambda to enrich them before sending to Cribl, or we'll need to look at adding something to support this.
1 -
Thanks @Brendan Dalpe !
0
