Is there documentation for implementing local storage archival and replay functions?

Neil Parisi

Is there any documentation available for implementing local storage archival and replay functions?

xpac xpac

https://docs.cribl.io/stream/destinations-fs/

https://docs.cribl.io/stream/collectors-filesystem/

Jon Rust

This would get tricky. The collector assumes workers have identical views. > ... that is available on all Worker Nodes.

Raanan Dagan

Also, if you can, pointing Cribl to an on-prem Minio, can be the simplest solution

Jon Rust

yep. Slightly more tricky, you could have a CIFS or NFS share that all the workers mount in the same place

Jon Rust

but purely local would likely not work in a multi-worker scenario

Raanan Dagan

NFS share for the win. Must be identical though. Very important.

xpac xpac

https://docs.cribl.io/stream/destinations-fs/

https://docs.cribl.io/stream/collectors-filesystem/