We have updated our Terms of Service, Code of Conduct, and Addendum.

Can search read gzip files?

Options
Tony Reinke - Cribl
Tony Reinke - Cribl Posts: 134 admin

Can search read gzip files?

Tagged:

Best Answer

Answers

  • dritan
    dritan Posts: 51 ✭✭
    Answer ✓
    Options

    Yes - list of currently supported formats here:  https://docs.cribl.io/search/data-formats

  • David Maislin
    David Maislin Posts: 228 mod
    Options

    Yes it can. https://docs.cribl.io/search/data-formats/#

    Cribl Search supports the following data formats:

    • Journal: Journal binary files are used for logging and storing system and application events. Cribl Search supports .journal and temporary .journal~ files, which are helpful when investigating unexpected process failures. LZ4 and ZSTD compressed data objects are supported.
    • Parquet: See the Parquet section below for details on how Parquet files are processed.
    • Splunk rawdata: Splunk rawdata journal files are used to store raw data ingested by indexers.
    • TAR: See the tarballs section below for details on how tar files are processed.
    • Text: Text files are a popular format that contains human-readable characters. E.g., JSONCSV, and .log.

    Compression formats are used to reduce the size of data to optimize storage space and speed up data transmission. The following are supported:

    • Gzip
    • Snappy