We have updated our Terms of Service, Code of Conduct, and Addendum.

Cribl leader and worker node on same VM

Arnold Johnson
Arnold Johnson Posts: 4 ✭
in Stream

I have installed cribl standalone on a VM , but need to change it to leader ..

Do I need a worker node or only a leader can do the processing work as a stream ?

If worker node is required, can the same VM be a leader and worked node together ?

Answers

  • Jon Rust
    Jon Rust Posts: 487 mod

    The Leader does not process any data. Minimally 1 Worker Node will be required to do anything more than tinker with configs. In theory you can install both on one server, but you will have some port conflicts you'll need to resolve.

  • Arnold Johnson
    Arnold Johnson Posts: 4 ✭

    Thanks Jon for the response ..

    If I have to install Leader and worker on same VM , Do I need to do two installations of Cribl stream ?

  • Jon Rust
    Jon Rust Posts: 487 mod

    Yes, you will need 2 installs. Install the Leader normally, following the instructions. For the worker you're going to need a new directory (/opt/cribl-worker?) and new ports: 9000 and 4200 will already be used by the Leader. This isn't something we recommend doing, so we don't have instructions documented for it. You might also check out using docker. Probably makes it easier.

    Compose example:

    version: "3.7"

services:
  leader:
    image: cribl/cribl:latest
    ports:
      - 9000:9000
    environment:
      CRIBL_DIST_MODE: master
      CRIBL_DIST_MASTER_URL: tcp://criblmaster@leader:4200
    hostname: leader

  worker1:
    image: cribl/cribl:latest
    ports:
      - "9997:9997"
      - "8088:8088"
      - "10090:10090"
      - "1514:1514"
      - "1514:1514/udp"
    environment:
      CRIBL_DIST_MODE: worker
      CRIBL_DIST_MASTER_URL: tcp://criblmaster@leader:4200
    hostname: worker1

Categories