I'm having a hard time get Redis running on my Cribl Workers
Hi all, I'm having a hard time get Redis running on my Cribl Workers and I don't know what the issue is. What I've done so far: 1. Setup a Redis Server in Docker (Standalone) 2. Set Up a pipeline as demonstarted in https://docs.cribl.io/stream/redis-function/#scenario-a|Docs 3. Setup Redis URL `redis://<password>@<host>:<port>` 4. Authentication: None 5. Tested the connection from my cribl worker via `redis-cli` from which I was able to write and retrive Keys from the Redis-Server Basically, my question is: Why doesn't it work using Cribl? Any ideas on that? Cheers :zebra_face:
Answers
-
if your Redis endpoint is encrypted you may need to use rediss (double S)
0 -
<@U01AWTNNHQB> you mean: Setup Redis URL `rediss://<password>@<host>:<port>` If so, it is still not working.
0 -
Can you share a screenshot of your redis function in Cribl?
0 -
Yep, rediss:// is necessary for encrypted endpoints, you can think of it as http(s). We use redis<s://fqdn:port|s://fqdn:port> and add the credentials under Authentication Method as manual.
0 -
- Is the Redis URL quoted`'redis://<password>@<host>:<port>'`
0 -
- Is the Key quoted?
0 -
Just an example
0 -
First Screenshot shows settings, the second one that there is data on the server. Tried both, with quoted and unquoted URL.
0 -
I just set and get
0 -
Do you have any special characters in the password? Colons, percents, etc?
0 -
Still not working... Getting an Error, if I check the logs nothing of interesst appears in there, just the two rows you can see in the screenshot
0 -
Basically would this regex fail? `[a-zA-Z0-9_-]+`
0 -
<@U01LSBF5953> no special characters. You're regex would catch
0 -
Can you share more about this Docker setup? How are you handling exposing the port?
0 -
Think that is not the issue, as I retrieve data from the Redis-Server when using the `redis-cli -h <redis-server-ip> -p 6379` command and `get <key>` from cribl worker. Or do you think that still could be an issue?
0 -
No, that's a good sign.
0 -
Although I couldn't find any information about this, but are there maybe other requirements, such as packages, libraries I need to install on the OS?
0 -
Hold on... you can't put your password in the URL like that.
0 -
You need to use "Manual" authentication and enter it into the password box.
0 -
Like so:
0 -
Additionally, do you require a password using the `redis-cli` by specifying the `-a <password>` flag?
0 -
If not, I don't think you require any authentication at all.
0 -
In regards to the docs, I can set the password in the URL (see screenshot). For `redis-cli` before quering any data I use `AUTH <password>` but I dont need a password in order to execute this one successfully `redis-cli -h <redis-server-ip> -p 6379`
0 -
Cool. Try taking the password out of the URL and entering it under Manual auth
0 -
Doesn't work either. I tried without an entry in Username and with `default` as the Username
0 -
Would you be willing to share your docker setup? What version of Cribl are you running? Standalone or distributed?
0 -
» Cribl 4.0.2 » Distributed Setup » Docker: ‚ó¶ Image: redis:latest ‚ó¶ PORTS: 0.0.0.:6379 -> 6379/tcp Docker isn't really my business and someone else set up the Container. Do you need some more information? If so, what do you like to see?
0 -
Are you using the first or second option? `'redis..'` ``redis..``
0 -
<@U01J549PR6Y> the first with single-quotes, if you're asking for the URL.
0 -
try the second option ( ``redis..``).. at least that seems to work for me ..
0
