How do the Windows Edge Nodes extract Windows Event logs and forward them to Cribl?
Hi Team, quick question. How do the Windows Edge Nodes extract Windows Event logs and forward them to Cribl? Does it spin a powrshell process and send logs up in batches?
Answers
-
Yes, it does. We leverage native PowerShell utilities to export the Windows logs.
1 -
My understanding is that Edge collects the logs in batches using the `Get-WinEvent` powershell command
0 -
ooh, I see Brendan answered already!
0 -
Got it. How frequent is the batching process?
0 -
Uh, I believe in order to reduce some overhead, we queue up all commands (for a particular collection) at once to prevent us overloading powershell processes. Not sure of the exact frequency though
0 -
I see there's a polling interval that can be modified. That would change how frequent the batching happens, right?
0 -
Oh duh, yeah probably. I think the polling period is when the all the powershell commands are executed. I just reviewed some internal architectural docs on Windows Event collection with Edge and the doc seems to indicate the polling interval is when the batching happens
0 -
Yes, you can customize the polling interval. Just note that if you poll too frequently, you could be duplicating events because the previous one could still be running.
1 -
Is 10 seconds too frequent? That is the default
0 -
Shouldn't be
0 -
Depends on the batch size and how many logs are in there that it's trying to catch up on. And there's not much directly useful logging to be able to see what's really going on. Best I can offer is test and see but know that we are actively working to get more observability data about ourself to support tuning.
1
