gRPC(Syslog-port->key:value->parquet)

Getting Help
1

Dear All,

I am glad to be here and I hope to learn and share valuable experiences.

So my question is regarding the Syslog theme.

Maybe someone may help with the following problems:

within the gRPC project

  1. I would like to catch data from the command line or Syslog-port and adapt parser with https://github.com/elastic/beats/tree/master/filebeat/input/syslog

  2. Then all events falling into Syslog-port (for ex.) store in the key-value store (I assume it will be Redis or any other recommendations?)

  3. In the end I want to serialize data to parquet format with the date and time and to be able to search/query for the data with the time interval in order to fetch the full path (and probably stored in clickhouse).

Would be great to hear your ideas and thoughts about that.

Kind Regards,

Ramin

2

This topic was automatically closed 90 days after the last reply. New replies are no longer allowed.