RSyslog Documentation

omhttpfs: Hadoop HTTPFS Output Module

Module Name:omhttpfs
Available Since:8.10.0
Author:sskaje <sskaje@gmail.com>

Purpose

This module is an alternative to omhdfs via Hadoop HDFS over HTTP.

Dependencies

  • libcurl

Configuration Parameters

Note

Parameter names are case-insensitive.

Action Parameters

Host

typedefaultmandatoryobsolete legacy directive
word127.0.0.1nonone

HttpFS server host.

Port

typedefaultmandatoryobsolete legacy directive
integer14000nonone

HttpFS server port.

User

typedefaultmandatoryobsolete legacy directive
wordhdfsnonone

HttpFS auth user.

https

typedefaultmandatoryobsolete legacy directive
binaryoffnonone

Turn on if your HttpFS runs on HTTPS.

File

typedefaultmandatoryobsolete legacy directive
wordnoneyesnone

File to write, or a template name.

isDynFile

typedefaultmandatoryobsolete legacy directive
binaryoffnonone

Turn this on if your file is a template name. See examples below.

Template

typedefaultmandatoryobsolete legacy directive
wordRSYSLOG_FileFormatnonone

Format your message when writing to file. Default: RSYSLOG_FileFormat

Configure

./configure --enable-omhttpfs

Examples

Example 1

module(load="omhttpfs")
template(name="hdfs_tmp_file" type="string" string="/tmp/%$YEAR%/test.log")
template(name="hdfs_tmp_filecontent" type="string" string="%$YEAR%-%$MONTH%-%$DAY% %MSG% ==\n")
local4.*    action(type="omhttpfs" host="10.1.1.161" port="14000" https="off" file="hdfs_tmp_file" isDynFile="on")
local5.*    action(type="omhttpfs" host="10.1.1.161" port="14000" https="off" file="hdfs_tmp_file" isDynFile="on" template="hdfs_tmp_filecontent")

See also

Help with configuring/using Rsyslog:

  • Mailing list - best route for general questions
  • GitHub: rsyslog source project - detailed questions, reporting issues that are believed to be bugs with Rsyslog
  • Stack Exchange (View, Ask) - experimental support from rsyslog community

See also

Contributing to Rsyslog:

© 2008-2019, `Rainer Gerhards and Others. This site uses the “better” theme for Sphinx.
Scroll to top