Search Results for: queue

Version 5.1.0 [DEVEL] (rgerhards), 2009-05-29

• redesigned queue engine so that it supports ultra-reliable operations. This resulted in a rewrite of large parts. The new capability can be used to build audit-grade systems on the basis of rsyslog.
• added $MainMsgQueueDequeueBatchSize and $ActionQueueDequeueBatchSize configuration directives
• implemented a new transactional output module interface which provides superior performance (for databases potentially far superior performance)
• increased ompgsql performance by adapting to new transactional output module interface

Version 4.3.1 [DEVEL] (rgerhards), 2009-05-25

• added capability to run multiple tcp listeners (on different ports)
• performance enhancement: imtcp calls parser no longer on input thread but rather inside on of the potentially many main msg queue worker threads (an enhancement scheduled for all input plugins where this is possible)
• added $GenerateConfigGraph configuration command which can be used to generate nice-looking (and very informative) rsyslog configuration graphs.
• added $ActionName configuration directive (currently only used for graph generation, but may find other uses)
• improved doc
  * added (hopefully) easier to grasp queue explanation

• improved testbench
  * added tests for queue disk-only mode (checks disk queue logic)

• bugfix: light and full delay watermarks had invalid values, badly affecting performance for delayable inputs
• build system improvements – thanks to Michael Biebl
• added new testing module imdiag, which enables to talk to the rsyslog core at runtime. The current implementation is only a beginning, but can be expanded over time

Version 4.1.6 [DEVEL] (rgerhards), 2009-04-07

• added new “csv” property replacer options to enable simple creation of CSV-formatted outputs (format from RFC4180 is used)
• implemented function support in RainerScript. That means the engine parses and compile functions, as well as executes a few build-in ones. Dynamic loading and registration of functions is not yet supported – but we now have a good foundation to do that later on.
• implemented the strlen() RainerScript function
• added a template output module
• added -T rsyslogd command line option, enables to specify a directory where to chroot() into on startup. This is NOT a security feature but introduced to support testing. Thus, -T does not make sure chroot() is used in a secure way. (may be removed later)
• added omstdout module for testing purposes. Spits out all messages to stdout – no config option, no other features
• added a parser testing suite (still needs to be extended, but a good start)
• modified $ModLoad statement so that for modules whom’s name starts with
  a dot, no path is prepended (this enables relative-pathes and should not break any valid current config)

• fixed a bug that caused action retries not to work correctly situation was only cleared by a restart
• bugfix: closed dynafile was potentially never written until another dynafile name was generated – potential loss of messages
• improved omfile so that it properly suspends itself if there is an i/o or file name generation error. This enables it to be used with the full high availability features of rsyslog’s engine
• bugfix: fixed some segaults on Solaris, where vsprintf() does not check for NULL pointers
• improved performance of regexp-based filters. Thanks to Arnaud Cornet for providing the idea and initial patch.
• added a new way how output plugins may be passed parameters. This is more effcient for some outputs. They new can receive fields not only as a single string but rather in an array where each string is seperated.
• added (some) developer documentation for output plugin interface
• bugfix: potential abort with DA queue after high watermark is reached There exists a race condition that can lead to a segfault. Thanks go to vbernetr, who performed the analysis and provided patch, which I only tweaked a very little bit.
• bugfix: imtcp did incorrectly parse hostname/tag Thanks to Luis Fernando Muñoz Mejías for the patch.

Version 4.1.0 [DEVEL] (rgerhards), 2008-11-18

********************************* WARNING *********************************
This version has a slightly different on-disk format for message entries.
As a consequence, old queue files being read by this version may have
an invalid output timestamp, which could result to some malfunction inside
the output driver. It is recommended to drain queues with the previous
version before switching to this one.
********************************* WARNING *********************************

• greatly enhanced performance when compared to v3.
• added configuration directive “HUPisRestart” which enables to configure
  HUP to be either a full restart or “just” a leightweight way to
  close open files.

• enhanced legacy syslog parser to detect year if part of the timestamp
  the format is based on what Cisco devices seem to emit.

• added a setting “$OptimizeForUniprocessor” to enable users to turn off
  pthread_yield calls which are counter-productive on multiprocessor
  machines (but have been shown to be useful on uniprocessors)

• reordered imudp processing. Message parsing is now done as part of main
  message queue worker processing (was part of the input thread)
  This should also improve performance, as potentially more work is
  done in parallel.

• bugfix: compressed syslog messages could be slightly mis-uncompressed
  if the last byte of the compressed record was a NUL

• added $UDPServerTimeRequery option which enables to work with
  less acurate timestamps in favor of performance. This enables querying
  of the time only every n-th time if imudp is running in the tight
  receive loop (aka receiving messsages at a high rate)

• doc bugfix: queue doc had wrong parameter name for setting controlling
  worker thread shutdown period

• restructured rsyslog.conf documentation
• bugfix: memory leak in ompgsql
  Thanks to Ken for providing the patch

Version 3.21.5 [DEVEL] (rgerhards), 2008-09-30

• performance optimization: unnecessary time() calls during message
  parsing removed – thanks to David Lang for his excellent performance
  analysis

• added new capability to property replacer: multiple immediately
  successive field delimiters are treated as a single one.
  Thanks to Zhuang Yuyao for the patch.

• added message property “inputname”, which contains the name of the
  input (module) that generated it. Presence is depending on suport in
  each input module (else it is blank).

• added system property “$myhostname”, which contains the name of the
  local host as it knows itself.

• imported a number of fixes and enhancements from the stable and
  devel branches, including a fix to a potential segfault on HUP
  when using UDP listners

• re-enabled gcc builtin atomic operations and added a proper
  ./configure check

• bugfix: potential race condition when adding messages to queue
  There was a wrong order of mutex lock operations. It is hard to
  believe that really caused problems, but in theory it could and with
  threading we often see that theory becomes practice if something is only
  used long enough on a fast enough machine with enough CPUs ;)

• cleaned up internal debug system code and made it behave better
  in regard to multi-threading

Version 3.21.4 [DEVEL] (rgerhards), 2008-09-04

• removed compile time fixed message size limit (was 2K), limit can now
  be set via $MaxMessageSize global config directive (finally gotten rid
  of MAXLINE ;))

• enhanced doc for $ActionExecOnlyEveryNthTimeTimeout
• integrated a number of patches from 3.18.4, namely
  • bugfix: order-of magnitude issue with base-10 size definitions
    in config file parser. Could lead to invalid sizes, constraints
    etc for e.g. queue files and any other object whose size was specified
    in base-10 entities. Did not apply to binary entities. Thanks to
    RB for finding this bug and providing a patch.

  • bugfix: action was not called when system time was set backwards
    (until the previous time was reached again). There are still some
    side-effects when time is rolled back (A time rollback is really a bad
    thing to do, ideally the OS should issue pseudo time (like NetWare did)
    when the user tries to roll back time). Thanks to varmojfekoj for this
    patch.

  • doc bugfix: rsyslog.conf man page improved and minor nit fixed
    thanks to Lukas Kuklinek for the patch.