Home

Table of Contents About Scope Contact Issue tracking Maven Info Releases Features and Design User Guide Configuring Log4j Enable Foundation Logging Enable Logging Pattern Conversion Pattern Changing ConversionPattern Turn Off Archiving Support Configure Reload Period Configure Roll on Startup Configure Max File Rolling Size Configure Max File Rolling Count Keeping Files According to their Age Control Exception Handling How to Write to More than One File How to Indent Multi Line Messages How to Enable Asynchronous Logging Application State log4j Default Configuration File Foundation Structured Logging Introduction What is Structured Logging? Implementation In Depth Implementation How to use Foundation Logging Markers Human readable logs UHE Developers Notes Q&A

About

The Foundation Logging API is an extension of the standard log4j library exposed through SLF4J API. Besides complementing some core log4j features (e.g. size based log file rolling), it also introduces Structured Logging in support of log based analytics use cases.

Scope

The Foundation Logging should be used in ALL Foundation java components.

Contact

Yair Ogen

Issue tracking

https://github.com/foundation-runtime/logging/issues Github Issues

Maven Info

<syntaxhighlight lang="xml"> &lt;groupid&gt;com.cisco.oss.foundation&lt;/groupid&gt; &lt;artifcatid&gt;logging&#45;api&lt;/artifcatid&gt; &lt;version&gt;Latest Version&lt;/version&gt; &lt;groupid&gt;com.cisco.oss.foundation&lt;/groupid&gt; &lt;artifcatid&gt;logging&#45;log4j&lt;/artifcatid&gt; &lt;version&gt;Latest Version&lt;/version&gt;&lt;/pre&gt; </syntaxhighlight>>

Releases

All releases are available in public maven repo.

Features and Design

Following is a high level capture of the overall design of Foundation Logging:

~~ATTACHED_IMAGE~~VCSF Logging Design.jpg

• Users are expected to use the SLF4J API
• Below that you can (optionally) use the Markers for Structured Logging (see below more info)
• Foundation logging adds a binding (on logging-log4j lib) between SLF4J and log4j
• Log4j Implementation allows the following main features:
  • Support writing to a log file (or any other output) asynchronously.
  • Verify all logs are in UTC timezone. This improves greatly the ability to compare logs from different nodes from (possibly) different sites.
  • Use common Log Patterns - I.e. the time-stamp format, logger name, thread name etc.
  • Add support for Archiving
  • Allow rolling to a new file every time your process is restarted.
  • Allow rolling to a new file based on a specific time of day (e.g. Midnight).
  • Allow rolling to a new file based on file size OR based on History (i.e. every 5 days - regardless of file size).

User Guide

Following is a simple, developer oriented, user guide on how to use Foundation Logging.

Configuring Log4j

As we currently only support log4j, you must add the log4j configuration file to your classpath. Following are some tips and tricks on how to tweak the logging library to your needs..

Enable Foundation Logging

In order to enable Foundation Logging you need to add this row in your config file:

<syntaxhighlight lang="ini"> log4j.loggerFactory=com.cisco.oss.foundation.logging.FoundationLogFactory &lt;/syntaxhighligt&gt;</syntaxhighlight>

Enable Logging Pattern

In order to use the Foundation Logging logging pattern as detailed in the requirements, you need to use the "LogFileAppender" appender for logfile. This appender is tailored specific to meet the different requirements of foundation logging (utc log, common pattern, archiving to name a few) with nearly zero configuration needed.

There are some parameters that have default values passed to these appenders but they can all be overridden in the config file.

Mandatory parameter in the config file is:

file - file name including path of the base file.

Sample of minimum appender definition:

<syntaxhighlight lang="ini"> log4j.appender.logfile=com.cisco.oss.foundation.logging.appender.LogFileAppender log4j.appender.logfile.file=./log/stat_rolling.log </syntaxhighlight>

Optional parameters in the config file are:

• DatePattern - the date pattern that will appear in the log file name after rolling the file.
• MaxFileSize - the size of the file that when reached will cause file rolling.
• MaxRollFileCount - the maximum number of rolling files to be create. It is highly recommended to use default values here as wrong values may cause data loss.

Override this property only if you want to omit part of the Foundation Logging default parts. Note that is not recommended. For an explanation about the pattern different parts please see the requirements document.

Sample of full appender definition:

<syntaxhighlight lang="ini"> log4j.appender.logfile=com.cisco.oss.foundation.logging.appender.LogFileAppender log4j.appender.logfile.file=./log/stat_rolling.log log4j.appender.logfile.DatePattern=.yyyy-MM-dd log4j.appender.logfile.MaxFileSize=100MB log4j.appender.logfile.MaxRollFileCount=100 </syntaxhighlight>

Conversion Pattern

The LogFileAppender automatically sets the ConversionPattern:

In LogFileAppender the pattern is:

<syntaxhighlight lang="ini"> %d{yyyy/MM/dd HH:mm:ss.SSS}{UTC} [%c{1}] [%t]: %audit %p: %X{flowCtxt} %sl %errorcode %throwable{full} %n. </syntaxhighlight>

Changing ConversionPattern

Example of changing LogFile ConversionPattern:

log4j.appender.logfile=com.cisco.oss.foundation.logging.appender.FoundationFileRollingAppender
log4j.appender.logfile.file=./log/stat_rolling.log
log4j.appender.logfile.layout=com.cisco.oss.foundation.logging.FoundationLoggingPatternLayout
log4j.appender.logfile.layout.ConversionPattern=%d{yyyy/MM/dd HH:mm:ss.SSS}{UTC} [%c{1}] [%t]: %p: %X{flowCtxt} %m%n

Turn Off Archiving Support

By default the Foundation Loggger supports archiving of files after they are rolled. The default is to archive where a zip file is created in Windows OS and a gzip file is created in Linux or HP-UX. You can override this by adding the following property to the log4j.properties file:

FoundationLogger.archiveFiles=false

Configure Reload Period

By default the Foundation Loggger will reload the properties if a change to configuration file was done - every 10 seconds. You can override this by adding the following property to the log4j.properties file:

FoundationLogger.fileReloadDelay=60000 // value is in milliseconds

Configure Roll on Startup

By default each time you start your program a rolling will occur and the existing file will be rolled over and a new empty file will be created. In order to disable this feature you can into your log4j.properties the following:

FoundationLogger.rollOnStartup=false

Configure Max File Rolling Size

By default Foundation logging sets rolling to be a maximum of 100mb. You can override this on any specific file appender instance like this:

log4j.appender.logfile.MaxFileSize=100MB

Configure Max File Rolling Count

By default Foundation logging sets number of rolling files to 100 files. this is to reduce the possibility of loosing logs dues to rolling. You can override this on any specific file appender instance like this:

log4j.appender.logfile.MaxRollFileCount=100

Keeping Files According to their Age

There is an option to keep files according to their age instead of keeping a given number of files.

To apply this:

#The number of days it keeps files can also be configured. By default maxFileAge=7.
log4j.appender.logfile.MaxFileAge=10

Control Exception Handling

Use the new pattern layout (instead if the EnhancedPatternLayout):

com.cisco.oss.foundation.logging.FoundationLoggingPatternLayout

To enable new pattern features:

• %throwable{none} - remove any exception logging when using the log4j API that received Throwable in it's method signature.
• %throwable{short} - Display only short abbreviation of the exception stack trace. I.e. "Cause by: <exception></exception> <exception></exception>" - repeasred for exception in the trace.
• %throwable{full} - Display full exception stack trace.
• %errorcode - Display the error code in case throwable is of type: Application Exception. See Application Exception ({color:red}TODO:Add link{color})

How to Write to More than One File

If you want to write to more than one file, you need to add another appender and point to that new appender from one or more loggers:

&#35&#59; &quot&#59;logfile&quot&#59; is just a suggested name, you can rename as needed.
&#35&#59; of course you can add as many as file appenders you may need

log4j.appender.logfile&#61&#59;com.cisco.oss.foundation.logging.appender.LogFileAppender
&#35&#59; the file is a sample and of course could be any name you want.
log4j.appender.logfile.file&#61&#59;./log/stat_rolling.log


&#35&#59; &quot&#59;logfile2&quot&#59; is just a suggested name, you can rename as needed.
&#35&#59; This is an example of adding a new appender

&#35&#59;log4j.appender.logfile2&#61&#59;com.cisco.oss.foundation.logging.appender.LogFileAppender
&#35&#59; the file is a sample and of course could be any name you want.
&#35&#59;log4j.appender.logfile2.file&#61&#59;./log/stat_rolling2.log

How to Indent Multi Line Messages

If you have in your messages more than one line (e.g. you use 'n'), you can format them so they all start aligned and start on the same position.

To enable this, we now support using "%slpretty" in the conversion pattern instead of "%sl" (in the past we used %pm for pretty messagem, and %m for regular message - which still works but does not support StrecturedLogging).

INFO: Note

Example of use:

log4j.appender.logfile.layout.ConversionPattern&amp&#59;&#35&#59;61&#59&#59;%d&amp&#59;&#35&#59;91&#59&#59;yyyy/MM/dd HH&amp&#59;&#35&#59;58&#59&#59;mm&amp&#59;&#35&#59;58&#59&#59;ss.SSS&amp&#59;&#35&#59;93&#59&#59;&amp&#59;&#35&#59;91&#59&#59;UTC&amp&#59;&#35&#59;93&#59&#59; %p&amp&#59;&#35&#59;58&#59&#59; %sl&amp&#59;&#35&#59;91&#59&#59;pretty&amp&#59;&#35&#59;93&#59&#59; %n

How to Enable Asynchronous Logging

It is quite common that logging every request can have a performance burden - for high load components this can be a problem. When using Asynchronous logging, the logging thread does not do the brunt of the logging work itself, instead it is delegated to a different thread to complete, without blocking the main application sequence.

To enable Asynchronous logging you need to add a new parameter in the log4j.properties file that will point to the appenders you wish to wrap with Asynchronous calls. The way it works is that you define appenders as you are used to and you can wrap any one of them Asynchronously.

Usage example (The square braces are a must and are NOT place holders):

FoundationLogger.asyncAppenderReferences&amp&#59;&#35&#59;61&#59&#59;&amp&#59;&#35&#59;91&#59&#59;rollingfile&amp&#59;&#35&#59;93&#59&#59;

INFO: Note

Application State

In order to meet the requirement of "enabling persistent data" which is to print some logs at the beginning of each file - please use the ApplicationState class. See java doc for info on the API.

log4j Default Configuration File

Following is the Foundation headend default log4j.properties configuration file. As a rule this sample should be used as is (except for changes to log file names as appropriate).

&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;
&amp&#59;&#35&#59;35&#59&#59;NDS &amp&#59;&#35&#59;45&#59&#59; functionality &amp&#59;&#35&#59;45&#59&#59; specific logger section&amp&#59;&#35&#59;58&#59&#59;
&amp&#59;&#35&#59;35&#59&#59;By default NDS functionality specific logging should occur from the &amp&#59;quot&#59&#59;info&amp&#59;quot&#59&#59; level.
&amp&#59;&#35&#59;35&#59&#59;For more detailed logging &amp&#59;&#35&#59;39&#59&#59;log4j.logger.com.nds&amp&#59;&#35&#59;39&#59&#59; can be assigned &amp&#59;quot&#59&#59;debug&amp&#59;quot&#59&#59; or &amp&#59;quot&#59&#59;trace&amp&#59;quot&#59&#59;

log4j.logger.com.nds&amp&#59;&#35&#59;61&#59&#59;info

&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;
&amp&#59;&#35&#59;35&#59&#59;Handle noisy third party software modules&amp&#59;&#35&#59;58&#59&#59;
&amp&#59;&#35&#59;35&#59&#59;Although root logger has a level of &amp&#59;quot&#59&#59;error&amp&#59;quot&#59&#59; by default, the following lines
&amp&#59;&#35&#59;35&#59&#59;guarantee that even if this level is changed, a few very noisy internal libraries
&amp&#59;&#35&#59;35&#59&#59;will remain quiet.

&amp&#59;&#35&#59;35&#59&#59;communication utils
log4j.logger.com.nds.ch.utils.tsocket&amp&#59;&#35&#59;61&#59&#59;error

&amp&#59;&#35&#59;35&#59&#59;spring logs
log4j.logger.org.springframework&amp&#59;&#35&#59;61&#59&#59;error

&amp&#59;&#35&#59;35&#59&#59;connection pool component
log4j.logger.com.mchange&amp&#59;&#35&#59;61&#59&#59;error


&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;
&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;39&#59&#59;logfile&amp&#59;&#35&#59;39&#59&#59; appender settings&amp&#59;&#35&#59;58&#59&#59;
&amp&#59;&#35&#59;35&#59&#59;The logfile appender is of type &amp&#59;&#35&#59;39&#59&#59;LogFileAppender&amp&#59;&#35&#59;39&#59&#59; which is automatically d
&amp&#59;&#35&#59;35&#59&#59;with the UHE standard layout for log files.
&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;39&#59&#59;log4j.appender.logfile.file&amp&#59;&#35&#59;39&#59&#59; defines the log file path, which should
&amp&#59;&#35&#59;35&#59&#59; be&amp&#59;&#35&#59;58&#59&#59;/var/log/cisco/&amp&#59;lt&#59&#59;appname&amp&#59;gt&#59&#59;/&amp&#59;lt&#59&#59;appname&amp&#59;gt&#59&#59;.log (make sure that &amp&#59;quot&#59&#59;appname&amp&#59;quot&#59&#59; is instantiated
&amp&#59;&#35&#59;35&#59&#59; as appropriate).

log4j.appender.logfile&amp&#59;&#35&#59;61&#59&#59;com.cisco.oss.foundation.logging.appender.LogFileAppender
log4j.appender.logfile.file&amp&#59;&#35&#59;61&#59&#59;/var/log/cisco/&amp&#59;lt&#59&#59;appname&amp&#59;gt&#59&#59;/&amp&#59;lt&#59&#59;appname&amp&#59;gt&#59&#59;.log


&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;&amp&#59;&#35&#59;35&#59&#59;
&amp&#59;&#35&#59;35&#59&#59; Additional logging settings&amp&#59;&#35&#59;58&#59&#59;
&amp&#59;&#35&#59;35&#59&#59; By default should be commented out, and appear as place holders.

&amp&#59;&#35&#59;35&#59&#59; default set to true &amp&#59;&#35&#59;45&#59&#59; archiving enabled
&amp&#59;&#35&#59;35&#59&#59;FoundationLogger.archiveFiles&amp&#59;&#35&#59;61&#59&#59;false

&amp&#59;&#35&#59;35&#59&#59;default set to true &amp&#59;&#35&#59;45&#59&#59; log is rolled after restart of process.
&amp&#59;&#35&#59;35&#59&#59;(Use ‘tail –F’ and not ‘tail –f’ to get tail to show the new file after rollover.)
&amp&#59;&#35&#59;35&#59&#59;FoundationLogger.rollOnStartup&amp&#59;&#35&#59;61&#59&#59;false

INFO: Note

Foundation Structured Logging

Introduction

What is Structured Logging?

To understand the notion of "structured" logging, it's useful to consider the current situation. Take a look at this snippet.

int transactionId &amp&#59;&#35&#59;61&#59&#59; 6492&amp&#59;&#35&#59;59&#59&#59;
String actionType &amp&#59;&#35&#59;61&#59&#59; &amp&#59;quot&#59&#59;CreateHousehold&amp&#59;quot&#59&#59;&amp&#59;&#35&#59;59&#59&#59;
String householdType &amp&#59;&#35&#59;61&#59&#59; &amp&#59;quot&#59&#59;Multi&amp&#59;quot&#59&#59;&amp&#59;&#35&#59;59&#59&#59;
int deviceCount &amp&#59;&#35&#59;61&#59&#59; 10&amp&#59;&#35&#59;59&#59&#59;

logger.Log( "Transaction " + transactionId + " of type " + actionType + "( " + householdType + ") " + " was received for creation of " + deviceCount + " devices");

What is happening here? A component is logging information about a request to create a certain type of household. So far so good. Except that once in the log file, all the data points themselves - transactionId, actionType, householdType and deviceCount have essentially been "deconstructed" into a string. To reestablish these values - let's say for the purpose of BI analysis or log file playback, a process of parsing will be necessary. Parsing is expensive (developer time) and error prone.

At the conceptual level there is a flaw here. The component 'knows' the values for transactionId, actionType, householdType and deviceCount, but it actively deconstructs them in the logging method, for lack of a better option.

Structured Logging is that better option. It will allow component developers to use a standard based mechanism to log messages, without having to deconstruct the data points in the process. Consider the following pseudo code:

logger.info( new HouseHouseholdTransaction( 6492,&amp&#59;quot&#59&#59;CreateHousehold&amp&#59;quot&#59&#59;, &amp&#59;quot&#59&#59;Multi&amp&#59;quot&#59&#59;, 10),&amp&#59;quot&#59&#59;&amp&#59;quot&#59&#59;)&amp&#59;&#35&#59;59&#59&#59;

A configuration/resource file could define a pattern for the human readable log file, something like:

messagetype.HouseHouseholdTransaction.format &amp&#59;&#35&#59;61&#59&#59; &amp&#59;quot&#59&#59;Transaction $transactionId of type $actionType ( $householdType ) was received for creation of $deviceCount $devices&amp&#59;quot&#59&#59;

Because the data points of HouseHouseholdTransaction are available to Foundation Logging infrastructure, it’s now possible to implement additional appenders that can work with ‘ HouseHouseholdTransaction ’ directly and do all types of interesting things in the area of playback and BI.

In summary, 'Structured Logging' is a mechanism, based on standard logging API, to allow components to maintain a log message's data points in structured fashion, to provide visibility and control for logging to human readable files, BI data files or playback files.

Implementation

The current implementation is based on the popular http://www.slf4j.org/ slf4j library. Slf4j allows users to code their logging against a common API which can in turn be pointed to a large variety of implementations (log4j, java util logging, commons-logging to name a few).

One of the basic concepts in slf4j is the notion of a http://slf4j.org/api/org/slf4j/Marker.html Marker.

Markers allow us to enable users to log their logs, that are targeted to an external consumer (as mentioned above), using markers themselves to enrich the log event with log event specific data which is not part of the regular log message or payload (e.g. source host in case of remote request handler or correlation id etc.).

In Depth Implementation

This section describes the solution in depth and will answer some commonly asked questions.

To use the Marker API you will have to use the slf4j API. Regardless, we expect users to use the fl4j API which will enable switch to another slf4j binding seamlessly to the applicative code.

INFO: Note

How to use Foundation Logging Markers

When using Foundation Logging Markers to log transaction activity, you should always use the same Marker type for all steps in the transaction. Thus, the Marker type should have some type of 'state' field that describes the current transaction phage (examples: START, SUCCESS, FAILURE). As per explanation below, it's possible to define multiple human readable output formats for the same Marker, depending on its state.

WARNING: Warning

Human readable logs

If you use a Logger and pass in a Marker and you want the output in a human readable format, you should follow the following guidelines.

First and foremost First and foremost - your marker should extend AbstractFoundationLoggingMarker.

User Field Annotation Any field you want to expose and use in an external pattern should be annotated using @UserField.

The UserField annotation can, optionally, be set with 2 attributes:

*suppressNull - set to true if you wish a field to be omitted when its value is not set. default is false meaning if a field in the marker is not filled, a "null" string will be used. *description - for future use, you may add description of this field.

Marker fields annotated by @UserField are accesible from the pattern layout by using the %u{fieldName} syntax.

For example:

My default format for %u&amp&#59;&#35&#59;123&#59&#59;sourceId&amp&#59;&#35&#59;125&#59&#59; and %u&amp&#59;&#35&#59;123&#59&#59;sourceType&amp&#59;&#35&#59;125&#59&#59;

In the above example, in runtime, the actual values of "sourceId" and "sourceType" fields will be inserted in their designated place holders.

Defining Layout Annotations

The recommended way to define Human Readable Layout formats is by using the following annotations:

• @DefaultFormat - This is a must in any Marker. You specify here the default human readable format of this Marker. See example below.
• @ConditionalFormats - Optionally You can define a list of @ConditionalFormat under a single @ConditionalFormats annotation. Each @ConditionalFormat contains a format String and a list of @FieldCriterion annotations. Each @FieldCriterion contains a name and a value.

How Does It Work Upon Component start-up, Foundation Logging scans the classpath and finds all markers that have the above annotations. Once found, these annotations are parse ONCE per marker class and a formatter class is generated in Runtime. This class contains the logic on which format is to be used cased on the marker state.

The logic of the annotations is as follows: Between @FieldCriterion there is an AND relationship. Between the @ConditionalFormat annotations there is a OR relationship. you can see the generated class source in the log file if you turn on TRACE level debug on the "log4j.logger.com.cisco.oss.foudnation.logging" logger in your log4j.properties.

WARNING: Warning

Marker Example

@ConditionalFormats(&amp&#59;&#35&#59;123&#59&#59;

@ConditionalFormat(	format&amp&#59;&#35&#59;61&#59&#59;TransactionMarker.COND_FORMAT_1,
criteria&amp&#59;&#35&#59;61&#59&#59;&amp&#59;&#35&#59;123&#59&#59;
@FieldCriterion(name&amp&#59;&#35&#59;61&#59&#59;&amp&#59;quot&#59&#59;sourceId&amp&#59;quot&#59&#59;, value&amp&#59;&#35&#59;61&#59&#59;&amp&#59;quot&#59&#59;sourceId1&amp&#59;quot&#59&#59;),
@FieldCriterion(name&amp&#59;&#35&#59;61&#59&#59;&amp&#59;quot&#59&#59;sourceType&amp&#59;quot&#59&#59;, value&amp&#59;&#35&#59;61&#59&#59;&amp&#59;quot&#59&#59;sourceType1&amp&#59;quot&#59&#59;)&amp&#59;&#35&#59;125&#59&#59;),
@ConditionalFormat(	format&amp&#59;&#35&#59;61&#59&#59;TransactionMarker.COND_FORMAT_2,
criteria&amp&#59;&#35&#59;61&#59&#59;&amp&#59;&#35&#59;123&#59&#59;
@FieldCriterion(name&amp&#59;&#35&#59;61&#59&#59;&amp&#59;quot&#59&#59;sourceId&amp&#59;quot&#59&#59;, value&amp&#59;&#35&#59;61&#59&#59;&amp&#59;quot&#59&#59;sourceId2&amp&#59;quot&#59&#59;),
@FieldCriterion(name&amp&#59;&#35&#59;61&#59&#59;&amp&#59;quot&#59&#59;sourceType&amp&#59;quot&#59&#59;, value&amp&#59;&#35&#59;61&#59&#59;&amp&#59;quot&#59&#59;sourceType2&amp&#59;quot&#59&#59;)
&amp&#59;&#35&#59;125&#59&#59;
),
@ConditionalFormat(	format&amp&#59;&#35&#59;61&#59&#59;TransactionMarker.COND_FORMAT_3,
criteria&amp&#59;&#35&#59;61&#59&#59;&amp&#59;&#35&#59;123&#59&#59;
@FieldCriterion(name&amp&#59;&#35&#59;61&#59&#59;&amp&#59;quot&#59&#59;sourceId&amp&#59;quot&#59&#59;, value&amp&#59;&#35&#59;61&#59&#59;&amp&#59;quot&#59&#59;sourceId3&amp&#59;quot&#59&#59;),
@FieldCriterion(name&amp&#59;&#35&#59;61&#59&#59;&amp&#59;quot&#59&#59;sourceType&amp&#59;quot&#59&#59;, value&amp&#59;&#35&#59;61&#59&#59;&amp&#59;quot&#59&#59;sourceType3&amp&#59;quot&#59&#59;)
&amp&#59;&#35&#59;125&#59&#59;
)
&amp&#59;&#35&#59;125&#59&#59;)

public class TransactionMarker extends BaseTransactionLoggingMarker &amp&#59;&#35&#59;123&#59&#59;

Logger LOGGER &amp&#59;&#35&#59;61&#59&#59; LoggerFactory.getLogger(TransactionMarker.class)&amp&#59;&#35&#59;59&#59&#59;

private static final long serialVersionUID &amp&#59;&#35&#59;61&#59&#59; 9161271890930513129L&amp&#59;&#35&#59;59&#59&#59;

public static final String DEFAULT_FORMAT &amp&#59;&#35&#59;61&#59&#59; &amp&#59;quot&#59&#59;my default uncoditioned format&amp&#59;&#35&#59;33&#59&#59;&amp&#59;&#35&#59;33&#59&#59;&amp&#59;&#35&#59;33&#59&#59;&amp&#59;quot&#59&#59;&amp&#59;&#35&#59;59&#59&#59;
public static final String COND_FORMAT_1 &amp&#59;&#35&#59;61&#59&#59; &amp&#59;quot&#59&#59;my human readbale format 1&amp&#59;quot&#59&#59;&amp&#59;&#35&#59;59&#59&#59;
public static final String COND_FORMAT_2 &amp&#59;&#35&#59;61&#59&#59; &amp&#59;quot&#59&#59;my human readbale format 2&amp&#59;quot&#59&#59;&amp&#59;&#35&#59;59&#59&#59;
public static final String COND_FORMAT_3 &amp&#59;&#35&#59;61&#59&#59; &amp&#59;quot&#59&#59;my human readbale format 3&amp&#59;quot&#59&#59;&amp&#59;&#35&#59;59&#59&#59;


public TransactionMarker(String sessionId) &amp&#59;&#35&#59;123&#59&#59;
this.sessionId &amp&#59;&#35&#59;61&#59&#59; sessionId&amp&#59;&#35&#59;59&#59&#59;
&amp&#59;&#35&#59;125&#59&#59;

@UserField(suppressNull &amp&#59;&#35&#59;61&#59&#59; true)
private FoundationLoggingEventType eventType&amp&#59;&#35&#59;59&#59&#59;
@UserField
private FoundationLoggingTransMsgType transMsgType&amp&#59;&#35&#59;59&#59&#59;
@UserField
private String sessionId&amp&#59;&#35&#59;59&#59&#59;
@UserField
private String sourceId&amp&#59;&#35&#59;59&#59&#59;
@UserField
private String sourceType&amp&#59;&#35&#59;59&#59&#59;
@UserField
private String destinationId&amp&#59;&#35&#59;59&#59&#59;
@UserField
private String destinationType&amp&#59;&#35&#59;59&#59&#59;
@UserField
private String messagePayload&amp&#59;&#35&#59;59&#59&#59;


public TransactionMarker setEventType(FoundationLoggingEventType eventType) &amp&#59;&#35&#59;123&#59&#59;
this.eventType &amp&#59;&#35&#59;61&#59&#59; eventType&amp&#59;&#35&#59;59&#59&#59;
return this&amp&#59;&#35&#59;59&#59&#59;
&amp&#59;&#35&#59;125&#59&#59;
public TransactionMarker setTransMsgType(FoundationLoggingTransMsgType transMsgType) &amp&#59;&#35&#59;123&#59&#59;
this.transMsgType &amp&#59;&#35&#59;61&#59&#59; transMsgType&amp&#59;&#35&#59;59&#59&#59;
return this&amp&#59;&#35&#59;59&#59&#59;
&amp&#59;&#35&#59;125&#59&#59;
public TransactionMarker setSessionId(String sessionId) &amp&#59;&#35&#59;123&#59&#59;
this.sessionId &amp&#59;&#35&#59;61&#59&#59; sessionId&amp&#59;&#35&#59;59&#59&#59;
return this&amp&#59;&#35&#59;59&#59&#59;
&amp&#59;&#35&#59;125&#59&#59;
public TransactionMarker setSourceId(String sourceId) &amp&#59;&#35&#59;123&#59&#59;
this.sourceId &amp&#59;&#35&#59;61&#59&#59; sourceId&amp&#59;&#35&#59;59&#59&#59;
return this&amp&#59;&#35&#59;59&#59&#59;
&amp&#59;&#35&#59;125&#59&#59;
public TransactionMarker setSourceType(String sourceType) &amp&#59;&#35&#59;123&#59&#59;
this.sourceType &amp&#59;&#35&#59;61&#59&#59; sourceType&amp&#59;&#35&#59;59&#59&#59;
return this&amp&#59;&#35&#59;59&#59&#59;
&amp&#59;&#35&#59;125&#59&#59;
public TransactionMarker setDestinationId(String destinationId) &amp&#59;&#35&#59;123&#59&#59;
this.destinationId &amp&#59;&#35&#59;61&#59&#59; destinationId&amp&#59;&#35&#59;59&#59&#59;
return this&amp&#59;&#35&#59;59&#59&#59;
&amp&#59;&#35&#59;125&#59&#59;
public TransactionMarker setDestinationType(String destinationType) &amp&#59;&#35&#59;123&#59&#59;
this.destinationType &amp&#59;&#35&#59;61&#59&#59; destinationType&amp&#59;&#35&#59;59&#59&#59;
return this&amp&#59;&#35&#59;59&#59&#59;
&amp&#59;&#35&#59;125&#59&#59;
public TransactionMarker setMessagePayload(String messagePayload) &amp&#59;&#35&#59;123&#59&#59;
this.messagePayload &amp&#59;&#35&#59;61&#59&#59; messagePayload&amp&#59;&#35&#59;59&#59&#59;
return this&amp&#59;&#35&#59;59&#59&#59;
&amp&#59;&#35&#59;125&#59&#59;

public static long getSerialversionuid() &amp&#59;&#35&#59;123&#59&#59;
return serialVersionUID&amp&#59;&#35&#59;59&#59&#59;
&amp&#59;&#35&#59;125&#59&#59;
public static String getDefaultFormat() &amp&#59;&#35&#59;123&#59&#59;
return DEFAULT_FORMAT&amp&#59;&#35&#59;59&#59&#59;
&amp&#59;&#35&#59;125&#59&#59;
public static String getCondFormat1() &amp&#59;&#35&#59;123&#59&#59;
return COND_FORMAT_1&amp&#59;&#35&#59;59&#59&#59;
&amp&#59;&#35&#59;125&#59&#59;
public static String getCondFormat2() &amp&#59;&#35&#59;123&#59&#59;
return COND_FORMAT_2&amp&#59;&#35&#59;59&#59&#59;
&amp&#59;&#35&#59;125&#59&#59;
public static String getCondFormat3() &amp&#59;&#35&#59;123&#59&#59;
return COND_FORMAT_3&amp&#59;&#35&#59;59&#59&#59;
&amp&#59;&#35&#59;125&#59&#59;
public FoundationLoggingEventType getEventType() &amp&#59;&#35&#59;123&#59&#59;
return eventType&amp&#59;&#35&#59;59&#59&#59;
&amp&#59;&#35&#59;125&#59&#59;
public FoundationLoggingTransMsgType getTransMsgType() &amp&#59;&#35&#59;123&#59&#59;
return transMsgType&amp&#59;&#35&#59;59&#59&#59;
&amp&#59;&#35&#59;125&#59&#59;
public String getSessionId() &amp&#59;&#35&#59;123&#59&#59;
return sessionId&amp&#59;&#35&#59;59&#59&#59;
&amp&#59;&#35&#59;125&#59&#59;
public String getSourceId() &amp&#59;&#35&#59;123&#59&#59;
return sourceId&amp&#59;&#35&#59;59&#59&#59;
&amp&#59;&#35&#59;125&#59&#59;
public String getSourceType() &amp&#59;&#35&#59;123&#59&#59;
return sourceType&amp&#59;&#35&#59;59&#59&#59;
&amp&#59;&#35&#59;125&#59&#59;
public String getDestinationId() &amp&#59;&#35&#59;123&#59&#59;
return destinationId&amp&#59;&#35&#59;59&#59&#59;
&amp&#59;&#35&#59;125&#59&#59;
public String getDestinationType() &amp&#59;&#35&#59;123&#59&#59;
return destinationType&amp&#59;&#35&#59;59&#59&#59;
&amp&#59;&#35&#59;125&#59&#59;
public String getMessagePayload() &amp&#59;&#35&#59;123&#59&#59;
return messagePayload&amp&#59;&#35&#59;59&#59&#59;
&amp&#59;&#35&#59;125&#59&#59;

&amp&#59;&#35&#59;125&#59&#59;

In the above example the generated formatter class will check if getSourceId() is equal to "sourceId1" AND getSourceType() is equal to "sourceType1" - if yes - COND_FORMAT_1 will be used.

If NOT, formatter class will check if getSourceId() is equal to "sourceId2" AND getSourceType() is equal to "sourceType2" - if yes - COND_FORMAT_2 will be used.

If NOT, formatter class will check if getSourceId() is equal to "sourceId3" AND getSourceType() is equal to "sourceType3" - if yes - COND_FORMAT_3 will be used.

If NOT - DEFAULT_FORMAT will be used.

Defining Layout Overrides Via External XML Foundation Logging, when started, will search the class path for a file named: "messageFormat.xml". This is an optional file that allows users to alter the format strings returned by the annotations and even change the conditions internal logic.

The schema file for this xml is located http://ch-infra.il.nds.com/cabResources/messageFormat.xsd here

The xml file has an a advantage over the annotations that it supports different formats for different appenders.

Here is an XML example. Note that the minimum required elements and attributes are:

• One "defaultAppender" element (not more than one). Minimal attribute is:
  • defaultFormat - - the default format of this marker for the default appender - i.e. any appender used that isn't detailed in an "appender" element below.
• Zero or more "appender" elements. Minimal attributes per appender element are:
  • id - the fully qualified marker class name
  • defaultFormat - the default format of this marker.

All other elements and attributes are optional and follow the same logic described above for the annotations.

&amp&#59;lt&#59&#59;appender id&amp&#59;&#35&#59;61&#59&#59;&amp&#59;quot&#59&#59;anotherfile&amp&#59;quot&#59&#59; defaultFormat&amp&#59;&#35&#59;61&#59&#59;&amp&#59;quot&#59&#59;My default format for %u&amp&#59;&#35&#59;123&#59&#59;sourceId&amp&#59;&#35&#59;125&#59&#59; and %u&amp&#59;&#35&#59;123&#59&#59;sourceType&amp&#59;&#35&#59;125&#59&#59; and %u&amp&#59;&#35&#59;123&#59&#59;base&amp&#59;&#35&#59;125&#59&#59;&amp&#59;quot&#59&#59;&amp&#59;gt&#59&#59;
&amp&#59;lt&#59&#59;criteria&amp&#59;gt&#59&#59;
&amp&#59;lt&#59&#59;criterion format&amp&#59;&#35&#59;61&#59&#59;&amp&#59;quot&#59&#59;my conditional format 1 from xml &amp&#59;&#35&#59;45&#59&#59; something else&amp&#59;quot&#59&#59;&amp&#59;gt&#59&#59;
&amp&#59;lt&#59&#59;field name&amp&#59;&#35&#59;61&#59&#59;&amp&#59;quot&#59&#59;sourceId&amp&#59;quot&#59&#59; equals&amp&#59;&#35&#59;61&#59&#59;&amp&#59;quot&#59&#59;sourceId1&amp&#59;quot&#59&#59; /&amp&#59;gt&#59&#59;
&amp&#59;lt&#59&#59;field name&amp&#59;&#35&#59;61&#59&#59;&amp&#59;quot&#59&#59;sourceType&amp&#59;quot&#59&#59; equals&amp&#59;&#35&#59;61&#59&#59;&amp&#59;quot&#59&#59;sourceType1&amp&#59;quot&#59&#59; /&amp&#59;gt&#59&#59;
&amp&#59;lt&#59&#59;/criterion&amp&#59;gt&#59&#59;
&amp&#59;lt&#59&#59;/criteria&amp&#59;gt&#59&#59;
&amp&#59;lt&#59&#59;/appender&amp&#59;gt&#59&#59;

&amp&#59;lt&#59&#59;appender id&amp&#59;&#35&#59;61&#59&#59;&amp&#59;quot&#59&#59;biFile&amp&#59;quot&#59&#59; defaultFormat&amp&#59;&#35&#59;61&#59&#59;&amp&#59;quot&#59&#59;My default format for %u&amp&#59;&#35&#59;123&#59&#59;sourceId&amp&#59;&#35&#59;125&#59&#59; and %u&amp&#59;&#35&#59;123&#59&#59;sourceType&amp&#59;&#35&#59;125&#59&#59;&amp&#59;quot&#59&#59; /&amp&#59;gt&#59&#59;

&amp&#59;lt&#59&#59;/marker&amp&#59;gt&#59&#59;

&amp&#59;lt&#59&#59;marker id&amp&#59;&#35&#59;61&#59&#59;&amp&#59;quot&#59&#59;TransactionMarker3&amp&#59;quot&#59&#59;&amp&#59;gt&#59&#59;
&amp&#59;lt&#59&#59;defaultAppender defaultFormat&amp&#59;&#35&#59;61&#59&#59;&amp&#59;quot&#59&#59;My default format for %u&amp&#59;&#35&#59;123&#59&#59;sourceId&amp&#59;&#35&#59;125&#59&#59; and %u&amp&#59;&#35&#59;123&#59&#59;sourceType&amp&#59;&#35&#59;125&#59&#59;&amp&#59;quot&#59&#59; /&amp&#59;gt&#59&#59;

&amp&#59;lt&#59&#59;appender id&amp&#59;&#35&#59;61&#59&#59;&amp&#59;quot&#59&#59;logfile&amp&#59;quot&#59&#59; defaultFormat&amp&#59;&#35&#59;61&#59&#59;&amp&#59;quot&#59&#59;My default format for %u&amp&#59;&#35&#59;123&#59&#59;sourceId&amp&#59;&#35&#59;125&#59&#59; and %u&amp&#59;&#35&#59;123&#59&#59;sourceType&amp&#59;&#35&#59;125&#59&#59;&amp&#59;quot&#59&#59;&amp&#59;gt&#59&#59;
&amp&#59;lt&#59&#59;criteria&amp&#59;gt&#59&#59;
&amp&#59;lt&#59&#59;criterion format&amp&#59;&#35&#59;61&#59&#59;&amp&#59;quot&#59&#59; my conditional format 1 from xml &amp&#59;quot&#59&#59;&amp&#59;gt&#59&#59;
&amp&#59;lt&#59&#59;field name&amp&#59;&#35&#59;61&#59&#59;&amp&#59;quot&#59&#59;sourceId&amp&#59;quot&#59&#59; equals&amp&#59;&#35&#59;61&#59&#59;&amp&#59;quot&#59&#59;sourceId1&amp&#59;quot&#59&#59; /&amp&#59;gt&#59&#59;
&amp&#59;lt&#59&#59;field name&amp&#59;&#35&#59;61&#59&#59;&amp&#59;quot&#59&#59;sourceType&amp&#59;quot&#59&#59; equals&amp&#59;&#35&#59;61&#59&#59;&amp&#59;quot&#59&#59;sourceType1&amp&#59;quot&#59&#59; /&amp&#59;gt&#59&#59;
&amp&#59;lt&#59&#59;/criterion&amp&#59;gt&#59&#59;
&amp&#59;lt&#59&#59;criterion format&amp&#59;&#35&#59;61&#59&#59;&amp&#59;quot&#59&#59;my conditional format 2 from xml&amp&#59;quot&#59&#59;&amp&#59;gt&#59&#59;
&amp&#59;lt&#59&#59;field name&amp&#59;&#35&#59;61&#59&#59;&amp&#59;quot&#59&#59;sourceId&amp&#59;quot&#59&#59; equals&amp&#59;&#35&#59;61&#59&#59;&amp&#59;quot&#59&#59;sourceId2&amp&#59;quot&#59&#59; /&amp&#59;gt&#59&#59;
&amp&#59;lt&#59&#59;field name&amp&#59;&#35&#59;61&#59&#59;&amp&#59;quot&#59&#59;sourceType&amp&#59;quot&#59&#59; equals&amp&#59;&#35&#59;61&#59&#59;&amp&#59;quot&#59&#59;sourceType2&amp&#59;quot&#59&#59; /&amp&#59;gt&#59&#59;
&amp&#59;lt&#59&#59;/criterion&amp&#59;gt&#59&#59;
&amp&#59;lt&#59&#59;/criteria&amp&#59;gt&#59&#59;
&amp&#59;lt&#59&#59;/appender&amp&#59;gt&#59&#59;

&amp&#59;lt&#59&#59;appender id&amp&#59;&#35&#59;61&#59&#59;&amp&#59;quot&#59&#59;anotherfile&amp&#59;quot&#59&#59; defaultFormat&amp&#59;&#35&#59;61&#59&#59;&amp&#59;quot&#59&#59;My default format for %u&amp&#59;&#35&#59;123&#59&#59;sourceId&amp&#59;&#35&#59;125&#59&#59; and %u&amp&#59;&#35&#59;123&#59&#59;sourceType&amp&#59;&#35&#59;125&#59&#59;&amp&#59;quot&#59&#59;&amp&#59;gt&#59&#59;
&amp&#59;lt&#59&#59;criteria&amp&#59;gt&#59&#59;
&amp&#59;lt&#59&#59;criterion format&amp&#59;&#35&#59;61&#59&#59;&amp&#59;quot&#59&#59;my conditional format 1 from xml&amp&#59;quot&#59&#59;&amp&#59;gt&#59&#59;
&amp&#59;lt&#59&#59;field name&amp&#59;&#35&#59;61&#59&#59;&amp&#59;quot&#59&#59;sourceId&amp&#59;quot&#59&#59; equals&amp&#59;&#35&#59;61&#59&#59;&amp&#59;quot&#59&#59;sourceId1&amp&#59;quot&#59&#59; /&amp&#59;gt&#59&#59;
&amp&#59;lt&#59&#59;field name&amp&#59;&#35&#59;61&#59&#59;&amp&#59;quot&#59&#59;sourceType&amp&#59;quot&#59&#59; equals&amp&#59;&#35&#59;61&#59&#59;&amp&#59;quot&#59&#59;sourceType1&amp&#59;quot&#59&#59; /&amp&#59;gt&#59&#59;
&amp&#59;lt&#59&#59;/criterion&amp&#59;gt&#59&#59;
&amp&#59;lt&#59&#59;/criteria&amp&#59;gt&#59&#59;
&amp&#59;lt&#59&#59;/appender&amp&#59;gt&#59&#59;

&amp&#59;lt&#59&#59;appender id&amp&#59;&#35&#59;61&#59&#59;&amp&#59;quot&#59&#59;biFile&amp&#59;quot&#59&#59; defaultFormat&amp&#59;&#35&#59;61&#59&#59;&amp&#59;quot&#59&#59;My default format for %u&amp&#59;&#35&#59;123&#59&#59;sourceId&amp&#59;&#35&#59;125&#59&#59; and %u&amp&#59;&#35&#59;123&#59&#59;sourceType&amp&#59;&#35&#59;125&#59&#59;&amp&#59;quot&#59&#59; /&amp&#59;gt&#59&#59;

&amp&#59;lt&#59&#59;/marker&amp&#59;gt&#59&#59;

&amp&#59;lt&#59&#59;marker id&amp&#59;&#35&#59;61&#59&#59;&amp&#59;quot&#59&#59;com.cisco.oss.foundation.logging.structured.test.TransactionMarker2&amp&#59;quot&#59&#59;&amp&#59;gt&#59&#59;
&amp&#59;lt&#59&#59;defaultAppender defaultFormat&amp&#59;&#35&#59;61&#59&#59;&amp&#59;quot&#59&#59;My default format for %u&amp&#59;&#35&#59;123&#59&#59;sourceId&amp&#59;&#35&#59;125&#59&#59; and %u&amp&#59;&#35&#59;123&#59&#59;sourceType&amp&#59;&#35&#59;125&#59&#59;&amp&#59;quot&#59&#59; /&amp&#59;gt&#59&#59;

&amp&#59;lt&#59&#59;appender id&amp&#59;&#35&#59;61&#59&#59;&amp&#59;quot&#59&#59;logfile&amp&#59;quot&#59&#59; defaultFormat&amp&#59;&#35&#59;61&#59&#59;&amp&#59;quot&#59&#59;My default format for %u&amp&#59;&#35&#59;123&#59&#59;sourceId&amp&#59;&#35&#59;125&#59&#59; and %u&amp&#59;&#35&#59;123&#59&#59;sourceType&amp&#59;&#35&#59;125&#59&#59;&amp&#59;quot&#59&#59;&amp&#59;gt&#59&#59;
&amp&#59;lt&#59&#59;criteria&amp&#59;gt&#59&#59;
&amp&#59;lt&#59&#59;criterion format&amp&#59;&#35&#59;61&#59&#59;&amp&#59;quot&#59&#59; my conditional format 1 from xml &amp&#59;quot&#59&#59;&amp&#59;gt&#59&#59;
&amp&#59;lt&#59&#59;field name&amp&#59;&#35&#59;61&#59&#59;&amp&#59;quot&#59&#59;sourceId&amp&#59;quot&#59&#59; equals&amp&#59;&#35&#59;61&#59&#59;&amp&#59;quot&#59&#59;sourceId1&amp&#59;quot&#59&#59; /&amp&#59;gt&#59&#59;
&amp&#59;lt&#59&#59;field name&amp&#59;&#35&#59;61&#59&#59;&amp&#59;quot&#59&#59;sourceType&amp&#59;quot&#59&#59; equals&amp&#59;&#35&#59;61&#59&#59;&amp&#59;quot&#59&#59;sourceType1&amp&#59;quot&#59&#59; /&amp&#59;gt&#59&#59;
&amp&#59;lt&#59&#59;/criterion&amp&#59;gt&#59&#59;
&amp&#59;lt&#59&#59;criterion format&amp&#59;&#35&#59;61&#59&#59;&amp&#59;quot&#59&#59;my conditional format 2 from xml&amp&#59;quot&#59&#59;&amp&#59;gt&#59&#59;
&amp&#59;lt&#59&#59;field name&amp&#59;&#35&#59;61&#59&#59;&amp&#59;quot&#59&#59;sourceId&amp&#59;quot&#59&#59; equals&amp&#59;&#35&#59;61&#59&#59;&amp&#59;quot&#59&#59;sourceId2&amp&#59;quot&#59&#59; /&amp&#59;gt&#59&#59;
&amp&#59;lt&#59&#59;field name&amp&#59;&#35&#59;61&#59&#59;&amp&#59;quot&#59&#59;sourceType&amp&#59;quot&#59&#59; equals&amp&#59;&#35&#59;61&#59&#59;&amp&#59;quot&#59&#59;sourceType2&amp&#59;quot&#59&#59; /&amp&#59;gt&#59&#59;
&amp&#59;lt&#59&#59;/criterion&amp&#59;gt&#59&#59;
&amp&#59;lt&#59&#59;/criteria&amp&#59;gt&#59&#59;
&amp&#59;lt&#59&#59;/appender&amp&#59;gt&#59&#59;

&amp&#59;lt&#59&#59;appender id&amp&#59;&#35&#59;61&#59&#59;&amp&#59;quot&#59&#59;anotherfile&amp&#59;quot&#59&#59; defaultFormat&amp&#59;&#35&#59;61&#59&#59;&amp&#59;quot&#59&#59;My default format for %u&amp&#59;&#35&#59;123&#59&#59;sourceId&amp&#59;&#35&#59;125&#59&#59; and %u&amp&#59;&#35&#59;123&#59&#59;sourceType&amp&#59;&#35&#59;125&#59&#59;&amp&#59;quot&#59&#59;&amp&#59;gt&#59&#59;
&amp&#59;lt&#59&#59;criteria&amp&#59;gt&#59&#59;
&amp&#59;lt&#59&#59;criterion format&amp&#59;&#35&#59;61&#59&#59;&amp&#59;quot&#59&#59;my conditional format 1 from xml&amp&#59;quot&#59&#59;&amp&#59;gt&#59&#59;
&amp&#59;lt&#59&#59;field name&amp&#59;&#35&#59;61&#59&#59;&amp&#59;quot&#59&#59;sourceId&amp&#59;quot&#59&#59; equals&amp&#59;&#35&#59;61&#59&#59;&amp&#59;quot&#59&#59;sourceId1&amp&#59;quot&#59&#59; /&amp&#59;gt&#59&#59;
&amp&#59;lt&#59&#59;field name&amp&#59;&#35&#59;61&#59&#59;&amp&#59;quot&#59&#59;sourceType&amp&#59;quot&#59&#59; equals&amp&#59;&#35&#59;61&#59&#59;&amp&#59;quot&#59&#59;sourceType1&amp&#59;quot&#59&#59; /&amp&#59;gt&#59&#59;
&amp&#59;lt&#59&#59;/criterion&amp&#59;gt&#59&#59;
&amp&#59;lt&#59&#59;/criteria&amp&#59;gt&#59&#59;
&amp&#59;lt&#59&#59;/appender&amp&#59;gt&#59&#59;

&amp&#59;lt&#59&#59;appender id&amp&#59;&#35&#59;61&#59&#59;&amp&#59;quot&#59&#59;biFile&amp&#59;quot&#59&#59; defaultFormat&amp&#59;&#35&#59;61&#59&#59;&amp&#59;quot&#59&#59;My default format for %u&amp&#59;&#35&#59;123&#59&#59;sourceId&amp&#59;&#35&#59;125&#59&#59; and %u&amp&#59;&#35&#59;123&#59&#59;sourceType&amp&#59;&#35&#59;125&#59&#59;&amp&#59;quot&#59&#59; /&amp&#59;gt&#59&#59;

&amp&#59;lt&#59&#59;/marker&amp&#59;gt&#59&#59;

&amp&#59;lt&#59&#59;/markers&amp&#59;gt&#59&#59;

UHE Developers Notes

The above guideline has omitted the log/audit guideline you may remember from Ex-NDS Wiki as it is currently under review.

Q&A

Q. When do files get “rolled”? -- e.g. when does one file close and a new one opens?

A. Either on midnight, OR when max file size is reached, OR when component is restarted.

Q. Where are the default parameters controlled?

A. They are hard coded inside Foundation logging library -- but can (optionally) be overridden in log4j.properties.

Q. Does archiving flag control when log files are rolled or deleted?

A. It only controls whether to archive a file once a new one was created. It by no means deleted files or does anything other than archive files.

Q. We’ve seen log messages get deleted when archiving is turned on. Why?

A. there was a bug prior to iteration 35 that rolling during archive caused messages to get lost. Post version 3.35.0-1 (inclusive) this is resolved.

Q. We’ve seen that upon rolling to a new file -- only last 10 files are kept. Is this expected?

A. There was a bug in Foundation logging that mandated override of MaxFileRollCount=100 to overcome this issue. As of version 3.35.0-1 -- this bug was resolved and you can safely rely on the defaults that come with the library itself.