Page Comparison

...

This section describes how to configure the Abiquo logs so that old webapp log files are periodically deleted. This will prevent problems due to lack of hard disk spacewebapp logs to reduce the size of these files and periodically delete old files. Customers must determine their own logging requirements and configure the webapp logs in their environment appropriately.

Log Files 

A current log is created for each webapp in the directory \{catalina.base}/logs/ 

In a standard install, this is /opt/abiquo/tomcat/logs. The logs are named after the webapps and then renamed with date information when they are rotated.

In Abiquo the log files have the format *.log, for example:

am.log
api.log
bpm-async.log
catalina.out
nars.log
ssm.log
virtualfactory.log
vsm.log

The logback config file is in WEB-INF/classes in each webapp directory and can be edited. 

 For example, for the nodecollector webapp, the default file would be /opt/abiquo/tomcat/webapps/nodecollector/WEB-INF/classes/logback.xml

Log Level Example

The default logback.xml file for the VSM in Abiquo 2.4 is shown here. Note that some of the loggers are set to a log level of TRACE, the standard configuration is as follows. This example shows the log for "nodecollector", which is the name of the webapp for the Discovery Manager Remote Service.(in the example below: com.abiquo and akka). This can create large amounts of log data. A log level of DEBUG should be sufficient for most Abiquo installations.

<?xml version="1.0" encoding="UTF-8"?>
<configuration>
        <appender name="STDOUT" class="ch.qos.logback.core.ConsoleAppender">
                <layout class="ch.qos.logback.classic.PatternLayout">
                        <Pattern>%d{HH:mm:ss.SSS} %-5level %logger{36} %X{akkaSource} - %msg%n</Pattern>
                </layout>
                <filter class="ch.qos.logback.classic.filter.ThresholdFilter">
                        <level>DEBUG</level>
                </filter>
        </appender>
        <appender name="FILE"
                class="ch.qos.logback.core.rolling.RollingFileAppender">
                <file>${catalina.base}/logs/vsm.log</file>
                <layout class="ch.qos.logback.classic.PatternLayout">
                        <Pattern>%d{HH:mm:ss.SSS} %-5level %logger{36} %X{akkaSource} - %msg%n</Pattern>
                </layout>
                <rollingPolicy class="ch.qos.logback.core.rolling.TimeBasedRollingPolicy">
                        <fileNamePattern>${catalina.base}/logs/vsm-%d{yyyy-MM-dd}.%i.log
                        </fileNamePattern>
                        <timeBasedFileNamingAndTriggeringPolicy
                                class="ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP">
                                <maxFileSize>50MB</maxFileSize>
                        </timeBasedFileNamingAndTriggeringPolicy>
                </rollingPolicy>
        </appender>
        <logger name="com.abiquo">
                <level value="TRACE" />
        </logger>
        <logger name="akka">
                <level value="TRACE" />
        </logger>
    <logger name="org.jinterop">
        <level value="ERROR" />
    </logger>
        <root>
                <level value="DEBUG" />
                <appender-ref ref="STDOUT" />
                <appender-ref ref="FILE" />
        </root>
</configuration>

Log Rotation Example

The following example shows the default logback rollingPolicy configuration for nodecollector 

<rollingPolicy class="ch.qos.logback.core.rolling.TimeBasedRollingPolicy">
  <fileNamePattern>${catalina.base}/logs/nodecollector-%d{yyyy-MM-dd}.%i.log</fileNamePattern>
  <timeBasedFileNamingAndTriggeringPolicy class="ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP">
    <maxFileSize>50MB</maxFileSize>
  </timeBasedFileNamingAndTriggeringPolicy>
</rollingPolicy>

This configuration will rotate the logs daily or when the size of the file is larger than 50 MB. However, the standard configuration shown above does not means that the log files are kept indefinitely, which can cause the system disk to fill up.

So we suggest you specify the maxHistory parameter (as described on http://logback.qos.ch/manual/appenders.html).

This means that the logs are kept indefinitely. 

...

The optional maxHistory property controls the maximum number of archive files to keep, deleting older files. For example, if you specify monthly rollover, and set maxHistory to 6, then 6 months worth of archives files will be kept with files older than 6 months deleted. Note as old archived log files are removed, any folders which were created for the purpose of log file archiving will be removed as appropriate.

Set the maxHistory size for each log file by adding a line after maxFileSize and replacing \{NUMBER OF FILES TO KEEP} with a suitable number, for example, 30.

<rollingPolicy class="ch.qos.logback.core.rolling.TimeBasedRollingPolicy">
  <fileNamePattern>${catalina.base}/logs/nodecollector-%d{yyyy-MM-dd}.%i.log</fileNamePattern>
  <timeBasedFileNamingAndTriggeringPolicy class="ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP">
    <maxFileSize>50MB</maxFileSize>
    <maxHistory>{NUMBER OF FILES TO KEEP}</maxHistory>
  </timeBasedFileNamingAndTriggeringPolicy>
</rollingPolicy>

At the moment 2.4 doesn't delete historirc logs from webapps, this may lead ( and actually it did ) to an usable platform because of full filesystem.
I'm going to open an improvement but I think is really important for new customers to configure this properly at installation time. Could you please include this as a note on the installation documentation?
On my first mail you can find the steps to configure the deletion and the link to official documentation, it would be something like:

What do you think?

Regards,
Sergio

...

El 29/05/2013 22:25, "Sergio Pena" <sergio.pena@abiquo.com> escribió:

Hi guys,

I think we do not specify any retention time on logback's configuration, We had one customer with a full filesystem today.

We define rotation policy as:

<rollingPolicy class="ch.qos.logback.core.rolling.TimeBasedRollingPolicy">
To enable automatic log compression, set the filename extension as .gz for each log file. This will compress each log automatically to GZIP format each midnight with the daily rollover. For instance, if you want to compress nodecollector logs you would issue:

  <fileNamePattern>${catalina.base}/logs/nodecollector-%d{yyyy-MM-dd}.%i.log.

...

gz</fileNamePattern>

...

Size and time based archiving supports deletion of old archive files. You need to specify the number of periods to preserve with the maxHistory property. When your application is stopped and restarted, logging will continue at the correct location, i.e. at the largest index number for the current period.

Is this intended by any reason? If so we should advise this on the wiki so customers can define their own retention times / rotation policies.

...

Disk Requirements

This section describes how to calculate the disk space requirements for the webapp logs. Customers must determine their own logging requirements.

Changes apply within 60 seconds

In versions prior to Abiquo 3.4, after you have made you changes restart the Tomcat server.

In Abiquo 3.4 and later versions, do not restart the Tomcat server because modifications will be applied within 60 seconds.