log4net not logging properly when rolling to a new date - log4net

Log4Net worked fine for a few months and then started giving problems when rolling out a new file for the next day.
Problem:
Whenever I check in the daytime or until 23:59 everything is logged but as soon as it rolls over, the rolled file will have the data of 00:00 - 06:00 hrs of the next day. All the logs of the previous day are lost.
So for the rolledfile Service.log20100702 will contain the data 00:00 - 06:00 hrs for 03/07/2010 date and nothing else.
The problem is mainly on the Production boxes, it's working fine on my local box.
My rolling file appender looks like
<appender name="RollingLogFileAppender" type="log4net.Appender.RollingFileAppender">
<file value="C:\TTLLogs\Refunds\Ttl.Refunds.Web.UI.log"/>
<appendToFile value="true" />
<datePattern value="yyyyMMdd" />
<rollingStyle value="Date" />
<maximumFileSize value="10MB" />
<maxSizeRollBackups value="100" />
<layout type="log4net.Layout.PatternLayout">
<header value="[Header]
"/>
<footer value="[Footer]
"/>
<conversionPattern value="%date %-5level %logger ${COMPUTERNAME} %property{UserHostAddress} [%property{SessionID}] - %message%newline"/>
</layout>
<lockingModel type="log4net.Appender.FileAppender+MinimalLock" />
</appender>

I'd try:
Adding <staticLogFileName value="true" />. This prevents file renaming when the appender rolls the date.
Change the lockingModel to FileAppender.ExclusiveLock to prevent another process from locking the log file. I.e. maybe a virus scanner of similar is locking the log file.
Removing maximumFileSize as it isn't applicable when the rollingStyle is Date.
Removing maxSizeRollBackups as you can manually delete the extra log files until the logging is working as expected again.

Related

Log4net file rollingFile not deleting old files

I have log4Net set up with the following config settings in a web service web.config file:
<log4net>
<!-- RollingFile is set to be a File Appender -->
<appender name="RollingFile" type="log4net.Appender.RollingFileAppender">
<file value="c:\temp\Sync.log" />
<appendToFile value="true" />
<maximumFileSize value="50MB" />
<maxSizeRollBackups value="10" />
<datePattern value="yyyyMMdd" />
<layout type="log4net.Layout.PatternLayout">
<conversionPattern value="%date %-5level %-50logger - %message%newline%newline" />
</layout>
</appender>
<!-- Set root logger level to DEBUG to have all log -->
<root>
<level value="INFO" />
<appender-ref ref="RollingFile" />
</root>
The issue I am having is when I look in temp I see 17 files
Sync.Log
Sync.log20180424.log
(other sync files with dates)
...
the last one being
Sync.log20180405
I am confused as to why it is not removing the ones beyond 10 days as stated by the maxSizeRollBackups.
I know that by default the is rollingStyle = composite.
With my current config, how would it behave if I let it go?
And as a second - what am I missing in my current settings.
Thanks. I know there are similar questions out there but in reading them I feel like I am still missing something.
It turns out that what I was trying to do is not possible.
As stated in other places:
A maximum number of backup files when rolling on date/time boundaries is not supported.
Because of this, I took the date portion out so that the backups roll by size only. After doing that I did not have the same issues. I don't like the file name as much but it is still easy enough to track them based on their file properties having the date last edited.

why files not delete for maxDateRollBackups settings

I have below log4Net configuration,
<appender name="WhateverYouNameThis" type="log4net.Appender.RollingFileAppender">
<threshold value="All" />
<file value="logs\WhateverYouNameThisFile.log" />
<appendToFile value="true" />
<maxDateRollBackups value="2" />
<maxSizeRollBackups value="2" />
<maximumFileSize value="2KB" />
<rollingStyle value="Composite" />
<staticLogFileName value="true" />
<datePattern value="yyyyMMdd-HH.lo\g" />
<layout type="log4net.Layout.PatternLayout">
<param name="ConversionPattern" value="%d [%t] %-5p - %m%n" />
</layout>
</appender>
"maxSizeRollBackups =2" works fine. When file gets larger than 2KB, it will roll to another file, up to 2 times, and then these will start getting deleted too if it goes over 2 files.
but "maxDateRollBackups=2" is not working. Any files older than 2 days is not deleted. Please suggest the reason!
When date change the file rename with 1 day before date, but files older than 2 days is not delete,
This issue seems known in log4net. These issues https://issues.apache.org/jira/browse/LOG4NET-27 / https://issues.apache.org/jira/browse/LOG4NET-367 describes the major problems with the rolling file appender. If you have any new information, I am interested in solutions as well.

File Name issue with RollingFileAppender in Log4net

I have implemented RollingFileAppender to log my ASP errors and it works fine.
Now I need to change the file names based on the date value. Currently my log file name is MyLog.log, it's max size is 1 MB and maxBackup is 10. Now I want my log files with date like MyLog_2011-12-29 for each day. I tried the below settings, but it's not appending the date value to the file name and it just creates the file as MyLog. Any suggestions?
EDITED
<appender name="RollingLogFileAppender" type="log4net.Appender.RollingFileAppender">
<file value="C:\\xxx\\ASPErrors\\LogFile"/>
<staticLogFileName value="false"/>
<appendToFile value="true"/>
<rollingStyle value="Composite"/>
<eventId value="5" />
<eventCategory value="ErrorLogging" />
<datePattern value="_yyyy-MM-dd'.log'" />
<maxSizeRollBackups value="10"/>
<maximumFileSize value="1MB"/>
<layout type="log4net.Layout.PatternLayout">
<conversionPattern value="%-5p %d %5rms %-22.22c{1} %-18.18M - %m%n"/>
</layout>
</appender>
I think the problem is you have the "staticLogFileName" property twice in the config, the second one is overwriting the first.

Log4Net configuration occasionally append the date multiple times to the file name

Often in our production (or production-like) environments, Log4Net is appending the date multiple times to my log files, thus:
AppLog.2011.08.26.log
AppLog.2011.08.26.log.2011.08.26.log
AppLog.2011.08.26.log.2011.08.26.log.2011.08.26.log
etc.
The files are inconsistently sized and they never reach the 10 MB limit that is set for the maximumFileSize.
Here is my appender setup:
<appender name="AppLog" type="log4net.Appender.RollingFileAppender,log4net">
<file type="log4net.Util.PatternString" value="Logs/AppLog[%processid]" />
<appendToFile value="true"/>
<rollingStyle value="Composite"/>
<maximumFileSize value="10000KB"/>
<maxSizeRollBackups value="2"/>
<param name="DatePattern" value=".yyyy.MM.dd'.log'"/>
<param name="StaticLogFileName" value="false"/>
<layout type="log4net.Layout.PatternLayout">
<conversionPattern value="%date !! %thread !! %-5level !! %logger !! %property{NDC} !! %message%newline"/>
</layout>
</appender>
You specified [%processid] in the value for the log file name,
but in the example you provided for the resulting log file names there is no such value.
With this expander, the resulting name should be something like
AppLog[2156].2011.10.07.log
If you need the id in the filename, make sure to understand why it is not there. It is possible that you found the origin of the appending problem as well.
Or maybe this is not the appender configuration used to produce these logfiles.

log4net one file per run

I need my application to create a log file each time it runs.
My preferred format would be App.log.yyyy-MM-dd_HH-mm-ss. If that's not possible, I'd settle for App.log.yyyy-MM-dd.counter
This is my current appender configuration:
<appender name="File" type="log4net.Appender.RollingFileAppender">
<file value="App.log"/>
<rollingStyle value="Date"/>
<datePattern value=".yyyy-MM-dd_HH-mm-ss"/>
<staticLogFileName value="false"/>
<lockingModel type="log4net.Appender.FileAppender+MinimalLock" />
</appender>
But it creates a random number of files based on the date and time.
I assume that the application should create only one log file every time it runs, so you do not need a rolling file appender (though my solution would apply for rolling file appenders as well):
<appender name="FileAppender" type="log4net.Appender.FileAppender">
<file type="log4net.Util.PatternString" value="c:\temp\App-%date{yyyy-MM-dd_HH-mm-ss}.log" />
<appendToFile value="true" />
<layout type="log4net.Layout.PatternLayout">
<conversionPattern value="%date [%2thread] %-5level - %message%newline" />
</layout>
</appender>
(Obviously you can use other your own layout and other settings for the file appender.)
Also note that you can set your rolling style as
rollingstyle="Once"
and it will create a new file every time it is run. If staticLogFileName is set to true (e.g., logname.log) the previous logs will be set to logname.log.1, logname.log.2, etc.
The number of files kept before overwriting the oldest (say, 10) can be controlled by setting
maxSizeRollBackups="10"
Edit:
My config, which creates a datestamped log per execution (unless one exists, in which case it follows the .1 rule, looks like this:
<appender name="RollingFileAppender" type="log4net.Appender.RollingFileAppender">
<file type="log4net.Util.PatternString" value="Logs\MyLog-%date{dd-MM-yyyy}.log" />
<appendToFile value="false" />
<maxSizeRollBackups value="-1" /> <!--infinite-->
<staticLogFileName value="true" />
<rollingStyle value="Once" />
<layout type="log4net.Layout.PatternLayout">
<conversionPattern value="%-5level %date [%thread] %c{1} - %m%n" />
</layout>
</appender>
Not 100% sure if I need appendToFile="false" as the docs say that's done automatically when you use rollingStyle="Once", but this makes it clearer in any case.
It's documented from apache in the log4net docs at:
https://logging.apache.org/log4net/release/config-examples.html
ctrl+f for "per program execution"
<appender name="RollingLogFileAppender" type="log4net.Appender.RollingFileAppender">
<file value="logfile.txt" />
<appendToFile value="false" />
<rollingStyle value="Size" />
<maxSizeRollBackups value="-1" />
<maximumFileSize value="50GB" />
<layout type="log4net.Layout.PatternLayout">
<conversionPattern value="%date [%thread] %-5level %logger [%property{NDC}] - %message%newline" />
</layout>
</appender>

Resources