3
� �f � @ s< d dl Z d dlmZmZ d dlZd dlZG dd� de�ZdS )� N)�datetime� timedeltac @ sT e Zd ZdZdd� Zddd�Zddd�Zd d
� Zd d � Ze d
d� �Z
e dd� �Z dS )�
LogMatcherz5
Handles the matching of filter in the logs.
c C s
|| _ dS )zV
@param file_creation: last known creation timestamp of the log file.
N)�_inode)�self�inode� r �(/usr/lib/fm-agent/library/log_matcher.py�__init__ s zLogMatcher.__init__Nc s� |sg }y | j � W n4 tk
rH ddl}|j� \}}}tj|� g S X � fdd�}tt||��}|jt j
� t |�f� |S dS )z�
Match the ampount of times expression is present in lines,
return the results with the new entry appended to it.
@param expression: String,
@param lines: Iterable
@param results: List of past results
r Nc s t j� | �}|r| pdS )NF)�re�search)�line�match)�
expressionr r �
find_match% s z$LogMatcher.match.<locals>.find_match) � _valid_inode�
ValueError�sys�exc_info�logging�info�list�filter�appendr �now�len) r �linesr �resultsr �_�errorr �
matched_linesr )r r r s
zLogMatcher.matchc s� |sg }y | j � W n4 tk
rH ddl}|j� \}}}tj|� g S X dd� |D �}� �fdd�} tt| |��}
|jt j
� t |
�f� |S )a�
Return the number of lines that the where the column is
equal to the expression by splitting the lines.
@param lines: Array of lines to split and search.
@param expression: Regular expression to match agains the specified column
@param column: Column number to separate from the regular line.
@param results: List of past results
r Nc S s g | ] }|j � �qS r )�split)�.0r
r r r �
<listcomp>@ s z.LogMatcher.match_in_column.<locals>.<listcomp>c s | � }t j�|�}|r | p dS )NF)r r )r
Z
data_pointr )�columnr r r r B s z.LogMatcher.match_in_column.<locals>.find_match) r r r r r r r r r r r r ) r r r r$ r r r r Zsplitted_linesr r r )r$ r r �match_in_column- s
zLogMatcher.match_in_columnc C s | j dkrtd��dS )z�
Validate that we have an inode. If we dont
that means we are running the check for the first time,
and don't have enought information to calculate the matchs.
Nz Inode is None. Returning None)r r )r r r r r J s
zLogMatcher._valid_inodec C s` d}g }x@|D ]8\}}t j� | }|t|d�k r||7 }|j||f� qW | jsXdg fS ||fS )a�
Check the results and the timescale to determine if a metric
should be given. The delta between now and the last results time
must be greater than the timescale to properly calculate the metric.
@param results: List of past results.
@param timescale: Integer of the buffer size to take into
consideration.
@param last_results_time: Datetime
r )�minutesN)r r r r r )r r � timescaleZ total_sumZ
valid_results� timestamp�result�deltar r r �calculate_metricS s zLogMatcher.calculate_metricc C sv g }d}d}t |d�}|dkr:xt|�D ]\}}q(W |}n,x&t|�D ]\}}|| krD|j|� qDW |}|j� ||fS )z`
Grab the lines from the last known line number to the
end of the file.
r �rN)�open� enumerater �close) Zlast_known_line_number�sourceZ
current_inode� stored_inodeZexpected_lines�index� total_linesZ opened_filer
r r r �get_file_linesi s
zLogMatcher.get_file_linesc C s t j| �jS )z1
Grab the file created timstamp.
)�os�stat�st_ino)r0 r r r �get_file_inode� s zLogMatcher.get_file_inode)N)N) �__name__�
__module__� __qualname__�__doc__r
r r% r r+ � staticmethodr4 r8 r r r r r s
r )r r r r r5 �objectr r r r r �<module> s