成人无码视频,亚洲精品久久久久av无码,午夜精品久久久久久毛片,亚洲 中文字幕 日韩 无码

資訊專(zhuān)欄INFORMATION COLUMN

Python logging調(diào)用Logger.info方法的處理過(guò)程

lmxdawn / 3525人閱讀

摘要:中的部分可以看到,在處理時(shí),會(huì)去加鎖,然后調(diào)用方法去處理。有三種可以看出對(duì)應(yīng)到操作符的格式化,方法的格式化以及的格式化。的方法源碼為看到會(huì)調(diào)用這里僅僅是獲取我們需要的日志信息。

本次分析一下Logger.info的流程

1. Logger.info源碼:
    def info(self, msg, *args, **kwargs):
        """
        Log "msg % args" with severity "INFO".

        To pass exception information, use the keyword argument exc_info with
        a true value, e.g.

        logger.info("Houston, we have a %s", "interesting problem", exc_info=1)
        """
        if self.isEnabledFor(INFO):
            self._log(INFO, msg, args, **kwargs)

注釋中反應(yīng)了可以通過(guò) msg和不定參數(shù)args來(lái)進(jìn)行日志的格式化。
真實(shí)的調(diào)用為:_log方法:

2. Logger._log方法:
    def _log(self, level, msg, args, exc_info=None, extra=None, stack_info=False):
        """
        Low-level logging routine which creates a LogRecord and then calls
        all the handlers of this logger to handle the record.
        """
        sinfo = None
        if _srcfile:
            #IronPython doesn"t track Python frames, so findCaller raises an
            #exception on some versions of IronPython. We trap it here so that
            #IronPython can use logging.
            try:
                fn, lno, func, sinfo = self.findCaller(stack_info)
            except ValueError: # pragma: no cover
                fn, lno, func = "(unknown file)", 0, "(unknown function)"
        else: # pragma: no cover
            fn, lno, func = "(unknown file)", 0, "(unknown function)"
        if exc_info:
            if isinstance(exc_info, BaseException):
                exc_info = (type(exc_info), exc_info, exc_info.__traceback__)
            elif not isinstance(exc_info, tuple):
                exc_info = sys.exc_info()
        record = self.makeRecord(self.name, level, fn, lno, msg, args,
                                 exc_info, func, extra, sinfo)
        self.handle(record)

最后兩行:

生成日志記錄:

record = self.makeRecord(self.name, level, fn, lno, msg, args, exc_info, func, extra, sinfo)

處理日志記錄

self.handle(record)

2 生成日志記錄:
    def makeRecord(self, name, level, fn, lno, msg, args, exc_info,
                   func=None, extra=None, sinfo=None):
        """
        A factory method which can be overridden in subclasses to create
        specialized LogRecords.
        """
        rv = _logRecordFactory(name, level, fn, lno, msg, args, exc_info, func,
                             sinfo)
        if extra is not None:
            for key in extra:
                if (key in ["message", "asctime"]) or (key in rv.__dict__):
                    raise KeyError("Attempt to overwrite %r in LogRecord" % key)
                rv.__dict__[key] = extra[key]
        return rv

調(diào)用_logRecordFactory初始化一個(gè)日志記錄實(shí)例,_logRecordFactory 其實(shí)就是LogRecord類(lèi),初始化時(shí),可能包含logger的name, level、調(diào)用的函數(shù)、行號(hào)、日志字符串、模板參數(shù)、堆棧信息等。
再看extra信息,extra到底有何用?現(xiàn)在從代碼中可以看到,只是更新到生成的日志記錄實(shí)例的__dict__中去.猜測(cè):肯定會(huì)在生成最終的日志字符串的時(shí)候會(huì)用到。繼續(xù)往下看。

3 處理日志記錄self.handle(record):

Logger繼承自Filterer,

    def handle(self, record):
        """
        Call the handlers for the specified record.

        This method is used for unpickled records received from a socket, as
        well as those created locally. Logger-level filtering is applied.
        """
        if (not self.disabled) and self.filter(record):
            self.callHandlers(record)
3.1 if語(yǔ)句中有一self.filter(record)的判斷,看函數(shù)名,是來(lái)篩選是否要繼續(xù)處理消息的,其核心源碼如下:
    def filter(self, record):
        """
        Determine if a record is loggable by consulting all the filters.

        The default is to allow the record to be logged; any filter can veto
        this and the record is then dropped. Returns a zero value if a record
        is to be dropped, else non-zero.

        .. versionchanged:: 3.2

           Allow filters to be just callables.
        """
        rv = True
        for f in self.filters:
            if hasattr(f, "filter"):
                result = f.filter(record)
            else:
                result = f(record) # assume callable - will raise if not
            if not result:
                rv = False
                break
        return rv

可以看到, 如果在handler中的filter中如果有返回為False或空,則會(huì)屏蔽對(duì)應(yīng)的record,返回True或部位空的值,則會(huì)將record放行。那么我們就可以自定義自己的filter。

3.2 讓Logger中所有的handles去處理record:
    def callHandlers(self, record):
        """
        Pass a record to all relevant handlers.

        Loop through all handlers for this logger and its parents in the
        logger hierarchy. If no handler was found, output a one-off error
        message to sys.stderr. Stop searching up the hierarchy whenever a
        logger with the "propagate" attribute set to zero is found - that
        will be the last logger whose handlers are called.
        """
        c = self
        found = 0
        while c:
            for hdlr in c.handlers:
                found = found + 1
                if record.levelno >= hdlr.level:
                    hdlr.handle(record)
            if not c.propagate:
                c = None    #break out
            else:
                c = c.parent
        if (found == 0):
            if lastResort:
                if record.levelno >= lastResort.level:
                    lastResort.handle(record)
            elif raiseExceptions and not self.manager.emittedNoHandlerWarning:
                sys.stderr.write("No handlers could be found for logger"
                                 " "%s"
" % self.name)
                self.manager.emittedNoHandlerWarning = True

代碼中會(huì)去循環(huán)調(diào)用當(dāng)前logger的所有handlers去處理record,for循環(huán)部分,之后,如果當(dāng)前的loggerpropagate的值為False或空,則不向logger父logger傳遞,即向上傳遞。

4. Handler 中的 handler(record) 部分:
    def handle(self, record):
        """
        Conditionally emit the specified logging record.

        Emission depends on filters which may have been added to the handler.
        Wrap the actual emission of the record with acquisition/release of
        the I/O thread lock. Returns whether the filter passed the record for
        emission.
        """
        rv = self.filter(record)
        if rv:
            self.acquire()
            try:
                self.emit(record)
            finally:
                self.release()
        return rv

可以看到, Handler在處理record時(shí), 會(huì)去加鎖,然后調(diào)用self.emit(record)方法去處理。

4.1 emit(record)
    def emit(self, record):
        """
        Do whatever it takes to actually log the specified logging record.

        This version is intended to be implemented by subclasses and so
        raises a NotImplementedError.
        """
        raise NotImplementedError("emit must be implemented "
                                  "by Handler subclasses")

看到需要由子類(lèi)去實(shí)現(xiàn),以StreamHandler為例子:

    def emit(self, record):
        """
        Emit a record.

        If a formatter is specified, it is used to format the record.
        The record is then written to the stream with a trailing newline.  If
        exception information is present, it is formatted using
        traceback.print_exception and appended to the stream.  If the stream
        has an "encoding" attribute, it is used to determine how to do the
        output to the stream.
        """
        try:
            msg = self.format(record)
            stream = self.stream
            stream.write(msg)
            stream.write(self.terminator)
            self.flush()
        except Exception:
            self.handleError(record)
4.2 Handler.format(record):
    def format(self, record):
        """
        Format the specified record.

        If a formatter is set, use it. Otherwise, use the default formatter
        for the module.
        """
        if self.formatter:
            fmt = self.formatter
        else:
            fmt = _defaultFormatter
        return fmt.format(record)

如果handler有自定義的formatter就用自定義的,如果沒(méi)有則用默認(rèn)的Formatter的實(shí)例, 初始化元源碼為:

    def __init__(self, fmt=None, datefmt=None, style="%"):
        """
        Initialize the formatter with specified format strings.

        Initialize the formatter either with the specified format string, or a
        default as described above. Allow for specialized date formatting with
        the optional datefmt argument (if omitted, you get the ISO8601 format).

        Use a style parameter of "%", "{" or "$" to specify that you want to
        use one of %-formatting, :meth:`str.format` (``{}``) formatting or
        :class:`string.Template` formatting in your format string.

        .. versionchanged:: 3.2
           Added the ``style`` parameter.
        """
        if style not in _STYLES:
            raise ValueError("Style must be one of: %s" % ",".join(
                             _STYLES.keys()))
        self._style = _STYLES[style][0](fmt)
        self._fmt = self._style._fmt
        self.datefmt = datefmt

有三個(gè)參數(shù):

fmt: 格式化模板

datefmt: 時(shí)間格式化參數(shù)

style: 日志格式化的樣式。

style有三種:

_STYLES = {
    "%": (PercentStyle, BASIC_FORMAT),
    "{": (StrFormatStyle, "{levelname}:{name}:{message}"),
    "$": (StringTemplateStyle, "${levelname}:${name}:${message}"),

可以看出對(duì)應(yīng)到:% 操作符的格式化, format方法的格式化以及Template的格式化。
Formatter的format方法源碼為:

    def format(self, record):
        """
        Format the specified record as text.
        The record"s attribute dictionary is used as the operand to a
        string formatting operation which yields the returned string.
        Before formatting the dictionary, a couple of preparatory steps
        are carried out. The message attribute of the record is computed
        using LogRecord.getMessage(). If the formatting string uses the
        time (as determined by a call to usesTime(), formatTime() is
        called to format the event time. If there is exception information,
        it is formatted using formatException() and appended to the message.
        """
        record.message = record.getMessage()
        if self.usesTime():
            record.asctime = self.formatTime(record, self.datefmt)
        s = self.formatMessage(record)
        if record.exc_info:
            # Cache the traceback text to avoid converting it multiple times
            # (it"s constant anyway)
            if not record.exc_text:
                record.exc_text = self.formatException(record.exc_info)
        if record.exc_text:
            if s[-1:] != "
":
                s = s + "
"
            s = s + record.exc_text
        if record.stack_info:
            if s[-1:] != "
":
                s = s + "
"
            s = s + self.formatStack(record.stack_info)

看到會(huì)調(diào)用record.getMessage(),這里僅僅是獲取我們需要的日志信息。
之后會(huì)調(diào)用s = self.formatMessage(record):

    def formatMessage(self, record):
        return self._style.format(record)

其實(shí)是調(diào)用了當(dāng)前style的format方法,以%這一類(lèi)型為例PercentStyle

class PercentStyle(object):

    default_format = "%(message)s"
    asctime_format = "%(asctime)s"
    asctime_search = "%(asctime)"

    def __init__(self, fmt):
        self._fmt = fmt or self.default_format

    def usesTime(self):
        return self._fmt.find(self.asctime_search) >= 0

    def format(self, record):
        return self._fmt % record.__dict__

從其中的format方法可以看出,是針對(duì)record__dict__屬性中的所有參數(shù)進(jìn)行格式化,這下,就清楚了之前的extra參數(shù)是干嘛用的了:可以在formatter中加入自己自定義的一些參數(shù),如固定的用戶(hù)信息等等。

之后,將最終的message flush到對(duì)應(yīng)的Stream里面去就行了,就是整個(gè)流程:

請(qǐng)大家多多指點(diǎn)。

文章版權(quán)歸作者所有,未經(jīng)允許請(qǐng)勿轉(zhuǎn)載,若此文章存在違規(guī)行為,您可以聯(lián)系管理員刪除。

轉(zhuǎn)載請(qǐng)注明本文地址:http://m.hztianpu.com/yun/43144.html

相關(guān)文章

  • Python模塊分析:第4節(jié)-logging日志模塊

    摘要:上一篇文章模塊分析第節(jié)模塊一日志記錄的級(jí)別優(yōu)先級(jí),記錄調(diào)試的詳細(xì)信息,只在調(diào)試時(shí)開(kāi)啟優(yōu)先級(jí),記錄普通的消息,報(bào)告錯(cuò)誤和警告等待。監(jiān)聽(tīng)端口號(hào)上一篇文章模塊分析第節(jié)模塊 上一篇文章:Python模塊分析:第3節(jié)-typing模塊 一、日志記錄的級(jí)別 debug:優(yōu)先級(jí)10,記錄調(diào)試的詳細(xì)信息,只在調(diào)試時(shí)開(kāi)啟 info:優(yōu)先級(jí)20,記錄普通的消息,報(bào)告錯(cuò)誤和警告等待。 warning:優(yōu)...

    MartinHan 評(píng)論0 收藏0
  • Python Logging庫(kù)HTTPHandler消息格式化方法

    摘要:原因是,直接傳遞格式化后的字符串會(huì)導(dǎo)致參數(shù)被完全求值,這個(gè)有可能是非必要的,會(huì)導(dǎo)致日志性能下降。添加一個(gè)過(guò)濾器用來(lái)進(jìn)行消息格式化上面的中的中文注釋部分直接說(shuō)明了解決方案。 問(wèn)題 Python的logging庫(kù)是標(biāo)準(zhǔn)庫(kù)中用來(lái)實(shí)現(xiàn)日志的庫(kù),功能強(qiáng)大,而且使用起來(lái)也算是方便。該庫(kù)提供了很多個(gè)不同的Handler,用來(lái)對(duì)日志進(jìn)行不同的處理。例如FileHandler用來(lái)將日志記錄到文件,Rot...

    tunny 評(píng)論0 收藏0
  • Pythonlogging模塊

    摘要:最近修改了項(xiàng)目里的相關(guān)功能,用到了標(biāo)準(zhǔn)庫(kù)里的模塊,在此做一些記錄??赡軟](méi)有線程名??赡軟](méi)有用戶(hù)輸出的消息日志級(jí)別有如下級(jí)別,,,,默認(rèn)級(jí)別是,模塊只會(huì)輸出指定以上的。在或者中這是很常見(jiàn)的方式。正常的做法應(yīng)該是全局只配置一次。 最近修改了項(xiàng)目里的logging相關(guān)功能,用到了python標(biāo)準(zhǔn)庫(kù)里的logging模塊,在此做一些記錄。主要是從官方文檔和stackoverflow上查詢(xún)到的一...

    zsirfs 評(píng)論0 收藏0
  • Python Logging 日志記錄入門(mén)

    Python Logging原來(lái)真的遠(yuǎn)比我想象的要復(fù)雜很多很多,學(xué)習(xí)路線堪比git。但是又繞不過(guò)去,alternatives又少,所以必須要予以重視,踏踏實(shí)實(shí)認(rèn)認(rèn)真真的來(lái)好好學(xué)學(xué)才行。 學(xué)習(xí)Logging的目的:簡(jiǎn)單腳本還好,print足夠。但是稍微復(fù)雜點(diǎn),哪怕是三四個(gè)文件加起來(lái)兩三百行代碼,調(diào)試也開(kāi)始變復(fù)雜起來(lái)了。再加上如果是后臺(tái)長(zhǎng)期運(yùn)行的那種腳本,運(yùn)行信息的調(diào)查更是復(fù)雜起來(lái)。一開(kāi)始我還在各種查...

    fnngj 評(píng)論0 收藏0
  • python--模塊2

    摘要:可能沒(méi)有用戶(hù)輸出的消息創(chuàng)建一個(gè),用于寫(xiě)入日志文件再創(chuàng)建一個(gè),用于輸出到控制臺(tái)對(duì)象可以添加多個(gè)和對(duì)象序列化模塊什么叫序列化將原本的字典列表等內(nèi)容轉(zhuǎn)換成一個(gè)字符串的過(guò)程就叫做序列化。 hashlib模塊 1.Python的hashlib提供了常見(jiàn)的摘要算法,如MD5,SHA1等等。什么是摘要算法呢?摘要算法又稱(chēng)哈希算法、散列算法。它通過(guò)一個(gè)函數(shù),把任意長(zhǎng)度的數(shù)據(jù)轉(zhuǎn)換為一個(gè)長(zhǎng)度固定的數(shù)據(jù)串(...

    13651657101 評(píng)論0 收藏0

發(fā)表評(píng)論

0條評(píng)論

閱讀需要支付1元查看
<