Home Backend Development Python Tutorial In-depth analysis of the role and usage of descriptors in Python

In-depth analysis of the role and usage of descriptors in Python

Jul 06, 2016 pm 01:29 PM
python

Generally speaking, a descriptor is an object attribute with "binding behavior", and its access control is overridden by the descriptor protocol method. These methods are __get__(), __set__(), and __delete__(). Objects with these methods are called descriptors.

The default access control for attributes is to get (get), set (set) and delete (delete) it from the object's dictionary (__dict__). For example, the search order for a.x is, a.__dict__['x'], then type(a).__dict__['x'], then find the parent class of type(a) (excluding metaclass) .If the value found is a descriptor, Python will call the descriptor's method to override the default control behavior. Where in the lookup phase this overriding occurs depends on which descriptor method is defined. Note that descriptors only work when inside a new-style class. (New-style classes are classes that inherit from type or object)

Descriptors are powerful and widely used. Descriptors are the mechanism behind properties, instance methods, static methods, class methods, and super. Descriptors are used extensively in Python itself to implement the new-style classes introduced in Python 2.2. Descriptors simplify the underlying C code and provide a flexible new set of tools for everyday programming in Python.

Descriptor Protocol

descr.__get__(self, obj, type=None) --> value
descr.__get__(self, obj, value) --> None
descr.__delete__(self, obj) --> None

Copy after login

Override the default search behavior when an object is a descriptor and is treated as an object property (very important).

If an object defines both __get__ and __set__, it is called data descriptor. A descriptor that only defines __get__ is called a non-data descriptor.

The difference between data descriptor and non-data descriptor is: the priority relative to the dictionary of the instance. If the instance dictionary has an attribute with the same name as the description device, and if the descriptor is a data descriptor, the data descriptor will be used first. If it is a non-data descriptor, the attributes in the dictionary will be used first.

class B(object):

  def __init__(self):
    self.name = 'mink'

  def __get__(self, obj, objtype=None):
    return self.name

class A(object):
  name = B()

a = A()
print a.__dict__  # print {}
print a.name    # print mink
a.name = 'kk'    
print a.__dict__  # print {'name': 'kk'}
print a.name    # print kk

Copy after login

Here B is a non-data descriptor, so when a.name = 'kk', there will be a name attribute in a.__dict__. Next, set it __set__

def __set__(self, obj, value):
  self.name = value

 ... do something

a = A()
print a.__dict__  # print {}
print a.name    # print mink
a.name = 'kk'    
print a.__dict__  # print {}
print a.name    # print kk

Copy after login

Because the data descriptor has a higher priority for accessing attributes than the instance's dictionary, a.__dict__ is empty.

Descriptor call
The descriptor can be called directly like this: d.__get__(obj)

However, a more common situation is that the descriptor is automatically called when the property is accessed. For example, obj.d will look for d in the dictionary of obj. If d defines the __get__ method, then d.__get__(obj) will be called according to the following precedence rules.

The details of the call depend on whether obj is a class or an instance. In addition, descriptors only work for new-style objects and new-style classes. Classes that inherit from object are called new-style classes.

For objects, the method object.__getattribute__() turns b.x into type(b).__dict__['x'].__get__(b, type(b)) . The specific implementation is based on this priority order: data descriptors take precedence over instance variables, instance variables take precedence over non-data descriptors, and the __getattr__() method (if included in the object) has the lowest priority. The complete C language implementation can be viewed in PyObject_GenericGetAttr() in Objects/object.c.

For classes, the method type.__getattribute__() turns B.x into B.__dict__['x'].__get__(None, B) . To describe it in Python is:

def __getattribute__(self, key):
  "Emulate type_getattro() in Objects/typeobject.c"
  v = object.__getattribute__(self, key)
  if hasattr(v, '__get__'):
    return v.__get__(None, self)
  return v
Copy after login

A few important points:

  • The descriptor is called because of __getattribute__()
  • Overriding the __getattribute__() method will prevent normal descriptor calls
  • __getattribute__() is only available for instances of new-style classes
  • Object.__getattribute__() and type.__getattribute__() call __get__() differently
  • Data descriptors always take precedence over instance dictionaries.
  • Non-data descriptors may be overridden by instance dictionaries. (Non-data descriptors take precedence over instance dictionaries)
  • The object returned by super() also has a customized __getattribute__() method for calling the descriptor. When calling super(B, obj).m(), it will first search for the base class A immediately adjacent to B in obj.__class__.__mro__, and then return A.__dict__['m'].__get__(obj, A). If not a descriptor, m is returned unchanged. If m is not found in the instance dictionary, it will backtrack and continue to call object.__getattribute__() to search. (Translator’s Note: Search in the next base class in __mro__)

Note: In Python 2.2, if m is a descriptor, super(B, obj).m() will only call the method __get__() . In Python 2.3, non-data descriptors (unless it is an old-style class) will also be called. The implementation details of super_getattro() are in: Objects/typeobject.c, [del] An equivalent Python implementation is in Guido's Tutorial [/del] (Translator's Note: The original sentence has been deleted and is retained for your reference).

The above shows that the mechanism of the descriptor is implemented in the __getattribute__() method of object, type, and super. Classes derived from object automatically inherit this mechanism, or they have a metaclass with a similar mechanism. Likewise, a class's __getattribute__() method can be overridden to turn off the descriptor behavior for this class.

描述器例子
下面的代码中定义了一个资料描述器,每次 get 和 set 都会打印一条消息。重写 __getattribute__() 是另一个可以使所有属性拥有这个行为的方法。但是,描述器在监视特定属性的时候是很有用的。

class RevealAccess(object):
  """A data descriptor that sets and returns values
    normally and prints a message logging their access.
  """

  def __init__(self, initval=None, name='var'):
    self.val = initval
    self.name = name

  def __get__(self, obj, objtype):
    print 'Retrieving', self.name
    return self.val

  def __set__(self, obj, val):
    print 'Updating' , self.name
    self.val = val

>>> class MyClass(object):
  x = RevealAccess(10, 'var "x"')
  y = 5

>>> m = MyClass()
>>> m.x
Retrieving var "x"
10
>>> m.x = 20
Updating var "x"
>>> m.x
Retrieving var "x"
20
>>> m.y
5

Copy after login

这个协议非常简单,并且提供了令人激动的可能。一些用途实在是太普遍以致于它们被打包成独立的函数。像属性(property), 方法(bound和unbound method), 静态方法和类方法都是基于描述器协议的。

Statement of this Website
The content of this article is voluntarily contributed by netizens, and the copyright belongs to the original author. This site does not assume corresponding legal responsibility. If you find any content suspected of plagiarism or infringement, please contact admin@php.cn

Hot AI Tools

Undresser.AI Undress

Undresser.AI Undress

AI-powered app for creating realistic nude photos

AI Clothes Remover

AI Clothes Remover

Online AI tool for removing clothes from photos.

Undress AI Tool

Undress AI Tool

Undress images for free

Clothoff.io

Clothoff.io

AI clothes remover

Video Face Swap

Video Face Swap

Swap faces in any video effortlessly with our completely free AI face swap tool!

Hot Article

Roblox: Bubble Gum Simulator Infinity - How To Get And Use Royal Keys
3 weeks ago By 尊渡假赌尊渡假赌尊渡假赌
Mandragora: Whispers Of The Witch Tree - How To Unlock The Grappling Hook
3 weeks ago By 尊渡假赌尊渡假赌尊渡假赌
Nordhold: Fusion System, Explained
3 weeks ago By 尊渡假赌尊渡假赌尊渡假赌

Hot Tools

Notepad++7.3.1

Notepad++7.3.1

Easy-to-use and free code editor

SublimeText3 Chinese version

SublimeText3 Chinese version

Chinese version, very easy to use

Zend Studio 13.0.1

Zend Studio 13.0.1

Powerful PHP integrated development environment

Dreamweaver CS6

Dreamweaver CS6

Visual web development tools

SublimeText3 Mac version

SublimeText3 Mac version

God-level code editing software (SublimeText3)

Hot Topics

Java Tutorial
1669
14
PHP Tutorial
1273
29
C# Tutorial
1256
24
PHP and Python: Different Paradigms Explained PHP and Python: Different Paradigms Explained Apr 18, 2025 am 12:26 AM

PHP is mainly procedural programming, but also supports object-oriented programming (OOP); Python supports a variety of paradigms, including OOP, functional and procedural programming. PHP is suitable for web development, and Python is suitable for a variety of applications such as data analysis and machine learning.

Choosing Between PHP and Python: A Guide Choosing Between PHP and Python: A Guide Apr 18, 2025 am 12:24 AM

PHP is suitable for web development and rapid prototyping, and Python is suitable for data science and machine learning. 1.PHP is used for dynamic web development, with simple syntax and suitable for rapid development. 2. Python has concise syntax, is suitable for multiple fields, and has a strong library ecosystem.

How to run sublime code python How to run sublime code python Apr 16, 2025 am 08:48 AM

To run Python code in Sublime Text, you need to install the Python plug-in first, then create a .py file and write the code, and finally press Ctrl B to run the code, and the output will be displayed in the console.

PHP and Python: A Deep Dive into Their History PHP and Python: A Deep Dive into Their History Apr 18, 2025 am 12:25 AM

PHP originated in 1994 and was developed by RasmusLerdorf. It was originally used to track website visitors and gradually evolved into a server-side scripting language and was widely used in web development. Python was developed by Guidovan Rossum in the late 1980s and was first released in 1991. It emphasizes code readability and simplicity, and is suitable for scientific computing, data analysis and other fields.

Python vs. JavaScript: The Learning Curve and Ease of Use Python vs. JavaScript: The Learning Curve and Ease of Use Apr 16, 2025 am 12:12 AM

Python is more suitable for beginners, with a smooth learning curve and concise syntax; JavaScript is suitable for front-end development, with a steep learning curve and flexible syntax. 1. Python syntax is intuitive and suitable for data science and back-end development. 2. JavaScript is flexible and widely used in front-end and server-side programming.

Golang vs. Python: Performance and Scalability Golang vs. Python: Performance and Scalability Apr 19, 2025 am 12:18 AM

Golang is better than Python in terms of performance and scalability. 1) Golang's compilation-type characteristics and efficient concurrency model make it perform well in high concurrency scenarios. 2) Python, as an interpreted language, executes slowly, but can optimize performance through tools such as Cython.

Where to write code in vscode Where to write code in vscode Apr 15, 2025 pm 09:54 PM

Writing code in Visual Studio Code (VSCode) is simple and easy to use. Just install VSCode, create a project, select a language, create a file, write code, save and run it. The advantages of VSCode include cross-platform, free and open source, powerful features, rich extensions, and lightweight and fast.

How to run python with notepad How to run python with notepad Apr 16, 2025 pm 07:33 PM

Running Python code in Notepad requires the Python executable and NppExec plug-in to be installed. After installing Python and adding PATH to it, configure the command "python" and the parameter "{CURRENT_DIRECTORY}{FILE_NAME}" in the NppExec plug-in to run Python code in Notepad through the shortcut key "F6".

See all articles