Table of Contents
摘要
redisObject
类型与编码介绍
String
List
Collection
Ordered Set
Hash table
The underlying principles of types and encoding
Encoding conversion
Data structure
Home Database Redis What are the principles and usage of Redis type and encoding encoding?

What are the principles and usage of Redis type and encoding encoding?

May 29, 2023 pm 04:21 PM
redis type encoding

    摘要

    Redis是一款开源的高性能key-value数据库,广泛应用于各种场景。在Redis中,数据类型(type)和编码(encoding) 是非常重要的概念。本篇博客将详细介绍Redis支持的数据类型以及相应的编码方式和底层实现原理。

    要查看Redis某个key的内部编码,可以使用Redis命令OBJECT ENCODING key。其中,key是你想要查询的键名。例如,如果你想要查询名为mykey的键的内部编码,可以执行以下命令:

    127.0.0.1:6379> object encoding mykey  // 查看某个Redis键值的编码
    Copy after login

    redisObject

    在 Redis 中,redisObject 是 Redis 中最基本的数据结构之一。redisObject 用于表示 Redis 中的键值对中的值,它可以是字符串、整数、列表、哈希表等任意一种 Redis 数据类型。

    redisObject 的定义如下:

    typedef struct redisObject {
    
        // 类型
        unsigned type:4;
    
        // 编码方式
        unsigned encoding:4;
    
        // 引用计数
        int refcount;
    
        // 指向实际值的指针
        void *ptr;
    
    } robj;
    Copy after login
    • type:表示 redisObject 的类型。

    • encoding:表示 redisObject 的编码方式。

    • refcount:表示当前 redisObject 被引用的次数。

    • ptr: ptr字段则是一个指针,指向实际的 Redis 对象。

    Redis源码encoding取值有如下几种:

    #define OBJ_ENCODING_RAW 0        /* Raw representation */
    #define OBJ_ENCODING_INT 1        /* Encoded as integer */
    #define OBJ_ENCODING_HT 2         /* Encoded as hash table */
    #define OBJ_ENCODING_ZIPMAP 3     /* Encoded as zipmap */
    #define OBJ_ENCODING_LINKEDLIST 4 /* No longer used: old list encoding. */
    #define OBJ_ENCODING_ZIPLIST 5    /* Encoded as ziplist */
    #define OBJ_ENCODING_INTSET 6     /* Encoded as intset */
    #define OBJ_ENCODING_SKIPLIST 7   /* Encoded as skiplist */
    #define OBJ_ENCODING_EMBSTR 8     /* Embedded sds string encoding */
    #define OBJ_ENCODING_QUICKLIST 9  /* Encoded as linked list of ziplists */
    Copy after login

    类型与编码介绍

    Redis支持五种主要的数据类型:字符串(string)、列表(list)、集合(set)、有序集合(sorted set)和哈希(hash)。每种数据类型都有对应的编码方式。

    数据类型与编码方式总览如下:

    数据类型 编码方式
    字符串 int、embstr、raw
    哈希表 ziplist、hashtable
    列表 ziplist、linkedlist、quicklist
    集合 intset、hashtable
    有序集合 ziplist、skiplist

    String

    String is the most basic data type in Redis, usually used to store text or binary data. Redis supports two encoding methods:

    • In Redis, when a string can be represented as an integer, it will be converted to an integer and stored using int encoding. The advantages of int encoding are small storage space and high operating efficiency. The disadvantage is that it can only store integers and does not support string operations.

    • embstr(embstr-encoded string): Save a string with a length less than 44 bytes. When a string is relatively short, use this encoding method to store it. Reduce memory usage.

    • raw(raw-encoded string): Save strings longer than 44 bytes. When a string is relatively long, this encoding method is used to store it.

    List

    A list is an ordered collection of strings in which elements can be added, modified, and deleted. Redis supports three encoding methods:

    • ziplist: Before Redis3.2 version, When the length of each string in the List is less than 64 bytes and the length of the string in the List is When the number of elements is less than 512, the List object uses ziplist encoding, and in other cases, linkedlist encoding is used. ziplist is a compact, compressed list structure that saves memory. Good for small lists.

    • Linkedlist is a type of data structure that supports lists of any size through a linked list structure.. But its memory footprint will increase as the length of the list increases.

    • quicklist: Introduced in Redis 3.2 version, quicklist is a list structure composed of multiple ziplists, which can not only ensure performance, but also save memory. Suitable for large lists.

    Collection

    A collection is a series of unordered string collections that support adding, deleting and querying elements. Redis supports two encoding methods:

    • intset: When the elements in the collection are all integers, Redis will use intset encoding to store . The advantages of intset encoding are small storage space and high operating efficiency.

    • hashtable: When the elements in the collection contain strings, Redis will use hashtable encoding to store . The advantage of hashtable encoding is that it can store elements of any type and supports string operations. The disadvantage is that the storage space is relatively large and the operating efficiency is relatively low.

    Ordered Set

    Unordered collection of strings will be assigned a score, so that they can be sorted according to the score and form an ordered set. Redis supports two encoding methods:

    • ziplist: Save less than 128 elements and the size of all elements is less than 64 bytes. Use ziplist encoding , ziplist is a A compact, compressed list structure suitable for small ordered collections.

    • skiplist: skiplist is a skip list structure that supports fast query and sorting. Suitable for large ordered collections.

    Hash table

    A hash table is a collection of key-value pairs, with each key associated with a value. Redis supports two encoding methods:

    • ziplist: The string length of all key values ​​stored in the hash object is less than 64 bytes and the number of key-value pairs is less than 512, Redis will use ziplist encoding to store. The advantages of the ziplist encoding method are small storage space and high operating efficiency. The disadvantage is that fast key lookup operations are not supported.

    • In addition to the above conditions, Redis will use hash table encoding to store. The advantage of hashtable encoding is that it supports fast key lookup operations. The disadvantage is that the storage space is relatively large and the operating efficiency is relatively low.

    The underlying principles of types and encoding

    After understanding the data types and encoding methods supported by Redis, let's take a look at their underlying implementation principles.

    Encoding conversion

    In Redis, each key-value pair has a type identifier, which is used to indicate the data type stored in the key-value pair. When we operate on a key, Redis will encode the key-value pair based on the current encoding of the key and the encoding required for the operation.

    For example, when we append content to a string, if the current encoding method of the string is raw, but the new content can be stored using embstr encoding, then Redis will encode the string The method is converted from raw to embstr.

    Data structure

    Redis uses a variety of classic data structures to implement various data types, not just limited to encoding methods. For example, Redis lists and hash tables are implemented using linked list structures. Skip List is an efficient data structure used in ordered collections.

    These data structures have been carefully designed and optimized to meet application needs in various scenarios. For example, the linked list structure is suitable for situations where elements need to be frequently added and deleted, while the skip list structure is more suitable for sorting and search operations.

    The above is the detailed content of What are the principles and usage of Redis type and encoding encoding?. For more information, please follow other related articles on the PHP Chinese website!

    Statement of this Website
    The content of this article is voluntarily contributed by netizens, and the copyright belongs to the original author. This site does not assume corresponding legal responsibility. If you find any content suspected of plagiarism or infringement, please contact admin@php.cn

    Hot AI Tools

    Undresser.AI Undress

    Undresser.AI Undress

    AI-powered app for creating realistic nude photos

    AI Clothes Remover

    AI Clothes Remover

    Online AI tool for removing clothes from photos.

    Undress AI Tool

    Undress AI Tool

    Undress images for free

    Clothoff.io

    Clothoff.io

    AI clothes remover

    Video Face Swap

    Video Face Swap

    Swap faces in any video effortlessly with our completely free AI face swap tool!

    Hot Tools

    Notepad++7.3.1

    Notepad++7.3.1

    Easy-to-use and free code editor

    SublimeText3 Chinese version

    SublimeText3 Chinese version

    Chinese version, very easy to use

    Zend Studio 13.0.1

    Zend Studio 13.0.1

    Powerful PHP integrated development environment

    Dreamweaver CS6

    Dreamweaver CS6

    Visual web development tools

    SublimeText3 Mac version

    SublimeText3 Mac version

    God-level code editing software (SublimeText3)

    Hot Topics

    Java Tutorial
    1662
    14
    PHP Tutorial
    1261
    29
    C# Tutorial
    1234
    24
    How to build the redis cluster mode How to build the redis cluster mode Apr 10, 2025 pm 10:15 PM

    Redis cluster mode deploys Redis instances to multiple servers through sharding, improving scalability and availability. The construction steps are as follows: Create odd Redis instances with different ports; Create 3 sentinel instances, monitor Redis instances and failover; configure sentinel configuration files, add monitoring Redis instance information and failover settings; configure Redis instance configuration files, enable cluster mode and specify the cluster information file path; create nodes.conf file, containing information of each Redis instance; start the cluster, execute the create command to create a cluster and specify the number of replicas; log in to the cluster to execute the CLUSTER INFO command to verify the cluster status; make

    How to clear redis data How to clear redis data Apr 10, 2025 pm 10:06 PM

    How to clear Redis data: Use the FLUSHALL command to clear all key values. Use the FLUSHDB command to clear the key value of the currently selected database. Use SELECT to switch databases, and then use FLUSHDB to clear multiple databases. Use the DEL command to delete a specific key. Use the redis-cli tool to clear the data.

    How to read redis queue How to read redis queue Apr 10, 2025 pm 10:12 PM

    To read a queue from Redis, you need to get the queue name, read the elements using the LPOP command, and process the empty queue. The specific steps are as follows: Get the queue name: name it with the prefix of "queue:" such as "queue:my-queue". Use the LPOP command: Eject the element from the head of the queue and return its value, such as LPOP queue:my-queue. Processing empty queues: If the queue is empty, LPOP returns nil, and you can check whether the queue exists before reading the element.

    How to configure Lua script execution time in centos redis How to configure Lua script execution time in centos redis Apr 14, 2025 pm 02:12 PM

    On CentOS systems, you can limit the execution time of Lua scripts by modifying Redis configuration files or using Redis commands to prevent malicious scripts from consuming too much resources. Method 1: Modify the Redis configuration file and locate the Redis configuration file: The Redis configuration file is usually located in /etc/redis/redis.conf. Edit configuration file: Open the configuration file using a text editor (such as vi or nano): sudovi/etc/redis/redis.conf Set the Lua script execution time limit: Add or modify the following lines in the configuration file to set the maximum execution time of the Lua script (unit: milliseconds)

    How to use the redis command line How to use the redis command line Apr 10, 2025 pm 10:18 PM

    Use the Redis command line tool (redis-cli) to manage and operate Redis through the following steps: Connect to the server, specify the address and port. Send commands to the server using the command name and parameters. Use the HELP command to view help information for a specific command. Use the QUIT command to exit the command line tool.

    How to implement redis counter How to implement redis counter Apr 10, 2025 pm 10:21 PM

    Redis counter is a mechanism that uses Redis key-value pair storage to implement counting operations, including the following steps: creating counter keys, increasing counts, decreasing counts, resetting counts, and obtaining counts. The advantages of Redis counters include fast speed, high concurrency, durability and simplicity and ease of use. It can be used in scenarios such as user access counting, real-time metric tracking, game scores and rankings, and order processing counting.

    How to optimize the performance of debian readdir How to optimize the performance of debian readdir Apr 13, 2025 am 08:48 AM

    In Debian systems, readdir system calls are used to read directory contents. If its performance is not good, try the following optimization strategy: Simplify the number of directory files: Split large directories into multiple small directories as much as possible, reducing the number of items processed per readdir call. Enable directory content caching: build a cache mechanism, update the cache regularly or when directory content changes, and reduce frequent calls to readdir. Memory caches (such as Memcached or Redis) or local caches (such as files or databases) can be considered. Adopt efficient data structure: If you implement directory traversal by yourself, select more efficient data structures (such as hash tables instead of linear search) to store and access directory information

    How to set the redis expiration policy How to set the redis expiration policy Apr 10, 2025 pm 10:03 PM

    There are two types of Redis data expiration strategies: periodic deletion: periodic scan to delete the expired key, which can be set through expired-time-cap-remove-count and expired-time-cap-remove-delay parameters. Lazy Deletion: Check for deletion expired keys only when keys are read or written. They can be set through lazyfree-lazy-eviction, lazyfree-lazy-expire, lazyfree-lazy-user-del parameters.

    See all articles