Table of Contents
回复内容:
Home Backend Development PHP Tutorial redis高并发(数据洪流)插入(SET)是如何工作的?如何应对?

redis高并发(数据洪流)插入(SET)是如何工作的?如何应对?

Jun 06, 2016 pm 08:49 PM
java php redis web concurrent

众所周知redis只有一个线程,那么在多并发情况下:

  1. 有多个相同的set请求,redis内部的处理流程是怎样的?
  2. 我只知道命令会等待,这里的等待是所有命令都等待么?比如此时的其他set和任何get都会阻塞么?
  3. redis内部是将命令作为一个队列来处理么?或者是其他方式?
  4. 当第一个set处理完后,其他的相同的set会覆盖掉么,也就是说依然会占用cpu来工作么?希望能具体说说

面对同一时间高并发请求的场景,将数据设置进redis时如何避免大量请求redis导致cpu过高?我想到了三种方案:

  1. 调用set的时候,通过exist再次判断(取的时候会先判断exist一下,如果不存在才去SET);
  2. 通过向缓存中设置一个对象锁,set完毕后释放;
  3. 第三种方案是今天刚查到的,通过setnx命令来控制。

不知道哪一种最合适,个人感觉第三种因为是redis支持的。希望高人指点一二,不胜感激

回复内容:

众所周知redis只有一个线程,那么在多并发情况下:

  1. 有多个相同的set请求,redis内部的处理流程是怎样的?
  2. 我只知道命令会等待,这里的等待是所有命令都等待么?比如此时的其他set和任何get都会阻塞么?
  3. redis内部是将命令作为一个队列来处理么?或者是其他方式?
  4. 当第一个set处理完后,其他的相同的set会覆盖掉么,也就是说依然会占用cpu来工作么?希望能具体说说

面对同一时间高并发请求的场景,将数据设置进redis时如何避免大量请求redis导致cpu过高?我想到了三种方案:

  1. 调用set的时候,通过exist再次判断(取的时候会先判断exist一下,如果不存在才去SET);
  2. 通过向缓存中设置一个对象锁,set完毕后释放;
  3. 第三种方案是今天刚查到的,通过setnx命令来控制。

不知道哪一种最合适,个人感觉第三种因为是redis支持的。希望高人指点一二,不胜感激

  1. 参考epoll(IO多路复用)
  2. 参见1
  3. 陆续执行。具体请看源码

后一个问题请高人回答。

关于楼主的问题,我觉得重点是了解下面2点:

  1. redis是一个单线程程序,也就说同一时刻它只能处理一个客户端请求;
  2. redis是通过IO多路复用(select,epoll, kqueue,依据不同的平台,采取不同的实现)来处理多个客户端请求的,伪代码:
while True:
        # 当没有客户端发请求时,redis会阻塞在select调用
        clients = select(...);
        for client in clients:
            processRequest(client)
Copy after login

上述的整个流程封装在ae事件库中,可以参考ae.c, ae.h源代码

Statement of this Website
The content of this article is voluntarily contributed by netizens, and the copyright belongs to the original author. This site does not assume corresponding legal responsibility. If you find any content suspected of plagiarism or infringement, please contact admin@php.cn

Hot AI Tools

Undresser.AI Undress

Undresser.AI Undress

AI-powered app for creating realistic nude photos

AI Clothes Remover

AI Clothes Remover

Online AI tool for removing clothes from photos.

Undress AI Tool

Undress AI Tool

Undress images for free

Clothoff.io

Clothoff.io

AI clothes remover

Video Face Swap

Video Face Swap

Swap faces in any video effortlessly with our completely free AI face swap tool!

Hot Tools

Notepad++7.3.1

Notepad++7.3.1

Easy-to-use and free code editor

SublimeText3 Chinese version

SublimeText3 Chinese version

Chinese version, very easy to use

Zend Studio 13.0.1

Zend Studio 13.0.1

Powerful PHP integrated development environment

Dreamweaver CS6

Dreamweaver CS6

Visual web development tools

SublimeText3 Mac version

SublimeText3 Mac version

God-level code editing software (SublimeText3)

PHP and Python: Comparing Two Popular Programming Languages PHP and Python: Comparing Two Popular Programming Languages Apr 14, 2025 am 12:13 AM

PHP and Python each have their own advantages, and choose according to project requirements. 1.PHP is suitable for web development, especially for rapid development and maintenance of websites. 2. Python is suitable for data science, machine learning and artificial intelligence, with concise syntax and suitable for beginners.

PHP's Purpose: Building Dynamic Websites PHP's Purpose: Building Dynamic Websites Apr 15, 2025 am 12:18 AM

PHP is used to build dynamic websites, and its core functions include: 1. Generate dynamic content and generate web pages in real time by connecting with the database; 2. Process user interaction and form submissions, verify inputs and respond to operations; 3. Manage sessions and user authentication to provide a personalized experience; 4. Optimize performance and follow best practices to improve website efficiency and security.

PHP in Action: Real-World Examples and Applications PHP in Action: Real-World Examples and Applications Apr 14, 2025 am 12:19 AM

PHP is widely used in e-commerce, content management systems and API development. 1) E-commerce: used for shopping cart function and payment processing. 2) Content management system: used for dynamic content generation and user management. 3) API development: used for RESTful API development and API security. Through performance optimization and best practices, the efficiency and maintainability of PHP applications are improved.

The Enduring Relevance of PHP: Is It Still Alive? The Enduring Relevance of PHP: Is It Still Alive? Apr 14, 2025 am 12:12 AM

PHP is still dynamic and still occupies an important position in the field of modern programming. 1) PHP's simplicity and powerful community support make it widely used in web development; 2) Its flexibility and stability make it outstanding in handling web forms, database operations and file processing; 3) PHP is constantly evolving and optimizing, suitable for beginners and experienced developers.

PHP and Python: Different Paradigms Explained PHP and Python: Different Paradigms Explained Apr 18, 2025 am 12:26 AM

PHP is mainly procedural programming, but also supports object-oriented programming (OOP); Python supports a variety of paradigms, including OOP, functional and procedural programming. PHP is suitable for web development, and Python is suitable for a variety of applications such as data analysis and machine learning.

PHP and Python: Code Examples and Comparison PHP and Python: Code Examples and Comparison Apr 15, 2025 am 12:07 AM

PHP and Python have their own advantages and disadvantages, and the choice depends on project needs and personal preferences. 1.PHP is suitable for rapid development and maintenance of large-scale web applications. 2. Python dominates the field of data science and machine learning.

PHP: Handling Databases and Server-Side Logic PHP: Handling Databases and Server-Side Logic Apr 15, 2025 am 12:15 AM

PHP uses MySQLi and PDO extensions to interact in database operations and server-side logic processing, and processes server-side logic through functions such as session management. 1) Use MySQLi or PDO to connect to the database and execute SQL queries. 2) Handle HTTP requests and user status through session management and other functions. 3) Use transactions to ensure the atomicity of database operations. 4) Prevent SQL injection, use exception handling and closing connections for debugging. 5) Optimize performance through indexing and cache, write highly readable code and perform error handling.

Why Use PHP? Advantages and Benefits Explained Why Use PHP? Advantages and Benefits Explained Apr 16, 2025 am 12:16 AM

The core benefits of PHP include ease of learning, strong web development support, rich libraries and frameworks, high performance and scalability, cross-platform compatibility, and cost-effectiveness. 1) Easy to learn and use, suitable for beginners; 2) Good integration with web servers and supports multiple databases; 3) Have powerful frameworks such as Laravel; 4) High performance can be achieved through optimization; 5) Support multiple operating systems; 6) Open source to reduce development costs.

See all articles