Home Database Mysql Tutorial Sql optimization example sharing when offset is too large during mysql paging

Sql optimization example sharing when offset is too large during mysql paging

Dec 25, 2017 am 11:16 AM
mysql offset optimization

When we display the content in a list, we will inevitably encounter paging problems, because the amount of content in the list may be large, but the size of the interface that users can see at one time is limited, and it is impossible to display all the content on one interface. , fetching too much data from the backend at once will also cause additional pressure on the backend. Mysql paging is a function that we often encounter in development. Recently, we encountered a problem when implementing this function. Therefore, this article mainly introduces to you the SQL optimization experience of excessive offset when mysql paging. The article introduces very It is detailed and has certain reference and learning value for everyone's study or work. Friends who need it can follow the editor to take a look.

Usually such a statement is used when performing paging queries:

1

2

3

4

5

6

7

8

9

SELECT

*

FROM table

where condition1 = 0

and condition2 = 0

and condition3 = -1

and condition4 = -1

order by id asc

LIMIT 2000 OFFSET 50000

Copy after login

When the offset is particularly large, the execution efficiency of this statement will be significantly reduced, and The efficiency decreases as the offset increases.

The reason is:

MySQL does not skip the offset row, but takes the offset+N row, and then returns the offset row before giving up. Returning N rows, when the offset is particularly large and the single piece of data is also large, more data needs to be obtained for each query, which will naturally be very slow.

Optimization solution:


##

1

2

3

4

5

6

7

8

9

10

11

12

SELECT

*

FROM table

JOIN

(select id from table

where condition1 = 0

and condition2 = 0

and condition3 = -1

and condition4 = -1

order by id asc

LIMIT 2000 OFFSET 50000)

as tmp using(id)

Copy after login

or


1

2

3

4

5

6

7

8

9

SELECT a.* FROM table a,

(select id from table

where condition1 = 0

and condition2 = 0

and condition3 = -1

and condition4 = -1

order by id asc

LIMIT 2000 OFFSET 50000) b

where a.id = b.id

Copy after login
First obtain the primary key list, and then query the target data through the primary key. Even if the offset is large, a lot of primary keys are obtained instead of all field data. Relatively speaking, the efficiency will be improved a lot.

Related recommendations:


MySQL optimization summary-total number of queries

Summary of commonly used mysql optimization sql statement query methods

MySQL optimization includes three aspects

The above is the detailed content of Sql optimization example sharing when offset is too large during mysql paging. For more information, please follow other related articles on the PHP Chinese website!

Statement of this Website
The content of this article is voluntarily contributed by netizens, and the copyright belongs to the original author. This site does not assume corresponding legal responsibility. If you find any content suspected of plagiarism or infringement, please contact admin@php.cn

Hot AI Tools

Undresser.AI Undress

Undresser.AI Undress

AI-powered app for creating realistic nude photos

AI Clothes Remover

AI Clothes Remover

Online AI tool for removing clothes from photos.

Undress AI Tool

Undress AI Tool

Undress images for free

Clothoff.io

Clothoff.io

AI clothes remover

Video Face Swap

Video Face Swap

Swap faces in any video effortlessly with our completely free AI face swap tool!

Hot Tools

Notepad++7.3.1

Notepad++7.3.1

Easy-to-use and free code editor

SublimeText3 Chinese version

SublimeText3 Chinese version

Chinese version, very easy to use

Zend Studio 13.0.1

Zend Studio 13.0.1

Powerful PHP integrated development environment

Dreamweaver CS6

Dreamweaver CS6

Visual web development tools

SublimeText3 Mac version

SublimeText3 Mac version

God-level code editing software (SublimeText3)

Hot Topics

Java Tutorial
1664
14
PHP Tutorial
1268
29
C# Tutorial
1243
24
MySQL's Role: Databases in Web Applications MySQL's Role: Databases in Web Applications Apr 17, 2025 am 12:23 AM

The main role of MySQL in web applications is to store and manage data. 1.MySQL efficiently processes user information, product catalogs, transaction records and other data. 2. Through SQL query, developers can extract information from the database to generate dynamic content. 3.MySQL works based on the client-server model to ensure acceptable query speed.

Laravel Introduction Example Laravel Introduction Example Apr 18, 2025 pm 12:45 PM

Laravel is a PHP framework for easy building of web applications. It provides a range of powerful features including: Installation: Install the Laravel CLI globally with Composer and create applications in the project directory. Routing: Define the relationship between the URL and the handler in routes/web.php. View: Create a view in resources/views to render the application's interface. Database Integration: Provides out-of-the-box integration with databases such as MySQL and uses migration to create and modify tables. Model and Controller: The model represents the database entity and the controller processes HTTP requests.

MySQL and phpMyAdmin: Core Features and Functions MySQL and phpMyAdmin: Core Features and Functions Apr 22, 2025 am 12:12 AM

MySQL and phpMyAdmin are powerful database management tools. 1) MySQL is used to create databases and tables, and to execute DML and SQL queries. 2) phpMyAdmin provides an intuitive interface for database management, table structure management, data operations and user permission management.

MySQL vs. Other Programming Languages: A Comparison MySQL vs. Other Programming Languages: A Comparison Apr 19, 2025 am 12:22 AM

Compared with other programming languages, MySQL is mainly used to store and manage data, while other languages ​​such as Python, Java, and C are used for logical processing and application development. MySQL is known for its high performance, scalability and cross-platform support, suitable for data management needs, while other languages ​​have advantages in their respective fields such as data analytics, enterprise applications, and system programming.

Solve database connection problem: a practical case of using minii/db library Solve database connection problem: a practical case of using minii/db library Apr 18, 2025 am 07:09 AM

I encountered a tricky problem when developing a small application: the need to quickly integrate a lightweight database operation library. After trying multiple libraries, I found that they either have too much functionality or are not very compatible. Eventually, I found minii/db, a simplified version based on Yii2 that solved my problem perfectly.

Laravel framework installation method Laravel framework installation method Apr 18, 2025 pm 12:54 PM

Article summary: This article provides detailed step-by-step instructions to guide readers on how to easily install the Laravel framework. Laravel is a powerful PHP framework that speeds up the development process of web applications. This tutorial covers the installation process from system requirements to configuring databases and setting up routing. By following these steps, readers can quickly and efficiently lay a solid foundation for their Laravel project.

MySQL for Beginners: Getting Started with Database Management MySQL for Beginners: Getting Started with Database Management Apr 18, 2025 am 12:10 AM

The basic operations of MySQL include creating databases, tables, and using SQL to perform CRUD operations on data. 1. Create a database: CREATEDATABASEmy_first_db; 2. Create a table: CREATETABLEbooks(idINTAUTO_INCREMENTPRIMARYKEY, titleVARCHAR(100)NOTNULL, authorVARCHAR(100)NOTNULL, published_yearINT); 3. Insert data: INSERTINTObooks(title, author, published_year)VA

Solve MySQL mode problem: The experience of using the TheliaMySQLModesChecker module Solve MySQL mode problem: The experience of using the TheliaMySQLModesChecker module Apr 18, 2025 am 08:42 AM

When developing an e-commerce website using Thelia, I encountered a tricky problem: MySQL mode is not set properly, causing some features to not function properly. After some exploration, I found a module called TheliaMySQLModesChecker, which is able to automatically fix the MySQL pattern required by Thelia, completely solving my troubles.

See all articles