


The amount of data is relatively large. How to better implement statistical functions?
How to count the total number when the amount of data is relatively large?
For example, if there are 5 million pieces of data in a table, the traditional method is count(), which is very inefficient.
Some people on the Internet said to use mysql triggers to insert statistical results into a result table.
Are there any other methods? For example, is it possible to insert asynchronous execution into a MySQL result table?
Or can the statistical results be put into redis?
There is also talk of using scheduled execution, but our usage scenario requires real-time calculation of the sum.
How to count the total number when the amount of data is relatively large?
For example, if there are 5 million pieces of data in a table, the traditional method is count(), which is very inefficient.
1. Someone on the Internet said to use mysql triggers to insert statistical results into a result table.
Are there any other methods? For example, is it possible to insert asynchronous execution into a MySQL result table?
2. Or can the statistical results be put into redis?
There is also talk of using scheduled execution, but our usage scenario requires real-time calculation of the sum.
3. You can create a new table to save row number information
Table name (primary key) | data amount
If data is inserted during the trigger, the data amount of the corresponding table will be +1, and if data is deleted, it will be decremented by 1.
4. Another option is to only calculate increments of 1 minute each time (according to your business's real-time requirements). The last statistical value plus the increment of 1 minute is the current total. Of course, this depends on whether the old data has been deleted. I think this method will be coupled with inserting statistical results into the table.
I tend to use redis to store, insert+1, delete-1. There is no pressure on the db, and coupling is reduced at the same time. Just use memcache or redis to count.
When you need to check the count, check the memcache first. If it is not found, go to the database count, and then set up the memcache. If you check the memcache next time, you will have it, so you don’t need to count.
The above is a relatively large amount of data. How to better implement statistical functions? For more related content, please pay attention to the PHP Chinese website (www.php.cn)!

Hot AI Tools

Undresser.AI Undress
AI-powered app for creating realistic nude photos

AI Clothes Remover
Online AI tool for removing clothes from photos.

Undress AI Tool
Undress images for free

Clothoff.io
AI clothes remover

Video Face Swap
Swap faces in any video effortlessly with our completely free AI face swap tool!

Hot Article

Hot Tools

Notepad++7.3.1
Easy-to-use and free code editor

SublimeText3 Chinese version
Chinese version, very easy to use

Zend Studio 13.0.1
Powerful PHP integrated development environment

Dreamweaver CS6
Visual web development tools

SublimeText3 Mac version
God-level code editing software (SublimeText3)

Hot Topics

Alipay PHP...

JWT is an open standard based on JSON, used to securely transmit information between parties, mainly for identity authentication and information exchange. 1. JWT consists of three parts: Header, Payload and Signature. 2. The working principle of JWT includes three steps: generating JWT, verifying JWT and parsing Payload. 3. When using JWT for authentication in PHP, JWT can be generated and verified, and user role and permission information can be included in advanced usage. 4. Common errors include signature verification failure, token expiration, and payload oversized. Debugging skills include using debugging tools and logging. 5. Performance optimization and best practices include using appropriate signature algorithms, setting validity periods reasonably,

Session hijacking can be achieved through the following steps: 1. Obtain the session ID, 2. Use the session ID, 3. Keep the session active. The methods to prevent session hijacking in PHP include: 1. Use the session_regenerate_id() function to regenerate the session ID, 2. Store session data through the database, 3. Ensure that all session data is transmitted through HTTPS.

The application of SOLID principle in PHP development includes: 1. Single responsibility principle (SRP): Each class is responsible for only one function. 2. Open and close principle (OCP): Changes are achieved through extension rather than modification. 3. Lisch's Substitution Principle (LSP): Subclasses can replace base classes without affecting program accuracy. 4. Interface isolation principle (ISP): Use fine-grained interfaces to avoid dependencies and unused methods. 5. Dependency inversion principle (DIP): High and low-level modules rely on abstraction and are implemented through dependency injection.

How to debug CLI mode in PHPStorm? When developing with PHPStorm, sometimes we need to debug PHP in command line interface (CLI) mode...

Article discusses essential security features in frameworks to protect against vulnerabilities, including input validation, authentication, and regular updates.

How to automatically set the permissions of unixsocket after the system restarts. Every time the system restarts, we need to execute the following command to modify the permissions of unixsocket: sudo...

Static binding (static::) implements late static binding (LSB) in PHP, allowing calling classes to be referenced in static contexts rather than defining classes. 1) The parsing process is performed at runtime, 2) Look up the call class in the inheritance relationship, 3) It may bring performance overhead.
