Home Common Problem There are several ways to split a database

There are several ways to split a database

Jun 29, 2020 pm 01:20 PM
database

Database splitting includes: 1. Divide by function [vertical segmentation] and put tables related to different functions into different databases. The advantage of this is that it is very intuitive; 2. According to a certain part of the table Range division of field values ​​[horizontal segmentation]. When the amount of data in a certain table becomes larger and larger and becomes unbearable, it needs to be further segmented.

There are several ways to split a database

Several ways to split the database:

1. Divide by function (vertical segmentation)

Put tables related to different functions into different databases. The advantage of this is that it is very intuitive. But when the data volume or performance requirements of a certain part of the function exceed the controllable range, it needs to be further segmented.

2. Divide according to the range of a certain field value in the table (horizontal segmentation)

When the amount of data accompanying a certain table becomes larger and larger and becomes unbearable, it needs to be Further segmentation. One option is to segment based on the key range, for example, put the IDs 1-10000 on A, and the IDs 10000~20000 on B. Such expansion is foreseeable. The other is to divide according to a certain field value. For example, according to the first letter of the user name, if it is A-D, it belongs to A, and E-H belongs to B. There is also an imbalance in this. When a certain range exceeds the range that a single point can bear, it needs to continue to be divided. There are also segmentation by date and so on.

Advantages: The size of a single table is controllable, and natural horizontal expansion

Disadvantages: The problem of centralized writing bottleneck cannot be solved.

3. Segmentation based on hash

Generally use mod to split. First determine the number of split databases, and decide which one to use by taking the hash modulus. This method can distribute data evenly, but as the amount of data increases, when expansion is needed, this method cannot achieve online expansion. Every time a node is added, the hash algorithm needs to be recalculated.

Therefore, it is recommended to use the consistent hash mod 2^n using this method.

Taking the Dianping Unified Order Database as an example, the solution for sub-database and sub-table is 32*32, that is The last four digits of userId are divided into 32 libraries by mod 32. At the same time, each library is divided into 32 tables by using the last four digits of userId div 32 mod 32, for a total of 1024 tables. Its online deployment is 8 clusters (master-slave), each cluster has 4 libraries

4. Segmentation based on routing table

The previous methods all determine operations based on application data. Segmentation based on routing tables is a more relaxed method. It maintains a separate routing table and searches the routing table to decide which database to use based on a certain attribute of the user. This method is a more general solution.

Advantages: The mapping algorithm of id and library can be changed at will

Disadvantages: Additional single points may be introduced

The above is the detailed content of There are several ways to split a database. For more information, please follow other related articles on the PHP Chinese website!

Statement of this Website
The content of this article is voluntarily contributed by netizens, and the copyright belongs to the original author. This site does not assume corresponding legal responsibility. If you find any content suspected of plagiarism or infringement, please contact admin@php.cn

Hot AI Tools

Undresser.AI Undress

Undresser.AI Undress

AI-powered app for creating realistic nude photos

AI Clothes Remover

AI Clothes Remover

Online AI tool for removing clothes from photos.

Undress AI Tool

Undress AI Tool

Undress images for free

Clothoff.io

Clothoff.io

AI clothes remover

Video Face Swap

Video Face Swap

Swap faces in any video effortlessly with our completely free AI face swap tool!

Hot Tools

Notepad++7.3.1

Notepad++7.3.1

Easy-to-use and free code editor

SublimeText3 Chinese version

SublimeText3 Chinese version

Chinese version, very easy to use

Zend Studio 13.0.1

Zend Studio 13.0.1

Powerful PHP integrated development environment

Dreamweaver CS6

Dreamweaver CS6

Visual web development tools

SublimeText3 Mac version

SublimeText3 Mac version

God-level code editing software (SublimeText3)

Hot Topics

Java Tutorial
1655
14
PHP Tutorial
1253
29
C# Tutorial
1227
24
iOS 18 adds a new 'Recovered' album function to retrieve lost or damaged photos iOS 18 adds a new 'Recovered' album function to retrieve lost or damaged photos Jul 18, 2024 am 05:48 AM

Apple's latest releases of iOS18, iPadOS18 and macOS Sequoia systems have added an important feature to the Photos application, designed to help users easily recover photos and videos lost or damaged due to various reasons. The new feature introduces an album called "Recovered" in the Tools section of the Photos app that will automatically appear when a user has pictures or videos on their device that are not part of their photo library. The emergence of the "Recovered" album provides a solution for photos and videos lost due to database corruption, the camera application not saving to the photo library correctly, or a third-party application managing the photo library. Users only need a few simple steps

How does Hibernate implement polymorphic mapping? How does Hibernate implement polymorphic mapping? Apr 17, 2024 pm 12:09 PM

Hibernate polymorphic mapping can map inherited classes to the database and provides the following mapping types: joined-subclass: Create a separate table for the subclass, including all columns of the parent class. table-per-class: Create a separate table for subclasses, containing only subclass-specific columns. union-subclass: similar to joined-subclass, but the parent class table unions all subclass columns.

Detailed tutorial on establishing a database connection using MySQLi in PHP Detailed tutorial on establishing a database connection using MySQLi in PHP Jun 04, 2024 pm 01:42 PM

How to use MySQLi to establish a database connection in PHP: Include MySQLi extension (require_once) Create connection function (functionconnect_to_db) Call connection function ($conn=connect_to_db()) Execute query ($result=$conn->query()) Close connection ( $conn->close())

How to handle database connection errors in PHP How to handle database connection errors in PHP Jun 05, 2024 pm 02:16 PM

To handle database connection errors in PHP, you can use the following steps: Use mysqli_connect_errno() to obtain the error code. Use mysqli_connect_error() to get the error message. By capturing and logging these error messages, database connection issues can be easily identified and resolved, ensuring the smooth running of your application.

An in-depth analysis of how HTML reads the database An in-depth analysis of how HTML reads the database Apr 09, 2024 pm 12:36 PM

HTML cannot read the database directly, but it can be achieved through JavaScript and AJAX. The steps include establishing a database connection, sending a query, processing the response, and updating the page. This article provides a practical example of using JavaScript, AJAX and PHP to read data from a MySQL database, showing how to dynamically display query results in an HTML page. This example uses XMLHttpRequest to establish a database connection, send a query and process the response, thereby filling data into page elements and realizing the function of HTML reading the database.

How to use database callback functions in Golang? How to use database callback functions in Golang? Jun 03, 2024 pm 02:20 PM

Using the database callback function in Golang can achieve: executing custom code after the specified database operation is completed. Add custom behavior through separate functions without writing additional code. Callback functions are available for insert, update, delete, and query operations. You must use the sql.Exec, sql.QueryRow, or sql.Query function to use the callback function.

How to connect to remote database using Golang? How to connect to remote database using Golang? Jun 01, 2024 pm 08:31 PM

Through the Go standard library database/sql package, you can connect to remote databases such as MySQL, PostgreSQL or SQLite: create a connection string containing database connection information. Use the sql.Open() function to open a database connection. Perform database operations such as SQL queries and insert operations. Use defer to close the database connection to release resources.

How to save JSON data to database in Golang? How to save JSON data to database in Golang? Jun 06, 2024 am 11:24 AM

JSON data can be saved into a MySQL database by using the gjson library or the json.Unmarshal function. The gjson library provides convenience methods to parse JSON fields, and the json.Unmarshal function requires a target type pointer to unmarshal JSON data. Both methods require preparing SQL statements and performing insert operations to persist the data into the database.