MySQL导入导出以及性能测试
最近做了MySQL的相关测试,包括备份数据的导入导出、压力测试等,因为数据量比较大,每次测试等待时间很长,所以自己动手写了相关
最近做了MySQL的相关测试,包括备份数据的导入导出、压力测试等,因为数据量比较大,每次测试等待时间很长,所以自己动手写了相关测试脚本,直接放后台screen运行即可:import.sh、dump.sh,需要读者对screen、mysqldump、tee等命令比较熟悉,screen的话可以参考我写的一篇关于screen的文章:,另外两个命令读者就在网上搜罗吧^_^,如有疑问可以联系我(QQ:349871740)。
我的mysqld启动方式如下:
/usr/local/mysql5/bin/mysqld_safe --defaults-file=/usr/local/mysql5/etc/innodb.cnf --datadir=/data1/mysql5/data/ --user=mysql &
以下是mysqldump出来的文件大小:
[root@localhost data1]# du -sh /data2/6_ddb_201204260120
47G /data2/6_ddb_201204260120
导入数据库之后:
[root@localhost mysql5]# du -sh data/
72G data/
以下是我的脚本具体内容:
[root@localhost data1]# more import.sh
::::::::::::::
import.sh
::::::::::::::
#!bin/bash
DIR=/data/script/db_back/
DIST=6
DDB=${DIST}_ddb_
MYSQL_BIN=/usr/local/mysql5/bin/
cd ${DIR}
if [ $? -eq 0 ] ; then
echo "`date -d today "+%Y-%m-%d %H:%M:%S"` Import Game Start!" | tee -a import.log
TIME=`date -d today +%Y%m%d%H%M`
#{ /usr/bin/time ${mysql} ddb >import.log
{ /usr/bin/time ${MYSQL_BIN}mysql ddb &1 | tee -a import.log
echo -e "`date -d today "+%Y-%m-%d %H:%M:%S"` Import Game Over!\n" | tee -a import.log
sleep 300
fi
::::::::::::::
dump.sh
::::::::::::::
#!/bin/sh
DIR=/data/script/db_back/
DIST=6
DDB=${DIST}_ddb_
MYSQL_BIN=/usr/local/mysql5/bin/
cd ${DIR}
if [ $? -eq 0 ] ; then
echo "`date -d today "+%Y-%m-%d %H:%M:%S"` Game Start!" | tee -a dump.log
TIME=`date -d today +%Y%m%d%H%M`
#{ /usr/bin/time ${MYSQL_BIN}mysqldump -Q -e -a -q --no-autocommit --single-transaction ddb | bzip2 -2 > ${DIST}_ddb_${TIME}.bz2; } 2>>dump.log
{ /usr/bin/time ${MYSQL_BIN}mysqldump -Q -e -a -q --no-autocommit --single-transaction ddb | bzip2 -2 > ${DIST}_ddb_${TIME}.bz2; } 2>&1 | tee -a dump.log
echo -e "`date -d today "+%Y-%m-%d %H:%M:%S"` Game Over!\n" | tee -a dump.log
sleep 300
rm -f ${DIST}_ddb_${TIME}.bz2
sleep 30
fi
[root@localhost data1]#
然后用下面的命令对导入和导出各测试10次,这两个测试跑完总时间用了5天左右,但是我是在业余时间做的测试,,所以前后时间间隔很长,后面还有压力测试,例如:mysqlslap,sql_bench等,随后附上。
[root@localhost data1]# for i in $(seq 10); do sh dump.sh ;done
[root@localhost data1]# for i in $(seq 10); do sh import.sh ;done
脚本中将测试结果输出到文本中,截取部分内容:
[root@localhost db_back]# tail -10 dump.log
2012-05-11 15:24:09 Game Start!
1147.64user 265.25system 45:49.79elapsed 51%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (1major+330minor)pagefaults 0swaps
2012-05-11 16:09:59 Game Over!
2012-05-11 16:55:24 Game Start!
1149.02user 266.73system 44:25.40elapsed 53%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (4major+314minor)pagefaults 0swaps
2012-05-11 17:39:49 Game Over!
[root@localhost db_back]# tail -10 import.log
2012-05-07 02:29:26 Import Game Start!
1149.62user 67.70system 2:41:43elapsed 12%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (7major+1089minor)pagefaults 0swaps
2012-05-07 05:11:09 Import Game Over!
2012-05-07 05:16:09 Import Game Start!
1149.78user 66.98system 2:41:45elapsed 12%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (7major+1089minor)pagefaults 0swaps
2012-05-07 07:57:54 Import Game Over!
这次测试模拟线上服务器的真实环境,所以测试还是比较准确的,如果读者有类似环境,可以拿去加以修改应用,希望对读者有所帮助,测试过程中也能学习到很多拓展知识,需要我们去花大量的时间、精力去做。

Hot AI Tools

Undresser.AI Undress
AI-powered app for creating realistic nude photos

AI Clothes Remover
Online AI tool for removing clothes from photos.

Undress AI Tool
Undress images for free

Clothoff.io
AI clothes remover

Video Face Swap
Swap faces in any video effortlessly with our completely free AI face swap tool!

Hot Article

Hot Tools

Notepad++7.3.1
Easy-to-use and free code editor

SublimeText3 Chinese version
Chinese version, very easy to use

Zend Studio 13.0.1
Powerful PHP integrated development environment

Dreamweaver CS6
Visual web development tools

SublimeText3 Mac version
God-level code editing software (SublimeText3)

Hot Topics











Apple's latest releases of iOS18, iPadOS18 and macOS Sequoia systems have added an important feature to the Photos application, designed to help users easily recover photos and videos lost or damaged due to various reasons. The new feature introduces an album called "Recovered" in the Tools section of the Photos app that will automatically appear when a user has pictures or videos on their device that are not part of their photo library. The emergence of the "Recovered" album provides a solution for photos and videos lost due to database corruption, the camera application not saving to the photo library correctly, or a third-party application managing the photo library. Users only need a few simple steps

Hibernate polymorphic mapping can map inherited classes to the database and provides the following mapping types: joined-subclass: Create a separate table for the subclass, including all columns of the parent class. table-per-class: Create a separate table for subclasses, containing only subclass-specific columns. union-subclass: similar to joined-subclass, but the parent class table unions all subclass columns.

To handle database connection errors in PHP, you can use the following steps: Use mysqli_connect_errno() to obtain the error code. Use mysqli_connect_error() to get the error message. By capturing and logging these error messages, database connection issues can be easily identified and resolved, ensuring the smooth running of your application.

How to use MySQLi to establish a database connection in PHP: Include MySQLi extension (require_once) Create connection function (functionconnect_to_db) Call connection function ($conn=connect_to_db()) Execute query ($result=$conn->query()) Close connection ( $conn->close())

Using the database callback function in Golang can achieve: executing custom code after the specified database operation is completed. Add custom behavior through separate functions without writing additional code. Callback functions are available for insert, update, delete, and query operations. You must use the sql.Exec, sql.QueryRow, or sql.Query function to use the callback function.

JSON data can be saved into a MySQL database by using the gjson library or the json.Unmarshal function. The gjson library provides convenience methods to parse JSON fields, and the json.Unmarshal function requires a target type pointer to unmarshal JSON data. Both methods require preparing SQL statements and performing insert operations to persist the data into the database.

Through the Go standard library database/sql package, you can connect to remote databases such as MySQL, PostgreSQL or SQLite: create a connection string containing database connection information. Use the sql.Open() function to open a database connection. Perform database operations such as SQL queries and insert operations. Use defer to close the database connection to release resources.

Use the DataAccessObjects (DAO) library in C++ to connect and operate the database, including establishing database connections, executing SQL queries, inserting new records and updating existing records. The specific steps are: 1. Include necessary library statements; 2. Open the database file; 3. Create a Recordset object to execute SQL queries or manipulate data; 4. Traverse the results or update records according to specific needs.
