目录
- 一、mysql主从复制原理
- 二、mysql编译安装
- 三、主从配置
- 四、主从不同步
系统:centos6.6
主:192.168.142.129 mysql-5.6.30.tar.gz
从:192.168.142.130 192.168.142.131 mysql-5.6.30.tar.gz
一、mysql主从复制原理
(1) master将改变记录到二进制日志(binary log)中;
(2) slave将master的binary log events拷贝到它的中继日志(relay log);slave的i/o线程从master的二进制日志中读取事件并写入中继日志;
(3) slave重做中继日志中的事件,将改变反映它自己的数据。slave的sql线程从中继日志读取事件,并在本地重放其中的事件,使其与master中的数据一致。
mysql主从实现的步骤:
1、使用mysqldump 命令备份数据库,
2、查看主节点二进制的位置点
3、创建备份用户,并授权(replication client.replication slave)
4、从服务器修改server-id,必须与主mysql的server-id不同,开启中继日子,关闭二进制日子
5、从数据库,倒入数据,并使用授权用户,连接主mysql
6、start slave
sql语言共分为以下几大类:查询语言dql,控制语言dcl,操纵语言dml,定义语言ddl。事务控制tcl.
dql(data query languages)语句:即数据库定义语句,用来查询select子句,from子句,where子句组成的查询块,比如:select–from–where–grouop by–having–order by–limit
ddl(data definition languages)语句:即数据库定义语句,用来创建数据库中的表、索引、视图、存储过程、触发器等,常用的语句关键字有create,alter,drop,truncate,comment,rename。增删改表的结构
dml(data manipulation language)语句:即数据操纵语句,用来查询、添加、更新、删除等,常用的语句关键字有:select,insert,update,delete,merge,call,explain plan,lock table,包括通用性的增删改查。增删改表的数据
dcl(data control language)语句:即数据控制语句,用于授权/撤销数据库及其字段的权限(dcl is short name of data control language which includes commands such as grant and mostly concerned with rights, permissions and other controls of the database system.)。常用的语句关键字有:grant,revoke。
tcl(transaction control language)语句:事务控制语句,用于控制事务,常用的语句关键字有:commit,rollback,savepoint,set transaction。
二、mysql编译安装
#!/bin/bash yum -y install make gcc gcc-c++ openssl openssl-devel pcre-devel gd cmake ncurses ncurses-devel id -u mysql if [ `echo $?` -ne 0 ]; then groupadd mysql useradd -m -g mysql -s /sbin/nologin mysql fi if [ ! -d "/usr/local/mysql" ]; then mkdir -p /usr/local/mysql fi mkdir -p /data/mysql chown -r mysql:mysql /data/mysql cd /home/soft/ #软件存放目录 tar zxvf mysql-5.6.30.tar.gz cd mysql-5.6.30 cmake -dcmake_install_prefix=/usr/local/mysql -dsysconfdir=/etc -dmysql_datadir=/data/mysql/data -dinstall_mandir=/usr/share/man -dmysql_tcp_port=3306 -dmysql_unix_addr=/tmp/mysql.sock -ddefault_charset=utf8 -dextra_charsets=all -ddefault_collation=utf8_general_ci -dwith_readline=1 -dwith_ssl=system -dwith_embedded_server=1 -denabled_local_infile=1 -dwith_innobase_storage_engine=1 make && make install chown -r mysql:mysql . chmod +x scripts/mysql_install_db ./scripts/mysql_install_db --user=mysql --basedir=/usr/local/mysql --datadir=/data/mysql cp ./support-files/mysql.server /etc/rc.d/init.d/mysqld chmod 755 /etc/init.d/mysqld chkconfig mysqld on cat> /etc/rc.d/init.d/mysqld <<'eof' #mysql启动脚本 #!/bin/sh # copyright abandoned 1996 tcx datakonsult ab & monty program kb & detron hb # this file is public domain and comes with no warranty of any kind # mysql daemon start/stop script. # usually this is put in /etc/init.d (at least on machines sysv r4 based # systems) and linked to /etc/rc3.d/s99mysql and /etc/rc0.d/k01mysql. # when this is done the mysql server will be started when the machine is # started and shut down when the systems goes down. # comments to support chkconfig on redhat linux # chkconfig: 2345 64 36 # description: a very fast and reliable sql database engine. # comments to support lsb init script conventions ### begin init info # provides: mysql # required-start: $local_fs $network $remote_fs # should-start: ypbind nscd ldap ntpd xntpd # required-stop: $local_fs $network $remote_fs # default-start: 2 3 4 5 # default-stop: 0 1 6 # short-description: start and stop mysql # description: mysql is a very fast and reliable sql database engine. ### end init info # if you install mysql on some other places than /usr/local/mysql, then you # have to do one of the following things for this script to work: # # - run this script from within the mysql installation directory # - create a /etc/my.cnf file with the following information: # [mysqld] # basedir=<path-to-mysql-installation-directory> # - add the above to any other configuration file (for example ~/.my.ini) # and copy my_print_defaults to /usr/bin # - add the path to the mysql-installation-directory to the basedir variable # below. # # if you want to affect other mysql variables, you should make your changes # in the /etc/my.cnf, ~/.my.cnf or other mysql configuration files. # if you change base dir, you must also change datadir. these may get # overwritten by settings in the mysql configuration files. basedir=/usr/local/mysql datadir=/data/mysql # default value, in seconds, afterwhich the script should timeout waiting # for server start. # value here is overriden by value in my.cnf. # 0 means don't wait at all # negative numbers mean to wait indefinitely service_startup_timeout=900 # lock directory for redhat / suse. lockdir='/var/lock/subsys' lock_file_path="$lockdir/mysql" # the following variables are only set for letting mysql.server find things. # set some defaults mysqld_pid_file_path= if test -z "$basedir" then basedir=/usr/local/mysql bindir=/usr/local/mysql/bin if test -z "$datadir" then datadir=/data/mysql/data fi sbindir=/usr/local/mysql/bin libexecdir=/usr/local/mysql/bin else bindir="$basedir/bin" if test -z "$datadir" then datadir="$basedir/data" fi sbindir="$basedir/sbin" libexecdir="$basedir/libexec" fi # datadir_set is used to determine if datadir was set (and so should be # *not* set inside of the --basedir= handler.) datadir_set= # use lsb init script functions for printing messages, if possible # lsb_functions="/lib/lsb/init-functions" if test -f $lsb_functions ; then . $lsb_functions else log_success_msg() { echo " success! $@" } log_failure_msg() { echo " error! $@" } fi path="/sbin:/usr/sbin:/bin:/usr/bin:$basedir/bin" export path mode=$1 # start or stop [ $# -ge 1 ] && shift other_args="$*" # uncommon, but needed when called from an rpm upgrade action # expected: "--skip-networking --skip-grant-tables" # they are not checked here, intentionally, as it is the resposibility # of the "spec" file author to give correct arguments only. case `echo "testing\c"`,`echo -n testing` in *c*,-n*) echo_n= echo_c= ;; *c*,*) echo_n=-n echo_c= ;; *) echo_n= echo_c='\c' ;; esac parse_server_arguments() { for arg do case "$arg" in --basedir=*) basedir=`echo "$arg" | sed -e 's/^[^=]*=//'` bindir="$basedir/bin" if test -z "$datadir_set"; then datadir="$basedir/data" fi sbindir="$basedir/sbin" libexecdir="$basedir/libexec" ;; --datadir=*) datadir=`echo "$arg" | sed -e 's/^[^=]*=//'` datadir_set=1 ;; --pid-file=*) mysqld_pid_file_path=`echo "$arg" | sed -e 's/^[^=]*=//'` ;; --service-startup-timeout=*) service_startup_timeout=`echo "$arg" | sed -e 's/^[^=]*=//'` ;; esac done } wait_for_pid () { verb="$1" # created | removed pid="$2" # process id of the program operating on the pid-file pid_file_path="$3" # path to the pid file. i=0 avoid_race_condition="by checking again" while test $i -ne $service_startup_timeout ; do case "$verb" in 'created') # wait for a pid-file to pop into existence. test -s "$pid_file_path" && i='' && break ;; 'removed') # wait for this pid-file to disappear test ! -s "$pid_file_path" && i='' && break ;; *) echo "wait_for_pid () usage: wait_for_pid created|removed pid pid_file_path" exit 1 ;; esac # if server isn't running, then pid-file will never be updated if test -n "$pid"; then if kill -0 "$pid" 2>/dev/null; then : # the server still runs else # the server may have exited between the last pid-file check and now. if test -n "$avoid_race_condition"; then avoid_race_condition="" continue # check again. fi # there's nothing that will affect the file. log_failure_msg "the server quit without updating pid file ($pid_file_path)." return 1 # not waiting any more. fi fi echo $echo_n ".$echo_c" i=`expr $i + 1` sleep 1 done if test -z "$i" ; then log_success_msg return 0 else log_failure_msg return 1 fi } # get arguments from the my.cnf file, # the only group, which is read from now on is [mysqld] if test -x ./bin/my_print_defaults then print_defaults="./bin/my_print_defaults" elif test -x $bindir/my_print_defaults then print_defaults="$bindir/my_print_defaults" elif test -x $bindir/mysql_print_defaults then print_defaults="$bindir/mysql_print_defaults" else # try to find basedir in /etc/my.cnf conf=/etc/my.cnf print_defaults= if test -r $conf then subpat='^[^=]*basedir[^=]*=\(.*\)$' dirs=`sed -e "/$subpat/!d" -e 's//\1/' $conf` for d in $dirs do d=`echo $d | sed -e 's/[ ]//g'` if test -x "$d/bin/my_print_defaults" then print_defaults="$d/bin/my_print_defaults" break fi if test -x "$d/bin/mysql_print_defaults" then print_defaults="$d/bin/mysql_print_defaults" break fi done fi # hope it's in the path ... but i doubt it test -z "$print_defaults" && print_defaults="my_print_defaults" fi # # read defaults file from 'basedir'. if there is no defaults file there # check if it's in the old (depricated) place (datadir) and read it from there # extra_args="" if test -r "$basedir/my.cnf" then extra_args="-e $basedir/my.cnf" else if test -r "$datadir/my.cnf" then extra_args="-e $datadir/my.cnf" fi fi parse_server_arguments `$print_defaults $extra_args mysqld server mysql_server mysql.server` # # set pid file if not given # if test -z "$mysqld_pid_file_path" then mysqld_pid_file_path=$datadir/`hostname`.pid else case "$mysqld_pid_file_path" in /* ) ;; * ) mysqld_pid_file_path="$datadir/$mysqld_pid_file_path" ;; esac fi case "$mode" in 'start') # start daemon # safeguard (relative paths, core dumps..) cd $basedir echo $echo_n "starting mysql" if test -x $bindir/mysqld_safe then # give extra arguments to mysqld with the my.cnf file. this script # may be overwritten at next upgrade. $bindir/mysqld_safe --datadir="$datadir" --pid-file="$mysqld_pid_file_path" $other_args >/dev/null 2>&1 & wait_for_pid created "$!" "$mysqld_pid_file_path"; return_value=$? # make lock for redhat / suse if test -w "$lockdir" then touch "$lock_file_path" fi exit $return_value else log_failure_msg "couldn't find mysql server ($bindir/mysqld_safe)" fi ;; 'stop') # stop daemon. we use a signal here to avoid having to know the # root password. if test -s "$mysqld_pid_file_path" then mysqld_pid=`cat "$mysqld_pid_file_path"` if (kill -0 $mysqld_pid 2>/dev/null) then echo $echo_n "shutting down mysql" kill $mysqld_pid # mysqld should remove the pid file when it exits, so wait for it. wait_for_pid removed "$mysqld_pid" "$mysqld_pid_file_path"; return_value=$? else log_failure_msg "mysql server process #$mysqld_pid is not running!" rm "$mysqld_pid_file_path" fi # delete lock for redhat / suse if test -f "$lock_file_path" then rm -f "$lock_file_path" fi exit $return_value else log_failure_msg "mysql server pid file could not be found!" fi ;; 'restart') # stop the service and regardless of whether it was # running or not, start it again. if $0 stop $other_args; then $0 start $other_args else log_failure_msg "failed to stop running server, so refusing to try to start." exit 1 fi ;; 'reload'|'force-reload') if test -s "$mysqld_pid_file_path" ; then read mysqld_pid < "$mysqld_pid_file_path" kill -hup $mysqld_pid && log_success_msg "reloading service mysql" touch "$mysqld_pid_file_path" else log_failure_msg "mysql pid file could not be found!" exit 1 fi ;; 'status') # first, check to see if pid file exists if test -s "$mysqld_pid_file_path" ; then read mysqld_pid < "$mysqld_pid_file_path" if kill -0 $mysqld_pid 2>/dev/null ; then log_success_msg "mysql running ($mysqld_pid)" exit 0 else log_failure_msg "mysql is not running, but pid file exists" exit 1 fi else # try to find appropriate mysqld process mysqld_pid=`pidof $libexecdir/mysqld` if test -z $mysqld_pid ; then if test -f "$lock_file_path" ; then log_failure_msg "mysql is not running, but lock file ($lock_file_path) exists" exit 2 fi log_failure_msg "mysql is not running" exit 3 else log_failure_msg "mysql is running but pid file could not be found" exit 4 fi fi ;; *) # usage basename=`basename "$0"` echo "usage: $basename {start|stop|restart|reload|force-reload|status} [ mysql server options ]" exit 1 ;; esac exit 0 eof cat> /etc/my.cnf <<'eof' #mysql配置文件 [client] #password = your_password port = 3306 socket = /tmp/mysql.sock # here follows entries for some specific programs # the mysql server [mysqld] port = 3306 socket = /tmp/mysql.sock skip-external-locking key_buffer_size = 384m max_allowed_packet = 64m table_open_cache = 512 sort_buffer_size = 2m read_buffer_size = 2m read_rnd_buffer_size = 8m myisam_sort_buffer_size = 64m thread_cache_size = 8 query_cache_size = 32m # try number of cpu's*2 for thread_concurrency thread_concurrency = 8 basedir = /usr/local/mysql datadir = /data/mysql max_connections = 5000 long_query_time = 1 slow_query_log = 1 slow_query_log_file = /var/log/mysql/slow.log # don't listen on a tcp/ip port at all. this can be a security enhancement, # if all processes that need to connect to mysqld run on the same host. # all interaction with mysqld must be made via unix sockets or named pipes. # note that using this option without enabling named pipes on windows # (via the "enable-named-pipe" option) will render mysqld useless! lower_case_table_names = 1 # replication master server (default) # binary logging is required for replication #log-bin=mysql-bin skip-name-resolve # required unique id between 1 and 2^32 - 1 # defaults to 1 if master-host is not set # but will not function as a master if omitted #server-id = 1 # binary logging - not required for slaves, but recommended #log-bin=mysql-bin # # binary logging format - mixed recommended #binlog_format=mixed # uncomment the following if you are using innodb tables #innodb_data_home_dir = /data/mysql/data #innodb_data_file_path = ibdata1:2000m;ibdata2:10m:autoextend #innodb_log_group_home_dir = /data/mysql/data # you can set .._buffer_pool_size up to 50 - 80 % # of ram but beware of setting memory usage too high innodb_buffer_pool_size = 4096m #innodb_additional_mem_pool_size = 20m # set .._log_file_size to 25 % of buffer pool size innodb_log_file_size = 512m #innodb_log_buffer_size = 8m innodb_flush_log_at_trx_commit = 0 #innodb_lock_wait_timeout = 50 [mysqldump] quick max_allowed_packet = 64m [mysql] no-auto-rehash # remove the next comment character if you are not familiar with sql #safe-updates [myisamchk] key_buffer_size = 256m sort_buffer_size = 256m read_buffer = 2m write_buffer = 2m [mysqlhotcopy] interactive-timeout eof ln -s /usr/local/mysql/bin/mysqladmin /usr/bin ln -s /usr/local/mysql/lib/mysql /usr/lib ln -s /usr/local/mysql/include/mysql /usr/include/mysql mkdir /var/lib/mysql ln -s /tmp/mysql.sock /var/lib/mysql/mysql.sock echo 'export path=$path:/usr/local/mysql/bin' >> /etc/profile sleep 2 source /etc/profile service mysqld start sleep 5 cd /usr/local/mysql/bin && mysqladmin -uroot password 'mysql' #授权root用户的password source /etc/profile
三、主从配置
1、这里验证主库有数据的情况,然后授权有复制权限的用户
mysql> create database db1; mysql> use db1 mysql> create table t1(id int, name varchar(12)); mysql> insert into t1 values(1, 'tom'), (2, 'jerry'), (3, 'jack'); mysql> grant replication slave,replication client on *.* to 'backuser'@'192.168.142.130' identified by 'mysqll'; mysql> grant replication slave,replication client on *.* to 'backuser'@'192.168.142.131' identified by 'mysql'; mysql> flush privileges;
2、修改各个数据库的配置文件后重启数据库
vi /etc/my.cnf #主库配置文件 server-id=1 log-bin=mysql-bin binlog-do-db=db1 binlog-ignore-db=mysql vi /etc/my.cnf #从库配置文件 server-id=2 #从库id不能和主库一样,其他从库往后面排 log-bin=relay-bin replicate-do-db=db1 #同步db1库 replicate-ignore-db=mysql #不会同步mysql库 read_only #只读 service mysqld restart
3、主库锁表备份,然后文件传给从库
mysql> flush tables with read lock; #主库锁表防止新的数据写入 mysql> show master status; #查看主库位置节点 新打开一个终端备份: mysqldump -u root -p --default-character-set=utf8 --opt -q -r --skip-lock-tables db1 > /root/db1.sql scp /root/db1.sql root@192.168.142.130:/root scp /root/db1.sql root@192.168.142.130:/root
4、从库导入数据,然后change到主库的节点
mysql -u root -p mysql> create database db1; mysql> use db1 mysql> source /root/db1.sql mysql> change master to master_host='192.168.142.129',master_user='backuser',master_password='mysql',master_log_file='mysql-bin.000001',master_log_pos=120; mysql> start slave; mysql> show slave status\g
5、主库解锁
mysql> unlock tables;
以上配置对主从不同步,重新配置主从同样适用。
四、主从不同步
1、造成不同步的原因
网络的延迟主从两台机器的负载不一致max_allowed_packet设置不一致key自增键开始的键值跟自增步长设置不一致引起的主从不一致mysql异常宕机情况下,如果未设置sync_binlog=1或者innodb_flush_log_at_trx_commit=1很有可能
出现binlog或者relaylog文件出现损坏,导致主从不一致mysql本身的bug引起的主从不同步版本不一致,特别是高版本是主,低版本为从的情况下,主数据库上面支持的功能,从数据库上面不支持该功能
2、解决办法
(1)忽略错误后,继续同步
该方法适用于主从库数据相差不大,或者要求数据可以不完全统一的情况,数据要求不严格的情况
stop slave; set global sql_slave_skip_counter =1; start slave; show slave status\g
(2)重新做主从
参考上面配置主库锁表重新做主从。
到此这篇关于mysql5.6主从搭建以及不同步问题详解的文章就介绍到这了,更多相关mysql主从搭建和不同步内容请搜索www.887551.com以前的文章或继续浏览下面的相关文章希望大家以后多多支持www.887551.com!