codis-3.0.3数据同步和高可用及压力测试.doc
- 配套讲稿:
如PPT文件的首页显示word图标,表示该PPT已包含配套word讲稿。双击word图标可打开word文档。
- 特殊限制:
部分文档作品中含有的国旗、国徽等图片,仅作为作品整体效果示例展示,禁止商用。设计者仅对作品中独创性部分享有著作权。
- 关 键 词:
- codis 3.0 数据 同步 可用 压力 测试
- 资源描述:
-
codis 3.0.3数据同步和高可用及压力测试 一.基本信息 三台机器:192.168.30.113 192.168.30.114 192.168.30.115 zk1 zk2 zk3 codis-dashboard codis-fe codis-ha codis-proxy1 codis-proxy2 codis-proxy3 codis_group1_M(6379) codis_group2_M(6379) codis_group3_M(6379) codis_group3_S(6380) codis_group1_S(6380) codis_group2_S(6380) 二.主从数据同步测试 group1: redis-cli -h 192.168.30.113 -p 6379 auth xxx 192.168.30.113:6379> auth xxxx OK 192.168.30.113:6379> set a 1 OK redis-cli -h 192.168.30.115 -p 6380 192.168.30.115:6380> auth xxx OK 192.168.30.115:6380> get a "1" group2: redis-cli -h 192.168.30.114 -p 6379 auth xxx 192.168.30.114:6379> set b 2 OK redis-cli -h 192.168.30.113 -p 6380 auth xxx 192.168.30.113:6380> get b "2" group3: redis-cli -h 192.168.30.115 -p 6379 auth xxx 192.168.30.115:6379> set c 3 OK redis-cli -h 192.168.30.114 -p 6380 auth xxx 192.168.30.114:6380> get c "3" 三.高可用测试 1.将proxy1 offline(192.168.30.113)后,验证通过proxy2(192.168.30.114)的19000 端口访问redis 关闭proxy1: [codisapp@mvxl2579 codis]$ chmod u+x * [codisapp@mvxl2579 codis]$ ps -ef|grep proxy codisapp 10479 8345 0 13:36 pts/0 00:00:00 grep proxy codisapp 30898 1 0 May31 ? 00:08:46 /codisapp/svr/codis/bin/codis-proxy --ncpu=4 --config=/codisapp/conf/codis/proxy.toml --log=/codisapp/logs/codis/proxy.log --log-level=WARN [codisapp@mvxl2579 codis]$ ./stop_codis_proxy.sh [codisapp@mvxl2579 codis]$ ps -ef|grep proxy codisapp 10520 8345 0 13:36 pts/0 00:00:00 grep proxy [codisapp@mvxl2580 ~]$ redis-cli -h 192.168.30.114 -p 19000 192.168.30.114:19000> auth xxxx OK 192.168.30.114:19000> set d 4 OK 192.168.30.114:19000> get d "4" 2.将proxy1 offline后,且将codis server1的6379和6380关掉,验证通过proxy3的19000 端口访问redis 再接着关闭server 1的redis: [codisapp@mvxl2579 codis]$ ps -ef|grep codis-server codisapp 10584 8345 0 13:44 pts/0 00:00:00 grep codis-server codisapp 28919 1 0 May31 ? 00:01:28 /codisapp/svr/codis/bin/codis-server *:6379 codisapp 29151 1 0 May31 ? 00:01:18 /codisapp/svr/codis/bin/codis-server *:6380 [codisapp@mvxl2579 codis]$ ./stop_codis_server.sh [codisapp@mvxl2579 codis]$ ps -ef|grep codis-server codisapp 10626 8345 0 13:44 pts/0 00:00:00 grep codis-server 通过proxy3访问正常: [codisapp@mvxl2580 ~]$ redis-cli -h 192.168.30.115 -p 19000 192.168.30.115:19000> auth xxxxxxx OK 192.168.30.115:19000> set e 5 OK 192.168.30.115:19000> get e "5" 3. HA主从自动切换测试 将server group 3(192.168.30.115)上的6379进程kill,查看HA是否能自动实现主从切换,及原主库启动后,如何处理? mvxl2530主机上将6380对应的进程kill: [codisapp@mvxl2581 codis]$ ps -ef|grep codis-server codisapp 813 454 0 15:58 pts/0 00:00:00 grep codis-server codisapp 21682 1 0 May31 ? 00:01:17 /codisapp/svr/codis/bin/codis-server *:6379 codisapp 21701 1 0 May31 ? 00:01:14 /codisapp/svr/codis/bin/codis-server *:6380 [codisapp@mvxl2581 codis]$ kill 21682 [codisapp@mvxl2581 codis]$ ps -ef|grep codis-server codisapp 849 454 0 15:58 pts/0 00:00:00 grep codis-server codisapp 21701 1 0 May31 ? 00:01:14 /codisapp/svr/codis/bin/codis-server *:6380 以下显示:group 3中的从库已有自动提升为主库,并且原主库已下线,从组中剔除. 下线的原主库redis需要先启动服务,再重新加入到组中,并点击帮手小图标进行同步: 三.大数据量下的主从同步测试 插入20W个key(每次测试运行前,需要更改INSTANCE_NAME) vim redis-key.sh #!/bin/bash REDISCLT="redis-cli -h 192.168.30.113 -p 19000 -a "xxxxxxx" -n 0 set" ID=1 while [ $ID -le 50000 ] do INSTANCE_NAME="i-2-$ID-VM" UUID=`cat /proc/sys/kernel/random/uuid` CREATED=`date "+%Y-%m-%d %H:%M:%S"` $REDISCLT vm_instance:$ID:instance_name "$INSTANCE_NAME" $REDISCLT vm_instance:$ID:uuid "$UUID" $REDISCLT vm_instance:$ID:created "$CREATED" $REDISCLT vm_instance:$INSTANCE_NAME:id "$ID" ID=`expr $ID + 1` done 执行上面脚本, 查看面板,各组主从数据同步正常,QPS达到了800以上,显示如下: 五. 压力测试 1、/codisapp/svr/codis/bin/redis-benchmark -h 192.168.30.113 -p 19000 -a “xxxxxx” -c 100 -n 100000 100个并发连接,100000个请求,检测host为localhost 端口为6379的redis服务器性能。 以下显示100%的请求都在15ms或13ms或1ms内处理完成。 [codisapp@mvxl2579 codis]$ /codisapp/svr/codis/bin/redis-benchmark -h 192.168.30.113 -p 19000 -a "xxxxxxx" -c 100 -n 100000 ====== PING_INLINE ====== 100000 requests completed in 0.83 seconds 100 parallel clients 3 bytes payload keep alive: 1 100.00% <= 1 milliseconds 120627.27 requests per second ====== PING_BULK ====== 100000 requests completed in 0.79 seconds 100 parallel clients 3 bytes payload keep alive: 1 100.00% <= 20 milliseconds 127064.80 requests per second ====== SET ====== 100000 requests completed in 1.08 seconds 100 parallel clients 3 bytes payload keep alive: 1 100.00% <= 14 milliseconds 92506.94 requests per second ====== GET ====== 100000 requests completed in 1.02 seconds 100 parallel clients 3 bytes payload keep alive: 1 100.00% <= 15 milliseconds 97560.98 requests per second ====== INCR ====== 100000 requests completed in 0.80 seconds 100 parallel clients 3 bytes payload keep alive: 1 100.00% <= 19 milliseconds 124843.95 requests per second ====== LPUSH ====== 100000 requests completed in 0.81 seconds 100 parallel clients 3 bytes payload keep alive: 1 100.00% <= 18 milliseconds 123762.38 requests per second ====== LPOP ====== 100000 requests completed in 0.82 seconds 100 parallel clients 3 bytes payload keep alive: 1 100.00% <= 6 milliseconds 121212.12 requests per second ====== SADD ====== 100000 requests completed in 0.93 seconds 100 parallel clients 3 bytes payload keep alive: 1 100.00% <= 6 milliseconds 108108.11 requests per second ====== SPOP ====== 100000 requests completed in 0.91 seconds 100 parallel clients 3 bytes payload keep alive: 1 100.00% <= 16 milliseconds 110011.00 requests per second ====== LPUSH (needed to benchmark LRANGE) ====== 100000 requests completed in 0.88 seconds 100 parallel clients 3 bytes payload keep alive: 1 100.00% <= 15 milliseconds 114155.25 requests per second ====== LRANGE_100 (first 100 elements) ====== 100000 requests completed in 3.76 seconds 100 parallel clients 3 bytes payload keep alive: 1 100.00% <= 19 milliseconds 26588.67 requests per second ====== LRANGE_300 (first 300 elements) ====== 100000 requests completed in 11.85 seconds 100 parallel clients 3 bytes payload keep alive: 1 100.00% <= 53 milliseconds 8438.82 requests per second ====== LRANGE_500 (first 450 elements) ====== 100000 requests completed in 17.56 seconds 100 parallel clients 3 bytes payload keep alive: 1 100.00% <= 61 milliseconds 5693.46 requests per second ====== LRANGE_600 (first 600 elements) ====== 100000 requests completed in 22.23 seconds 100 parallel clients 3 bytes payload keep alive: 1 100.00% <= 74 milliseconds 4499.44 requests per second ====== MSET (10 keys) ====== 100000 requests completed in 3.24 seconds 100 parallel clients 3 bytes payload keep alive: 1 100.00% <= 20 milliseconds 30873.73 requests per second 2、/codisapp/svr/codis/bin/redis-benchmark -h 192.168.30.113 -p 19000 -a "xxxxxxx" -q -d 100 测试存取大小为100字节的数据包的性能 [codisapp@mvxl2579 codis]$ /codisapp/svr/codis/bin/redis-benchmark -h 192.168.30.113 -p 19000 -a "xxxxxxx" -q -d 100 PING_INLINE: 124223.60 requests per second PING_BULK: 129533.68 requests per second SET: 59772.86 requests per second GET: 68446.27 requests per second INCR: 104166.67 requests per second LPUSH: 121359.23 requests per second LPOP: 125156.45 requests per second SADD: 78926.60 requests per second SPOP: 79113.92 requests per second LPUSH (needed to benchmark LRANGE): 125628.14 requests per second LRANGE_100 (first 100 elements): 19149.75 requests per second LRANGE_300 (first 300 elements): 6358.90 requests per second LRANGE_500 (first 450 elements): 4207.87 requests per second LRANGE_600 (first 600 elements): 3238.34 requests per second MSET (10 keys): 23430.18 requests per second 3、/codisapp/svr/codis/bin/redis-benchmark -h 192.168.30.113 -p 19000 -a "xxxxxxx" -t set,lpush -n 100000 –q 只测试部分操作性能。 [codisapp@mvxl2579 codis]$ /codisapp/svr/codis/bin/redis-benchmark -h 192.168.30.113 -p 19000 -a "xxxxxxx" -t set,lpush -n 100000 -q SET: 65231.57 requests per second LPUSH: 119189.52 requests per second展开阅读全文
咨信网温馨提示:1、咨信平台为文档C2C交易模式,即用户上传的文档直接被用户下载,收益归上传人(含作者)所有;本站仅是提供信息存储空间和展示预览,仅对用户上传内容的表现方式做保护处理,对上载内容不做任何修改或编辑。所展示的作品文档包括内容和图片全部来源于网络用户和作者上传投稿,我们不确定上传用户享有完全著作权,根据《信息网络传播权保护条例》,如果侵犯了您的版权、权益或隐私,请联系我们,核实后会尽快下架及时删除,并可随时和客服了解处理情况,尊重保护知识产权我们共同努力。
2、文档的总页数、文档格式和文档大小以系统显示为准(内容中显示的页数不一定正确),网站客服只以系统显示的页数、文件格式、文档大小作为仲裁依据,个别因单元格分列造成显示页码不一将协商解决,平台无法对文档的真实性、完整性、权威性、准确性、专业性及其观点立场做任何保证或承诺,下载前须认真查看,确认无误后再购买,务必慎重购买;若有违法违纪将进行移交司法处理,若涉侵权平台将进行基本处罚并下架。
3、本站所有内容均由用户上传,付费前请自行鉴别,如您付费,意味着您已接受本站规则且自行承担风险,本站不进行额外附加服务,虚拟产品一经售出概不退款(未进行购买下载可退充值款),文档一经付费(服务费)、不意味着购买了该文档的版权,仅供个人/单位学习、研究之用,不得用于商业用途,未经授权,严禁复制、发行、汇编、翻译或者网络传播等,侵权必究。
4、如你看到网页展示的文档有www.zixin.com.cn水印,是因预览和防盗链等技术需要对页面进行转换压缩成图而已,我们并不对上传的文档进行任何编辑或修改,文档下载后都不会有水印标识(原文档上传前个别存留的除外),下载后原文更清晰;试题试卷类文档,如果标题没有明确说明有答案则都视为没有答案,请知晓;PPT和DOC文档可被视为“模板”,允许上传人保留章节、目录结构的情况下删减部份的内容;PDF文档不管是原文档转换或图片扫描而得,本站不作要求视为允许,下载前可先查看【教您几个在下载文档中可以更好的避免被坑】。
5、本文档所展示的图片、画像、字体、音乐的版权可能需版权方额外授权,请谨慎使用;网站提供的党政主题相关内容(国旗、国徽、党徽--等)目的在于配合国家政策宣传,仅限个人学习分享使用,禁止用于任何广告和商用目的。
6、文档遇到问题,请及时联系平台进行协调解决,联系【微信客服】、【QQ客服】,若有其他问题请点击或扫码反馈【服务填表】;文档侵犯商业秘密、侵犯著作权、侵犯人身权等,请点击“【版权申诉】”,意见反馈和侵权处理邮箱:1219186828@qq.com;也可以拔打客服电话:0574-28810668;投诉电话:18658249818。




codis-3.0.3数据同步和高可用及压力测试.doc



实名认证













自信AI助手
















微信客服
客服QQ
发送邮件
意见反馈



链接地址:https://www.zixin.com.cn/doc/12006625.html