Redis集群无感知上线下线节点

搭建集群是为了提高性能提高可用性,当业务高速发展时,肯定会需要新增节点来支撑业务,或者某个节点以外down掉,这时候我们就需要做到无感知新增、删除节点。

先说一个题外话,今天是大年初一,我和我十多年的老炮友,去了一个没人的山上,做了一件非常有激情的事。

最近的,新型肺炎也是四处蔓延,为了给社会做一点贡献,就早早的回家,蹲在家里写点东西。我继续昨天写的Docker搭建Redis集群

集群信息

我们先来看看节点的基本信息:

1
2
3
4
5
6
7
8
182.61.35.33:16380> cluster nodes
9d1935b3462566449d9f3c3c38b8d3ab9b97b134 182.61.35.33:16381@26381 slave 6c255660ba138e0cb7ac521ad945bafbf0901f1a 0 1579935926810 15 connected
b1790b6e64961f2da927cd78ad64cf02463727da 182.61.35.33:16380@26380 myself,master - 0 1579935924000 14 connected 5461-10922
6c255660ba138e0cb7ac521ad945bafbf0901f1a 182.61.35.33:16384@26384 master - 0 1579935926000 15 connected 10923-16383
5923fef0a1e7a7b3a77290af1c13e1e57678f6e2 182.61.35.33:16382@26382 master - 0 1579935925000 18 connected 0-5460
d1b77c63e1e652b786c9e52e42f7594e9752903c 182.61.35.33:16379@26379 slave 5923fef0a1e7a7b3a77290af1c13e1e57678f6e2 0 1579935927000 18 connected
93fe47529c3f671d6d5b75c46ac965d43b904c34 182.61.35.33:16383@26383 slave b1790b6e64961f2da927cd78ad64cf02463727da 0 1579935927813 14 connected

我们可以看到他们的主从(端口)对应关系.

16382 16379
16384 16381
16380 16383

新增节点

这里先shell脚本初始化2个节点的配置信息,

1
2
3
4
5
for port in {6385..6386}
do
mkdir -p /root/redis/${port}/conf && port=${port} envsubst < redis-cluster.conf > /root/redis/${port}/conf/redis.conf && mkdir -p /root/redis/${port}/data;
done

运行init-redis-config.sh脚本进行配置文件初始化。接下来启动这两个节点:

1
2
3
4
5
[root@instance-p0a4erj8 ~]# docker run  -p 16385:16385 -p 26385:26385  --name redis-6385 -v /root/redis/6385/conf/redis.conf:/usr/local/etc/redis.conf -v /root/redis/6385/data:/data -d redis redis-server /usr/local/etc/redis.conf
2bf222ef7923f4d6b7b4dfbc4b2e74b5c6508af3da4a519447b1431bc8a6a4c2
[root@instance-p0a4erj8 ~]# docker run -p 16386:16386 -p 26386:26386 --name redis-6386 -v /root/redis/6386/conf/redis.conf:/usr/local/etc/redis.conf -v /root/redis/6386/data:/data -d redis redis-server /usr/local/etc/redis.conf
17db2933515d335e781f7701a878c3b73daa5da2ca35963e18b8f4d7f7a442a6

进入到Redis任意节点,

1
docker exec -it redis-6385 bash

执行节点添加命令redis-cli --cluster add-node 新节点IP:端口 集群中现有IP:端口 [-a 密码]:

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
root@2bf222ef7923:/data# redis-cli --cluster add-node 182.61.35.33:16385 182.61.35.33:16379 -a dockerredis
Warning: Using a password with '-a' or '-u' option on the command line interface may not be safe.
>>> Adding node 182.61.35.33:16385 to cluster 182.61.35.33:16379
>>> Performing Cluster Check (using node 182.61.35.33:16379)
S: d1b77c63e1e652b786c9e52e42f7594e9752903c 182.61.35.33:16379
slots: (0 slots) slave
replicates 5923fef0a1e7a7b3a77290af1c13e1e57678f6e2
S: 93fe47529c3f671d6d5b75c46ac965d43b904c34 182.61.35.33:16383
slots: (0 slots) slave
replicates b1790b6e64961f2da927cd78ad64cf02463727da
M: 5923fef0a1e7a7b3a77290af1c13e1e57678f6e2 182.61.35.33:16382
slots:[0-5460] (5461 slots) master
1 additional replica(s)
S: 9d1935b3462566449d9f3c3c38b8d3ab9b97b134 182.61.35.33:16381
slots: (0 slots) slave
replicates 6c255660ba138e0cb7ac521ad945bafbf0901f1a
M: b1790b6e64961f2da927cd78ad64cf02463727da 182.61.35.33:16380
slots:[5461-10922] (5462 slots) master
1 additional replica(s)
M: 6c255660ba138e0cb7ac521ad945bafbf0901f1a 182.61.35.33:16384
slots:[10923-16383] (5461 slots) master
1 additional replica(s)
[OK] All nodes agree about slots configuration.
>>> Check for open slots...
>>> Check slots coverage...
[OK] All 16384 slots covered.
>>> Send CLUSTER MEET to node 182.61.35.33:16385 to make it join the cluster.
[OK] New node added correctly.

可以看到节点添加成功,这时候可以看看集群节点的信息:

1
2
3
4
5
6
7
8
9
182.61.35.33:16385> cluster nodes
93fe47529c3f671d6d5b75c46ac965d43b904c34 182.61.35.33:16383@26383 slave b1790b6e64961f2da927cd78ad64cf02463727da 0 1579938935357 14 connected
5923fef0a1e7a7b3a77290af1c13e1e57678f6e2 182.61.35.33:16382@26382 master - 0 1579938938363 18 connected 0-5460
d1b77c63e1e652b786c9e52e42f7594e9752903c 182.61.35.33:16379@26379 slave 5923fef0a1e7a7b3a77290af1c13e1e57678f6e2 0 1579938936000 18 connected
fc576f7421e4b453dc500d4cbe028716bb1efbf8 182.61.35.33:16385@26385 myself,master - 0 1579938934000 0 connected
b1790b6e64961f2da927cd78ad64cf02463727da 182.61.35.33:16380@26380 master - 0 1579938936357 14 connected 5461-10922
6c255660ba138e0cb7ac521ad945bafbf0901f1a 182.61.35.33:16384@26384 master - 0 1579938937360 15 connected 10923-16383
9d1935b3462566449d9f3c3c38b8d3ab9b97b134 182.61.35.33:16381@26381 slave 6c255660ba138e0cb7ac521ad945bafbf0901f1a 0 1579938934354 15 connected

可以看到新添加的节点是master节点,但是并没有哈希槽,需要我们手动为其添加

1
redis-cli --cluster reshard  任意集群中的IP:端口

分配哈希槽有两种方式:

  • 将其他节点随机的哈希槽分配到目标节点
  • 在指定的节点取出指定数量的哈希槽分配到目标节点
    1
    2
    3
    4
    5
    6
    7
    8
    9
    10
    11
    12
    13
    14
    15
    16
    17
    18
    19
    20
    21
    22
    23
    24
    25
    26
    27
    28
    29
    30
    31
    32
    33
    34
    35
    36
    37
    38
    39
    40
    41
    42
    43
    44
    45
    46
    47
    48
    49
    50
    51
    52
    53
    54
    55
    56
    57
    58
    59
    60
    61
    62
    63
    64
    65
    66
    67
    68
    69
    70
    71
    72
    73
    74
    75
    76
    77
    78
    79
    80
    81
    82
    83
    84
    85
    86
    87
    88
    89
    90
    91
    92
    93
    94
    95
    96
    97
    98
    99
    100
    101
    102
    103
    104
    105
    106
    107
    108
    109
    110
    111
    112
    113
    114
    115
    116
    117
    118
    119
    120
    121
    122
    123
    124
    125
    126
    127
    128
    129
    130
    131
    132
    133
    134
    135
    136
    137
    138
    139
    140
    141
    142
    143
    144
    145
    146
    147
    148
    149
    150
    151
    152
    153
    154
    155
    156
    157
    158
    159
    160
    161
    162
    163
    164
    165
    166
    167
    168
    169
    170
    171
    172
    173
    174
    175
    176
    177
    178
    179
    180
    181
    182
    183
    184
    185
    186
    187
    188
    189
    190
    191
    192
    193
    194
    195
    196
    197
    198
    199
    200
    201
    202
    203
    204
    205
    206
    207
    208
    209
    210
    211
    212
    213
    214
    215
    216
    217
    218
    219
    220
    221
    222
    223
    224
    225
    226
    227
    228
    229
    230
    231
    232
    233
    234
    235
    236
    237
    238
    239
    240
    241
    242
    243
    244
    245
    246
    247
    248
    249
    250
    251
    252
    253
    254
    255
    256
    257
    258
    259
    260
    261
    262
    263
    264
    265
    266
    267
    268
    269
    270
    271
    272
    273
    274
    275
    276
    277
    278
    279
    280
    281
    282
    283
    284
    285
    286
    287
    288
    289
    290
    291
    292
    293
    294
    295
    296
    297
    298
    299
    300
    301
    302
    303
    304
    305
    306
    307
    308
    309
    310
    311
    312
    313
    314
    315
    316
    317
    318
    319
    320
    321
    322
    323
    324
    325
    326
    327
    328
    329
    330
    331
    332
    333
    334
    335
    336
    337
    338
    339
    340
    341
    342
    343
    344
    345
    346
    347
    348
    349
    350
    351
    352
    353
    354
    355
    356
    357
    358
    359
    360
    361
    362
    363
    364
    365
    366
    367
    368
    369
    370
    371
    372
    373
    374
    375
    376
    377
    378
    379
    380
    381
    382
    383
    384
    385
    386
    387
    388
    389
    390
    391
    392
    393
    394
    395
    396
    397
    398
    399
    400
    401
    402
    403
    404
    405
    406
    407
    408
    409
    410
    411
    412
    413
    414
    415
    416
    417
    418
    419
    420
    421
    422
    423
    424
    425
    426
    427
    428
    429
    430
    431
    432
    433
    434
    435
    436
    437
    438
    439
    440
    441
    442
    443
    444
    445
    446
    447
    448
    449
    450
    451
    452
    453
    454
    455
    456
    457
    458
    459
    460
    461
    462
    463
    464
    465
    466
    467
    468
    469
    470
    471
    472
    473
    474
    475
    476
    477
    478
    479
    480
    481
    482
    483
    484
    485
    486
    487
    488
    489
    490
    491
    492
    493
    494
    495
    496
    497
    498
    499
    500
    501
    502
    503
    504
    505
    506
    507
    508
    509
    510
    511
    512
    513
    514
    515
    516
    517
    518
    519
    520
    521
    522
    523
    524
    525
    526
    527
    528
    529
    530
    531
    532
    533
    534
    535
    536
    537
    538
    539
    540
    541
    542
    543
    544
    545
    546
    547
    548
    549
    550
    551
    552
    553
    554
    555
    556
    557
    558
    559
    560
    561
    562
    563
    564
    565
    566
    567
    568
    569
    570
    571
    572
    573
    574
    575
    576
    577
    578
    579
    580
    581
    582
    583
    584
    585
    586
    587
    588
    589
    590
    591
    592
    593
    594
    595
    596
    597
    598
    599
    600
    601
    602
    603
    604
    605
    606
    607
    608
    609
    610
    611
    612
    613
    614
    615
    616
    617
    618
    619
    620
    621
    622
    623
    624
    625
    626
    627
    628
    629
    630
    631
    632
    633
    634
    635
    636
    637
    638
    639
    640
    641
    642
    643
    644
    645
    646
    647
    648
    root@2bf222ef7923:/data# redis-cli --cluster reshard  182.61.35.33:16379 -a dockerredis
    Warning: Using a password with '-a' or '-u' option on the command line interface may not be safe.
    >>> Performing Cluster Check (using node 182.61.35.33:16379)
    S: d1b77c63e1e652b786c9e52e42f7594e9752903c 182.61.35.33:16379
    slots: (0 slots) slave
    replicates 5923fef0a1e7a7b3a77290af1c13e1e57678f6e2
    S: 93fe47529c3f671d6d5b75c46ac965d43b904c34 182.61.35.33:16383
    slots: (0 slots) slave
    replicates b1790b6e64961f2da927cd78ad64cf02463727da
    M: fc576f7421e4b453dc500d4cbe028716bb1efbf8 182.61.35.33:16385
    slots: (0 slots) master
    M: 5923fef0a1e7a7b3a77290af1c13e1e57678f6e2 182.61.35.33:16382
    slots:[0-5460] (5461 slots) master
    1 additional replica(s)
    S: 9d1935b3462566449d9f3c3c38b8d3ab9b97b134 182.61.35.33:16381
    slots: (0 slots) slave
    replicates 6c255660ba138e0cb7ac521ad945bafbf0901f1a
    M: b1790b6e64961f2da927cd78ad64cf02463727da 182.61.35.33:16380
    slots:[5461-10922] (5462 slots) master
    1 additional replica(s)
    M: 6c255660ba138e0cb7ac521ad945bafbf0901f1a 182.61.35.33:16384
    slots:[10923-16383] (5461 slots) master
    1 additional replica(s)
    [OK] All nodes agree about slots configuration.
    >>> Check for open slots...
    >>> Check slots coverage...
    [OK] All 16384 slots covered.
    How many slots do you want to move (from 1 to 16384)? 300
    What is the receiving node ID? fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Please enter all the source node IDs.
    Type 'all' to use all the nodes as source nodes for the hash slots.
    Type 'done' once you entered all the source nodes IDs.
    Source node #1: all

    Ready to move 300 slots.
    Source nodes:
    M: 5923fef0a1e7a7b3a77290af1c13e1e57678f6e2 182.61.35.33:16382
    slots:[0-5460] (5461 slots) master
    1 additional replica(s)
    M: b1790b6e64961f2da927cd78ad64cf02463727da 182.61.35.33:16380
    slots:[5461-10922] (5462 slots) master
    1 additional replica(s)
    M: 6c255660ba138e0cb7ac521ad945bafbf0901f1a 182.61.35.33:16384
    slots:[10923-16383] (5461 slots) master
    1 additional replica(s)
    Destination node:
    M: fc576f7421e4b453dc500d4cbe028716bb1efbf8 182.61.35.33:16385
    slots: (0 slots) master
    Resharding plan:
    Moving slot 5461 from b1790b6e64961f2da927cd78ad64cf02463727da
    Moving slot 5462 from b1790b6e64961f2da927cd78ad64cf02463727da
    Moving slot 5463 from b1790b6e64961f2da927cd78ad64cf02463727da
    Moving slot 5464 from b1790b6e64961f2da927cd78ad64cf02463727da
    Moving slot 5465 from b1790b6e64961f2da927cd78ad64cf02463727da
    Moving slot 5466 from b1790b6e64961f2da927cd78ad64cf02463727da
    Moving slot 5467 from b1790b6e64961f2da927cd78ad64cf02463727da
    Moving slot 5468 from b1790b6e64961f2da927cd78ad64cf02463727da
    Moving slot 5469 from b1790b6e64961f2da927cd78ad64cf02463727da
    Moving slot 5470 from b1790b6e64961f2da927cd78ad64cf02463727da
    Moving slot 5471 from b1790b6e64961f2da927cd78ad64cf02463727da
    Moving slot 5472 from b1790b6e64961f2da927cd78ad64cf02463727da
    Moving slot 5473 from b1790b6e64961f2da927cd78ad64cf02463727da
    Moving slot 5474 from b1790b6e64961f2da927cd78ad64cf02463727da
    Moving slot 5475 from b1790b6e64961f2da927cd78ad64cf02463727da
    Moving slot 5476 from b1790b6e64961f2da927cd78ad64cf02463727da
    Moving slot 5477 from b1790b6e64961f2da927cd78ad64cf02463727da
    Moving slot 5478 from b1790b6e64961f2da927cd78ad64cf02463727da
    Moving slot 5479 from b1790b6e64961f2da927cd78ad64cf02463727da
    Moving slot 5480 from b1790b6e64961f2da927cd78ad64cf02463727da
    Moving slot 5481 from b1790b6e64961f2da927cd78ad64cf02463727da
    Moving slot 5482 from b1790b6e64961f2da927cd78ad64cf02463727da
    Moving slot 5483 from b1790b6e64961f2da927cd78ad64cf02463727da
    Moving slot 5484 from b1790b6e64961f2da927cd78ad64cf02463727da
    Moving slot 5485 from b1790b6e64961f2da927cd78ad64cf02463727da
    Moving slot 5486 from b1790b6e64961f2da927cd78ad64cf02463727da
    Moving slot 5487 from b1790b6e64961f2da927cd78ad64cf02463727da
    Moving slot 5488 from b1790b6e64961f2da927cd78ad64cf02463727da
    Moving slot 5489 from b1790b6e64961f2da927cd78ad64cf02463727da
    Moving slot 5490 from b1790b6e64961f2da927cd78ad64cf02463727da
    Moving slot 5491 from b1790b6e64961f2da927cd78ad64cf02463727da
    Moving slot 5492 from b1790b6e64961f2da927cd78ad64cf02463727da
    Moving slot 5493 from b1790b6e64961f2da927cd78ad64cf02463727da
    Moving slot 5494 from b1790b6e64961f2da927cd78ad64cf02463727da
    Moving slot 5495 from b1790b6e64961f2da927cd78ad64cf02463727da
    Moving slot 5496 from b1790b6e64961f2da927cd78ad64cf02463727da
    Moving slot 5497 from b1790b6e64961f2da927cd78ad64cf02463727da
    Moving slot 5498 from b1790b6e64961f2da927cd78ad64cf02463727da
    Moving slot 5499 from b1790b6e64961f2da927cd78ad64cf02463727da
    Moving slot 5500 from b1790b6e64961f2da927cd78ad64cf02463727da
    Moving slot 5501 from b1790b6e64961f2da927cd78ad64cf02463727da
    Moving slot 5502 from b1790b6e64961f2da927cd78ad64cf02463727da
    Moving slot 5503 from b1790b6e64961f2da927cd78ad64cf02463727da
    Moving slot 5504 from b1790b6e64961f2da927cd78ad64cf02463727da
    Moving slot 5505 from b1790b6e64961f2da927cd78ad64cf02463727da
    Moving slot 5506 from b1790b6e64961f2da927cd78ad64cf02463727da
    Moving slot 5507 from b1790b6e64961f2da927cd78ad64cf02463727da
    Moving slot 5508 from b1790b6e64961f2da927cd78ad64cf02463727da
    Moving slot 5509 from b1790b6e64961f2da927cd78ad64cf02463727da
    Moving slot 5510 from b1790b6e64961f2da927cd78ad64cf02463727da
    Moving slot 5511 from b1790b6e64961f2da927cd78ad64cf02463727da
    Moving slot 5512 from b1790b6e64961f2da927cd78ad64cf02463727da
    Moving slot 5513 from b1790b6e64961f2da927cd78ad64cf02463727da
    Moving slot 5514 from b1790b6e64961f2da927cd78ad64cf02463727da
    Moving slot 5515 from b1790b6e64961f2da927cd78ad64cf02463727da
    Moving slot 5516 from b1790b6e64961f2da927cd78ad64cf02463727da
    Moving slot 5517 from b1790b6e64961f2da927cd78ad64cf02463727da
    Moving slot 5518 from b1790b6e64961f2da927cd78ad64cf02463727da
    Moving slot 5519 from b1790b6e64961f2da927cd78ad64cf02463727da
    Moving slot 5520 from b1790b6e64961f2da927cd78ad64cf02463727da
    Moving slot 5521 from b1790b6e64961f2da927cd78ad64cf02463727da
    Moving slot 5522 from b1790b6e64961f2da927cd78ad64cf02463727da
    Moving slot 5523 from b1790b6e64961f2da927cd78ad64cf02463727da
    Moving slot 5524 from b1790b6e64961f2da927cd78ad64cf02463727da
    Moving slot 5525 from b1790b6e64961f2da927cd78ad64cf02463727da
    Moving slot 5526 from b1790b6e64961f2da927cd78ad64cf02463727da
    Moving slot 5527 from b1790b6e64961f2da927cd78ad64cf02463727da
    Moving slot 5528 from b1790b6e64961f2da927cd78ad64cf02463727da
    Moving slot 5529 from b1790b6e64961f2da927cd78ad64cf02463727da
    Moving slot 5530 from b1790b6e64961f2da927cd78ad64cf02463727da
    Moving slot 5531 from b1790b6e64961f2da927cd78ad64cf02463727da
    Moving slot 5532 from b1790b6e64961f2da927cd78ad64cf02463727da
    Moving slot 5533 from b1790b6e64961f2da927cd78ad64cf02463727da
    Moving slot 5534 from b1790b6e64961f2da927cd78ad64cf02463727da
    Moving slot 5535 from b1790b6e64961f2da927cd78ad64cf02463727da
    Moving slot 5536 from b1790b6e64961f2da927cd78ad64cf02463727da
    Moving slot 5537 from b1790b6e64961f2da927cd78ad64cf02463727da
    Moving slot 5538 from b1790b6e64961f2da927cd78ad64cf02463727da
    Moving slot 5539 from b1790b6e64961f2da927cd78ad64cf02463727da
    Moving slot 5540 from b1790b6e64961f2da927cd78ad64cf02463727da
    Moving slot 5541 from b1790b6e64961f2da927cd78ad64cf02463727da
    Moving slot 5542 from b1790b6e64961f2da927cd78ad64cf02463727da
    Moving slot 5543 from b1790b6e64961f2da927cd78ad64cf02463727da
    Moving slot 5544 from b1790b6e64961f2da927cd78ad64cf02463727da
    Moving slot 5545 from b1790b6e64961f2da927cd78ad64cf02463727da
    Moving slot 5546 from b1790b6e64961f2da927cd78ad64cf02463727da
    Moving slot 5547 from b1790b6e64961f2da927cd78ad64cf02463727da
    Moving slot 5548 from b1790b6e64961f2da927cd78ad64cf02463727da
    Moving slot 5549 from b1790b6e64961f2da927cd78ad64cf02463727da
    Moving slot 5550 from b1790b6e64961f2da927cd78ad64cf02463727da
    Moving slot 5551 from b1790b6e64961f2da927cd78ad64cf02463727da
    Moving slot 5552 from b1790b6e64961f2da927cd78ad64cf02463727da
    Moving slot 5553 from b1790b6e64961f2da927cd78ad64cf02463727da
    Moving slot 5554 from b1790b6e64961f2da927cd78ad64cf02463727da
    Moving slot 5555 from b1790b6e64961f2da927cd78ad64cf02463727da
    Moving slot 5556 from b1790b6e64961f2da927cd78ad64cf02463727da
    Moving slot 5557 from b1790b6e64961f2da927cd78ad64cf02463727da
    Moving slot 5558 from b1790b6e64961f2da927cd78ad64cf02463727da
    Moving slot 5559 from b1790b6e64961f2da927cd78ad64cf02463727da
    Moving slot 5560 from b1790b6e64961f2da927cd78ad64cf02463727da
    Moving slot 5561 from b1790b6e64961f2da927cd78ad64cf02463727da
    Moving slot 0 from 5923fef0a1e7a7b3a77290af1c13e1e57678f6e2
    Moving slot 1 from 5923fef0a1e7a7b3a77290af1c13e1e57678f6e2
    Moving slot 2 from 5923fef0a1e7a7b3a77290af1c13e1e57678f6e2
    Moving slot 3 from 5923fef0a1e7a7b3a77290af1c13e1e57678f6e2
    Moving slot 4 from 5923fef0a1e7a7b3a77290af1c13e1e57678f6e2
    Moving slot 5 from 5923fef0a1e7a7b3a77290af1c13e1e57678f6e2
    Moving slot 6 from 5923fef0a1e7a7b3a77290af1c13e1e57678f6e2
    Moving slot 7 from 5923fef0a1e7a7b3a77290af1c13e1e57678f6e2
    Moving slot 8 from 5923fef0a1e7a7b3a77290af1c13e1e57678f6e2
    Moving slot 9 from 5923fef0a1e7a7b3a77290af1c13e1e57678f6e2
    Moving slot 10 from 5923fef0a1e7a7b3a77290af1c13e1e57678f6e2
    Moving slot 11 from 5923fef0a1e7a7b3a77290af1c13e1e57678f6e2
    Moving slot 12 from 5923fef0a1e7a7b3a77290af1c13e1e57678f6e2
    Moving slot 13 from 5923fef0a1e7a7b3a77290af1c13e1e57678f6e2
    Moving slot 14 from 5923fef0a1e7a7b3a77290af1c13e1e57678f6e2
    Moving slot 15 from 5923fef0a1e7a7b3a77290af1c13e1e57678f6e2
    Moving slot 16 from 5923fef0a1e7a7b3a77290af1c13e1e57678f6e2
    Moving slot 17 from 5923fef0a1e7a7b3a77290af1c13e1e57678f6e2
    Moving slot 18 from 5923fef0a1e7a7b3a77290af1c13e1e57678f6e2
    Moving slot 19 from 5923fef0a1e7a7b3a77290af1c13e1e57678f6e2
    Moving slot 20 from 5923fef0a1e7a7b3a77290af1c13e1e57678f6e2
    Moving slot 21 from 5923fef0a1e7a7b3a77290af1c13e1e57678f6e2
    Moving slot 22 from 5923fef0a1e7a7b3a77290af1c13e1e57678f6e2
    Moving slot 23 from 5923fef0a1e7a7b3a77290af1c13e1e57678f6e2
    Moving slot 24 from 5923fef0a1e7a7b3a77290af1c13e1e57678f6e2
    Moving slot 25 from 5923fef0a1e7a7b3a77290af1c13e1e57678f6e2
    Moving slot 26 from 5923fef0a1e7a7b3a77290af1c13e1e57678f6e2
    Moving slot 27 from 5923fef0a1e7a7b3a77290af1c13e1e57678f6e2
    Moving slot 28 from 5923fef0a1e7a7b3a77290af1c13e1e57678f6e2
    Moving slot 29 from 5923fef0a1e7a7b3a77290af1c13e1e57678f6e2
    Moving slot 30 from 5923fef0a1e7a7b3a77290af1c13e1e57678f6e2
    Moving slot 31 from 5923fef0a1e7a7b3a77290af1c13e1e57678f6e2
    Moving slot 32 from 5923fef0a1e7a7b3a77290af1c13e1e57678f6e2
    Moving slot 33 from 5923fef0a1e7a7b3a77290af1c13e1e57678f6e2
    Moving slot 34 from 5923fef0a1e7a7b3a77290af1c13e1e57678f6e2
    Moving slot 35 from 5923fef0a1e7a7b3a77290af1c13e1e57678f6e2
    Moving slot 36 from 5923fef0a1e7a7b3a77290af1c13e1e57678f6e2
    Moving slot 37 from 5923fef0a1e7a7b3a77290af1c13e1e57678f6e2
    Moving slot 38 from 5923fef0a1e7a7b3a77290af1c13e1e57678f6e2
    Moving slot 39 from 5923fef0a1e7a7b3a77290af1c13e1e57678f6e2
    Moving slot 40 from 5923fef0a1e7a7b3a77290af1c13e1e57678f6e2
    Moving slot 41 from 5923fef0a1e7a7b3a77290af1c13e1e57678f6e2
    Moving slot 42 from 5923fef0a1e7a7b3a77290af1c13e1e57678f6e2
    Moving slot 43 from 5923fef0a1e7a7b3a77290af1c13e1e57678f6e2
    Moving slot 44 from 5923fef0a1e7a7b3a77290af1c13e1e57678f6e2
    Moving slot 45 from 5923fef0a1e7a7b3a77290af1c13e1e57678f6e2
    Moving slot 46 from 5923fef0a1e7a7b3a77290af1c13e1e57678f6e2
    Moving slot 47 from 5923fef0a1e7a7b3a77290af1c13e1e57678f6e2
    Moving slot 48 from 5923fef0a1e7a7b3a77290af1c13e1e57678f6e2
    Moving slot 49 from 5923fef0a1e7a7b3a77290af1c13e1e57678f6e2
    Moving slot 50 from 5923fef0a1e7a7b3a77290af1c13e1e57678f6e2
    Moving slot 51 from 5923fef0a1e7a7b3a77290af1c13e1e57678f6e2
    Moving slot 52 from 5923fef0a1e7a7b3a77290af1c13e1e57678f6e2
    Moving slot 53 from 5923fef0a1e7a7b3a77290af1c13e1e57678f6e2
    Moving slot 54 from 5923fef0a1e7a7b3a77290af1c13e1e57678f6e2
    Moving slot 55 from 5923fef0a1e7a7b3a77290af1c13e1e57678f6e2
    Moving slot 56 from 5923fef0a1e7a7b3a77290af1c13e1e57678f6e2
    Moving slot 57 from 5923fef0a1e7a7b3a77290af1c13e1e57678f6e2
    Moving slot 58 from 5923fef0a1e7a7b3a77290af1c13e1e57678f6e2
    Moving slot 59 from 5923fef0a1e7a7b3a77290af1c13e1e57678f6e2
    Moving slot 60 from 5923fef0a1e7a7b3a77290af1c13e1e57678f6e2
    Moving slot 61 from 5923fef0a1e7a7b3a77290af1c13e1e57678f6e2
    Moving slot 62 from 5923fef0a1e7a7b3a77290af1c13e1e57678f6e2
    Moving slot 63 from 5923fef0a1e7a7b3a77290af1c13e1e57678f6e2
    Moving slot 64 from 5923fef0a1e7a7b3a77290af1c13e1e57678f6e2
    Moving slot 65 from 5923fef0a1e7a7b3a77290af1c13e1e57678f6e2
    Moving slot 66 from 5923fef0a1e7a7b3a77290af1c13e1e57678f6e2
    Moving slot 67 from 5923fef0a1e7a7b3a77290af1c13e1e57678f6e2
    Moving slot 68 from 5923fef0a1e7a7b3a77290af1c13e1e57678f6e2
    Moving slot 69 from 5923fef0a1e7a7b3a77290af1c13e1e57678f6e2
    Moving slot 70 from 5923fef0a1e7a7b3a77290af1c13e1e57678f6e2
    Moving slot 71 from 5923fef0a1e7a7b3a77290af1c13e1e57678f6e2
    Moving slot 72 from 5923fef0a1e7a7b3a77290af1c13e1e57678f6e2
    Moving slot 73 from 5923fef0a1e7a7b3a77290af1c13e1e57678f6e2
    Moving slot 74 from 5923fef0a1e7a7b3a77290af1c13e1e57678f6e2
    Moving slot 75 from 5923fef0a1e7a7b3a77290af1c13e1e57678f6e2
    Moving slot 76 from 5923fef0a1e7a7b3a77290af1c13e1e57678f6e2
    Moving slot 77 from 5923fef0a1e7a7b3a77290af1c13e1e57678f6e2
    Moving slot 78 from 5923fef0a1e7a7b3a77290af1c13e1e57678f6e2
    Moving slot 79 from 5923fef0a1e7a7b3a77290af1c13e1e57678f6e2
    Moving slot 80 from 5923fef0a1e7a7b3a77290af1c13e1e57678f6e2
    Moving slot 81 from 5923fef0a1e7a7b3a77290af1c13e1e57678f6e2
    Moving slot 82 from 5923fef0a1e7a7b3a77290af1c13e1e57678f6e2
    Moving slot 83 from 5923fef0a1e7a7b3a77290af1c13e1e57678f6e2
    Moving slot 84 from 5923fef0a1e7a7b3a77290af1c13e1e57678f6e2
    Moving slot 85 from 5923fef0a1e7a7b3a77290af1c13e1e57678f6e2
    Moving slot 86 from 5923fef0a1e7a7b3a77290af1c13e1e57678f6e2
    Moving slot 87 from 5923fef0a1e7a7b3a77290af1c13e1e57678f6e2
    Moving slot 88 from 5923fef0a1e7a7b3a77290af1c13e1e57678f6e2
    Moving slot 89 from 5923fef0a1e7a7b3a77290af1c13e1e57678f6e2
    Moving slot 90 from 5923fef0a1e7a7b3a77290af1c13e1e57678f6e2
    Moving slot 91 from 5923fef0a1e7a7b3a77290af1c13e1e57678f6e2
    Moving slot 92 from 5923fef0a1e7a7b3a77290af1c13e1e57678f6e2
    Moving slot 93 from 5923fef0a1e7a7b3a77290af1c13e1e57678f6e2
    Moving slot 94 from 5923fef0a1e7a7b3a77290af1c13e1e57678f6e2
    Moving slot 95 from 5923fef0a1e7a7b3a77290af1c13e1e57678f6e2
    Moving slot 96 from 5923fef0a1e7a7b3a77290af1c13e1e57678f6e2
    Moving slot 97 from 5923fef0a1e7a7b3a77290af1c13e1e57678f6e2
    Moving slot 98 from 5923fef0a1e7a7b3a77290af1c13e1e57678f6e2
    Moving slot 10923 from 6c255660ba138e0cb7ac521ad945bafbf0901f1a
    Moving slot 10924 from 6c255660ba138e0cb7ac521ad945bafbf0901f1a
    Moving slot 10925 from 6c255660ba138e0cb7ac521ad945bafbf0901f1a
    Moving slot 10926 from 6c255660ba138e0cb7ac521ad945bafbf0901f1a
    Moving slot 10927 from 6c255660ba138e0cb7ac521ad945bafbf0901f1a
    Moving slot 10928 from 6c255660ba138e0cb7ac521ad945bafbf0901f1a
    Moving slot 10929 from 6c255660ba138e0cb7ac521ad945bafbf0901f1a
    Moving slot 10930 from 6c255660ba138e0cb7ac521ad945bafbf0901f1a
    Moving slot 10931 from 6c255660ba138e0cb7ac521ad945bafbf0901f1a
    Moving slot 10932 from 6c255660ba138e0cb7ac521ad945bafbf0901f1a
    Moving slot 10933 from 6c255660ba138e0cb7ac521ad945bafbf0901f1a
    Moving slot 10934 from 6c255660ba138e0cb7ac521ad945bafbf0901f1a
    Moving slot 10935 from 6c255660ba138e0cb7ac521ad945bafbf0901f1a
    Moving slot 10936 from 6c255660ba138e0cb7ac521ad945bafbf0901f1a
    Moving slot 10937 from 6c255660ba138e0cb7ac521ad945bafbf0901f1a
    Moving slot 10938 from 6c255660ba138e0cb7ac521ad945bafbf0901f1a
    Moving slot 10939 from 6c255660ba138e0cb7ac521ad945bafbf0901f1a
    Moving slot 10940 from 6c255660ba138e0cb7ac521ad945bafbf0901f1a
    Moving slot 10941 from 6c255660ba138e0cb7ac521ad945bafbf0901f1a
    Moving slot 10942 from 6c255660ba138e0cb7ac521ad945bafbf0901f1a
    Moving slot 10943 from 6c255660ba138e0cb7ac521ad945bafbf0901f1a
    Moving slot 10944 from 6c255660ba138e0cb7ac521ad945bafbf0901f1a
    Moving slot 10945 from 6c255660ba138e0cb7ac521ad945bafbf0901f1a
    Moving slot 10946 from 6c255660ba138e0cb7ac521ad945bafbf0901f1a
    Moving slot 10947 from 6c255660ba138e0cb7ac521ad945bafbf0901f1a
    Moving slot 10948 from 6c255660ba138e0cb7ac521ad945bafbf0901f1a
    Moving slot 10949 from 6c255660ba138e0cb7ac521ad945bafbf0901f1a
    Moving slot 10950 from 6c255660ba138e0cb7ac521ad945bafbf0901f1a
    Moving slot 10951 from 6c255660ba138e0cb7ac521ad945bafbf0901f1a
    Moving slot 10952 from 6c255660ba138e0cb7ac521ad945bafbf0901f1a
    Moving slot 10953 from 6c255660ba138e0cb7ac521ad945bafbf0901f1a
    Moving slot 10954 from 6c255660ba138e0cb7ac521ad945bafbf0901f1a
    Moving slot 10955 from 6c255660ba138e0cb7ac521ad945bafbf0901f1a
    Moving slot 10956 from 6c255660ba138e0cb7ac521ad945bafbf0901f1a
    Moving slot 10957 from 6c255660ba138e0cb7ac521ad945bafbf0901f1a
    Moving slot 10958 from 6c255660ba138e0cb7ac521ad945bafbf0901f1a
    Moving slot 10959 from 6c255660ba138e0cb7ac521ad945bafbf0901f1a
    Moving slot 10960 from 6c255660ba138e0cb7ac521ad945bafbf0901f1a
    Moving slot 10961 from 6c255660ba138e0cb7ac521ad945bafbf0901f1a
    Moving slot 10962 from 6c255660ba138e0cb7ac521ad945bafbf0901f1a
    Moving slot 10963 from 6c255660ba138e0cb7ac521ad945bafbf0901f1a
    Moving slot 10964 from 6c255660ba138e0cb7ac521ad945bafbf0901f1a
    Moving slot 10965 from 6c255660ba138e0cb7ac521ad945bafbf0901f1a
    Moving slot 10966 from 6c255660ba138e0cb7ac521ad945bafbf0901f1a
    Moving slot 10967 from 6c255660ba138e0cb7ac521ad945bafbf0901f1a
    Moving slot 10968 from 6c255660ba138e0cb7ac521ad945bafbf0901f1a
    Moving slot 10969 from 6c255660ba138e0cb7ac521ad945bafbf0901f1a
    Moving slot 10970 from 6c255660ba138e0cb7ac521ad945bafbf0901f1a
    Moving slot 10971 from 6c255660ba138e0cb7ac521ad945bafbf0901f1a
    Moving slot 10972 from 6c255660ba138e0cb7ac521ad945bafbf0901f1a
    Moving slot 10973 from 6c255660ba138e0cb7ac521ad945bafbf0901f1a
    Moving slot 10974 from 6c255660ba138e0cb7ac521ad945bafbf0901f1a
    Moving slot 10975 from 6c255660ba138e0cb7ac521ad945bafbf0901f1a
    Moving slot 10976 from 6c255660ba138e0cb7ac521ad945bafbf0901f1a
    Moving slot 10977 from 6c255660ba138e0cb7ac521ad945bafbf0901f1a
    Moving slot 10978 from 6c255660ba138e0cb7ac521ad945bafbf0901f1a
    Moving slot 10979 from 6c255660ba138e0cb7ac521ad945bafbf0901f1a
    Moving slot 10980 from 6c255660ba138e0cb7ac521ad945bafbf0901f1a
    Moving slot 10981 from 6c255660ba138e0cb7ac521ad945bafbf0901f1a
    Moving slot 10982 from 6c255660ba138e0cb7ac521ad945bafbf0901f1a
    Moving slot 10983 from 6c255660ba138e0cb7ac521ad945bafbf0901f1a
    Moving slot 10984 from 6c255660ba138e0cb7ac521ad945bafbf0901f1a
    Moving slot 10985 from 6c255660ba138e0cb7ac521ad945bafbf0901f1a
    Moving slot 10986 from 6c255660ba138e0cb7ac521ad945bafbf0901f1a
    Moving slot 10987 from 6c255660ba138e0cb7ac521ad945bafbf0901f1a
    Moving slot 10988 from 6c255660ba138e0cb7ac521ad945bafbf0901f1a
    Moving slot 10989 from 6c255660ba138e0cb7ac521ad945bafbf0901f1a
    Moving slot 10990 from 6c255660ba138e0cb7ac521ad945bafbf0901f1a
    Moving slot 10991 from 6c255660ba138e0cb7ac521ad945bafbf0901f1a
    Moving slot 10992 from 6c255660ba138e0cb7ac521ad945bafbf0901f1a
    Moving slot 10993 from 6c255660ba138e0cb7ac521ad945bafbf0901f1a
    Moving slot 10994 from 6c255660ba138e0cb7ac521ad945bafbf0901f1a
    Moving slot 10995 from 6c255660ba138e0cb7ac521ad945bafbf0901f1a
    Moving slot 10996 from 6c255660ba138e0cb7ac521ad945bafbf0901f1a
    Moving slot 10997 from 6c255660ba138e0cb7ac521ad945bafbf0901f1a
    Moving slot 10998 from 6c255660ba138e0cb7ac521ad945bafbf0901f1a
    Moving slot 10999 from 6c255660ba138e0cb7ac521ad945bafbf0901f1a
    Moving slot 11000 from 6c255660ba138e0cb7ac521ad945bafbf0901f1a
    Moving slot 11001 from 6c255660ba138e0cb7ac521ad945bafbf0901f1a
    Moving slot 11002 from 6c255660ba138e0cb7ac521ad945bafbf0901f1a
    Moving slot 11003 from 6c255660ba138e0cb7ac521ad945bafbf0901f1a
    Moving slot 11004 from 6c255660ba138e0cb7ac521ad945bafbf0901f1a
    Moving slot 11005 from 6c255660ba138e0cb7ac521ad945bafbf0901f1a
    Moving slot 11006 from 6c255660ba138e0cb7ac521ad945bafbf0901f1a
    Moving slot 11007 from 6c255660ba138e0cb7ac521ad945bafbf0901f1a
    Moving slot 11008 from 6c255660ba138e0cb7ac521ad945bafbf0901f1a
    Moving slot 11009 from 6c255660ba138e0cb7ac521ad945bafbf0901f1a
    Moving slot 11010 from 6c255660ba138e0cb7ac521ad945bafbf0901f1a
    Moving slot 11011 from 6c255660ba138e0cb7ac521ad945bafbf0901f1a
    Moving slot 11012 from 6c255660ba138e0cb7ac521ad945bafbf0901f1a
    Moving slot 11013 from 6c255660ba138e0cb7ac521ad945bafbf0901f1a
    Moving slot 11014 from 6c255660ba138e0cb7ac521ad945bafbf0901f1a
    Moving slot 11015 from 6c255660ba138e0cb7ac521ad945bafbf0901f1a
    Moving slot 11016 from 6c255660ba138e0cb7ac521ad945bafbf0901f1a
    Moving slot 11017 from 6c255660ba138e0cb7ac521ad945bafbf0901f1a
    Moving slot 11018 from 6c255660ba138e0cb7ac521ad945bafbf0901f1a
    Moving slot 11019 from 6c255660ba138e0cb7ac521ad945bafbf0901f1a
    Moving slot 11020 from 6c255660ba138e0cb7ac521ad945bafbf0901f1a
    Moving slot 11021 from 6c255660ba138e0cb7ac521ad945bafbf0901f1a
    Do you want to proceed with the proposed reshard plan (yes/no)? yes
    Moving slot 5461 from 182.61.35.33:16380 to 182.61.35.33:16385:
    Moving slot 5462 from 182.61.35.33:16380 to 182.61.35.33:16385:
    Moving slot 5463 from 182.61.35.33:16380 to 182.61.35.33:16385:
    Moving slot 5464 from 182.61.35.33:16380 to 182.61.35.33:16385:
    Moving slot 5465 from 182.61.35.33:16380 to 182.61.35.33:16385:
    Moving slot 5466 from 182.61.35.33:16380 to 182.61.35.33:16385:
    Moving slot 5467 from 182.61.35.33:16380 to 182.61.35.33:16385:
    Moving slot 5468 from 182.61.35.33:16380 to 182.61.35.33:16385:
    Moving slot 5469 from 182.61.35.33:16380 to 182.61.35.33:16385:
    Moving slot 5470 from 182.61.35.33:16380 to 182.61.35.33:16385:
    Moving slot 5471 from 182.61.35.33:16380 to 182.61.35.33:16385:
    Moving slot 5472 from 182.61.35.33:16380 to 182.61.35.33:16385:
    Moving slot 5473 from 182.61.35.33:16380 to 182.61.35.33:16385:
    Moving slot 5474 from 182.61.35.33:16380 to 182.61.35.33:16385:
    Moving slot 5475 from 182.61.35.33:16380 to 182.61.35.33:16385:
    Moving slot 5476 from 182.61.35.33:16380 to 182.61.35.33:16385:
    Moving slot 5477 from 182.61.35.33:16380 to 182.61.35.33:16385:
    Moving slot 5478 from 182.61.35.33:16380 to 182.61.35.33:16385:
    Moving slot 5479 from 182.61.35.33:16380 to 182.61.35.33:16385:
    Moving slot 5480 from 182.61.35.33:16380 to 182.61.35.33:16385:
    Moving slot 5481 from 182.61.35.33:16380 to 182.61.35.33:16385:
    Moving slot 5482 from 182.61.35.33:16380 to 182.61.35.33:16385:
    Moving slot 5483 from 182.61.35.33:16380 to 182.61.35.33:16385:
    Moving slot 5484 from 182.61.35.33:16380 to 182.61.35.33:16385:
    Moving slot 5485 from 182.61.35.33:16380 to 182.61.35.33:16385:
    Moving slot 5486 from 182.61.35.33:16380 to 182.61.35.33:16385:
    Moving slot 5487 from 182.61.35.33:16380 to 182.61.35.33:16385:
    Moving slot 5488 from 182.61.35.33:16380 to 182.61.35.33:16385:
    Moving slot 5489 from 182.61.35.33:16380 to 182.61.35.33:16385:
    Moving slot 5490 from 182.61.35.33:16380 to 182.61.35.33:16385:
    Moving slot 5491 from 182.61.35.33:16380 to 182.61.35.33:16385:
    Moving slot 5492 from 182.61.35.33:16380 to 182.61.35.33:16385:
    Moving slot 5493 from 182.61.35.33:16380 to 182.61.35.33:16385:
    Moving slot 5494 from 182.61.35.33:16380 to 182.61.35.33:16385:
    Moving slot 5495 from 182.61.35.33:16380 to 182.61.35.33:16385:
    Moving slot 5496 from 182.61.35.33:16380 to 182.61.35.33:16385:
    Moving slot 5497 from 182.61.35.33:16380 to 182.61.35.33:16385:
    Moving slot 5498 from 182.61.35.33:16380 to 182.61.35.33:16385:
    Moving slot 5499 from 182.61.35.33:16380 to 182.61.35.33:16385:
    Moving slot 5500 from 182.61.35.33:16380 to 182.61.35.33:16385:
    Moving slot 5501 from 182.61.35.33:16380 to 182.61.35.33:16385:
    Moving slot 5502 from 182.61.35.33:16380 to 182.61.35.33:16385:
    Moving slot 5503 from 182.61.35.33:16380 to 182.61.35.33:16385:
    Moving slot 5504 from 182.61.35.33:16380 to 182.61.35.33:16385:
    Moving slot 5505 from 182.61.35.33:16380 to 182.61.35.33:16385:
    Moving slot 5506 from 182.61.35.33:16380 to 182.61.35.33:16385:
    Moving slot 5507 from 182.61.35.33:16380 to 182.61.35.33:16385:
    Moving slot 5508 from 182.61.35.33:16380 to 182.61.35.33:16385:
    Moving slot 5509 from 182.61.35.33:16380 to 182.61.35.33:16385:
    Moving slot 5510 from 182.61.35.33:16380 to 182.61.35.33:16385:
    Moving slot 5511 from 182.61.35.33:16380 to 182.61.35.33:16385:
    Moving slot 5512 from 182.61.35.33:16380 to 182.61.35.33:16385:
    Moving slot 5513 from 182.61.35.33:16380 to 182.61.35.33:16385:
    Moving slot 5514 from 182.61.35.33:16380 to 182.61.35.33:16385:
    Moving slot 5515 from 182.61.35.33:16380 to 182.61.35.33:16385:
    Moving slot 5516 from 182.61.35.33:16380 to 182.61.35.33:16385:
    Moving slot 5517 from 182.61.35.33:16380 to 182.61.35.33:16385:
    Moving slot 5518 from 182.61.35.33:16380 to 182.61.35.33:16385:
    Moving slot 5519 from 182.61.35.33:16380 to 182.61.35.33:16385:
    Moving slot 5520 from 182.61.35.33:16380 to 182.61.35.33:16385:
    Moving slot 5521 from 182.61.35.33:16380 to 182.61.35.33:16385:
    Moving slot 5522 from 182.61.35.33:16380 to 182.61.35.33:16385:
    Moving slot 5523 from 182.61.35.33:16380 to 182.61.35.33:16385:
    Moving slot 5524 from 182.61.35.33:16380 to 182.61.35.33:16385:
    Moving slot 5525 from 182.61.35.33:16380 to 182.61.35.33:16385:
    Moving slot 5526 from 182.61.35.33:16380 to 182.61.35.33:16385:
    Moving slot 5527 from 182.61.35.33:16380 to 182.61.35.33:16385:
    Moving slot 5528 from 182.61.35.33:16380 to 182.61.35.33:16385:
    Moving slot 5529 from 182.61.35.33:16380 to 182.61.35.33:16385:
    Moving slot 5530 from 182.61.35.33:16380 to 182.61.35.33:16385:
    Moving slot 5531 from 182.61.35.33:16380 to 182.61.35.33:16385:
    Moving slot 5532 from 182.61.35.33:16380 to 182.61.35.33:16385:
    Moving slot 5533 from 182.61.35.33:16380 to 182.61.35.33:16385:
    Moving slot 5534 from 182.61.35.33:16380 to 182.61.35.33:16385:
    Moving slot 5535 from 182.61.35.33:16380 to 182.61.35.33:16385:
    Moving slot 5536 from 182.61.35.33:16380 to 182.61.35.33:16385:
    Moving slot 5537 from 182.61.35.33:16380 to 182.61.35.33:16385:
    Moving slot 5538 from 182.61.35.33:16380 to 182.61.35.33:16385:
    Moving slot 5539 from 182.61.35.33:16380 to 182.61.35.33:16385:
    Moving slot 5540 from 182.61.35.33:16380 to 182.61.35.33:16385:
    Moving slot 5541 from 182.61.35.33:16380 to 182.61.35.33:16385:
    Moving slot 5542 from 182.61.35.33:16380 to 182.61.35.33:16385:
    Moving slot 5543 from 182.61.35.33:16380 to 182.61.35.33:16385:
    Moving slot 5544 from 182.61.35.33:16380 to 182.61.35.33:16385:
    Moving slot 5545 from 182.61.35.33:16380 to 182.61.35.33:16385:
    Moving slot 5546 from 182.61.35.33:16380 to 182.61.35.33:16385:
    Moving slot 5547 from 182.61.35.33:16380 to 182.61.35.33:16385:
    Moving slot 5548 from 182.61.35.33:16380 to 182.61.35.33:16385:
    Moving slot 5549 from 182.61.35.33:16380 to 182.61.35.33:16385:
    Moving slot 5550 from 182.61.35.33:16380 to 182.61.35.33:16385:
    Moving slot 5551 from 182.61.35.33:16380 to 182.61.35.33:16385:
    Moving slot 5552 from 182.61.35.33:16380 to 182.61.35.33:16385:
    Moving slot 5553 from 182.61.35.33:16380 to 182.61.35.33:16385:
    Moving slot 5554 from 182.61.35.33:16380 to 182.61.35.33:16385:
    Moving slot 5555 from 182.61.35.33:16380 to 182.61.35.33:16385:
    Moving slot 5556 from 182.61.35.33:16380 to 182.61.35.33:16385:
    Moving slot 5557 from 182.61.35.33:16380 to 182.61.35.33:16385:
    Moving slot 5558 from 182.61.35.33:16380 to 182.61.35.33:16385:
    Moving slot 5559 from 182.61.35.33:16380 to 182.61.35.33:16385:
    Moving slot 5560 from 182.61.35.33:16380 to 182.61.35.33:16385:
    Moving slot 5561 from 182.61.35.33:16380 to 182.61.35.33:16385:
    Moving slot 0 from 182.61.35.33:16382 to 182.61.35.33:16385:
    Moving slot 1 from 182.61.35.33:16382 to 182.61.35.33:16385:
    Moving slot 2 from 182.61.35.33:16382 to 182.61.35.33:16385:
    Moving slot 3 from 182.61.35.33:16382 to 182.61.35.33:16385:
    Moving slot 4 from 182.61.35.33:16382 to 182.61.35.33:16385:
    Moving slot 5 from 182.61.35.33:16382 to 182.61.35.33:16385:
    Moving slot 6 from 182.61.35.33:16382 to 182.61.35.33:16385:
    Moving slot 7 from 182.61.35.33:16382 to 182.61.35.33:16385:
    Moving slot 8 from 182.61.35.33:16382 to 182.61.35.33:16385:
    Moving slot 9 from 182.61.35.33:16382 to 182.61.35.33:16385:
    Moving slot 10 from 182.61.35.33:16382 to 182.61.35.33:16385:
    Moving slot 11 from 182.61.35.33:16382 to 182.61.35.33:16385:
    Moving slot 12 from 182.61.35.33:16382 to 182.61.35.33:16385:
    Moving slot 13 from 182.61.35.33:16382 to 182.61.35.33:16385:
    Moving slot 14 from 182.61.35.33:16382 to 182.61.35.33:16385:
    Moving slot 15 from 182.61.35.33:16382 to 182.61.35.33:16385:
    Moving slot 16 from 182.61.35.33:16382 to 182.61.35.33:16385:
    Moving slot 17 from 182.61.35.33:16382 to 182.61.35.33:16385:
    Moving slot 18 from 182.61.35.33:16382 to 182.61.35.33:16385:
    Moving slot 19 from 182.61.35.33:16382 to 182.61.35.33:16385:
    Moving slot 20 from 182.61.35.33:16382 to 182.61.35.33:16385:
    Moving slot 21 from 182.61.35.33:16382 to 182.61.35.33:16385:
    Moving slot 22 from 182.61.35.33:16382 to 182.61.35.33:16385:
    Moving slot 23 from 182.61.35.33:16382 to 182.61.35.33:16385:
    Moving slot 24 from 182.61.35.33:16382 to 182.61.35.33:16385:
    Moving slot 25 from 182.61.35.33:16382 to 182.61.35.33:16385:
    Moving slot 26 from 182.61.35.33:16382 to 182.61.35.33:16385:
    Moving slot 27 from 182.61.35.33:16382 to 182.61.35.33:16385:
    Moving slot 28 from 182.61.35.33:16382 to 182.61.35.33:16385:
    Moving slot 29 from 182.61.35.33:16382 to 182.61.35.33:16385:
    Moving slot 30 from 182.61.35.33:16382 to 182.61.35.33:16385:
    Moving slot 31 from 182.61.35.33:16382 to 182.61.35.33:16385:
    Moving slot 32 from 182.61.35.33:16382 to 182.61.35.33:16385:
    Moving slot 33 from 182.61.35.33:16382 to 182.61.35.33:16385:
    Moving slot 34 from 182.61.35.33:16382 to 182.61.35.33:16385:
    Moving slot 35 from 182.61.35.33:16382 to 182.61.35.33:16385:
    Moving slot 36 from 182.61.35.33:16382 to 182.61.35.33:16385:
    Moving slot 37 from 182.61.35.33:16382 to 182.61.35.33:16385:
    Moving slot 38 from 182.61.35.33:16382 to 182.61.35.33:16385:
    Moving slot 39 from 182.61.35.33:16382 to 182.61.35.33:16385:
    Moving slot 40 from 182.61.35.33:16382 to 182.61.35.33:16385:
    Moving slot 41 from 182.61.35.33:16382 to 182.61.35.33:16385:
    Moving slot 42 from 182.61.35.33:16382 to 182.61.35.33:16385:
    Moving slot 43 from 182.61.35.33:16382 to 182.61.35.33:16385:
    Moving slot 44 from 182.61.35.33:16382 to 182.61.35.33:16385:
    Moving slot 45 from 182.61.35.33:16382 to 182.61.35.33:16385:
    Moving slot 46 from 182.61.35.33:16382 to 182.61.35.33:16385:
    Moving slot 47 from 182.61.35.33:16382 to 182.61.35.33:16385:
    Moving slot 48 from 182.61.35.33:16382 to 182.61.35.33:16385:
    Moving slot 49 from 182.61.35.33:16382 to 182.61.35.33:16385:
    Moving slot 50 from 182.61.35.33:16382 to 182.61.35.33:16385:
    Moving slot 51 from 182.61.35.33:16382 to 182.61.35.33:16385:
    Moving slot 52 from 182.61.35.33:16382 to 182.61.35.33:16385:
    Moving slot 53 from 182.61.35.33:16382 to 182.61.35.33:16385:
    Moving slot 54 from 182.61.35.33:16382 to 182.61.35.33:16385:
    Moving slot 55 from 182.61.35.33:16382 to 182.61.35.33:16385:
    Moving slot 56 from 182.61.35.33:16382 to 182.61.35.33:16385:
    Moving slot 57 from 182.61.35.33:16382 to 182.61.35.33:16385:
    Moving slot 58 from 182.61.35.33:16382 to 182.61.35.33:16385:
    Moving slot 59 from 182.61.35.33:16382 to 182.61.35.33:16385:
    Moving slot 60 from 182.61.35.33:16382 to 182.61.35.33:16385:
    Moving slot 61 from 182.61.35.33:16382 to 182.61.35.33:16385:
    Moving slot 62 from 182.61.35.33:16382 to 182.61.35.33:16385:
    Moving slot 63 from 182.61.35.33:16382 to 182.61.35.33:16385:
    Moving slot 64 from 182.61.35.33:16382 to 182.61.35.33:16385:
    Moving slot 65 from 182.61.35.33:16382 to 182.61.35.33:16385:
    Moving slot 66 from 182.61.35.33:16382 to 182.61.35.33:16385:
    Moving slot 67 from 182.61.35.33:16382 to 182.61.35.33:16385:
    Moving slot 68 from 182.61.35.33:16382 to 182.61.35.33:16385:
    Moving slot 69 from 182.61.35.33:16382 to 182.61.35.33:16385:
    Moving slot 70 from 182.61.35.33:16382 to 182.61.35.33:16385:
    Moving slot 71 from 182.61.35.33:16382 to 182.61.35.33:16385:
    Moving slot 72 from 182.61.35.33:16382 to 182.61.35.33:16385:
    Moving slot 73 from 182.61.35.33:16382 to 182.61.35.33:16385:
    Moving slot 74 from 182.61.35.33:16382 to 182.61.35.33:16385:
    Moving slot 75 from 182.61.35.33:16382 to 182.61.35.33:16385:
    Moving slot 76 from 182.61.35.33:16382 to 182.61.35.33:16385:
    Moving slot 77 from 182.61.35.33:16382 to 182.61.35.33:16385:
    Moving slot 78 from 182.61.35.33:16382 to 182.61.35.33:16385:
    Moving slot 79 from 182.61.35.33:16382 to 182.61.35.33:16385:
    Moving slot 80 from 182.61.35.33:16382 to 182.61.35.33:16385:
    Moving slot 81 from 182.61.35.33:16382 to 182.61.35.33:16385:
    Moving slot 82 from 182.61.35.33:16382 to 182.61.35.33:16385:
    Moving slot 83 from 182.61.35.33:16382 to 182.61.35.33:16385:
    Moving slot 84 from 182.61.35.33:16382 to 182.61.35.33:16385:
    Moving slot 85 from 182.61.35.33:16382 to 182.61.35.33:16385:
    Moving slot 86 from 182.61.35.33:16382 to 182.61.35.33:16385:
    Moving slot 87 from 182.61.35.33:16382 to 182.61.35.33:16385:
    Moving slot 88 from 182.61.35.33:16382 to 182.61.35.33:16385:
    Moving slot 89 from 182.61.35.33:16382 to 182.61.35.33:16385:
    Moving slot 90 from 182.61.35.33:16382 to 182.61.35.33:16385:
    Moving slot 91 from 182.61.35.33:16382 to 182.61.35.33:16385:
    Moving slot 92 from 182.61.35.33:16382 to 182.61.35.33:16385:
    Moving slot 93 from 182.61.35.33:16382 to 182.61.35.33:16385:
    Moving slot 94 from 182.61.35.33:16382 to 182.61.35.33:16385:
    Moving slot 95 from 182.61.35.33:16382 to 182.61.35.33:16385:
    Moving slot 96 from 182.61.35.33:16382 to 182.61.35.33:16385:
    Moving slot 97 from 182.61.35.33:16382 to 182.61.35.33:16385:
    Moving slot 98 from 182.61.35.33:16382 to 182.61.35.33:16385:
    Moving slot 10923 from 182.61.35.33:16384 to 182.61.35.33:16385:
    Moving slot 10924 from 182.61.35.33:16384 to 182.61.35.33:16385:
    Moving slot 10925 from 182.61.35.33:16384 to 182.61.35.33:16385:
    Moving slot 10926 from 182.61.35.33:16384 to 182.61.35.33:16385:
    Moving slot 10927 from 182.61.35.33:16384 to 182.61.35.33:16385:
    Moving slot 10928 from 182.61.35.33:16384 to 182.61.35.33:16385:
    Moving slot 10929 from 182.61.35.33:16384 to 182.61.35.33:16385:
    Moving slot 10930 from 182.61.35.33:16384 to 182.61.35.33:16385:
    Moving slot 10931 from 182.61.35.33:16384 to 182.61.35.33:16385:
    Moving slot 10932 from 182.61.35.33:16384 to 182.61.35.33:16385:
    Moving slot 10933 from 182.61.35.33:16384 to 182.61.35.33:16385:
    Moving slot 10934 from 182.61.35.33:16384 to 182.61.35.33:16385:
    Moving slot 10935 from 182.61.35.33:16384 to 182.61.35.33:16385:
    Moving slot 10936 from 182.61.35.33:16384 to 182.61.35.33:16385:
    Moving slot 10937 from 182.61.35.33:16384 to 182.61.35.33:16385:
    Moving slot 10938 from 182.61.35.33:16384 to 182.61.35.33:16385:
    Moving slot 10939 from 182.61.35.33:16384 to 182.61.35.33:16385:
    Moving slot 10940 from 182.61.35.33:16384 to 182.61.35.33:16385:
    Moving slot 10941 from 182.61.35.33:16384 to 182.61.35.33:16385:
    Moving slot 10942 from 182.61.35.33:16384 to 182.61.35.33:16385:
    Moving slot 10943 from 182.61.35.33:16384 to 182.61.35.33:16385:
    Moving slot 10944 from 182.61.35.33:16384 to 182.61.35.33:16385:
    Moving slot 10945 from 182.61.35.33:16384 to 182.61.35.33:16385:
    Moving slot 10946 from 182.61.35.33:16384 to 182.61.35.33:16385:
    Moving slot 10947 from 182.61.35.33:16384 to 182.61.35.33:16385:
    Moving slot 10948 from 182.61.35.33:16384 to 182.61.35.33:16385:
    Moving slot 10949 from 182.61.35.33:16384 to 182.61.35.33:16385:
    Moving slot 10950 from 182.61.35.33:16384 to 182.61.35.33:16385:
    Moving slot 10951 from 182.61.35.33:16384 to 182.61.35.33:16385:
    Moving slot 10952 from 182.61.35.33:16384 to 182.61.35.33:16385:
    Moving slot 10953 from 182.61.35.33:16384 to 182.61.35.33:16385:
    Moving slot 10954 from 182.61.35.33:16384 to 182.61.35.33:16385:
    Moving slot 10955 from 182.61.35.33:16384 to 182.61.35.33:16385:
    Moving slot 10956 from 182.61.35.33:16384 to 182.61.35.33:16385:
    Moving slot 10957 from 182.61.35.33:16384 to 182.61.35.33:16385:
    Moving slot 10958 from 182.61.35.33:16384 to 182.61.35.33:16385:
    Moving slot 10959 from 182.61.35.33:16384 to 182.61.35.33:16385:
    Moving slot 10960 from 182.61.35.33:16384 to 182.61.35.33:16385:
    Moving slot 10961 from 182.61.35.33:16384 to 182.61.35.33:16385:
    Moving slot 10962 from 182.61.35.33:16384 to 182.61.35.33:16385:
    Moving slot 10963 from 182.61.35.33:16384 to 182.61.35.33:16385:
    Moving slot 10964 from 182.61.35.33:16384 to 182.61.35.33:16385:
    Moving slot 10965 from 182.61.35.33:16384 to 182.61.35.33:16385:
    Moving slot 10966 from 182.61.35.33:16384 to 182.61.35.33:16385:
    Moving slot 10967 from 182.61.35.33:16384 to 182.61.35.33:16385:
    Moving slot 10968 from 182.61.35.33:16384 to 182.61.35.33:16385:
    Moving slot 10969 from 182.61.35.33:16384 to 182.61.35.33:16385:
    Moving slot 10970 from 182.61.35.33:16384 to 182.61.35.33:16385:
    Moving slot 10971 from 182.61.35.33:16384 to 182.61.35.33:16385:
    Moving slot 10972 from 182.61.35.33:16384 to 182.61.35.33:16385:
    Moving slot 10973 from 182.61.35.33:16384 to 182.61.35.33:16385:
    Moving slot 10974 from 182.61.35.33:16384 to 182.61.35.33:16385:
    Moving slot 10975 from 182.61.35.33:16384 to 182.61.35.33:16385:
    Moving slot 10976 from 182.61.35.33:16384 to 182.61.35.33:16385:
    Moving slot 10977 from 182.61.35.33:16384 to 182.61.35.33:16385:
    Moving slot 10978 from 182.61.35.33:16384 to 182.61.35.33:16385:
    Moving slot 10979 from 182.61.35.33:16384 to 182.61.35.33:16385:
    Moving slot 10980 from 182.61.35.33:16384 to 182.61.35.33:16385:
    Moving slot 10981 from 182.61.35.33:16384 to 182.61.35.33:16385:
    Moving slot 10982 from 182.61.35.33:16384 to 182.61.35.33:16385:
    Moving slot 10983 from 182.61.35.33:16384 to 182.61.35.33:16385:
    Moving slot 10984 from 182.61.35.33:16384 to 182.61.35.33:16385:
    Moving slot 10985 from 182.61.35.33:16384 to 182.61.35.33:16385:
    Moving slot 10986 from 182.61.35.33:16384 to 182.61.35.33:16385:
    Moving slot 10987 from 182.61.35.33:16384 to 182.61.35.33:16385:
    Moving slot 10988 from 182.61.35.33:16384 to 182.61.35.33:16385:
    Moving slot 10989 from 182.61.35.33:16384 to 182.61.35.33:16385:
    Moving slot 10990 from 182.61.35.33:16384 to 182.61.35.33:16385:
    Moving slot 10991 from 182.61.35.33:16384 to 182.61.35.33:16385:
    Moving slot 10992 from 182.61.35.33:16384 to 182.61.35.33:16385:
    Moving slot 10993 from 182.61.35.33:16384 to 182.61.35.33:16385:
    Moving slot 10994 from 182.61.35.33:16384 to 182.61.35.33:16385:
    Moving slot 10995 from 182.61.35.33:16384 to 182.61.35.33:16385:
    Moving slot 10996 from 182.61.35.33:16384 to 182.61.35.33:16385:
    Moving slot 10997 from 182.61.35.33:16384 to 182.61.35.33:16385:
    Moving slot 10998 from 182.61.35.33:16384 to 182.61.35.33:16385:
    Moving slot 10999 from 182.61.35.33:16384 to 182.61.35.33:16385:
    Moving slot 11000 from 182.61.35.33:16384 to 182.61.35.33:16385:
    Moving slot 11001 from 182.61.35.33:16384 to 182.61.35.33:16385:
    Moving slot 11002 from 182.61.35.33:16384 to 182.61.35.33:16385:
    Moving slot 11003 from 182.61.35.33:16384 to 182.61.35.33:16385:
    Moving slot 11004 from 182.61.35.33:16384 to 182.61.35.33:16385:
    Moving slot 11005 from 182.61.35.33:16384 to 182.61.35.33:16385:
    Moving slot 11006 from 182.61.35.33:16384 to 182.61.35.33:16385:
    Moving slot 11007 from 182.61.35.33:16384 to 182.61.35.33:16385:
    Moving slot 11008 from 182.61.35.33:16384 to 182.61.35.33:16385:
    Moving slot 11009 from 182.61.35.33:16384 to 182.61.35.33:16385:
    Moving slot 11010 from 182.61.35.33:16384 to 182.61.35.33:16385:
    Moving slot 11011 from 182.61.35.33:16384 to 182.61.35.33:16385:
    Moving slot 11012 from 182.61.35.33:16384 to 182.61.35.33:16385:
    Moving slot 11013 from 182.61.35.33:16384 to 182.61.35.33:16385:
    Moving slot 11014 from 182.61.35.33:16384 to 182.61.35.33:16385:
    Moving slot 11015 from 182.61.35.33:16384 to 182.61.35.33:16385:
    Moving slot 11016 from 182.61.35.33:16384 to 182.61.35.33:16385:
    Moving slot 11017 from 182.61.35.33:16384 to 182.61.35.33:16385:
    Moving slot 11018 from 182.61.35.33:16384 to 182.61.35.33:16385:
    Moving slot 11019 from 182.61.35.33:16384 to 182.61.35.33:16385:
    Moving slot 11020 from 182.61.35.33:16384 to 182.61.35.33:16385:
    Moving slot 11021 from 182.61.35.33:16384 to 182.61.35.33:16385:
    上面有几个选项:
  • How many slots do you want to move (from 1 to 16384)? 要迁移的数量
  • What is the receiving node ID? 要迁移到的目的redis node id
  • Please enter all the source node IDs. 这里有两个选项:输入all,则随机在已有哈希槽上随机迁移。输入源node id,则是在指定redis中取出相应数量的哈希槽。
    当哈希槽分配完毕后,我们就可以看到新节点的哈希槽信息:
    1
    2
    3
    4
    5
    6
    7
    8
    9
    182.61.35.33:16379> cluster nodes
    93fe47529c3f671d6d5b75c46ac965d43b904c34 182.61.35.33:16383@26383 slave b1790b6e64961f2da927cd78ad64cf02463727da 0 1579941661922 14 connected
    fc576f7421e4b453dc500d4cbe028716bb1efbf8 182.61.35.33:16385@26385 master - 0 1579941658912 19 connected 0-98 5461-5561 10923-11021
    5923fef0a1e7a7b3a77290af1c13e1e57678f6e2 182.61.35.33:16382@26382 master - 0 1579941660000 18 connected 99-5460
    9d1935b3462566449d9f3c3c38b8d3ab9b97b134 182.61.35.33:16381@26381 slave 6c255660ba138e0cb7ac521ad945bafbf0901f1a 0 1579941659000 15 connected
    b1790b6e64961f2da927cd78ad64cf02463727da 182.61.35.33:16380@26380 master - 0 1579941660919 14 connected 5562-10922
    d1b77c63e1e652b786c9e52e42f7594e9752903c 182.61.35.33:16379@26379 myself,slave 5923fef0a1e7a7b3a77290af1c13e1e57678f6e2 0 1579941656000 13 connected
    6c255660ba138e0cb7ac521ad945bafbf0901f1a 182.61.35.33:16384@26384 master - 0 1579941659915 15 connected 11022-16383

    但是它没有从节点,现在我们就给它添加一个从节点去。这时候我们先把16386的节点添加到集群:
    1
    2
    3
    4
    5
    6
    7
    8
    9
    10
    11
    12
    13
    14
    15
    16
    17
    18
    19
    20
    21
    22
    23
    24
    25
    26
    27
    28
    29
    30
    31
    32
    33
    34
    35
    36
    37
    38
    39
    40
    root@6fba3a16d91d:/data# redis-cli --cluster add-node 182.61.35.33:16386 182.61.35.33:16379 -a dockerredis
    Warning: Using a password with '-a' or '-u' option on the command line interface may not be safe.
    >>> Adding node 182.61.35.33:16386 to cluster 182.61.35.33:16379
    >>> Performing Cluster Check (using node 182.61.35.33:16379)
    S: d1b77c63e1e652b786c9e52e42f7594e9752903c 182.61.35.33:16379
    slots: (0 slots) slave
    replicates 5923fef0a1e7a7b3a77290af1c13e1e57678f6e2
    S: 93fe47529c3f671d6d5b75c46ac965d43b904c34 182.61.35.33:16383
    slots: (0 slots) slave
    replicates b1790b6e64961f2da927cd78ad64cf02463727da
    M: fc576f7421e4b453dc500d4cbe028716bb1efbf8 182.61.35.33:16385
    slots:[0-98],[5461-5561],[10923-11021] (299 slots) master
    M: 5923fef0a1e7a7b3a77290af1c13e1e57678f6e2 182.61.35.33:16382
    slots:[99-5460] (5362 slots) master
    1 additional replica(s)
    S: 9d1935b3462566449d9f3c3c38b8d3ab9b97b134 182.61.35.33:16381
    slots: (0 slots) slave
    replicates 6c255660ba138e0cb7ac521ad945bafbf0901f1a
    M: b1790b6e64961f2da927cd78ad64cf02463727da 182.61.35.33:16380
    slots:[5562-10922] (5361 slots) master
    1 additional replica(s)
    M: 6c255660ba138e0cb7ac521ad945bafbf0901f1a 182.61.35.33:16384
    slots:[11022-16383] (5362 slots) master
    1 additional replica(s)
    [OK] All nodes agree about slots configuration.
    >>> Check for open slots...
    >>> Check slots coverage...
    [OK] All 16384 slots covered.
    >>> Send CLUSTER MEET to node 182.61.35.33:16386 to make it join the cluster.
    [OK] New node added correctly.
    182.61.35.33:16380> cluster nodes
    9d1935b3462566449d9f3c3c38b8d3ab9b97b134 182.61.35.33:16381@26381 slave 6c255660ba138e0cb7ac521ad945bafbf0901f1a 0 1579942113607 15 connected
    aa8b86fd7a3396f2c1eb43b3a5d1e98c3a791cca 182.61.35.33:16386@26386 master - 0 1579942110000 0 connected
    fc576f7421e4b453dc500d4cbe028716bb1efbf8 182.61.35.33:16385@26385 master - 0 1579942112000 19 connected 0-98 5461-5561 10923-11021
    b1790b6e64961f2da927cd78ad64cf02463727da 182.61.35.33:16380@26380 myself,master - 0 1579942110000 14 connected 5562-10922
    6c255660ba138e0cb7ac521ad945bafbf0901f1a 182.61.35.33:16384@26384 master - 0 1579942111000 15 connected 11022-16383
    5923fef0a1e7a7b3a77290af1c13e1e57678f6e2 182.61.35.33:16382@26382 master - 0 1579942109000 18 connected 99-5460
    d1b77c63e1e652b786c9e52e42f7594e9752903c 182.61.35.33:16379@26379 slave 5923fef0a1e7a7b3a77290af1c13e1e57678f6e2 0 1579942111000 18 connected
    93fe47529c3f671d6d5b75c46ac965d43b904c34 182.61.35.33:16383@26383 slave b1790b6e64961f2da927cd78ad64cf02463727da 0 1579942112604 14 connected

    我们可以从上面的信息中看到,新添加端口为16386的节点依然为一个master节点,这时候,我们需要把它变为16385的从节点,需要进行cluster replicate nodeId这个命令,但是这时候如果直接添加的话就会报错:
    1
    2
    3
    182.61.35.33:16380> cluster replicate fc576f7421e4b453dc500d4cbe028716bb1efbf8
    (error) ERR To set a master the node must be empty and without assigned slots.

    这是因为主节点和从节点要都为空,才能添加主从关系。所以,我们就麻烦一点,先把slot迁移走。
    1
    2
    3
    4
    5
    6
    7
    8
    9
    10
    11
    12
    13
    14
    15
    16
    17
    18
    19
    20
    21
    22
    23
    24
    25
    26
    27
    28
    29
    30
    31
    32
    33
    34
    35
    36
    37
    38
    39
    40
    41
    42
    43
    44
    45
    46
    47
    48
    49
    50
    51
    52
    53
    54
    55
    56
    57
    58
    59
    60
    61
    62
    63
    64
    65
    66
    67
    68
    69
    70
    71
    72
    73
    74
    75
    76
    77
    78
    79
    80
    81
    82
    83
    84
    85
    86
    87
    88
    89
    90
    91
    92
    93
    94
    95
    96
    97
    98
    99
    100
    101
    102
    103
    104
    105
    106
    107
    108
    109
    110
    111
    112
    113
    114
    115
    116
    117
    118
    119
    120
    121
    122
    123
    124
    125
    126
    127
    128
    129
    130
    131
    132
    133
    134
    135
    136
    137
    138
    139
    140
    141
    142
    143
    144
    145
    146
    147
    148
    149
    150
    151
    152
    153
    154
    155
    156
    157
    158
    159
    160
    161
    162
    163
    164
    165
    166
    167
    168
    169
    170
    171
    172
    173
    174
    175
    176
    177
    178
    179
    180
    181
    182
    183
    184
    185
    186
    187
    188
    189
    190
    191
    192
    193
    194
    195
    196
    197
    198
    199
    200
    201
    202
    203
    204
    205
    206
    207
    208
    209
    210
    211
    212
    213
    214
    215
    216
    217
    218
    219
    220
    221
    222
    223
    224
    225
    226
    227
    228
    229
    230
    231
    232
    233
    234
    235
    236
    237
    238
    239
    240
    241
    242
    243
    244
    245
    246
    247
    248
    249
    250
    251
    252
    253
    254
    255
    256
    257
    258
    259
    260
    261
    262
    263
    264
    265
    266
    267
    268
    269
    270
    271
    272
    273
    274
    275
    276
    277
    278
    279
    280
    281
    282
    283
    284
    285
    286
    287
    288
    289
    290
    291
    292
    293
    294
    295
    296
    297
    298
    299
    300
    301
    302
    303
    304
    305
    306
    307
    308
    309
    310
    311
    312
    313
    314
    315
    316
    317
    318
    319
    320
    321
    322
    323
    324
    325
    326
    327
    328
    329
    330
    331
    332
    333
    334
    335
    336
    337
    338
    339
    340
    341
    342
    343
    344
    345
    346
    347
    348
    349
    350
    351
    352
    353
    354
    355
    356
    357
    358
    359
    360
    361
    362
    363
    364
    365
    366
    367
    368
    369
    370
    371
    372
    373
    374
    375
    376
    377
    378
    379
    380
    381
    382
    383
    384
    385
    386
    387
    388
    389
    390
    391
    392
    393
    394
    395
    396
    397
    398
    399
    400
    401
    402
    403
    404
    405
    406
    407
    408
    409
    410
    411
    412
    413
    414
    415
    416
    417
    418
    419
    420
    421
    422
    423
    424
    425
    426
    427
    428
    429
    430
    431
    432
    433
    434
    435
    436
    437
    438
    439
    440
    441
    442
    443
    444
    445
    446
    447
    448
    449
    450
    451
    452
    453
    454
    455
    456
    457
    458
    459
    460
    461
    462
    463
    464
    465
    466
    467
    468
    469
    470
    471
    472
    473
    474
    475
    476
    477
    478
    479
    480
    481
    482
    483
    484
    485
    486
    487
    488
    489
    490
    491
    492
    493
    494
    495
    496
    497
    498
    499
    500
    501
    502
    503
    504
    505
    506
    507
    508
    509
    510
    511
    512
    513
    514
    515
    516
    517
    518
    519
    520
    521
    522
    523
    524
    525
    526
    527
    528
    529
    530
    531
    532
    533
    534
    535
    536
    537
    538
    539
    540
    541
    542
    543
    544
    545
    546
    547
    548
    549
    550
    551
    552
    553
    554
    555
    556
    557
    558
    559
    560
    561
    562
    563
    564
    565
    566
    567
    568
    569
    570
    571
    572
    573
    574
    575
    576
    577
    578
    579
    580
    581
    582
    583
    584
    585
    586
    587
    588
    589
    590
    591
    592
    593
    594
    595
    596
    597
    598
    599
    600
    601
    602
    603
    604
    605
    606
    607
    608
    609
    610
    611
    612
    613
    614
    615
    616
    617
    618
    619
    620
    621
    622
    623
    624
    625
    626
    627
    628
    629
    630
    631
    632
    633
    634
    635
    636
    637
    638
    639
    640
    641
    642
    643
    644
    645
    646
    647
    648
    649
    650
    651
    652
    653
    654
    655
    root@6fba3a16d91d:/data# redis-cli --cluster reshard  182.61.35.33:16385 -a dockerredis
    Warning: Using a password with '-a' or '-u' option on the command line interface may not be safe.
    >>> Performing Cluster Check (using node 182.61.35.33:16385)
    M: fc576f7421e4b453dc500d4cbe028716bb1efbf8 182.61.35.33:16385
    slots:[0-98],[5461-5561],[10923-11021] (299 slots) master
    S: 93fe47529c3f671d6d5b75c46ac965d43b904c34 182.61.35.33:16383
    slots: (0 slots) slave
    replicates b1790b6e64961f2da927cd78ad64cf02463727da
    M: 5923fef0a1e7a7b3a77290af1c13e1e57678f6e2 182.61.35.33:16382
    slots:[99-5460] (5362 slots) master
    1 additional replica(s)
    S: d1b77c63e1e652b786c9e52e42f7594e9752903c 182.61.35.33:16379
    slots: (0 slots) slave
    replicates 5923fef0a1e7a7b3a77290af1c13e1e57678f6e2
    M: aa8b86fd7a3396f2c1eb43b3a5d1e98c3a791cca 182.61.35.33:16386
    slots: (0 slots) master
    M: b1790b6e64961f2da927cd78ad64cf02463727da 182.61.35.33:16380
    slots:[5562-10922] (5361 slots) master
    1 additional replica(s)
    M: 6c255660ba138e0cb7ac521ad945bafbf0901f1a 182.61.35.33:16384
    slots:[11022-16383] (5362 slots) master
    1 additional replica(s)
    S: 9d1935b3462566449d9f3c3c38b8d3ab9b97b134 182.61.35.33:16381
    slots: (0 slots) slave
    replicates 6c255660ba138e0cb7ac521ad945bafbf0901f1a
    [OK] All nodes agree about slots configuration.
    >>> Check for open slots...
    >>> Check slots coverage...
    [OK] All 16384 slots covered.
    How many slots do you want to move (from 1 to 16384)? 300
    What is the receiving node ID? b1790b6e64961f2da927cd78ad64cf02463727da
    Please enter all the source node IDs.
    Type 'all' to use all the nodes as source nodes for the hash slots.
    Type 'done' once you entered all the source nodes IDs.
    Source node #1: fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Source node #2: done

    Ready to move 300 slots.
    Source nodes:
    M: fc576f7421e4b453dc500d4cbe028716bb1efbf8 182.61.35.33:16385
    slots:[0-98],[5461-5561],[10923-11021] (299 slots) master
    Destination node:
    M: b1790b6e64961f2da927cd78ad64cf02463727da 182.61.35.33:16380
    slots:[5562-10922] (5361 slots) master
    1 additional replica(s)
    Resharding plan:
    Moving slot 0 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 1 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 2 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 3 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 4 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 5 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 6 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 7 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 8 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 9 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 10 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 11 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 12 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 13 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 14 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 15 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 16 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 17 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 18 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 19 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 20 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 21 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 22 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 23 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 24 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 25 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 26 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 27 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 28 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 29 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 30 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 31 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 32 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 33 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 34 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 35 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 36 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 37 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 38 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 39 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 40 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 41 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 42 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 43 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 44 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 45 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 46 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 47 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 48 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 49 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 50 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 51 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 52 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 53 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 54 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 55 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 56 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 57 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 58 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 59 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 60 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 61 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 62 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 63 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 64 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 65 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 66 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 67 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 68 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 69 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 70 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 71 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 72 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 73 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 74 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 75 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 76 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 77 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 78 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 79 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 80 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 81 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 82 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 83 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 84 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 85 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 86 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 87 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 88 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 89 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 90 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 91 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 92 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 93 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 94 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 95 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 96 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 97 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 98 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 5461 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 5462 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 5463 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 5464 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 5465 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 5466 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 5467 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 5468 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 5469 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 5470 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 5471 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 5472 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 5473 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 5474 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 5475 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 5476 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 5477 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 5478 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 5479 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 5480 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 5481 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 5482 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 5483 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 5484 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 5485 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 5486 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 5487 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 5488 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 5489 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 5490 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 5491 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 5492 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 5493 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 5494 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 5495 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 5496 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 5497 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 5498 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 5499 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 5500 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 5501 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 5502 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 5503 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 5504 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 5505 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 5506 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 5507 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 5508 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 5509 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 5510 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 5511 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 5512 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 5513 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 5514 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 5515 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 5516 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 5517 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 5518 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 5519 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 5520 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 5521 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 5522 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 5523 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 5524 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 5525 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 5526 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 5527 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 5528 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 5529 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 5530 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 5531 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 5532 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 5533 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 5534 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 5535 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 5536 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 5537 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 5538 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 5539 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 5540 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 5541 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 5542 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 5543 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 5544 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 5545 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 5546 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 5547 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 5548 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 5549 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 5550 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 5551 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 5552 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 5553 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 5554 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 5555 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 5556 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 5557 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 5558 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 5559 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 5560 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 5561 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 10923 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 10924 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 10925 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 10926 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 10927 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 10928 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 10929 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 10930 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 10931 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 10932 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 10933 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 10934 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 10935 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 10936 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 10937 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 10938 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 10939 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 10940 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 10941 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 10942 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 10943 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 10944 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 10945 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 10946 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 10947 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 10948 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 10949 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 10950 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 10951 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 10952 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 10953 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 10954 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 10955 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 10956 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 10957 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 10958 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 10959 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 10960 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 10961 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 10962 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 10963 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 10964 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 10965 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 10966 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 10967 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 10968 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 10969 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 10970 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 10971 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 10972 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 10973 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 10974 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 10975 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 10976 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 10977 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 10978 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 10979 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 10980 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 10981 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 10982 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 10983 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 10984 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 10985 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 10986 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 10987 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 10988 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 10989 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 10990 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 10991 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 10992 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 10993 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 10994 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 10995 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 10996 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 10997 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 10998 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 10999 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 11000 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 11001 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 11002 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 11003 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 11004 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 11005 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 11006 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 11007 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 11008 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 11009 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 11010 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 11011 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 11012 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 11013 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 11014 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 11015 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 11016 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 11017 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 11018 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 11019 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 11020 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Moving slot 11021 from fc576f7421e4b453dc500d4cbe028716bb1efbf8
    Do you want to proceed with the proposed reshard plan (yes/no)? yes
    Moving slot 0 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 1 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 2 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 3 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 4 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 5 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 6 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 7 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 8 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 9 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 10 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 11 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 12 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 13 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 14 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 15 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 16 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 17 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 18 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 19 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 20 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 21 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 22 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 23 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 24 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 25 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 26 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 27 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 28 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 29 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 30 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 31 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 32 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 33 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 34 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 35 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 36 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 37 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 38 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 39 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 40 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 41 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 42 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 43 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 44 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 45 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 46 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 47 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 48 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 49 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 50 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 51 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 52 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 53 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 54 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 55 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 56 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 57 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 58 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 59 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 60 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 61 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 62 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 63 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 64 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 65 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 66 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 67 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 68 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 69 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 70 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 71 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 72 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 73 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 74 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 75 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 76 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 77 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 78 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 79 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 80 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 81 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 82 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 83 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 84 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 85 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 86 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 87 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 88 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 89 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 90 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 91 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 92 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 93 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 94 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 95 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 96 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 97 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 98 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 5461 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 5462 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 5463 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 5464 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 5465 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 5466 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 5467 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 5468 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 5469 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 5470 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 5471 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 5472 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 5473 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 5474 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 5475 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 5476 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 5477 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 5478 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 5479 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 5480 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 5481 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 5482 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 5483 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 5484 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 5485 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 5486 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 5487 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 5488 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 5489 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 5490 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 5491 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 5492 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 5493 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 5494 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 5495 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 5496 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 5497 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 5498 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 5499 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 5500 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 5501 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 5502 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 5503 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 5504 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 5505 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 5506 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 5507 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 5508 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 5509 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 5510 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 5511 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 5512 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 5513 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 5514 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 5515 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 5516 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 5517 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 5518 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 5519 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 5520 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 5521 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 5522 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 5523 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 5524 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 5525 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 5526 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 5527 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 5528 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 5529 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 5530 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 5531 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 5532 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 5533 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 5534 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 5535 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 5536 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 5537 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 5538 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 5539 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 5540 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 5541 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 5542 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 5543 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 5544 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 5545 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 5546 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 5547 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 5548 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 5549 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 5550 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 5551 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 5552 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 5553 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 5554 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 5555 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 5556 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 5557 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 5558 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 5559 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 5560 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 5561 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 10923 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 10924 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 10925 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 10926 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 10927 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 10928 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 10929 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 10930 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 10931 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 10932 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 10933 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 10934 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 10935 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 10936 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 10937 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 10938 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 10939 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 10940 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 10941 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 10942 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 10943 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 10944 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 10945 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 10946 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 10947 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 10948 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 10949 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 10950 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 10951 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 10952 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 10953 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 10954 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 10955 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 10956 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 10957 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 10958 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 10959 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 10960 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 10961 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 10962 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 10963 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 10964 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 10965 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 10966 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 10967 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 10968 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 10969 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 10970 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 10971 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 10972 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 10973 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 10974 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 10975 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 10976 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 10977 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 10978 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 10979 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 10980 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 10981 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 10982 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 10983 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 10984 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 10985 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 10986 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 10987 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 10988 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 10989 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 10990 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 10991 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 10992 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 10993 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 10994 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 10995 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 10996 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 10997 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 10998 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 10999 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 11000 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 11001 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 11002 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 11003 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 11004 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 11005 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 11006 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 11007 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 11008 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 11009 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 11010 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 11011 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 11012 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 11013 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 11014 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 11015 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 11016 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 11017 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 11018 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 11019 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 11020 from 182.61.35.33:16385 to 182.61.35.33:16380:
    Moving slot 11021 from 182.61.35.33:16385 to 182.61.35.33:16380:

    182.61.35.33:16385> cluster nodes
    93fe47529c3f671d6d5b75c46ac965d43b904c34 182.61.35.33:16383@26383 slave b1790b6e64961f2da927cd78ad64cf02463727da 0 1579943275000 20 connected
    5923fef0a1e7a7b3a77290af1c13e1e57678f6e2 182.61.35.33:16382@26382 master - 0 1579943276697 18 connected 99-5460
    d1b77c63e1e652b786c9e52e42f7594e9752903c 182.61.35.33:16379@26379 slave 5923fef0a1e7a7b3a77290af1c13e1e57678f6e2 0 1579943275000 18 connected
    aa8b86fd7a3396f2c1eb43b3a5d1e98c3a791cca 182.61.35.33:16386@26386 master - 0 1579943275694 0 connected
    fc576f7421e4b453dc500d4cbe028716bb1efbf8 182.61.35.33:16385@26385 myself,master - 0 1579943273000 19 connected
    b1790b6e64961f2da927cd78ad64cf02463727da 182.61.35.33:16380@26380 master - 0 1579943274000 20 connected 0-98 5461-11021
    6c255660ba138e0cb7ac521ad945bafbf0901f1a 182.61.35.33:16384@26384 master - 0 1579943271683 15 connected 11022-16383
    9d1935b3462566449d9f3c3c38b8d3ab9b97b134 182.61.35.33:16381@26381 slave 6c255660ba138e0cb7ac521ad945bafbf0901f1a 0 1579943274000 15 connected
    迁移完后,登录到从节点进行主从配置:
    1
    2
    3
    4
    5
    6
    7
    8
    9
    10
    11
    12
    182.61.35.33:16386> cluster replicate fc576f7421e4b453dc500d4cbe028716bb1efbf8
    OK
    182.61.35.33:16386> cluster nodes
    6c255660ba138e0cb7ac521ad945bafbf0901f1a 182.61.35.33:16384@26384 master - 0 1579943419000 15 connected 11022-16383
    aa8b86fd7a3396f2c1eb43b3a5d1e98c3a791cca 182.61.35.33:16386@26386 myself,slave fc576f7421e4b453dc500d4cbe028716bb1efbf8 0 1579943419000 0 connected
    93fe47529c3f671d6d5b75c46ac965d43b904c34 182.61.35.33:16383@26383 slave b1790b6e64961f2da927cd78ad64cf02463727da 0 1579943421134 20 connected
    b1790b6e64961f2da927cd78ad64cf02463727da 182.61.35.33:16380@26380 master - 0 1579943420132 20 connected 0-98 5461-11021
    fc576f7421e4b453dc500d4cbe028716bb1efbf8 182.61.35.33:16385@26385 master - 0 1579943423140 19 connected
    9d1935b3462566449d9f3c3c38b8d3ab9b97b134 182.61.35.33:16381@26381 slave 6c255660ba138e0cb7ac521ad945bafbf0901f1a 0 1579943419129 15 connected
    d1b77c63e1e652b786c9e52e42f7594e9752903c 182.61.35.33:16379@26379 slave 5923fef0a1e7a7b3a77290af1c13e1e57678f6e2 0 1579943421000 18 connected
    5923fef0a1e7a7b3a77290af1c13e1e57678f6e2 182.61.35.33:16382@26382 master - 0 1579943422137 18 connected 99-5460

    可以看到主从关系已经配置完成,我们再进哈希槽迁移,上面已经进行了两次哈希槽迁移,所以这里就省略掉,来看看最后的成功吧.
    1
    2
    3
    4
    5
    6
    7
    8
    9
    10
    182.61.35.33:16386> cluster nodes
    6c255660ba138e0cb7ac521ad945bafbf0901f1a 182.61.35.33:16384@26384 master - 0 1579943609713 15 connected 11022-16383
    aa8b86fd7a3396f2c1eb43b3a5d1e98c3a791cca 182.61.35.33:16386@26386 myself,slave fc576f7421e4b453dc500d4cbe028716bb1efbf8 0 1579943606000 0 connected
    93fe47529c3f671d6d5b75c46ac965d43b904c34 182.61.35.33:16383@26383 slave b1790b6e64961f2da927cd78ad64cf02463727da 0 1579943608708 20 connected
    b1790b6e64961f2da927cd78ad64cf02463727da 182.61.35.33:16380@26380 master - 0 1579943607706 20 connected 5662-11021
    fc576f7421e4b453dc500d4cbe028716bb1efbf8 182.61.35.33:16385@26385 master - 0 1579943607000 21 connected 0-98 5461-5661
    9d1935b3462566449d9f3c3c38b8d3ab9b97b134 182.61.35.33:16381@26381 slave 6c255660ba138e0cb7ac521ad945bafbf0901f1a 0 1579943610716 15 connected
    d1b77c63e1e652b786c9e52e42f7594e9752903c 182.61.35.33:16379@26379 slave 5923fef0a1e7a7b3a77290af1c13e1e57678f6e2 0 1579943610000 18 connected
    5923fef0a1e7a7b3a77290af1c13e1e57678f6e2 182.61.35.33:16382@26382 master - 0 1579943608000 18 connected 99-5460

删除节点

我们下线一个主节点,看看Redis Cluster的状态。这里我试试让16382这个端口的节点宕机,可以看到之前的从节点变为了主节点:

1
2
3
4
5
6
7
8
9
182.61.35.33:16379> cluster nodes
93fe47529c3f671d6d5b75c46ac965d43b904c34 182.61.35.33:16383@26383 slave b1790b6e64961f2da927cd78ad64cf02463727da 0 1579944069787 20 connected
fc576f7421e4b453dc500d4cbe028716bb1efbf8 182.61.35.33:16385@26385 master - 0 1579944068000 21 connected 0-98 5461-5661
5923fef0a1e7a7b3a77290af1c13e1e57678f6e2 182.61.35.33:16382@26382 master,fail - 1579944028558 1579944027556 18 disconnected
aa8b86fd7a3396f2c1eb43b3a5d1e98c3a791cca 182.61.35.33:16386@26386 slave fc576f7421e4b453dc500d4cbe028716bb1efbf8 0 1579944070795 21 connected
9d1935b3462566449d9f3c3c38b8d3ab9b97b134 182.61.35.33:16381@26381 slave 6c255660ba138e0cb7ac521ad945bafbf0901f1a 0 1579944068000 15 connected
b1790b6e64961f2da927cd78ad64cf02463727da 182.61.35.33:16380@26380 master - 0 1579944068000 20 connected 5662-11021
d1b77c63e1e652b786c9e52e42f7594e9752903c 182.61.35.33:16379@26379 myself,master - 0 1579944070000 22 connected 99-5460
6c255660ba138e0cb7ac521ad945bafbf0901f1a 182.61.35.33:16384@26384 master - 0 1579944071795 15 connected 11022-16383

我们再把16382这个节点启动起来,会发现,由于原来的从节点变为了主节点,所以它会变为其它节点的从节点(原主节点)。

1
2
3
4
5
6
7
8
9
10
182.61.35.33:16379> cluster nodes
93fe47529c3f671d6d5b75c46ac965d43b904c34 182.61.35.33:16383@26383 slave b1790b6e64961f2da927cd78ad64cf02463727da 0 1579944182000 20 connected
fc576f7421e4b453dc500d4cbe028716bb1efbf8 182.61.35.33:16385@26385 master - 0 1579944186307 21 connected 0-98 5461-5661
5923fef0a1e7a7b3a77290af1c13e1e57678f6e2 182.61.35.33:16382@26382 slave d1b77c63e1e652b786c9e52e42f7594e9752903c 0 1579944185000 22 connected
aa8b86fd7a3396f2c1eb43b3a5d1e98c3a791cca 182.61.35.33:16386@26386 slave fc576f7421e4b453dc500d4cbe028716bb1efbf8 0 1579944184000 21 connected
9d1935b3462566449d9f3c3c38b8d3ab9b97b134 182.61.35.33:16381@26381 slave 6c255660ba138e0cb7ac521ad945bafbf0901f1a 0 1579944187310 15 connected
b1790b6e64961f2da927cd78ad64cf02463727da 182.61.35.33:16380@26380 master - 0 1579944185306 20 connected 5662-11021
d1b77c63e1e652b786c9e52e42f7594e9752903c 182.61.35.33:16379@26379 myself,master - 0 1579944183000 22 connected 99-5460
6c255660ba138e0cb7ac521ad945bafbf0901f1a 182.61.35.33:16384@26384 master - 0 1579944184302 15 connected 11022-16383

现在我们来进行节点删除,这里我们删除点16379这个节点,首先需要把节点上的solt迁移到其它节点。

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
root@6fba3a16d91d:/data# redis-cli --cluster reshard  182.61.35.33:16385 -a dockerredis
Warning: Using a password with '-a' or '-u' option on the command line interface may not be safe.
>>> Performing Cluster Check (using node 182.61.35.33:16385)
M: fc576f7421e4b453dc500d4cbe028716bb1efbf8 182.61.35.33:16385
slots:[0-98],[5461-5661] (300 slots) master
1 additional replica(s)
S: 93fe47529c3f671d6d5b75c46ac965d43b904c34 182.61.35.33:16383
slots: (0 slots) slave
replicates b1790b6e64961f2da927cd78ad64cf02463727da
S: 5923fef0a1e7a7b3a77290af1c13e1e57678f6e2 182.61.35.33:16382
slots: (0 slots) slave
replicates d1b77c63e1e652b786c9e52e42f7594e9752903c
M: d1b77c63e1e652b786c9e52e42f7594e9752903c 182.61.35.33:16379
slots:[99-5460] (5362 slots) master
1 additional replica(s)
S: aa8b86fd7a3396f2c1eb43b3a5d1e98c3a791cca 182.61.35.33:16386
slots: (0 slots) slave
replicates fc576f7421e4b453dc500d4cbe028716bb1efbf8
M: b1790b6e64961f2da927cd78ad64cf02463727da 182.61.35.33:16380
slots:[5662-11021] (5360 slots) master
1 additional replica(s)
M: 6c255660ba138e0cb7ac521ad945bafbf0901f1a 182.61.35.33:16384
slots:[11022-16383] (5362 slots) master
1 additional replica(s)
S: 9d1935b3462566449d9f3c3c38b8d3ab9b97b134 182.61.35.33:16381
slots: (0 slots) slave
replicates 6c255660ba138e0cb7ac521ad945bafbf0901f1a
[OK] All nodes agree about slots configuration.
>>> Check for open slots...
>>> Check slots coverage...
[OK] All 16384 slots covered.
How many slots do you want to move (from 1 to 16384)? 99-5460
What is the receiving node ID? fc576f7421e4b453dc500d4cbe028716bb1efbf8
Please enter all the source node IDs.
Type 'all' to use all the nodes as source nodes for the hash slots.
Type 'done' once you entered all the source nodes IDs.
Source node #1: d1b77c63e1e652b786c9e52e42f7594e9752903c
Source node #2: done

Ready to move 99 slots.
Source nodes:
M: d1b77c63e1e652b786c9e52e42f7594e9752903c 182.61.35.33:16379
slots:[99-5460] (5362 slots) master
1 additional replica(s)
Destination node:
M: fc576f7421e4b453dc500d4cbe028716bb1efbf8 182.61.35.33:16385
slots:[0-98],[5461-5661] (300 slots) master
1 additional replica(s)
Resharding plan:
Moving slot 99 from d1b77c63e1e652b786c9e52e42f7594e9752903c
Moving slot 100 from d1b77c63e1e652b786c9e52e42f7594e9752903c
Moving slot 101 from d1b77c63e1e652b786c9e52e42f7594e9752903c
Moving slot 102 from d1b77c63e1e652b786c9e52e42f7594e9752903c
Moving slot 103 from d1b77c63e1e652b786c9e52e42f7594e9752903c
Moving slot 104 from d1b77c63e1e652b786c9e52e42f7594e9752903c
Moving slot 105 from d1b77c63e1e652b786c9e52e42f7594e9752903c
Moving slot 106 from d1b77c63e1e652b786c9e52e42f7594e9752903c
Moving slot 107 from d1b77c63e1e652b786c9e52e42f7594e9752903c
Moving slot 108 from d1b77c63e1e652b786c9e52e42f7594e9752903c
Moving slot 109 from d1b77c63e1e652b786c9e52e42f7594e9752903c
Moving slot 110 from d1b77c63e1e652b786c9e52e42f7594e9752903c
Moving slot 111 from d1b77c63e1e652b786c9e52e42f7594e9752903c
Moving slot 112 from d1b77c63e1e652b786c9e52e42f7594e9752903c
Moving slot 113 from d1b77c63e1e652b786c9e52e42f7594e9752903c
Moving slot 114 from d1b77c63e1e652b786c9e52e42f7594e9752903c
Moving slot 115 from d1b77c63e1e652b786c9e52e42f7594e9752903c
Moving slot 116 from d1b77c63e1e652b786c9e52e42f7594e9752903c
Moving slot 117 from d1b77c63e1e652b786c9e52e42f7594e9752903c
Moving slot 118 from d1b77c63e1e652b786c9e52e42f7594e9752903c
Moving slot 119 from d1b77c63e1e652b786c9e52e42f7594e9752903c
Moving slot 120 from d1b77c63e1e652b786c9e52e42f7594e9752903c
Moving slot 121 from d1b77c63e1e652b786c9e52e42f7594e9752903c
Moving slot 122 from d1b77c63e1e652b786c9e52e42f7594e9752903c
Moving slot 123 from d1b77c63e1e652b786c9e52e42f7594e9752903c
Moving slot 124 from d1b77c63e1e652b786c9e52e42f7594e9752903c
Moving slot 125 from d1b77c63e1e652b786c9e52e42f7594e9752903c
Moving slot 126 from d1b77c63e1e652b786c9e52e42f7594e9752903c
Moving slot 127 from d1b77c63e1e652b786c9e52e42f7594e9752903c
Moving slot 128 from d1b77c63e1e652b786c9e52e42f7594e9752903c
Moving slot 129 from d1b77c63e1e652b786c9e52e42f7594e9752903c
Moving slot 130 from d1b77c63e1e652b786c9e52e42f7594e9752903c
Moving slot 131 from d1b77c63e1e652b786c9e52e42f7594e9752903c
Moving slot 132 from d1b77c63e1e652b786c9e52e42f7594e9752903c
Moving slot 133 from d1b77c63e1e652b786c9e52e42f7594e9752903c
Moving slot 134 from d1b77c63e1e652b786c9e52e42f7594e9752903c
Moving slot 135 from d1b77c63e1e652b786c9e52e42f7594e9752903c
Moving slot 136 from d1b77c63e1e652b786c9e52e42f7594e9752903c
Moving slot 137 from d1b77c63e1e652b786c9e52e42f7594e9752903c
Moving slot 138 from d1b77c63e1e652b786c9e52e42f7594e9752903c
Moving slot 139 from d1b77c63e1e652b786c9e52e42f7594e9752903c
Moving slot 140 from d1b77c63e1e652b786c9e52e42f7594e9752903c
Moving slot 141 from d1b77c63e1e652b786c9e52e42f7594e9752903c
Moving slot 142 from d1b77c63e1e652b786c9e52e42f7594e9752903c
Moving slot 143 from d1b77c63e1e652b786c9e52e42f7594e9752903c
Moving slot 144 from d1b77c63e1e652b786c9e52e42f7594e9752903c
Moving slot 145 from d1b77c63e1e652b786c9e52e42f7594e9752903c
Moving slot 146 from d1b77c63e1e652b786c9e52e42f7594e9752903c
Moving slot 147 from d1b77c63e1e652b786c9e52e42f7594e9752903c
Moving slot 148 from d1b77c63e1e652b786c9e52e42f7594e9752903c
Moving slot 149 from d1b77c63e1e652b786c9e52e42f7594e9752903c
Moving slot 150 from d1b77c63e1e652b786c9e52e42f7594e9752903c
Moving slot 151 from d1b77c63e1e652b786c9e52e42f7594e9752903c
Moving slot 152 from d1b77c63e1e652b786c9e52e42f7594e9752903c
Moving slot 153 from d1b77c63e1e652b786c9e52e42f7594e9752903c
Moving slot 154 from d1b77c63e1e652b786c9e52e42f7594e9752903c
Moving slot 155 from d1b77c63e1e652b786c9e52e42f7594e9752903c
Moving slot 156 from d1b77c63e1e652b786c9e52e42f7594e9752903c
Moving slot 157 from d1b77c63e1e652b786c9e52e42f7594e9752903c
Moving slot 158 from d1b77c63e1e652b786c9e52e42f7594e9752903c
Moving slot 159 from d1b77c63e1e652b786c9e52e42f7594e9752903c
Moving slot 160 from d1b77c63e1e652b786c9e52e42f7594e9752903c
Moving slot 161 from d1b77c63e1e652b786c9e52e42f7594e9752903c
Moving slot 162 from d1b77c63e1e652b786c9e52e42f7594e9752903c
Moving slot 163 from d1b77c63e1e652b786c9e52e42f7594e9752903c
Moving slot 164 from d1b77c63e1e652b786c9e52e42f7594e9752903c
Moving slot 165 from d1b77c63e1e652b786c9e52e42f7594e9752903c
Moving slot 166 from d1b77c63e1e652b786c9e52e42f7594e9752903c
Moving slot 167 from d1b77c63e1e652b786c9e52e42f7594e9752903c
Moving slot 168 from d1b77c63e1e652b786c9e52e42f7594e9752903c
Moving slot 169 from d1b77c63e1e652b786c9e52e42f7594e9752903c
Moving slot 170 from d1b77c63e1e652b786c9e52e42f7594e9752903c
Moving slot 171 from d1b77c63e1e652b786c9e52e42f7594e9752903c
Moving slot 172 from d1b77c63e1e652b786c9e52e42f7594e9752903c
Moving slot 173 from d1b77c63e1e652b786c9e52e42f7594e9752903c
Moving slot 174 from d1b77c63e1e652b786c9e52e42f7594e9752903c
Moving slot 175 from d1b77c63e1e652b786c9e52e42f7594e9752903c
Moving slot 176 from d1b77c63e1e652b786c9e52e42f7594e9752903c
Moving slot 177 from d1b77c63e1e652b786c9e52e42f7594e9752903c
Moving slot 178 from d1b77c63e1e652b786c9e52e42f7594e9752903c
Moving slot 179 from d1b77c63e1e652b786c9e52e42f7594e9752903c
Moving slot 180 from d1b77c63e1e652b786c9e52e42f7594e9752903c
Moving slot 181 from d1b77c63e1e652b786c9e52e42f7594e9752903c
Moving slot 182 from d1b77c63e1e652b786c9e52e42f7594e9752903c
Moving slot 183 from d1b77c63e1e652b786c9e52e42f7594e9752903c
Moving slot 184 from d1b77c63e1e652b786c9e52e42f7594e9752903c
Moving slot 185 from d1b77c63e1e652b786c9e52e42f7594e9752903c
Moving slot 186 from d1b77c63e1e652b786c9e52e42f7594e9752903c
Moving slot 187 from d1b77c63e1e652b786c9e52e42f7594e9752903c
Moving slot 188 from d1b77c63e1e652b786c9e52e42f7594e9752903c
Moving slot 189 from d1b77c63e1e652b786c9e52e42f7594e9752903c
Moving slot 190 from d1b77c63e1e652b786c9e52e42f7594e9752903c
Moving slot 191 from d1b77c63e1e652b786c9e52e42f7594e9752903c
Moving slot 192 from d1b77c63e1e652b786c9e52e42f7594e9752903c
Moving slot 193 from d1b77c63e1e652b786c9e52e42f7594e9752903c
Moving slot 194 from d1b77c63e1e652b786c9e52e42f7594e9752903c
Moving slot 195 from d1b77c63e1e652b786c9e52e42f7594e9752903c
Moving slot 196 from d1b77c63e1e652b786c9e52e42f7594e9752903c
Moving slot 197 from d1b77c63e1e652b786c9e52e42f7594e9752903c
Do you want to proceed with the proposed reshard plan (yes/no)? yes
Moving slot 99 from 182.61.35.33:16379 to 182.61.35.33:16385:
Moving slot 100 from 182.61.35.33:16379 to 182.61.35.33:16385:
Moving slot 101 from 182.61.35.33:16379 to 182.61.35.33:16385:
Moving slot 102 from 182.61.35.33:16379 to 182.61.35.33:16385:
Moving slot 103 from 182.61.35.33:16379 to 182.61.35.33:16385:
Moving slot 104 from 182.61.35.33:16379 to 182.61.35.33:16385:
Moving slot 105 from 182.61.35.33:16379 to 182.61.35.33:16385:
Moving slot 106 from 182.61.35.33:16379 to 182.61.35.33:16385:
Moving slot 107 from 182.61.35.33:16379 to 182.61.35.33:16385:
Moving slot 108 from 182.61.35.33:16379 to 182.61.35.33:16385:
Moving slot 109 from 182.61.35.33:16379 to 182.61.35.33:16385:
Moving slot 110 from 182.61.35.33:16379 to 182.61.35.33:16385:
Moving slot 111 from 182.61.35.33:16379 to 182.61.35.33:16385:
Moving slot 112 from 182.61.35.33:16379 to 182.61.35.33:16385:
Moving slot 113 from 182.61.35.33:16379 to 182.61.35.33:16385:
Moving slot 114 from 182.61.35.33:16379 to 182.61.35.33:16385:
Moving slot 115 from 182.61.35.33:16379 to 182.61.35.33:16385:
Moving slot 116 from 182.61.35.33:16379 to 182.61.35.33:16385:
Moving slot 117 from 182.61.35.33:16379 to 182.61.35.33:16385:
Moving slot 118 from 182.61.35.33:16379 to 182.61.35.33:16385:
Moving slot 119 from 182.61.35.33:16379 to 182.61.35.33:16385:
Moving slot 120 from 182.61.35.33:16379 to 182.61.35.33:16385:
Moving slot 121 from 182.61.35.33:16379 to 182.61.35.33:16385:
Moving slot 122 from 182.61.35.33:16379 to 182.61.35.33:16385:
Moving slot 123 from 182.61.35.33:16379 to 182.61.35.33:16385:
Moving slot 124 from 182.61.35.33:16379 to 182.61.35.33:16385:
Moving slot 125 from 182.61.35.33:16379 to 182.61.35.33:16385:
Moving slot 126 from 182.61.35.33:16379 to 182.61.35.33:16385:
Moving slot 127 from 182.61.35.33:16379 to 182.61.35.33:16385:
Moving slot 128 from 182.61.35.33:16379 to 182.61.35.33:16385:
Moving slot 129 from 182.61.35.33:16379 to 182.61.35.33:16385:
Moving slot 130 from 182.61.35.33:16379 to 182.61.35.33:16385:
Moving slot 131 from 182.61.35.33:16379 to 182.61.35.33:16385:
Moving slot 132 from 182.61.35.33:16379 to 182.61.35.33:16385:
Moving slot 133 from 182.61.35.33:16379 to 182.61.35.33:16385:
Moving slot 134 from 182.61.35.33:16379 to 182.61.35.33:16385:
Moving slot 135 from 182.61.35.33:16379 to 182.61.35.33:16385:
Moving slot 136 from 182.61.35.33:16379 to 182.61.35.33:16385:
Moving slot 137 from 182.61.35.33:16379 to 182.61.35.33:16385:
Moving slot 138 from 182.61.35.33:16379 to 182.61.35.33:16385:
Moving slot 139 from 182.61.35.33:16379 to 182.61.35.33:16385:
Moving slot 140 from 182.61.35.33:16379 to 182.61.35.33:16385:
Moving slot 141 from 182.61.35.33:16379 to 182.61.35.33:16385:
Moving slot 142 from 182.61.35.33:16379 to 182.61.35.33:16385:
Moving slot 143 from 182.61.35.33:16379 to 182.61.35.33:16385:
Moving slot 144 from 182.61.35.33:16379 to 182.61.35.33:16385:
Moving slot 145 from 182.61.35.33:16379 to 182.61.35.33:16385:
Moving slot 146 from 182.61.35.33:16379 to 182.61.35.33:16385:
Moving slot 147 from 182.61.35.33:16379 to 182.61.35.33:16385:
Moving slot 148 from 182.61.35.33:16379 to 182.61.35.33:16385:
Moving slot 149 from 182.61.35.33:16379 to 182.61.35.33:16385:
Moving slot 150 from 182.61.35.33:16379 to 182.61.35.33:16385:
Moving slot 151 from 182.61.35.33:16379 to 182.61.35.33:16385:
Moving slot 152 from 182.61.35.33:16379 to 182.61.35.33:16385:
Moving slot 153 from 182.61.35.33:16379 to 182.61.35.33:16385:
Moving slot 154 from 182.61.35.33:16379 to 182.61.35.33:16385:
Moving slot 155 from 182.61.35.33:16379 to 182.61.35.33:16385:
Moving slot 156 from 182.61.35.33:16379 to 182.61.35.33:16385:
Moving slot 157 from 182.61.35.33:16379 to 182.61.35.33:16385:
Moving slot 158 from 182.61.35.33:16379 to 182.61.35.33:16385:
Moving slot 159 from 182.61.35.33:16379 to 182.61.35.33:16385:
Moving slot 160 from 182.61.35.33:16379 to 182.61.35.33:16385:
Moving slot 161 from 182.61.35.33:16379 to 182.61.35.33:16385:
Moving slot 162 from 182.61.35.33:16379 to 182.61.35.33:16385:
Moving slot 163 from 182.61.35.33:16379 to 182.61.35.33:16385:
Moving slot 164 from 182.61.35.33:16379 to 182.61.35.33:16385:
Moving slot 165 from 182.61.35.33:16379 to 182.61.35.33:16385:
Moving slot 166 from 182.61.35.33:16379 to 182.61.35.33:16385:
Moving slot 167 from 182.61.35.33:16379 to 182.61.35.33:16385:
Moving slot 168 from 182.61.35.33:16379 to 182.61.35.33:16385:
Moving slot 169 from 182.61.35.33:16379 to 182.61.35.33:16385:
Moving slot 170 from 182.61.35.33:16379 to 182.61.35.33:16385:
Moving slot 171 from 182.61.35.33:16379 to 182.61.35.33:16385:
Moving slot 172 from 182.61.35.33:16379 to 182.61.35.33:16385:
Moving slot 173 from 182.61.35.33:16379 to 182.61.35.33:16385:
Moving slot 174 from 182.61.35.33:16379 to 182.61.35.33:16385:
Moving slot 175 from 182.61.35.33:16379 to 182.61.35.33:16385:
Moving slot 176 from 182.61.35.33:16379 to 182.61.35.33:16385:
Moving slot 177 from 182.61.35.33:16379 to 182.61.35.33:16385:
Moving slot 178 from 182.61.35.33:16379 to 182.61.35.33:16385:
Moving slot 179 from 182.61.35.33:16379 to 182.61.35.33:16385:
Moving slot 180 from 182.61.35.33:16379 to 182.61.35.33:16385:
Moving slot 181 from 182.61.35.33:16379 to 182.61.35.33:16385:
Moving slot 182 from 182.61.35.33:16379 to 182.61.35.33:16385:
Moving slot 183 from 182.61.35.33:16379 to 182.61.35.33:16385:
Moving slot 184 from 182.61.35.33:16379 to 182.61.35.33:16385:
Moving slot 185 from 182.61.35.33:16379 to 182.61.35.33:16385:
Moving slot 186 from 182.61.35.33:16379 to 182.61.35.33:16385:
Moving slot 187 from 182.61.35.33:16379 to 182.61.35.33:16385:
Moving slot 188 from 182.61.35.33:16379 to 182.61.35.33:16385:
Moving slot 189 from 182.61.35.33:16379 to 182.61.35.33:16385:
Moving slot 190 from 182.61.35.33:16379 to 182.61.35.33:16385:
Moving slot 191 from 182.61.35.33:16379 to 182.61.35.33:16385:
Moving slot 192 from 182.61.35.33:16379 to 182.61.35.33:16385:
Moving slot 193 from 182.61.35.33:16379 to 182.61.35.33:16385:
Moving slot 194 from 182.61.35.33:16379 to 182.61.35.33:16385:
Moving slot 195 from 182.61.35.33:16379 to 182.61.35.33:16385:
Moving slot 196 from 182.61.35.33:16379 to 182.61.35.33:16385:
Moving slot 197 from 182.61.35.33:16379 to 182.61.35.33:16385:
...........
182.61.35.33:16385> cluster nodes
93fe47529c3f671d6d5b75c46ac965d43b904c34 182.61.35.33:16383@26383 slave b1790b6e64961f2da927cd78ad64cf02463727da 0 1579945059435 24 connected
5923fef0a1e7a7b3a77290af1c13e1e57678f6e2 182.61.35.33:16382@26382 slave b1790b6e64961f2da927cd78ad64cf02463727da 0 1579945058000 24 connected
d1b77c63e1e652b786c9e52e42f7594e9752903c 182.61.35.33:16379@26379 master - 0 1579945058000 22 connected
aa8b86fd7a3396f2c1eb43b3a5d1e98c3a791cca 182.61.35.33:16386@26386 slave fc576f7421e4b453dc500d4cbe028716bb1efbf8 0 1579945059000 23 connected
fc576f7421e4b453dc500d4cbe028716bb1efbf8 182.61.35.33:16385@26385 myself,master - 0 1579945055000 23 connected 0-5459 5461-5661
b1790b6e64961f2da927cd78ad64cf02463727da 182.61.35.33:16380@26380 master - 0 1579945058431 24 connected 5460 5662-11021
6c255660ba138e0cb7ac521ad945bafbf0901f1a 182.61.35.33:16384@26384 master - 0 1579945056000 15 connected 11022-16383
9d1935b3462566449d9f3c3c38b8d3ab9b97b134 182.61.35.33:16381@26381 slave 6c255660ba138e0cb7ac521ad945bafbf0901f1a 0 1579945057430 15 connected

迁移完后就可以进行节点删除,redis-cli cluster del-node 要查询集群信息的IP:端口 要移除的node id

1
2
3
4
5
6
7
8
9
10
11
12
13
14
root@6fba3a16d91d:/data# redis-cli --cluster del-node 182.61.35.33:16385 d1b77c63e1e652b786c9e52e42f7594e9752903c -a dockerredis
Warning: Using a password with '-a' or '-u' option on the command line interface may not be safe.
>>> Removing node d1b77c63e1e652b786c9e52e42f7594e9752903c from cluster 182.61.35.33:16385
>>> Sending CLUSTER FORGET messages to the cluster...
>>> SHUTDOWN the node.
182.61.35.33:16380> cluster nodes
9d1935b3462566449d9f3c3c38b8d3ab9b97b134 182.61.35.33:16381@26381 slave 6c255660ba138e0cb7ac521ad945bafbf0901f1a 0 1579945617000 15 connected
aa8b86fd7a3396f2c1eb43b3a5d1e98c3a791cca 182.61.35.33:16386@26386 slave fc576f7421e4b453dc500d4cbe028716bb1efbf8 0 1579945618000 23 connected
fc576f7421e4b453dc500d4cbe028716bb1efbf8 182.61.35.33:16385@26385 master - 0 1579945617000 23 connected 0-5459 5461-5661
b1790b6e64961f2da927cd78ad64cf02463727da 182.61.35.33:16380@26380 myself,master - 0 1579945615000 24 connected 5460 5662-11021
6c255660ba138e0cb7ac521ad945bafbf0901f1a 182.61.35.33:16384@26384 master - 0 1579945617633 15 connected 11022-16383
5923fef0a1e7a7b3a77290af1c13e1e57678f6e2 182.61.35.33:16382@26382 slave b1790b6e64961f2da927cd78ad64cf02463727da 0 1579945618635 24 connected
93fe47529c3f671d6d5b75c46ac965d43b904c34 182.61.35.33:16383@26383 slave b1790b6e64961f2da927cd78ad64cf02463727da 0 1579945616000 24 connected

可以看到16379的节点被移除掉。

redis-cli常用命令

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
redis-cli --cluster help
Cluster Manager Commands:
create host1:port1 ... hostN:portN #创建集群
--cluster-replicas <arg> #从节点个数
check host:port #检查集群
--cluster-search-multiple-owners #检查是否有槽同时被分配给了多个节点
info host:port #查看集群状态
fix host:port #修复集群
--cluster-search-multiple-owners #修复槽的重复分配问题
reshard host:port #指定集群的任意一节点进行迁移slot,重新分slots
--cluster-from <arg> #需要从哪些源节点上迁移slot,可从多个源节点完成迁移,以逗号隔开,传递的是节点的node id,还可以直接传递--from all,这样源节点就是集群的所有节点,不传递该参数的话,则会在迁移过程中提示用户输入
--cluster-to <arg> #slot需要迁移的目的节点的node id,目的节点只能填写一个,不传递该参数的话,则会在迁移过程中提示用户输入
--cluster-slots <arg> #需要迁移的slot数量,不传递该参数的话,则会在迁移过程中提示用户输入。
--cluster-yes #指定迁移时的确认输入
--cluster-timeout <arg> #设置migrate命令的超时时间
--cluster-pipeline <arg> #定义cluster getkeysinslot命令一次取出的key数量,不传的话使用默认值为10
--cluster-replace #是否直接replace到目标节点
rebalance host:port #指定集群的任意一节点进行平衡集群节点slot数量
--cluster-weight <node1=w1...nodeN=wN> #指定集群节点的权重
--cluster-use-empty-masters #设置可以让没有分配slot的主节点参与,默认不允许
--cluster-timeout <arg> #设置migrate命令的超时时间
--cluster-simulate #模拟rebalance操作,不会真正执行迁移操作
--cluster-pipeline <arg> #定义cluster getkeysinslot命令一次取出的key数量,默认值为10
--cluster-threshold <arg> #迁移的slot阈值超过threshold,执行rebalance操作
--cluster-replace #是否直接replace到目标节点
add-node new_host:new_port existing_host:existing_port #添加节点,把新节点加入到指定的集群,默认添加主节点
--cluster-slave #新节点作为从节点,默认随机一个主节点
--cluster-master-id <arg> #给新节点指定主节点
del-node host:port node_id #删除给定的一个节点,成功后关闭该节点服务
call host:port command arg arg .. arg #在集群的所有节点执行相关命令
set-timeout host:port milliseconds #设置cluster-node-timeout
import host:port #将外部redis数据导入集群
--cluster-from <arg> #将指定实例的数据导入到集群
--cluster-copy #migrate时指定copy
--cluster-replace #migrate时指定replace
help

For check, fix, reshard, del-node, set-timeout you can specify the host and port of any working node in the cluster.

Redis集群无感知上线下线节点

https://blogs.52fx.biz/posts/2841798292.html

作者

eyiadmin

发布于

2020-01-25

更新于

2024-05-31

许可协议

评论