Skip to content

test: flaky replication-py/cluster.test.py test #206

Open
@avtikhon

Description

@avtikhon

Tarantool version:
Tarantool 2.5.0-159-g83462a5
Target: Linux-x86_64-RelWithDebInfo
Build options: cmake . -DCMAKE_INSTALL_PREFIX=/usr/local -DENABLE_BACKTRACE=ON
Compiler: /usr/bin/cc /usr/bin/c++
C_FLAGS: -static-libstdc++ -fexceptions -funwind-tables -fno-omit-frame-pointer -fno-stack-protector -fno-common -fopenmp -msse2 -std=c11 -Wall -Wextra -Wno-strict-aliasing -Wno-char-subscripts -Wno-format-truncation -Wno-gnu-alignof-expression -fno-gnu89-inline -Wno-cast-function-type
CXX_FLAGS: -static-libstdc++ -fexceptions -funwind-tables -fno-omit-frame-pointer -fno-stack-protector -fno-common -fopenmp -msse2 -std=c++11 -Wall -Wextra -Wno-strict-aliasing -Wno-char-subscripts -Wno-format-truncation -Wno-invalid-offsetof -Wno-gnu-alignof-expression -Wno-cast-function-type

OS version:
Linux (found on static build w/ dockerfile)

Bug description:
https://gitlab.com/tarantool/tarantool/-/jobs/610343959
https://gitlab.com/tarantool/tarantool/-/jobs/597643547

 [040] --- replication-py/cluster.result	Wed Jun 24 15:03:35 2020
 [040] +++ replication-py/cluster.reject	Wed Jun 24 22:20:53 2020
 [040] @@ -80,7 +80,7 @@
 [040]  ...
 [040]  not box.info.ro
 [040]  ---
 [040] -- true
 [040] +- false
 [040]  ...
 [040]  box.info.lsn == 0
 [040]  ---
 [040] @@ -95,15 +95,15 @@
 [040]  -------------------------------------------------------------
 [040]  box.space._schema:insert{"test", 48}
 [040]  ---
 [040] -- ['test', 48]
 [040] +- error: Can't modify data because this instance is in read-only mode.
 [040]  ...
 [040]  box.info.lsn == 1
 [040]  ---
 [040] -- true
 [040] +- false
 [040]  ...
 [040]  box.info.vclock[2] == 1
 [040]  ---
 [040] -- true
 [040] +- false
 [040]  ...
 [040]  -------------------------------------------------------------
 [040]  Connect master to replica
 [040] @@ -126,7 +126,7 @@
 [040]  ...
 [040]  box.info.vclock[2] == 1
 [040]  ---
 [040] -- true
 [040] +- false
 [040]  ...
 [040]  -------------------------------------------------------------
 [040]  Modify data to bump LSN on replica
 [040] @@ -137,11 +137,11 @@
 [040]  ...
 [040]  box.info.lsn == 2
 [040]  ---
 [040] -- true
 [040] -...
 [040] -box.info.vclock[2] == 2
 [040] ----
 [040] -- true
 [040] +- false
 [040] +...
 [040] +box.info.vclock[2] == 2
 [040] +---
 [040] +- false
 [040]  ...
 [040]  -------------------------------------------------------------
 [040]  Master must not crash then receives orphan rows from replica
 [040] @@ -151,7 +151,7 @@
 [040]  ...
 [040]  box.info.vclock[2] == 2
 [040]  ---
 [040] -- true
 [040] +- false
 [040]  ...
 [040]  box.cfg{ replication = '' }
 [040]  ---
 [040] @@ -165,7 +165,7 @@
 [040]  ...
 [040]  box.info.vclock[2] == 2
 [040]  ---
 [040] -- true
 [040] +- false
 [040]  ...
 [040]  box.info.id == 2
 [040]  ---
 [040] @@ -177,11 +177,11 @@
 [040]  ...
 [040]  box.info.vclock[2] == 2
 [040]  ---
 [040] -- true
 [040] -...
 [040] -box.info.vclock[2] == 2
 [040] ----
 [040] -- true
 [040] +- false
 [040] +...
 [040] +box.info.vclock[2] == 2
 [040] +---
 [040] +- false
 [040]  ...
 [040]  box.space._cluster:delete{2} ~= nil
 [040]  ---
 [040] 
 [040] Last 15 lines of Tarantool Log file [Instance "master"][/tarantool/test/var/040_replication-py/master.log]:
 [040] 2020-06-24 22:20:49.895 [977] main/123/main I> subscribed replica f4c03aa9-0ca0-4d33-906c-26ca293fd43c at fd 20, aka [::1]:52352, peer of [::1]:52458
 [040] 2020-06-24 22:20:49.895 [977] main/123/main I> remote vclock {1: 4, 2: 1} local vclock {1: 4, 2: 1}
 [040] 2020-06-24 22:20:49.897 [977] relay/[::1]:52458/101/main I> recover from `/tarantool/test/var/040_replication-py/master/00000000000000000004.xlog'
 [040] 2020-06-24 22:20:50.900 [977] relay/[::1]:52458/101/main coio.cc:340 !> SystemError timed out: Connection timed out
 [040] 2020-06-24 22:20:50.900 [977] relay/[::1]:52458/101/main C> exiting the relay loop
 [040] 2020-06-24 22:20:52.103 [977] main I> removed replica f4c03aa9-0ca0-4d33-906c-26ca293fd43c
 [040] 2020-06-24 22:20:52.104 [977] main/119/console/::1:39540 I> set 'read_only' configuration option to true
 [040] 2020-06-24 22:20:52.176 [977] main/124/main box.cc:148 E> ER_READONLY: Can't modify data because this instance is in read-only mode.
 [040] 2020-06-24 22:20:52.178 [977] main/119/console/::1:39540 I> set 'read_only' configuration option to false
 [040] 2020-06-24 22:20:52.918 [977] main/124/main I> joining replica 3ad7c5d7-4bb0-4be0-8a50-da8fcd557332 at fd 20, aka [::1]:52352, peer of [::1]:53266
 [040] 2020-06-24 22:20:52.920 [977] main/124/main I> initial data sent.
 [040] 2020-06-24 22:20:52.920 [977] main I> assigned id 2 to replica 3ad7c5d7-4bb0-4be0-8a50-da8fcd557332
 [040] 2020-06-24 22:20:52.920 [977] relay/[::1]:53266/101/main I> recover from `/tarantool/test/var/040_replication-py/master/00000000000000000004.xlog'
 [040] 2020-06-24 22:20:52.921 [977] main/124/main I> final data sent.
 [040] 2020-06-24 22:20:53.758 [977] main I> removed replica 3ad7c5d7-4bb0-4be0-8a50-da8fcd557332

Steps to reproduce:

Optional (but very desirable):

  • coredump
  • backtrace
  • netstat

Metadata

Metadata

Assignees

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions