glusterfs.git/geo-replication/syncdaemon/monitor.py, branch v3.6.3beta1

geo-rep: Failover when a Slave node goes down

2014-11-13T06:22:53+00:00

When a slave node goes down, worker in master node
can connect to different slave node and resume the operation.

Existing georep was not checking the status of slave node before
worker restart. With this patch, geo-rep worker will check the
node status using `gluster volume status` when it goes faulty.

BUG: 1159209
Change-Id: I7ca2a66ff2a438435f297b7063313214c28f3d4b
Signed-off-by: Aravinda VK 
Reviewed-on: http://review.gluster.org/8921
Reviewed-by: Kotresh HR 
Tested-by: Gluster Build System 
Reviewed-by: Venky Shankar 
Tested-by: Venky Shankar 
Reviewed-on: http://review.gluster.org/9025

geo-rep: Fix the fd leak in worker/agent spawn

2014-06-30T10:40:45+00:00

worker and agent uses pipe to communicate, if worker dies
for some reason agent should get EOF and terminate.

Each worker-agent spawning is done in thread, Due to race
if multiple workers in same node retain the pipe refs of
other workers. Hence agent will not get EOF even if
worker dies.

BUG: 1114003
Change-Id: I36b9709b9392299483606bd3ef1db764fa3f2bff
Signed-off-by: Aravinda VK 
Reviewed-on: http://review.gluster.org/8194
Tested-by: Justin Clift 
Reviewed-by: Venky Shankar 
Tested-by: Venky Shankar

feature/geo-rep: Fix to retain pause state of gsyncd on restart

2014-06-20T08:17:22+00:00

On soft reboot, geo-rep monitor is writing 'faulty' into status
file. It should not do it if previous state is paused as
glusterd depend on the state file on node restart.

Change-Id: Idd45abf13350b087371935f1b4f6e1a346433d27
BUG: 1101410
Signed-off-by: Kotresh H R 
Reviewed-on: http://review.gluster.org/8097
Tested-by: Gluster Build System 
Reviewed-by: Venky Shankar 
Tested-by: Venky Shankar

feature/geo-rep: Fix for changelog agent becoming zombie.

2014-06-18T04:47:07+00:00

Monitor process spawns changelog agent and is not
wait on it, hence becoming zombie. When worker is
dies/killed, it respawns both worker and corresponding
agent leaving the earlier changelog agent in zombie
state. This patch addresses this issue by waiting
on agent process in montor process.

Change-Id: I571b7d6487133848edca67e7446f1caa70ae01c9
BUG: 1103643
Signed-off-by: Kotresh H R 
Reviewed-on: http://review.gluster.org/7956
Tested-by: Gluster Build System 
Reviewed-by: Aravinda VK 
Reviewed-by: Venky Shankar 
Tested-by: Venky Shankar

feature/geo-rep: Fix to retain pause state of gsyncd on restart.

2014-06-06T05:58:26+00:00

A new gsyncd options '--pause-on-start' is introduced. When node
reboots, if the status is paused, gsyncd is started with this
option. After gsyncd spawns worker and agent, worker will send 
SIGSTOP to negative pid of monitor to enter pause mode.

Change-Id: I5aad82c9a9fc8c243f384940b77d25e26e520d6d
BUG: 1101410
Signed-off-by: Kotresh H R 
Reviewed-on: http://review.gluster.org/7885
Reviewed-by: Aravinda VK 
Reviewed-by: Venky Shankar 
Tested-by: Venky Shankar

gsyncd / geo-rep: fix cli query for volinfo fetch

2014-05-26T02:51:22+00:00

With an unprivileged geo-replication session, monitor
was using user@slave for --remote-host option for gluster
cli, thereby failing to sucessfully connect to the slave
glusterd.

This patch fixes the issue by selecting the hostname/IP
from the speicified slave endpoint url.

- For privileged geo-replication sessions, this patch
has no effect as the slave endpoint url is just the
hostname/IP.

Change-Id: I88f66c406a8d9a34db7fc626965f949075e3ceac
BUG: 1077452
Signed-off-by: Venky Shankar 
Reviewed-on: http://review.gluster.org/7818
Reviewed-by: Aravinda VK 
Reviewed-by: Kotresh HR 
Tested-by: Gluster Build System

gsyncd/geo-rep: Fix remote vol info fetching for non-root

2014-05-15T08:21:04+00:00

Signed-off-by: Kotresh H R 

Change-Id: If1d2cab3fcfe2391105551e54f0b9729a7c204e4
BUG: 1077452
Reviewed-on: http://review.gluster.org/7767
Reviewed-by: Venky Shankar 
Tested-by: Venky Shankar

gsyncd / geo-rep: Partial support for Non-root geo-replication.

2014-05-14T17:24:01+00:00

This patch enables geo-replication to be run as an unprivileged
user. As of now, this is just the partial support, but is very
close to achieve full functionality.

Current limitation
* Geo-replication executed Gluster CLI commands on the slave
  via SSH. On a non-root setup, Gluster CLI would run as an
  unprivileged user, failing to execute the command. As a
  workaround (for testing), setuid(2) Gluster CLI executable
  or use the glusterd option to accept commands by unprivileged
  CLI process. The nature of cli commands are "system::"
  commands (for key management) and remote volume info fetching.

Remote volume info fetching has been modified to use --remote-host
gluster cli option rather than ssh and remote cli execution.

Change-Id: Ica89e2ba9b7f48fd6e1c876c477d7822dc693617
BUG: 1077452
Signed-off-by: Venky Shankar 
Reviewed-on: http://review.gluster.org/7658
Tested-by: Gluster Build System

geo-rep: Pause and Resume feature for geo-replication

2014-05-09T07:27:40+00:00

Changelog consumption/processing now happens in seperate process
group than monitor. When monitor process group gets SIGSTOP all
worker process, ssh, rsync will be paused except the changelog
processing. When it gets SIGCONT it resumes its operation.

Changelog agent runs as RepceServer, geo-rep worker communicates
with changelog agent using RepceClient.

Change-Id: I35c333e4d8b13d03a7808aed601960eef23cfa04
BUG: 1093602
Signed-off-by: Venky Shankar 
Signed-off-by: Aravinda VK 
Reviewed-on: http://review.gluster.org/7322

geo-rep: code pep8/flake8 fixes

2014-04-08T04:56:55+00:00

pep8 is a style guide for python.
http://legacy.python.org/dev/peps/pep-0008/

pep8 can be installed using, `pip install pep8`

Usage: `pep8 `, For example, `pep8 master.py`
will display all the coding standard errors.

flake8 is used to identify unused imports and other issues
in code.

pip install flake8

cd $GLUSTER_REPO/geo-replication/
flake8 syncdaemon

Updated license headers to each source file.

Change-Id: I01c7d0a6091d21bfa48720e9fb5624b77fa3db4a
Signed-off-by: Aravinda VK 
Reviewed-on: http://review.gluster.org/7311
Reviewed-by: Kotresh HR 
Reviewed-by: Prashanth Pai 
Tested-by: Gluster Build System