glusterfs.git/tools, branch v3.7.0beta1

Fix case mistake for MKDIR_P in Makefiles

2015-04-23T05:31:42+00:00

Some makefiles used $(mkdir_p) instead of the corectly defined $(MKDIR_P).
The former is substituted as an empty string, leading to possible failures
depending of the user shell tolerance. NetBSD's /bin/sh seems to choke
more easily than Linux's /bin/bash, but if the later does not fail, it
does not created the intended directories anyway.

Resubmit after rebase in hope that regression test will have less
spurious failures.

Backport of: I8caed4000f3c91cb3a685453848fb854793945ed

BUG: 1212676
Change-Id: I393ffda8aa24bffce86f7b1f19b999ffa30c3562
Signed-off-by: Emmanuel Dreyfus 
Reviewed-on: http://review.gluster.org/10279
Tested-by: NetBSD Build System
Tested-by: Gluster Build System 
Reviewed-by: Vijay Bellur

tools/glusterfind: Prevent ssh public key overwrite issue

2015-04-13T08:56:30+00:00

Same ssh key was used for all the sessions, when multiple
sessions created in Cluster, public keys get overwritten by
newest sessions. Moved ssh keys to respective session dir.

BUG: 1206547
Change-Id: I3d8fac9b24bc7c71445c7b4deae83104693e7dab
Signed-off-by: Aravinda VK 
Reviewed-on: http://review.gluster.org/10150
Tested-by: Gluster Build System 
Reviewed-by: Kotresh HR 
Reviewed-by: Venky Shankar 
Tested-by: Venky Shankar

tools/glusterfind: Check existence of Session

2015-04-09T09:52:33+00:00

Use glusterfind list command to check a session is valid or not

    glusterfind list --session  --volume 

Session exists if return code($?) is zero else invalid session

Change-Id: I37faa09e4e1bf2f10725dd8e5b0cc36a36a3cad4
Signed-off-by: Aravinda VK 
BUG: 1205057
Reviewed-on: http://review.gluster.org/10154
Reviewed-by: Kotresh HR 
Tested-by: Gluster Build System

tools/glusterfind: Validate Volume name before session Create

2015-04-01T17:35:20+00:00

Do not create Session directories if Volume does not exists.

Change-Id: I60c9107135c2bed2a7198582267b2328dec7e868
Signed-off-by: Aravinda VK 
BUG: 1206065
Reviewed-on: http://review.gluster.org/10072
Reviewed-by: Kotresh HR 
Reviewed-by: Venky Shankar 
Tested-by: Venky Shankar

tools/glusterfind: Convert Output file path to absolute path

2015-04-01T17:33:27+00:00

BUG: 1203656
Change-Id: Ie6c8f38894466246c453b2a863538a420acfe9f7
Signed-off-by: Aravinda VK 
Reviewed-on: http://review.gluster.org/10011
Tested-by: Gluster Build System 
Reviewed-by: Kotresh HR 
Reviewed-by: Prashanth Pai 
Reviewed-by: Venky Shankar 
Tested-by: Venky Shankar

tools/glusterfind: Changelog_init before changelog_register

2015-03-30T12:50:25+00:00

With the new Changelog RPC based approach, Changelog_init
needs to be called before changelog_register

BUG: 1206127
Change-Id: I817b84016d3f9ffdf2ea7a4e177953fe14ccc323
Signed-off-by: Aravinda VK 
Reviewed-on: http://review.gluster.org/10009
Tested-by: Gluster Build System 
Reviewed-by: Kotresh HR 
Reviewed-by: Prashanth Pai 
Reviewed-by: Kaleb KEITHLEY

tools/glusterfind: Ignore .trashcan dir during Brick Crawl

2015-03-30T12:35:32+00:00

BUG: 1203650
Change-Id: Icf81726ad34bd5cfec6d8e06763b02a159e84c2e
Signed-off-by: Aravinda VK 
Reviewed-on: http://review.gluster.org/10010
Reviewed-by: Kotresh HR 
Reviewed-by: Prashanth Pai 
Tested-by: Gluster Build System 
Reviewed-by: Kaleb KEITHLEY

feature/glusterfind: A tool to find incremental changes

2015-03-18T09:54:25+00:00

Documentation is available in patch:
http://review.gluster.org/#/c/9800/

A tool which helps to get list of modified files or list of all files in
GlusterFS Volume using Changelog or find command.

Usage
=====
glusterfind --help

Create:
-------
glusterfind create --help

The tool creates status file $GLUSTERD_WORKDIR/SESSION/VOLUME/status
and records current timestamp to initiate the session. This timestamp
will be used as start time for next runs.

As part of create also generates ssh key and distributes to all peers.
and enables build.pgfid and changelog using volume set command.

Pre:
----
glusterfind pre --help

This command is used to generate the list of files modified after session
creation time or after last run. To get list of all files/dirs in Volume,
run pre command with `--full` argument.

The tool gets all nodes details using gluster volume info and runs node
agent for each brick in respective nodes via ssh command. Once these node
agents generate the output file, tool copies to local using scp. Merges all
the output files to generate the final output file.

Post:
-----
glusterfind post --help

After consuming the list, this sub command is called to update the session
time based on pre command status file.

List:
-----
glusterfind list --help

To view all the sessions

Delete:
-------
glusterfind delete --help

Delete session.

Known Issues
------------
1. Deleted files will not get listed, since we can't convert GFID to
   Path if file/dir is deleted.
2. Only new name will get listed if Renamed.
3. All hardlinks will get listed.

Change-Id: I82991feb0aea85cb6ec035fddbf80a2b276e86b0
BUG: 1193893
Signed-off-by: Aravinda VK 
Reviewed-on: http://review.gluster.org/9682
Tested-by: Gluster Build System 
Reviewed-by: Venky Shankar 
Reviewed-by: Prashanth Pai 
Reviewed-by: Kotresh HR 
Reviewed-by: Vijay Bellur

tools: Finds missing files in gluster volume given backend brickpath

2015-03-16T04:20:03+00:00

The tool finds the missing files in a geo-replication slave volume.
The tool crawls backend .glusterfs of the brickpath, which is passed
as a parameter and stats each entry on slave volume mount to check
the presence of file. The mount used is aux-gfid-mount, hence no path
conversion is required and is fast. The tool needs to be run on every
node in cluster for each brickpath of geo-rep master volume to find
missing files on slave volume. The tool is generic enough and can be
used in non geo-replication context as well.

Most of the crawler code is leverged from Avati's xfind and is modified
to crawl only .glusterfs (https://github.com/avati/xsync)

Thanks Aravinda for scripts to convert gfid to path.

Change-Id: I84deaaaf638f7c571ff1319b67a3440fe27da810
BUG: 1187140
Signed-off-by: Aravinda VK 
Signed-off-by: Kotresh HR 
Reviewed-on: http://review.gluster.org/9503
Tested-by: Gluster Build System 
Reviewed-by: Vijay Bellur