glusterfs.git/Makefile.am, branch v3.8rc0

build: `make distclean` doesn't clean all it ought to, needs to

2015-11-15T11:02:32+00:00

Debian builds fail to "build twice in a row" due to left over files
remaining after running `make distclean`

The main culprits are files created from *.in files during ./configure.
In particular these are ./glusterfs-api.pc, ./libgfchangelog.pc,
./libgfdb.pc, and ./tests/env.rc.

The strange one is contrib/umountd/Makefile{,.in}. While these are
created by ./configure - for reasons I don't quite fathom, perhaps
because contrib/umountd is included in EXTRA_DIST - after that
make and make distclean don't descend into the directory to build or
clean it (because it's not needed for Linux, and not built.)

Also removing the `find . -name Makefile -exec rm -f {}\;` from the
gitclean target, it's not needed (redundant) as its prereq distclean
target will have already removed them.

Change-Id: Ifc45b71d852052ef4b92f356279ce2ba2bbc5bb6
BUG: 1279836
Signed-off-by: Kaleb S KEITHLEY 
Reviewed-on: http://review.gluster.org/12579
Tested-by: Gluster Build System 
Reviewed-by: Milind Changire 
Tested-by: Milind Changire 
Reviewed-by: Niels de Vos

build: fix gitclean target

2015-07-12T17:17:14+00:00

$ make gitclean   # deleting unexpected 'Makefile' files
...

$ git status
...

  deleted:    extras/FreeBSD/Makefile
  deleted:    extras/command-completion/Makefile
  deleted:    extras/test/ld-preload-test/Makefile

...

This change fix to ignore above built-in makefiles while executing
'gitclean' target

Change-Id: I5365f5a1fe5b36141a6fe7ba27c38a2158f9f3a3
BUG: 1229639
Signed-off-by: Prasanna Kumar Kalever 
Reviewed-on: http://review.gluster.org/11136
Tested-by: Gluster Build System 
Tested-by: NetBSD Build System 
Reviewed-by: Niels de Vos

build: always include the VERSION file in 'make dist'

2015-06-28T14:46:52+00:00

Building a 'make dist' tarball from a non-git directory fails to include
the VERSION file. This subsequently fails to set the version in the
installation directories (for the xlators) and the RPM packaging can not
find the correct files.

This change makes sure to include a VERSION file in the 'make dist'
tarball, no matter from where 'make dist' is run. It mainly addresses
this use case:

   $ git clone ... && cd glusterfs
   $ ./autogen.sh
   $ mkdir /tmp/workdir
   $ cd /tmp/workdir
   $ $OLDPWD/configure
   $ make dist

Change-Id: I3e87b5e16118b68d065fe99790d4b17e0cef9189
BUG: 1198849
Signed-off-by: Niels de Vos 
Reviewed-on: http://review.gluster.org/11297
Reviewed-by: Kaleb KEITHLEY 
Tested-by: Gluster Build System 
Tested-by: NetBSD Build System

build: fix compiling on older distributions

2015-06-03T13:53:43+00:00

data-tiering is disabled on RHEL-5 because it depends on a too new
SQLite version.

This change also prevents installing some of files that are used by
geo-replication, which is also not available on RHEL-5. geo-replication
depends on a too recent version of Python.

Due to an older version of OpenSSL, some of the newer functions can not
be used. A fallback to previous functions is done. Unfortunately RHEL-5
does not seem to have TLSv1.2 support, so only older versions can be
used.

Change-Id: I672264a673f5432358d2e83b17e2a34efd9fd913
BUG: 1222317
Signed-off-by: Niels de Vos 
Reviewed-on: http://review.gluster.org/10803
Tested-by: NetBSD Build System 
Tested-by: Gluster Build System 
Reviewed-by: Kaleb KEITHLEY 
Reviewed-by: Vijay Bellur

build: outdated autotools helper config.* files in dist tarfile

2015-05-31T22:14:59+00:00

Our jenkins release task clones the source, runs ./autogen.sh (where
config.{guess,sub} come from) and ./configure, before running `make
dist` to product the release glusterfs-X.Y.Z.tar.gz.

The config.{guess,sub} in the tar file come from the archaic autoconf
in CentOS 6.3, which is what the glusterfs jenkins is running on.

We should not be shipping the (arbitrary, old) config.{guess,sub} files
from our jenkins machine.

Change-Id: Ib7643ae2e54d0e25c95f4e93e5dffb22cbe11523
BUG: 1223937
Signed-off-by: Kaleb S. KEITHLEY 
Reviewed-on: http://review.gluster.org/11009
Reviewed-by: Niels de Vos 
Tested-by: Gluster Build System

build: Autogenerated files delivered in dist tarball

2015-05-05T12:54:28+00:00

Change-Id: I99028fe6ff4547f837b0997543234a9020b75607
BUG: 1216067
Signed-off-by: Kaleb S. KEITHLEY 
Reviewed-on: http://review.gluster.org/10429
Tested-by: Gluster Build System

build: make contrib/uuid dependency optional

2015-04-10T11:39:52+00:00

On Linux systems we should use the libuuid from the distribution and not
bundle and statically link the contrib/uuid/ bits.

libglusterfs/src/compat-uuid.h has been introduced and should become an
abstraction layer for different UUID APIs. Non-Linux operating systems
should implement their compatibility layer there.

Once all operating systems have an implementation in compat-uuid.h, we
can remove contrib/uuid/ from the repository completely.

Change-Id: I345e5357644be2521685e00358bb8c83c4ea0577
BUG: 1206587
Signed-off-by: Niels de Vos 
Reviewed-on: http://review.gluster.org/10129
Tested-by: Gluster Build System 
Reviewed-by: Vijay Bellur

Adding Libgfdb to GlusterFS

2015-03-18T17:36:42+00:00

*************************************************************************
			Libgfdb						|
*************************************************************************
Libgfdb provides abstract mechanism to record extra/rich metadata
required for data maintenance, such as data tiering/classification.
It provides consumer with API for recording and querying, keeping
the consumer abstracted from the data store used beneath for storing data.
It works in a plug-and-play model, where data stores can be plugged-in.
Presently we have plugin for Sqlite3. In the future will provide recording
and querying performance optimizer. In the current implementation the schema
of metadata is fixed.

Schema:
~~~~~~
      GF_FILE_TB Table:
      ~~~~~~~~~~~~~~~~~
      This table has one entry per file inode. It holds the metadata required to
      make decisions in data maintenance.
      GF_ID (Primary key)	: File GFID (Universal Unique IDentifier in the namespace)
      W_SEC, W_MSEC 		: Write wind time in sec & micro-sec
      UW_SEC, UW_MSEC		: Write un-wind time in sec & micro-sec
      W_READ_SEC, W_READ_MSEC 	: Read wind time in sec & micro-sec
      UW_READ_SEC, UW_READ_MSEC : Read un-wind time in sec & micro-sec
      WRITE_FREQ_CNTR INTEGER	: Write Frequency Counter
      READ_FREQ_CNTR INTEGER	: Read Frequency Counter

      GF_FLINK_TABLE:
      ~~~~~~~~~~~~~~
      This table has all the hardlinks to a file inode.
      GF_ID		: File GFID               (Composite Primary Key)``|
      GF_PID		: Parent Directory GFID  (Composite Primary Key)   |-> Primary Key
      FNAME 		: File Base Name          (Composite Primary Key)__|
      FPATH 		: File Full Path (Its redundant for now, this will go)
      W_DEL_FLAG 	: This Flag is used for crash consistancy, when a link is unlinked.
                  	  i.e Set to 1 during unlink wind and during unwind this record
                          is deleted
      LINK_UPDATE 	: This Flag is used when a link is changed i.e rename.
                          Set to 1 when rename wind and set to 0 in rename unwind

Libgfdb API:
~~~~~~~~~~~
Refer libglusterfs/src/gfdb/gfdb_data_store.h

Change-Id: I2e9fbab3878ce630a7f41221ef61017dc43db11f
BUG: 1194753
Signed-off-by: Joseph Fernandes 
Signed-off-by: Dan Lambright 
Signed-off-by: Joseph Fernandes 
Reviewed-on: http://review.gluster.org/9683
Tested-by: Gluster Build System 
Reviewed-by: Vijay Bellur

tools: Finds missing files in gluster volume given backend brickpath

2015-03-16T04:20:03+00:00

The tool finds the missing files in a geo-replication slave volume.
The tool crawls backend .glusterfs of the brickpath, which is passed
as a parameter and stats each entry on slave volume mount to check
the presence of file. The mount used is aux-gfid-mount, hence no path
conversion is required and is fast. The tool needs to be run on every
node in cluster for each brickpath of geo-rep master volume to find
missing files on slave volume. The tool is generic enough and can be
used in non geo-replication context as well.

Most of the crawler code is leverged from Avati's xfind and is modified
to crawl only .glusterfs (https://github.com/avati/xsync)

Thanks Aravinda for scripts to convert gfid to path.

Change-Id: I84deaaaf638f7c571ff1319b67a3440fe27da810
BUG: 1187140
Signed-off-by: Aravinda VK 
Signed-off-by: Kotresh HR 
Reviewed-on: http://review.gluster.org/9503
Tested-by: Gluster Build System 
Reviewed-by: Vijay Bellur

README: Adding information about Gluster dev workflow

2015-02-25T12:28:36+00:00

In the README.md (which is automatically rendered in
github) there is no information about GlusterFS
workflow. So community members send pull requests in
github.

This patch will put the workflow information, so that
it would be easy for community members to know about
it by looking at GlusterFS's github mirror.

Change-Id: I62718f75aa26a45fe28e3e9399d1aa2338211c73
BUG: 1195336
Signed-off-by: Lalatendu Mohanty 
Reviewed-on: http://review.gluster.org/9727
Tested-by: Gluster Build System 
Reviewed-by: Niels de Vos 
Reviewed-by: Humble Devassy Chirammal 
Tested-by: Humble Devassy Chirammal