diff options
author | James Shubin <james@shubin.ca> | 2012-07-24 19:28:59 -0400 |
---|---|---|
committer | James Shubin <james@shubin.ca> | 2012-07-24 19:28:59 -0400 |
commit | 61cf89af55bd57a224f0e600746a05a71fdb4c95 (patch) | |
tree | bf25d30450b882218e141b5c4e9d818515f10514 | |
download | puppet-gluster-61cf89af55bd57a224f0e600746a05a71fdb4c95.tar.gz puppet-gluster-61cf89af55bd57a224f0e600746a05a71fdb4c95.tar.xz puppet-gluster-61cf89af55bd57a224f0e600746a05a71fdb4c95.zip |
Initial commit. puppet-gluster, welcome to git.
-rw-r--r-- | COPYING | 661 | ||||
-rw-r--r-- | COPYRIGHT | 16 | ||||
-rw-r--r-- | README | 6 | ||||
-rw-r--r-- | TODO | 2 | ||||
-rw-r--r-- | examples/distributed-replicate.pp | 145 | ||||
-rw-r--r-- | manifests/brick.pp | 190 | ||||
-rw-r--r-- | manifests/client.pp | 78 | ||||
-rw-r--r-- | manifests/client/base.pp | 47 | ||||
-rw-r--r-- | manifests/host.pp | 81 | ||||
-rw-r--r-- | manifests/init.pp | 62 | ||||
-rw-r--r-- | manifests/server.pp | 151 | ||||
-rw-r--r-- | manifests/volume.pp | 111 | ||||
-rw-r--r-- | templates/glusterd.info.erb | 1 | ||||
-rw-r--r-- | templates/glusterd.vol.erb | 8 |
14 files changed, 1559 insertions, 0 deletions
@@ -0,0 +1,661 @@ + GNU AFFERO GENERAL PUBLIC LICENSE + Version 3, 19 November 2007 + + Copyright (C) 2007 Free Software Foundation, Inc. <http://fsf.org/> + Everyone is permitted to copy and distribute verbatim copies + of this license document, but changing it is not allowed. + + Preamble + + The GNU Affero General Public License is a free, copyleft license for +software and other kinds of works, specifically designed to ensure +cooperation with the community in the case of network server software. + + The licenses for most software and other practical works are designed +to take away your freedom to share and change the works. By contrast, +our General Public Licenses are intended to guarantee your freedom to +share and change all versions of a program--to make sure it remains free +software for all its users. + + When we speak of free software, we are referring to freedom, not +price. Our General Public Licenses are designed to make sure that you +have the freedom to distribute copies of free software (and charge for +them if you wish), that you receive source code or can get it if you +want it, that you can change the software or use pieces of it in new +free programs, and that you know you can do these things. + + Developers that use our General Public Licenses protect your rights +with two steps: (1) assert copyright on the software, and (2) offer +you this License which gives you legal permission to copy, distribute +and/or modify the software. + + A secondary benefit of defending all users' freedom is that +improvements made in alternate versions of the program, if they +receive widespread use, become available for other developers to +incorporate. Many developers of free software are heartened and +encouraged by the resulting cooperation. However, in the case of +software used on network servers, this result may fail to come about. +The GNU General Public License permits making a modified version and +letting the public access it on a server without ever releasing its +source code to the public. + + The GNU Affero General Public License is designed specifically to +ensure that, in such cases, the modified source code becomes available +to the community. It requires the operator of a network server to +provide the source code of the modified version running there to the +users of that server. Therefore, public use of a modified version, on +a publicly accessible server, gives the public access to the source +code of the modified version. + + An older license, called the Affero General Public License and +published by Affero, was designed to accomplish similar goals. This is +a different license, not a version of the Affero GPL, but Affero has +released a new version of the Affero GPL which permits relicensing under +this license. + + The precise terms and conditions for copying, distribution and +modification follow. + + TERMS AND CONDITIONS + + 0. Definitions. + + "This License" refers to version 3 of the GNU Affero General Public License. + + "Copyright" also means copyright-like laws that apply to other kinds of +works, such as semiconductor masks. + + "The Program" refers to any copyrightable work licensed under this +License. Each licensee is addressed as "you". "Licensees" and +"recipients" may be individuals or organizations. + + To "modify" a work means to copy from or adapt all or part of the work +in a fashion requiring copyright permission, other than the making of an +exact copy. The resulting work is called a "modified version" of the +earlier work or a work "based on" the earlier work. + + A "covered work" means either the unmodified Program or a work based +on the Program. + + To "propagate" a work means to do anything with it that, without +permission, would make you directly or secondarily liable for +infringement under applicable copyright law, except executing it on a +computer or modifying a private copy. Propagation includes copying, +distribution (with or without modification), making available to the +public, and in some countries other activities as well. + + To "convey" a work means any kind of propagation that enables other +parties to make or receive copies. Mere interaction with a user through +a computer network, with no transfer of a copy, is not conveying. + + An interactive user interface displays "Appropriate Legal Notices" +to the extent that it includes a convenient and prominently visible +feature that (1) displays an appropriate copyright notice, and (2) +tells the user that there is no warranty for the work (except to the +extent that warranties are provided), that licensees may convey the +work under this License, and how to view a copy of this License. If +the interface presents a list of user commands or options, such as a +menu, a prominent item in the list meets this criterion. + + 1. Source Code. + + The "source code" for a work means the preferred form of the work +for making modifications to it. "Object code" means any non-source +form of a work. + + A "Standard Interface" means an interface that either is an official +standard defined by a recognized standards body, or, in the case of +interfaces specified for a particular programming language, one that +is widely used among developers working in that language. + + The "System Libraries" of an executable work include anything, other +than the work as a whole, that (a) is included in the normal form of +packaging a Major Component, but which is not part of that Major +Component, and (b) serves only to enable use of the work with that +Major Component, or to implement a Standard Interface for which an +implementation is available to the public in source code form. A +"Major Component", in this context, means a major essential component +(kernel, window system, and so on) of the specific operating system +(if any) on which the executable work runs, or a compiler used to +produce the work, or an object code interpreter used to run it. + + The "Corresponding Source" for a work in object code form means all +the source code needed to generate, install, and (for an executable +work) run the object code and to modify the work, including scripts to +control those activities. However, it does not include the work's +System Libraries, or general-purpose tools or generally available free +programs which are used unmodified in performing those activities but +which are not part of the work. For example, Corresponding Source +includes interface definition files associated with source files for +the work, and the source code for shared libraries and dynamically +linked subprograms that the work is specifically designed to require, +such as by intimate data communication or control flow between those +subprograms and other parts of the work. + + The Corresponding Source need not include anything that users +can regenerate automatically from other parts of the Corresponding +Source. + + The Corresponding Source for a work in source code form is that +same work. + + 2. Basic Permissions. + + All rights granted under this License are granted for the term of +copyright on the Program, and are irrevocable provided the stated +conditions are met. This License explicitly affirms your unlimited +permission to run the unmodified Program. The output from running a +covered work is covered by this License only if the output, given its +content, constitutes a covered work. This License acknowledges your +rights of fair use or other equivalent, as provided by copyright law. + + You may make, run and propagate covered works that you do not +convey, without conditions so long as your license otherwise remains +in force. You may convey covered works to others for the sole purpose +of having them make modifications exclusively for you, or provide you +with facilities for running those works, provided that you comply with +the terms of this License in conveying all material for which you do +not control copyright. Those thus making or running the covered works +for you must do so exclusively on your behalf, under your direction +and control, on terms that prohibit them from making any copies of +your copyrighted material outside their relationship with you. + + Conveying under any other circumstances is permitted solely under +the conditions stated below. Sublicensing is not allowed; section 10 +makes it unnecessary. + + 3. Protecting Users' Legal Rights From Anti-Circumvention Law. + + No covered work shall be deemed part of an effective technological +measure under any applicable law fulfilling obligations under article +11 of the WIPO copyright treaty adopted on 20 December 1996, or +similar laws prohibiting or restricting circumvention of such +measures. + + When you convey a covered work, you waive any legal power to forbid +circumvention of technological measures to the extent such circumvention +is effected by exercising rights under this License with respect to +the covered work, and you disclaim any intention to limit operation or +modification of the work as a means of enforcing, against the work's +users, your or third parties' legal rights to forbid circumvention of +technological measures. + + 4. Conveying Verbatim Copies. + + You may convey verbatim copies of the Program's source code as you +receive it, in any medium, provided that you conspicuously and +appropriately publish on each copy an appropriate copyright notice; +keep intact all notices stating that this License and any +non-permissive terms added in accord with section 7 apply to the code; +keep intact all notices of the absence of any warranty; and give all +recipients a copy of this License along with the Program. + + You may charge any price or no price for each copy that you convey, +and you may offer support or warranty protection for a fee. + + 5. Conveying Modified Source Versions. + + You may convey a work based on the Program, or the modifications to +produce it from the Program, in the form of source code under the +terms of section 4, provided that you also meet all of these conditions: + + a) The work must carry prominent notices stating that you modified + it, and giving a relevant date. + + b) The work must carry prominent notices stating that it is + released under this License and any conditions added under section + 7. This requirement modifies the requirement in section 4 to + "keep intact all notices". + + c) You must license the entire work, as a whole, under this + License to anyone who comes into possession of a copy. This + License will therefore apply, along with any applicable section 7 + additional terms, to the whole of the work, and all its parts, + regardless of how they are packaged. This License gives no + permission to license the work in any other way, but it does not + invalidate such permission if you have separately received it. + + d) If the work has interactive user interfaces, each must display + Appropriate Legal Notices; however, if the Program has interactive + interfaces that do not display Appropriate Legal Notices, your + work need not make them do so. + + A compilation of a covered work with other separate and independent +works, which are not by their nature extensions of the covered work, +and which are not combined with it such as to form a larger program, +in or on a volume of a storage or distribution medium, is called an +"aggregate" if the compilation and its resulting copyright are not +used to limit the access or legal rights of the compilation's users +beyond what the individual works permit. Inclusion of a covered work +in an aggregate does not cause this License to apply to the other +parts of the aggregate. + + 6. Conveying Non-Source Forms. + + You may convey a covered work in object code form under the terms +of sections 4 and 5, provided that you also convey the +machine-readable Corresponding Source under the terms of this License, +in one of these ways: + + a) Convey the object code in, or embodied in, a physical product + (including a physical distribution medium), accompanied by the + Corresponding Source fixed on a durable physical medium + customarily used for software interchange. + + b) Convey the object code in, or embodied in, a physical product + (including a physical distribution medium), accompanied by a + written offer, valid for at least three years and valid for as + long as you offer spare parts or customer support for that product + model, to give anyone who possesses the object code either (1) a + copy of the Corresponding Source for all the software in the + product that is covered by this License, on a durable physical + medium customarily used for software interchange, for a price no + more than your reasonable cost of physically performing this + conveying of source, or (2) access to copy the + Corresponding Source from a network server at no charge. + + c) Convey individual copies of the object code with a copy of the + written offer to provide the Corresponding Source. This + alternative is allowed only occasionally and noncommercially, and + only if you received the object code with such an offer, in accord + with subsection 6b. + + d) Convey the object code by offering access from a designated + place (gratis or for a charge), and offer equivalent access to the + Corresponding Source in the same way through the same place at no + further charge. You need not require recipients to copy the + Corresponding Source along with the object code. If the place to + copy the object code is a network server, the Corresponding Source + may be on a different server (operated by you or a third party) + that supports equivalent copying facilities, provided you maintain + clear directions next to the object code saying where to find the + Corresponding Source. Regardless of what server hosts the + Corresponding Source, you remain obligated to ensure that it is + available for as long as needed to satisfy these requirements. + + e) Convey the object code using peer-to-peer transmission, provided + you inform other peers where the object code and Corresponding + Source of the work are being offered to the general public at no + charge under subsection 6d. + + A separable portion of the object code, whose source code is excluded +from the Corresponding Source as a System Library, need not be +included in conveying the object code work. + + A "User Product" is either (1) a "consumer product", which means any +tangible personal property which is normally used for personal, family, +or household purposes, or (2) anything designed or sold for incorporation +into a dwelling. In determining whether a product is a consumer product, +doubtful cases shall be resolved in favor of coverage. For a particular +product received by a particular user, "normally used" refers to a +typical or common use of that class of product, regardless of the status +of the particular user or of the way in which the particular user +actually uses, or expects or is expected to use, the product. A product +is a consumer product regardless of whether the product has substantial +commercial, industrial or non-consumer uses, unless such uses represent +the only significant mode of use of the product. + + "Installation Information" for a User Product means any methods, +procedures, authorization keys, or other information required to install +and execute modified versions of a covered work in that User Product from +a modified version of its Corresponding Source. The information must +suffice to ensure that the continued functioning of the modified object +code is in no case prevented or interfered with solely because +modification has been made. + + If you convey an object code work under this section in, or with, or +specifically for use in, a User Product, and the conveying occurs as +part of a transaction in which the right of possession and use of the +User Product is transferred to the recipient in perpetuity or for a +fixed term (regardless of how the transaction is characterized), the +Corresponding Source conveyed under this section must be accompanied +by the Installation Information. But this requirement does not apply +if neither you nor any third party retains the ability to install +modified object code on the User Product (for example, the work has +been installed in ROM). + + The requirement to provide Installation Information does not include a +requirement to continue to provide support service, warranty, or updates +for a work that has been modified or installed by the recipient, or for +the User Product in which it has been modified or installed. Access to a +network may be denied when the modification itself materially and +adversely affects the operation of the network or violates the rules and +protocols for communication across the network. + + Corresponding Source conveyed, and Installation Information provided, +in accord with this section must be in a format that is publicly +documented (and with an implementation available to the public in +source code form), and must require no special password or key for +unpacking, reading or copying. + + 7. Additional Terms. + + "Additional permissions" are terms that supplement the terms of this +License by making exceptions from one or more of its conditions. +Additional permissions that are applicable to the entire Program shall +be treated as though they were included in this License, to the extent +that they are valid under applicable law. If additional permissions +apply only to part of the Program, that part may be used separately +under those permissions, but the entire Program remains governed by +this License without regard to the additional permissions. + + When you convey a copy of a covered work, you may at your option +remove any additional permissions from that copy, or from any part of +it. (Additional permissions may be written to require their own +removal in certain cases when you modify the work.) You may place +additional permissions on material, added by you to a covered work, +for which you have or can give appropriate copyright permission. + + Notwithstanding any other provision of this License, for material you +add to a covered work, you may (if authorized by the copyright holders of +that material) supplement the terms of this License with terms: + + a) Disclaiming warranty or limiting liability differently from the + terms of sections 15 and 16 of this License; or + + b) Requiring preservation of specified reasonable legal notices or + author attributions in that material or in the Appropriate Legal + Notices displayed by works containing it; or + + c) Prohibiting misrepresentation of the origin of that material, or + requiring that modified versions of such material be marked in + reasonable ways as different from the original version; or + + d) Limiting the use for publicity purposes of names of licensors or + authors of the material; or + + e) Declining to grant rights under trademark law for use of some + trade names, trademarks, or service marks; or + + f) Requiring indemnification of licensors and authors of that + material by anyone who conveys the material (or modified versions of + it) with contractual assumptions of liability to the recipient, for + any liability that these contractual assumptions directly impose on + those licensors and authors. + + All other non-permissive additional terms are considered "further +restrictions" within the meaning of section 10. If the Program as you +received it, or any part of it, contains a notice stating that it is +governed by this License along with a term that is a further +restriction, you may remove that term. If a license document contains +a further restriction but permits relicensing or conveying under this +License, you may add to a covered work material governed by the terms +of that license document, provided that the further restriction does +not survive such relicensing or conveying. + + If you add terms to a covered work in accord with this section, you +must place, in the relevant source files, a statement of the +additional terms that apply to those files, or a notice indicating +where to find the applicable terms. + + Additional terms, permissive or non-permissive, may be stated in the +form of a separately written license, or stated as exceptions; +the above requirements apply either way. + + 8. Termination. + + You may not propagate or modify a covered work except as expressly +provided under this License. Any attempt otherwise to propagate or +modify it is void, and will automatically terminate your rights under +this License (including any patent licenses granted under the third +paragraph of section 11). + + However, if you cease all violation of this License, then your +license from a particular copyright holder is reinstated (a) +provisionally, unless and until the copyright holder explicitly and +finally terminates your license, and (b) permanently, if the copyright +holder fails to notify you of the violation by some reasonable means +prior to 60 days after the cessation. + + Moreover, your license from a particular copyright holder is +reinstated permanently if the copyright holder notifies you of the +violation by some reasonable means, this is the first time you have +received notice of violation of this License (for any work) from that +copyright holder, and you cure the violation prior to 30 days after +your receipt of the notice. + + Termination of your rights under this section does not terminate the +licenses of parties who have received copies or rights from you under +this License. If your rights have been terminated and not permanently +reinstated, you do not qualify to receive new licenses for the same +material under section 10. + + 9. Acceptance Not Required for Having Copies. + + You are not required to accept this License in order to receive or +run a copy of the Program. Ancillary propagation of a covered work +occurring solely as a consequence of using peer-to-peer transmission +to receive a copy likewise does not require acceptance. However, +nothing other than this License grants you permission to propagate or +modify any covered work. These actions infringe copyright if you do +not accept this License. Therefore, by modifying or propagating a +covered work, you indicate your acceptance of this License to do so. + + 10. Automatic Licensing of Downstream Recipients. + + Each time you convey a covered work, the recipient automatically +receives a license from the original licensors, to run, modify and +propagate that work, subject to this License. You are not responsible +for enforcing compliance by third parties with this License. + + An "entity transaction" is a transaction transferring control of an +organization, or substantially all assets of one, or subdividing an +organization, or merging organizations. If propagation of a covered +work results from an entity transaction, each party to that +transaction who receives a copy of the work also receives whatever +licenses to the work the party's predecessor in interest had or could +give under the previous paragraph, plus a right to possession of the +Corresponding Source of the work from the predecessor in interest, if +the predecessor has it or can get it with reasonable efforts. + + You may not impose any further restrictions on the exercise of the +rights granted or affirmed under this License. For example, you may +not impose a license fee, royalty, or other charge for exercise of +rights granted under this License, and you may not initiate litigation +(including a cross-claim or counterclaim in a lawsuit) alleging that +any patent claim is infringed by making, using, selling, offering for +sale, or importing the Program or any portion of it. + + 11. Patents. + + A "contributor" is a copyright holder who authorizes use under this +License of the Program or a work on which the Program is based. The +work thus licensed is called the contributor's "contributor version". + + A contributor's "essential patent claims" are all patent claims +owned or controlled by the contributor, whether already acquired or +hereafter acquired, that would be infringed by some manner, permitted +by this License, of making, using, or selling its contributor version, +but do not include claims that would be infringed only as a +consequence of further modification of the contributor version. For +purposes of this definition, "control" includes the right to grant +patent sublicenses in a manner consistent with the requirements of +this License. + + Each contributor grants you a non-exclusive, worldwide, royalty-free +patent license under the contributor's essential patent claims, to +make, use, sell, offer for sale, import and otherwise run, modify and +propagate the contents of its contributor version. + + In the following three paragraphs, a "patent license" is any express +agreement or commitment, however denominated, not to enforce a patent +(such as an express permission to practice a patent or covenant not to +sue for patent infringement). To "grant" such a patent license to a +party means to make such an agreement or commitment not to enforce a +patent against the party. + + If you convey a covered work, knowingly relying on a patent license, +and the Corresponding Source of the work is not available for anyone +to copy, free of charge and under the terms of this License, through a +publicly available network server or other readily accessible means, +then you must either (1) cause the Corresponding Source to be so +available, or (2) arrange to deprive yourself of the benefit of the +patent license for this particular work, or (3) arrange, in a manner +consistent with the requirements of this License, to extend the patent +license to downstream recipients. "Knowingly relying" means you have +actual knowledge that, but for the patent license, your conveying the +covered work in a country, or your recipient's use of the covered work +in a country, would infringe one or more identifiable patents in that +country that you have reason to believe are valid. + + If, pursuant to or in connection with a single transaction or +arrangement, you convey, or propagate by procuring conveyance of, a +covered work, and grant a patent license to some of the parties +receiving the covered work authorizing them to use, propagate, modify +or convey a specific copy of the covered work, then the patent license +you grant is automatically extended to all recipients of the covered +work and works based on it. + + A patent license is "discriminatory" if it does not include within +the scope of its coverage, prohibits the exercise of, or is +conditioned on the non-exercise of one or more of the rights that are +specifically granted under this License. You may not convey a covered +work if you are a party to an arrangement with a third party that is +in the business of distributing software, under which you make payment +to the third party based on the extent of your activity of conveying +the work, and under which the third party grants, to any of the +parties who would receive the covered work from you, a discriminatory +patent license (a) in connection with copies of the covered work +conveyed by you (or copies made from those copies), or (b) primarily +for and in connection with specific products or compilations that +contain the covered work, unless you entered into that arrangement, +or that patent license was granted, prior to 28 March 2007. + + Nothing in this License shall be construed as excluding or limiting +any implied license or other defenses to infringement that may +otherwise be available to you under applicable patent law. + + 12. No Surrender of Others' Freedom. + + If conditions are imposed on you (whether by court order, agreement or +otherwise) that contradict the conditions of this License, they do not +excuse you from the conditions of this License. If you cannot convey a +covered work so as to satisfy simultaneously your obligations under this +License and any other pertinent obligations, then as a consequence you may +not convey it at all. For example, if you agree to terms that obligate you +to collect a royalty for further conveying from those to whom you convey +the Program, the only way you could satisfy both those terms and this +License would be to refrain entirely from conveying the Program. + + 13. Remote Network Interaction; Use with the GNU General Public License. + + Notwithstanding any other provision of this License, if you modify the +Program, your modified version must prominently offer all users +interacting with it remotely through a computer network (if your version +supports such interaction) an opportunity to receive the Corresponding +Source of your version by providing access to the Corresponding Source +from a network server at no charge, through some standard or customary +means of facilitating copying of software. This Corresponding Source +shall include the Corresponding Source for any work covered by version 3 +of the GNU General Public License that is incorporated pursuant to the +following paragraph. + + Notwithstanding any other provision of this License, you have +permission to link or combine any covered work with a work licensed +under version 3 of the GNU General Public License into a single +combined work, and to convey the resulting work. The terms of this +License will continue to apply to the part which is the covered work, +but the work with which it is combined will remain governed by version +3 of the GNU General Public License. + + 14. Revised Versions of this License. + + The Free Software Foundation may publish revised and/or new versions of +the GNU Affero General Public License from time to time. Such new versions +will be similar in spirit to the present version, but may differ in detail to +address new problems or concerns. + + Each version is given a distinguishing version number. If the +Program specifies that a certain numbered version of the GNU Affero General +Public License "or any later version" applies to it, you have the +option of following the terms and conditions either of that numbered +version or of any later version published by the Free Software +Foundation. If the Program does not specify a version number of the +GNU Affero General Public License, you may choose any version ever published +by the Free Software Foundation. + + If the Program specifies that a proxy can decide which future +versions of the GNU Affero General Public License can be used, that proxy's +public statement of acceptance of a version permanently authorizes you +to choose that version for the Program. + + Later license versions may give you additional or different +permissions. However, no additional obligations are imposed on any +author or copyright holder as a result of your choosing to follow a +later version. + + 15. Disclaimer of Warranty. + + THERE IS NO WARRANTY FOR THE PROGRAM, TO THE EXTENT PERMITTED BY +APPLICABLE LAW. EXCEPT WHEN OTHERWISE STATED IN WRITING THE COPYRIGHT +HOLDERS AND/OR OTHER PARTIES PROVIDE THE PROGRAM "AS IS" WITHOUT WARRANTY +OF ANY KIND, EITHER EXPRESSED OR IMPLIED, INCLUDING, BUT NOT LIMITED TO, +THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR +PURPOSE. THE ENTIRE RISK AS TO THE QUALITY AND PERFORMANCE OF THE PROGRAM +IS WITH YOU. SHOULD THE PROGRAM PROVE DEFECTIVE, YOU ASSUME THE COST OF +ALL NECESSARY SERVICING, REPAIR OR CORRECTION. + + 16. Limitation of Liability. + + IN NO EVENT UNLESS REQUIRED BY APPLICABLE LAW OR AGREED TO IN WRITING +WILL ANY COPYRIGHT HOLDER, OR ANY OTHER PARTY WHO MODIFIES AND/OR CONVEYS +THE PROGRAM AS PERMITTED ABOVE, BE LIABLE TO YOU FOR DAMAGES, INCLUDING ANY +GENERAL, SPECIAL, INCIDENTAL OR CONSEQUENTIAL DAMAGES ARISING OUT OF THE +USE OR INABILITY TO USE THE PROGRAM (INCLUDING BUT NOT LIMITED TO LOSS OF +DATA OR DATA BEING RENDERED INACCURATE OR LOSSES SUSTAINED BY YOU OR THIRD +PARTIES OR A FAILURE OF THE PROGRAM TO OPERATE WITH ANY OTHER PROGRAMS), +EVEN IF SUCH HOLDER OR OTHER PARTY HAS BEEN ADVISED OF THE POSSIBILITY OF +SUCH DAMAGES. + + 17. Interpretation of Sections 15 and 16. + + If the disclaimer of warranty and limitation of liability provided +above cannot be given local legal effect according to their terms, +reviewing courts shall apply local law that most closely approximates +an absolute waiver of all civil liability in connection with the +Program, unless a warranty or assumption of liability accompanies a +copy of the Program in return for a fee. + + END OF TERMS AND CONDITIONS + + How to Apply These Terms to Your New Programs + + If you develop a new program, and you want it to be of the greatest +possible use to the public, the best way to achieve this is to make it +free software which everyone can redistribute and change under these terms. + + To do so, attach the following notices to the program. It is safest +to attach them to the start of each source file to most effectively +state the exclusion of warranty; and each file should have at least +the "copyright" line and a pointer to where the full notice is found. + + <one line to give the program's name and a brief idea of what it does.> + Copyright (C) <year> <name of author> + + This program is free software: you can redistribute it and/or modify + it under the terms of the GNU Affero General Public License as published by + the Free Software Foundation, either version 3 of the License, or + (at your option) any later version. + + This program is distributed in the hope that it will be useful, + but WITHOUT ANY WARRANTY; without even the implied warranty of + MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the + GNU Affero General Public License for more details. + + You should have received a copy of the GNU Affero General Public License + along with this program. If not, see <http://www.gnu.org/licenses/>. + +Also add information on how to contact you by electronic and paper mail. + + If your software can interact with users remotely through a computer +network, you should also make sure that it provides a way for users to +get its source. For example, if your program is a web application, its +interface could display a "Source" link that leads users to an archive +of the code. There are many ways you could offer source, and different +solutions will be better for different programs; see section 13 for the +specific requirements. + + You should also get your employer (if you work as a programmer) or school, +if any, to sign a "copyright disclaimer" for the program, if necessary. +For more information on this, and how to apply and follow the GNU AGPL, see +<http://www.gnu.org/licenses/>. diff --git a/COPYRIGHT b/COPYRIGHT new file mode 100644 index 0000000..6c43c6f --- /dev/null +++ b/COPYRIGHT @@ -0,0 +1,16 @@ +Copyright (C) 2010-2012 James Shubin +# Written by James Shubin <james@shubin.ca> + +This puppet module is free software: you can redistribute it and/or modify +it under the terms of the GNU Affero General Public License as published by +the Free Software Foundation, either version 3 of the License, or +(at your option) any later version. + +This puppet module is distributed in the hope that it will be useful, +but WITHOUT ANY WARRANTY; without even the implied warranty of +MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the +GNU Affero General Public License for more details. + +You should have received a copy of the GNU Affero General Public License +along with this program. If not, see <http://www.gnu.org/licenses/>. + @@ -0,0 +1,6 @@ +WARNING: This module is in development phase, and things will change drastically. You've been warned. Sorry abou any ugliness that will soon disappear. + +Put these two folders in your $PUPPET_MODULE_DIR/gluster/ +Configure your nodes... +Profit!!! + @@ -0,0 +1,2 @@ +* Fix up README file. + diff --git a/examples/distributed-replicate.pp b/examples/distributed-replicate.pp new file mode 100644 index 0000000..86ff109 --- /dev/null +++ b/examples/distributed-replicate.pp @@ -0,0 +1,145 @@ +# +# example of a distributed-replicate with four hosts, and two bricks each +# NOTE: this should be put on *every* gluster host +# +#$annex_loc_vip_1 = '172.16.1.80' # vip +$annex_loc_ip_1 = '172.16.1.81' +$annex_loc_ip_2 = '172.16.1.82' +$annex_loc_ip_3 = '172.16.1.83' +$annex_loc_ip_4 = '172.16.1.84' + +$some_client_ip = '' + +class gluster_base { + + class { 'gluster::server': + hosts => ['annex1.example.com', 'annex2.example.com', 'annex3.example.com', 'annex4.example.com'], + ips => ["${annex_loc_ip_1}", "${annex_loc_ip_2}", "${annex_loc_ip_3}", "${annex_loc_ip_4}"], + #vip => "${annex_loc_vip_1}", + clients => [$some_client_ip], + zone => 'loc', + shorewall => true, + } + + gluster::host { 'annex1.example.com': + # use uuidgen to make these + uuid => '1f660ca2-2c78-4aa0-8f4d-21608218c69c', + } + + gluster::brick { 'annex1.example.com:/mnt/storage1a': + dev => '/dev/disk/by-id/scsi-36003048007e26c00173ad3b633a2ef67', # /dev/sda + labeltype => 'gpt', + fstype => 'xfs', + fsuuid => '1ae49642-7f34-4886-8d23-685d13867fb1', + xfs_inode64 => true, + xfs_nobarrier => true, + areyousure => true, + } + + gluster::brick { 'annex1.example.com:/mnt/storage1c': + dev => '/dev/disk/by-id/scsi-36003048007e26c00173ad3b633a36700', # /dev/sdb + labeltype => 'gpt', + fstype => 'xfs', + fsuuid => '1c9ee010-9cd1-4d81-9a73-f0788d5b3e33', + xfs_inode64 => true, + xfs_nobarrier => true, + areyousure => true, + } + + gluster::host { 'annex2.example.com': + uuid => '2fbe6e2f-f6bc-4c2d-a301-62fa90c459f8', + } + + gluster::brick { 'annex2.example.com:/mnt/storage2a': + dev => '/dev/disk/by-id/scsi-36003048007df450014ca27ee19eaec55', # /dev/sdc + labeltype => 'gpt', + fstype => 'xfs', + fsuuid => '2affe5e3-c10d-4d42-a887-cf8993a6c7b5', + xfs_inode64 => true, + xfs_nobarrier => true, + areyousure => true, + } + + gluster::brick { 'annex2.example.com:/mnt/storage2c': + dev => '/dev/disk/by-id/scsi-36003048007df450014ca280e1bda8e70', # /dev/sdd + labeltype => 'gpt', + fstype => 'xfs', + fsuuid => '2c434d6c-7800-4eec-9121-483bee2336f6', + xfs_inode64 => true, + xfs_nobarrier => true, + areyousure => true, + } + + gluster::host { 'annex3.example.com': + uuid => '3f5a86fd-6956-46ca-bb80-65278dc5b945', + } + + gluster::brick { 'annex3.example.com:/mnt/storage3b': + dev => '/dev/disk/by-id/scsi-36003048007e14f0014ca2722130bc87c', # /dev/sdc + labeltype => 'gpt', + fstype => 'xfs', + fsuuid => '3b79d76b-a519-493c-9f21-ca35524187ef', + xfs_inode64 => true, + xfs_nobarrier => true, + areyousure => true, + } + + gluster::brick { 'annex3.example.com:/mnt/storage3d': + dev => '/dev/disk/by-id/scsi-36003048007e14f0014ca2743150a5471', # /dev/sdd + labeltype => 'gpt', + fstype => 'xfs', + fsuuid => '3d125f8a-c3c3-490d-a606-453401e9bc21', + xfs_inode64 => true, + xfs_nobarrier => true, + areyousure => true, + } + + gluster::host { 'annex4.example.com': + uuid => '4f8e3157-e1e3-4f13-b9a8-51e933d53915', + } + + gluster::brick { 'annex4.example.com:/mnt/storage4b': + dev => '/dev/disk/by-id/scsi-36003048007e36700174029270d81faa1', # /dev/sdc + labeltype => 'gpt', + fstype => 'xfs', + fsuuid => '4bf21ae6-06a0-44ad-ab48-ea23417e4e44', + xfs_inode64 => true, + xfs_nobarrier => true, + areyousure => true, + } + + gluster::brick { 'annex4.example.com:/mnt/storage4d': + dev => '/dev/disk/by-id/scsi-36003048007e36700174029270d82724d', # /dev/sdd + labeltype => 'gpt', + fstype => 'xfs', + fsuuid => '4dfa7e50-2315-44d3-909b-8e9423def6e5', + xfs_inode64 => true, + xfs_nobarrier => true, + areyousure => true, + } + + $brick_list = [ + 'annex1.example.com:/mnt/storage1a', + 'annex2.example.com:/mnt/storage2a', + 'annex3.example.com:/mnt/storage3b', + 'annex4.example.com:/mnt/storage4b', + 'annex1.example.com:/mnt/storage1c', + 'annex2.example.com:/mnt/storage2c', + 'annex3.example.com:/mnt/storage3d', + 'annex4.example.com:/mnt/storage4d', + ] + + # TODO: have this run transactionally on *one* gluster host. + gluster::volume { 'examplevol': + replica => 2, + bricks => $brick_list, + start => undef, # i'll start this myself + } + + #gluster::volume { 'someothervol': + # replica => 2, + # bricks => $brick_list, + # start => undef, + #} + +} diff --git a/manifests/brick.pp b/manifests/brick.pp new file mode 100644 index 0000000..b99ab0c --- /dev/null +++ b/manifests/brick.pp @@ -0,0 +1,190 @@ +# Simple? gluster module by James +# Copyright (C) 2010-2012 James Shubin +# Written by James Shubin <james@shubin.ca> +# +# This program is free software: you can redistribute it and/or modify +# it under the terms of the GNU Affero General Public License as published by +# the Free Software Foundation, either version 3 of the License, or +# (at your option) any later version. +# +# This program is distributed in the hope that it will be useful, +# but WITHOUT ANY WARRANTY; without even the implied warranty of +# MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the +# GNU Affero General Public License for more details. +# +# You should have received a copy of the GNU Affero General Public License +# along with this program. If not, see <http://www.gnu.org/licenses/>. + +class gluster::brick::xfs { + package { 'xfsprogs': + ensure => present, + } +} + +class gluster::brick::ext4 { + package { 'e2fsprogs': + ensure => present, + } +} + +define gluster::brick( + $dev, # /dev/sdc, /dev/disk/by-id/scsi-36003048007e14f0014ca2743150a5471 + $fsuuid, # set a uuid for this fs + $labeltype = '', # gpt + $fstype = '', # xfs + $xfs_inode64 = false, + $xfs_nobarrier = false, + $ro = false, # use for emergencies only- you want your fs rw + $force = false, # if true, this will overwrite any xfs fs it sees, useful for rebuilding gluster and wiping data. NOTE: there are other safeties in place to stop this. + $areyousure = false # do you allow puppet to do dangerous things ? +) { + # eg: annex1.example.com:/storage1a + $split = split($name, ':') # do some $name parsing + $host = $split[0] # host fqdn + $mount = $split[1] # brick mount + + if ! ( "${host}:${mount}" == "${name}" ) { + fail('The brick $name must match a $host-$mount pattern.') + } + + Gluster::Host[$host] -> Gluster::Brick[$name] # brick requires host + + $ro_bool = $ro ? { # this has been added as a convenience + true => 'ro', + default => 'rw', + } + + $valid_labeltype = $labeltype ? { + # 'msdos' => 'msdos', # TODO + default => 'gpt', + } + + $valid_fstype = $fstype ? { + 'ext4' => 'ext4', # TODO + default => 'xfs', + } + + $force_flag = $force ? { + true => 'f', + default => '', + } + + # XFS mount options: + # http://git.kernel.org/?p=linux/kernel/git/torvalds/linux-2.6.git;a=blob;f=Documentation/filesystems/xfs.txt;hb=HEAD + if ( $valid_fstype == 'xfs' ) { + # exec requires + include gluster::brick::xfs + $exec_requires = [Package['xfsprogs']] + + # mkfs w/ uuid command + # NOTE: the -f forces creation when it sees an old xfs part + # TODO: xfs_admin doesn't have a --quiet flag. silence it... + $exec_mkfs = "/sbin/mkfs.${valid_fstype} -q${force_flag} `/bin/readlink -e ${dev}`1 && /usr/sbin/xfs_admin -U '${fsuuid}' `/bin/readlink -e ${dev}`1" + + # By default, XFS allocates inodes to reflect their on-disk + # location. However, because some 32-bit userspace applications + # are not compatible with inode numbers greater than 232, XFS + # will allocate all inodes in disk locations which result in + # 32-bit inode numbers. This can lead to decreased performance + # on very large filesystems (i.e. larger than 2 terabytes), + # because inodes are skewed to the beginning of the block + # device, while data is skewed towards the end. + # To address this, use the inode64 mount option. This option + # configures XFS to allocate inodes and data across the entire + # file system, which can improve performance. + $option01 = $xfs_inode64 ? { + true => 'inode64', + default => '', + } + + # By default, XFS uses write barriers to ensure file system + # integrity even when power is lost to a device with write + # caches enabled. For devices without write caches, or with + # battery-backed write caches, disable barriers using the + # nobarrier option. + $option02 = $xfs_nobarrier ? { + true => 'nobarrier', + default => '', + } + + $options_list = ["${option01}", "${option02}"] + + } elsif ( $valid_fstype == 'ext4' ) { + # exec requires + include gluster::brick::ext4 + $exec_requires = [Package['e2fsprogs']] + + # mkfs w/ uuid command + $exec_mkfs = "/sbin/mkfs.${valid_fstype} -U '${fsuuid}' `/bin/readlink -e ${dev}`1" + + # mount options + $options_list = [] # TODO + } + + # put all the options in an array, remove the empty ones, and join with + # commas (this removes ',,' double comma uglyness) + # adding 'defaults' here ensures no ',' (leading comma) in mount command + $mount_options = inline_template('<%= (["defaults"]+options_list).delete_if {|x| x.empty? }.join(",") %>') + + $exec_noop = $areyousure ? { + true => false, + default => true, + } + + # if we're on itself + if ( "${fqdn}" == "${host}" ) { + + # first get the device ready + + # the scary parted command to run... + $exec_mklabel = "/sbin/parted -s -m -a optimal ${dev} mklabel ${valid_labeltype}" + $exec_mkpart = "/sbin/parted -s -m -a optimal ${dev} mkpart primary 0% 100%" + $scary_exec = "${exec_mklabel} && ${exec_mkpart} && ${exec_mkfs}" # the command + if $exec_noop { + notify { 'noop mode:': + message => "${scary_exec}", + } + } + + exec { "${scary_exec}": + logoutput => on_failure, + unless => [ # if one element is true, this *doesn't* run + "/usr/bin/test -e `/bin/readlink -e ${dev}`1", # does partition 1 exist ? + "/usr/bin/test -e /dev/disk/by-uuid/${fsuuid}", + "/bin/false", # TODO: add more criteria + ], + require => $exec_requires, + timeout => 3600, # set to something very long + noop => $exec_noop, + alias => "gluster-brick-make-${name}", + } + + # make an empty directory for the mount point + file { "${mount}": + ensure => directory, # make sure this is a directory + recurse => false, # don't recurse into directory + purge => false, # don't purge unmanaged files + force => false, # don't purge subdirs and links + require => Exec["gluster-brick-make-${name}"], + } + + mount { "${mount}": + atboot => true, + ensure => mounted, + device => "UUID=${fsuuid}", + fstype => "${valid_fstype}", + # noatime,nodiratime to save gluster from silly updates + options => "${mount_options},${ro_bool},noatime,nodiratime,noexec", # TODO: is nodev? nosuid? noexec? a good idea? + dump => '0', # fs_freq: 0 to skip file system dumps + # NOTE: technically this should be '2', to `fsck.xfs` + # after the rootfs ('1'), but fsck.xfs actually does + # 'nothing, successfully', so it's irrelevant, because + # xfs uses xfs_check and friends only when suspect. + pass => '2', # fs_passno: 0 to skip fsck on boot + require => [ + File["${mount}"], + ], + } + } +} + diff --git a/manifests/client.pp b/manifests/client.pp new file mode 100644 index 0000000..d6d0e45 --- /dev/null +++ b/manifests/client.pp @@ -0,0 +1,78 @@ +# Simple? gluster module by James +# Copyright (C) 2010-2012 James Shubin +# Written by James Shubin <james@shubin.ca> +# +# This program is free software: you can redistribute it and/or modify +# it under the terms of the GNU Affero General Public License as published by +# the Free Software Foundation, either version 3 of the License, or +# (at your option) any later version. +# +# This program is distributed in the hope that it will be useful, +# but WITHOUT ANY WARRANTY; without even the implied warranty of +# MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the +# GNU Affero General Public License for more details. +# +# You should have received a copy of the GNU Affero General Public License +# along with this program. If not, see <http://www.gnu.org/licenses/>. + +# XXX: try mounting with: glusterfs --volfile-server=<server-address> --volfile-id=<volume-name> <mount-point> --xlator-option='*dht*.assert-no-child-down=yes' # TODO: quotes or not? +define gluster::client( + $server, # NOTE: use a vip as server hostname + $rw = false, # mount read only (true) or rw (false) +# $suid = false, # mount with suid (true) or nosuid (false) # TODO: will this work with gluster ? + $mounted = true # useful if we want to pull in the group + # defs, but not actually mount (testing) +) { + #mount -t glusterfs brick1.example.com:/test /test + include gluster::client::base + + $rw_bool = $rw ? { + true => 'rw', + default => 'ro', + } + + # TODO: will this work with gluster ? + #$suid_bool = $suid ? { + # true => 'suid', + # default => 'nosuid', + #} + + $mounted_bool = $mounted ? { + true => mounted, + default => unmounted, + } + + # make an empty directory for the mount point + file { "${name}": + ensure => directory, # make sure this is a directory + recurse => false, # don't recurse into directory + purge => false, # don't purge unmanaged files + force => false, # don't purge subdirs and links + } + + # Mount Options: + # * backupvolfile-server=server-name + # * fetch-attempts=N (where N is number of attempts) + # * log-level=loglevel + # * log-file=logfile + # * direct-io-mode=[enable|disable] + # * ro (for readonly mounts) + # * acl (for enabling posix-ACLs) + # * worm (making the mount WORM - Write Once, Read Many type) + # * selinux (enable selinux on GlusterFS mount + mount { "${name}": + atboot => true, + ensure => $mounted_bool, + device => "${server}", + fstype => 'glusterfs', + options => "defaults,_netdev,${rw_bool}", # TODO: will $suid_bool work with gluster ? + dump => '0', # fs_freq: 0 to skip file system dumps + pass => '0', # fs_passno: 0 to skip fsck on boot + require => [ + Package[['glusterfs', 'glusterfs-fuse']], + File["${name}"], # the mountpoint + Exec['gluster-fuse'], # ensure fuse is loaded + ], + } +} + diff --git a/manifests/client/base.pp b/manifests/client/base.pp new file mode 100644 index 0000000..0aadb1b --- /dev/null +++ b/manifests/client/base.pp @@ -0,0 +1,47 @@ +# Simple? gluster module by James +# Copyright (C) 2010-2012 James Shubin +# Written by James Shubin <james@shubin.ca> +# +# This program is free software: you can redistribute it and/or modify +# it under the terms of the GNU Affero General Public License as published by +# the Free Software Foundation, either version 3 of the License, or +# (at your option) any later version. +# +# This program is distributed in the hope that it will be useful, +# but WITHOUT ANY WARRANTY; without even the implied warranty of +# MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the +# GNU Affero General Public License for more details. +# +# You should have received a copy of the GNU Affero General Public License +# along with this program. If not, see <http://www.gnu.org/licenses/>. + +class gluster::client::base { + # TODO: ensure these are from our 'gluster' repo + package { ['glusterfs', 'glusterfs-fuse']: + ensure => present, + } + + # FIXME: choose a reliable and correct way to ensure fuse is loaded + #[root@test2 ~]# dmesg | grep -i fuse + #[root@test2 ~]# modprobe fuse + #[root@test2 ~]# dmesg | grep -i fuse + #fuse init (API version 7.13) + #[root@test2 ~]# + + # modprobe fuse if it's missing + exec { '/sbin/modprobe fuse': + logoutput => on_failure, + onlyif => '/usr/bin/test -z "`/bin/dmesg | grep -i fuse`"', + alias => 'gluster-fuse', + } + + # TODO: will this autoload the fuse module? + #file { '/etc/modprobe.d/fuse.conf': + # content => "fuse\n", # TODO: "install fuse /sbin/modprobe --ignore-install fuse ; /bin/true\n" ? + # owner => root, + # group => root, + # mode => 644, # u=rw,go=r + # ensure => present, + #} +} + diff --git a/manifests/host.pp b/manifests/host.pp new file mode 100644 index 0000000..e1b7876 --- /dev/null +++ b/manifests/host.pp @@ -0,0 +1,81 @@ +# Simple? gluster module by James +# Copyright (C) 2010-2012 James Shubin +# Written by James Shubin <james@shubin.ca> +# +# This program is free software: you can redistribute it and/or modify +# it under the terms of the GNU Affero General Public License as published by +# the Free Software Foundation, either version 3 of the License, or +# (at your option) any later version. +# +# This program is distributed in the hope that it will be useful, +# but WITHOUT ANY WARRANTY; without even the implied warranty of +# MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the +# GNU Affero General Public License for more details. +# +# You should have received a copy of the GNU Affero General Public License +# along with this program. If not, see <http://www.gnu.org/licenses/>. + +define gluster::host( + $uuid +) { + # if we're on itself + if ( "${fqdn}" == "${name}" ) { + # set a unique uuid per host + file { '/var/lib/glusterd/glusterd.info': + content => template('gluster/glusterd.info.erb'), + owner => root, + group => root, + mode => 644, # u=rw,go=r + ensure => present, + require => File['/var/lib/glusterd/'], + } + } else { + # set uuid= + exec { "/bin/echo 'uuid=${uuid}' >> '/var/lib/glusterd/peers/${uuid}'": + logoutput => on_failure, + unless => "/bin/grep -qF 'uuid=' '/var/lib/glusterd/peers/${uuid}'", + notify => File['/var/lib/glusterd/peers/'], # propagate the notify up + before => File["/var/lib/glusterd/peers/${uuid}"], + alias => "gluster-host-uuid-${name}", + # FIXME: doing this causes a dependency cycle! adding + # the Package[] require doesn't. It would be most + # correct to require the peers/ folder, but since it's + # not working, requiring the Package[] will still give + # us the same result. (Package creates peers/ folder). + # NOTE: it's possible the cycle is a bug in puppet or a + # bug in the dependencies somewhere else in this module. + #require => File['/var/lib/glusterd/peers/'], + require => Package['glusterfs-server'], + } + + # set state= + exec { "/bin/echo 'state=3' >> '/var/lib/glusterd/peers/${uuid}'": + logoutput => on_failure, + unless => "/bin/grep -qF 'state=' '/var/lib/glusterd/peers/${uuid}'", + notify => File['/var/lib/glusterd/peers/'], # propagate the notify up + before => File["/var/lib/glusterd/peers/${uuid}"], + require => Exec["gluster-host-uuid-${name}"], + alias => "gluster-host-state-${name}", + } + + # set hostname1=... + exec { "/bin/echo 'hostname1=${name}' >> '/var/lib/glusterd/peers/${uuid}'": + logoutput => on_failure, + unless => "/bin/grep -qF 'hostname1=' '/var/lib/glusterd/peers/${uuid}'", + notify => File['/var/lib/glusterd/peers/'], # propagate the notify up + before => File["/var/lib/glusterd/peers/${uuid}"], + require => Exec["gluster-host-state-${name}"], + } + + # tag the file so it doesn't get removed by purge + file { "/var/lib/glusterd/peers/${uuid}": + ensure => present, + notify => File['/var/lib/glusterd/peers/'], # propagate the notify up + owner => root, + group => root, + # NOTE: this mode was found by inspecting the process + mode => 600, # u=rw,go= + } + } +} + diff --git a/manifests/init.pp b/manifests/init.pp new file mode 100644 index 0000000..ad356a7 --- /dev/null +++ b/manifests/init.pp @@ -0,0 +1,62 @@ +# Simple? gluster module by James +# Copyright (C) 2010-2012 James Shubin +# Written by James Shubin <james@shubin.ca> +# +# This program is free software: you can redistribute it and/or modify +# it under the terms of the GNU Affero General Public License as published by +# the Free Software Foundation, either version 3 of the License, or +# (at your option) any later version. +# +# This program is distributed in the hope that it will be useful, +# but WITHOUT ANY WARRANTY; without even the implied warranty of +# MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the +# GNU Affero General Public License for more details. +# +# You should have received a copy of the GNU Affero General Public License +# along with this program. If not, see <http://www.gnu.org/licenses/>. + +# +# NOTES +# + +# * To rebuild gluster (erasing all data), rm -rf the storage dirs to +# clear metadata. To do this without erasing data, read this article: +# http://joejulian.name/blog/glusterfs-path-or-a-prefix-of-it-is-already-part-of-a-volume/ +# +# * List of state codes: +# <MESSAGE> <CODE> +# static char *glusterd_friend_sm_state_names[] = { # glusterd-sm.c +# "Establishing Connection", # 0 +# "Probe Sent to Peer", # 1 +# "Probe Received from Peer", # 2 +# "Peer in Cluster", # 3 (verified) +# "Accepted peer request", # 4 +# "Sent and Received peer request", # 5 +# "Peer Rejected", # 6 (verified) +# "Peer detach in progress", # 7 +# "Probe Received from peer", # 8 +# "Connected to Peer", # 9 +# "Peer is connected and Accepted", # 10 +# "Invalid State" # 11 +# }; +# +# * To use this gluster module, it's recommended that all nodes receive +# the same puppet configuration. Puppet is smart enough to know what to +# run on each participating node. Watchout for the mild race condition. +# +# * TODO: add more notes... + +# +# XXX: FIXME: TODO +# +# XXX: does parted align disks properly ? +# XXX: mkfs.xfs -ssize=4k /dev/sdc1 ? # should "-s sector_size" be used ? http://kb.lsi.com/KnowledgebaseArticle16187.aspx ? +# XXX: setup auth somehow... ip address based for now + +# FIXME: test this: https://bugzilla.redhat.com/show_bug.cgi?id=GLUSTER-3769 +# FIXME: peering: maybe we can just specify a guid somewhere so that everyone peers together ? +# FIXME: can we setup gluster by using templated volume files instead ? + +# TODO: package { 'xfsdump': ensure => present } is this useful for something ? +# TODO: find out when ports are actually necessary for version 3.3 + diff --git a/manifests/server.pp b/manifests/server.pp new file mode 100644 index 0000000..c61c9ed --- /dev/null +++ b/manifests/server.pp @@ -0,0 +1,151 @@ +# Simple? gluster module by James +# Copyright (C) 2010-2012 James Shubin +# Written by James Shubin <james@shubin.ca> +# +# This program is free software: you can redistribute it and/or modify +# it under the terms of the GNU Affero General Public License as published by +# the Free Software Foundation, either version 3 of the License, or +# (at your option) any later version. +# +# This program is distributed in the hope that it will be useful, +# but WITHOUT ANY WARRANTY; without even the implied warranty of +# MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the +# GNU Affero General Public License for more details. +# +# You should have received a copy of the GNU Affero General Public License +# along with this program. If not, see <http://www.gnu.org/licenses/>. + +class gluster::server( + $hosts = [], # this should be a list of fqdn's # TODO: we could easily just setup gluster/shorewall by ip address instead of hostname! + $ips = [], # this should be a list of ip's for each in hosts[] # TODO: i would have rather this happen with a local dns resolver, but I can't figure out how to make one! # NOTE: this can be overcome probably by using exported resources or dns names in shorewall (bad) + $clients = [], # list of allowed client ip's + #$vip = '', # vip of the cluster (optional, but recommended) + $nfs = false, # TODO + $shorewall = false, + $zone = 'net', # TODO: allow a list of zones + $allow = 'all' +) { + # TODO: ensure these are from our 'gluster' repo + package { 'glusterfs-server': + ensure => present, + } + + # NOTE: not that we necessarily manage anything in here at the moment... + file { '/etc/glusterfs/': + ensure => directory, # make sure this is a directory + recurse => false, # TODO: eventually... + purge => false, # TODO: eventually... + force => false, # TODO: eventually... + owner => root, + group => root, + mode => 644, + #notify => Service['glusterd'], # TODO: ??? + require => Package['glusterfs-server'], + } + + file { '/etc/glusterfs/glusterd.vol': + content => template('gluster/glusterd.vol.erb'), # NOTE: currently no templating is being done + owner => root, + group => root, + mode => 644, # u=rw,go=r + ensure => present, + require => File['/etc/glusterfs/'], + } + + file { '/var/lib/glusterd/': + ensure => directory, # make sure this is a directory + recurse => false, # TODO: eventually... + purge => false, # TODO: eventually... + force => false, # TODO: eventually... + owner => root, + group => root, + mode => 644, + #notify => Service['glusterd'], # TODO: eventually... + require => File['/etc/glusterfs/glusterd.vol'], + } + + file { '/var/lib/glusterd/peers/': + ensure => directory, # make sure this is a directory + recurse => true, # recursively manage directory + purge => true, + force => true, + owner => root, + group => root, + mode => 644, + notify => Service['glusterd'], + require => File['/var/lib/glusterd/'], + } + + if $shorewall { + if $allow == 'all' { + $net = 'net' + } else { + $net = "net:${allow}" + } + # TODO: could the facter values help here ? + #$other_host_ips = inline_template("<%= ips.delete_if {|x| x == '${ipaddress}' }.join(',') %>") # list of ips except myself + $source_ips = inline_template("<%= (ips+clients).uniq.delete_if {|x| x.empty? }.join(',') %>") + #$all_ips = inline_template("<%= (ips+[vip]+clients).uniq.delete_if {|x| x.empty? }.join(',') %>") + #$list_of_hosts_except_myself = split(inline_template("<%= host_list.delete_if {|x| x == '${fqdn}' }.join(' ') %>"), ' ') + + ############################################################################ + # ACTION SOURCE DEST PROTO DEST SOURCE ORIGINAL + # PORT PORT(S) DEST + + # TODO: I've never seen anything connect on 24008. Is it ever used? + shorewall::rule { 'glusterd': + rule => " + ACCEPT ${zone}:${source_ips} $FW tcp 24007:24008 + ", + comment => 'Allow incoming tcp:24007-24008 from each other glusterd or client.', + before => Service['glusterd'], + } + + # TODO: Use the correct port range + shorewall::rule { 'glusterfsd-easyfw': + rule => " + ACCEPT ${zone}:${source_ips} $FW tcp 24009:25009 # XXX: Use the correct port range + ", + comment => 'Allow incoming tcp:24009-25009 from each other glusterfsd and clients.', + before => Service['glusterd'], + } + + # TODO: is this only used for nfs? + shorewall::rule { 'gluster-111': + rule => " + ACCEPT ${zone}:${source_ips} $FW tcp 111 + ACCEPT ${zone}:${source_ips} $FW udp 111 + ", + comment => 'Allow tcp/udp 111.', + before => Service['glusterd'], + } + + # XXX: WIP + #$endport = inline_template('<%= 24009+hosts.count %>') # XXX: is there one brick per server or two ? what does 'brick' mean in the context of open ports? + #$nfs_endport = inline_template('<%= 38465+hosts.count %>') # XXX: is there one brick per server or two ? what does 'brick' mean in the context of open ports? + #shorewall::rule { 'gluster-24000': + # rule => " + # ACCEPT ${zone} $FW tcp 24007,24008 + # ACCEPT ${zone} $FW tcp 24009:${endport} + # ", + # comment => 'Allow 24000s for gluster', + # before => Service['glusterd'], + #} + + if $nfs { # FIXME: TODO + shorewall::rule { 'gluster-nfs': rule => " + ACCEPT $(net} $FW tcp 38465:${nfs_endport} + ", comment => 'Allow nfs for gluster'} + } + } + + # start service only after the firewall is opened and hosts are defined + service { 'glusterd': + enable => true, # start on boot + ensure => running, # ensure it stays running + hasstatus => false, # FIXME: BUG: https://bugzilla.redhat.com/show_bug.cgi?id=836007 + hasrestart => true, # use restart, not start; stop + require => Gluster::Host[$hosts], + } +} + diff --git a/manifests/volume.pp b/manifests/volume.pp new file mode 100644 index 0000000..13c31fe --- /dev/null +++ b/manifests/volume.pp @@ -0,0 +1,111 @@ +# Simple? gluster module by James +# Copyright (C) 2010-2012 James Shubin +# Written by James Shubin <james@shubin.ca> +# +# This program is free software: you can redistribute it and/or modify +# it under the terms of the GNU Affero General Public License as published by +# the Free Software Foundation, either version 3 of the License, or +# (at your option) any later version. +# +# This program is distributed in the hope that it will be useful, +# but WITHOUT ANY WARRANTY; without even the implied warranty of +# MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the +# GNU Affero General Public License for more details. +# +# You should have received a copy of the GNU Affero General Public License +# along with this program. If not, see <http://www.gnu.org/licenses/>. + +define gluster::volume( + $bricks = [], + $transport = 'tcp', + $replica = 1, + $stripe = 1, + $start = undef # start volume ? true, false (stop it) or undef +) { + # TODO: if using rdma, maybe we should pull in the rdma package... ? + $valid_transport = $transport ? { + 'rdma' => 'rdma', + 'tcp,rdma' => 'tcp,rdma', + default => 'tcp', + } + + $valid_replica = $replica ? { + '1' => '', + default => "replica ${replica} ", + } + + $valid_stripe = $stripe ? { + '1' => '', + default => "stripe ${stripe} ", + } + + #Gluster::Brick[$bricks] -> Gluster::Volume[$name] # volume requires bricks + + # get the bricks that match our fqdn, and append /$name to their path. + # return only these paths, which can be used to build the volume dirs. + $volume_dirs = split(inline_template("<%= bricks.find_all{|x| x.split(':')[0] == '${fqdn}' }.collect {|y| y.split(':')[1].chomp('/')+'/${name}' }.join(' ') %>"), ' ') + + file { $volume_dirs: + ensure => directory, # make sure this is a directory + recurse => false, # don't recurse into directory + purge => false, # don't purge unmanaged files + force => false, # don't purge subdirs and links + before => Exec["gluster-volume-create-${name}"], + require => Gluster::Brick[$bricks], + } + + # add /${name} to the end of each: brick:/path entry + $brick_spec = inline_template("<%= bricks.collect {|x| ''+x.chomp('/')+'/${name}' }.join(' ') %>") + + # EXAMPLE: gluster volume create test replica 2 transport tcp annex1.example.com:/storage1a/test annex2.example.com:/storage2a/test annex3.example.com:/storage3b/test annex4.example.com:/storage4b/test annex1.example.com:/storage1c/test annex2.example.com:/storage2c/test annex3.example.com:/storage3d/test annex4.example.com:/storage4d/test + # NOTE: this should only happen on one host + # FIXME: there might be a theoretical race condition if this runs at + # exactly the same time time on more than one host. + # FIXME: this should probably fail on at least N-1 nodes before it + # succeeds because it probably shouldn't work until all the bricks are + # available, which per node will happen right before this runs. + exec { "/usr/sbin/gluster volume create ${name} ${valid_replica}${valid_stripe}transport ${valid_transport} ${brick_spec}": + logoutput => on_failure, + unless => "/usr/sbin/gluster volume list | /bin/grep -qxF '${name}' -", # add volume if it doesn't exist + #before => TODO?, + #require => Gluster::Brick[$bricks], + alias => "gluster-volume-create-${name}", + } + + # TODO: + #if $shorewall { + # shorewall::rule { 'gluster-TODO': + # rule => " + # ACCEPT ${zone} $FW tcp 24009:${endport} + # ", + # comment => 'TODO', + # before => Service['glusterd'], + # } + #} + + if $start == true { + # try to start volume if stopped + exec { "/usr/sbin/gluster volume start ${name}": + logoutput => on_failure, + unless => "/usr/sbin/gluster volume status ${name}", # returns false if stopped + require => Exec["gluster-volume-create-${name}"], + alias => "gluster-volume-start-${name}", + } + } elsif ( $start == false ) { + # try to stop volume if running + # NOTE: this will still succeed even if a client is mounted + # NOTE: This uses `yes` to workaround the: Stopping volume will + # make its data inaccessible. Do you want to continue? (y/n) + # TODO: http://community.gluster.org/q/how-can-i-make-automatic-scripts/ + # TODO: gluster --mode=script volume stop ... + exec { "/usr/bin/yes | /usr/sbin/gluster volume stop ${name}": + logoutput => on_failure, + onlyif => "/usr/sbin/gluster volume status ${name}", # returns true if started + require => Exec["gluster-volume-create-${name}"], + alias => "gluster-volume-stop-${name}", + } + } else { + # don't manage volume run state + } +} + diff --git a/templates/glusterd.info.erb b/templates/glusterd.info.erb new file mode 100644 index 0000000..fe849ba --- /dev/null +++ b/templates/glusterd.info.erb @@ -0,0 +1 @@ +UUID=<%= uuid %> diff --git a/templates/glusterd.vol.erb b/templates/glusterd.vol.erb new file mode 100644 index 0000000..de17d8f --- /dev/null +++ b/templates/glusterd.vol.erb @@ -0,0 +1,8 @@ +volume management + type mgmt/glusterd + option working-directory /var/lib/glusterd + option transport-type socket,rdma + option transport.socket.keepalive-time 10 + option transport.socket.keepalive-interval 2 + option transport.socket.read-fail-log off +end-volume |