summaryrefslogtreecommitdiffstats
path: root/roles/mirrormanager/backend
Commit message (Collapse)AuthorAgeFilesLines
* mirrormanager2: adapt umdl cron to new scriptsAdrian Reber2017-06-181-7/+7
| | | | | | | | | | | | | | | | With the stat()-less umdl and adapted wrapper script the umdl check can now run more often. Every 30 minutes: * fedora * epel * fedora-secondary Every 2 hours: * alt * archive Signed-off-by: Adrian Reber <adrian@lisas.de>
* mirrormanager2: remove last-sync fedmsg scriptAdrian Reber2017-06-182-156/+0
| | | | | | | Now that umdl can run much faster and often the message bus is no longer queried. Only the ctime of the fullfiletimelist-* is checked. Signed-off-by: Adrian Reber <adrian@lisas.de>
* mirrormanager2: change umdl-required scriptAdrian Reber2017-06-181-23/+22
| | | | | | | | | | The umdl-required script used to query the message bus if there have been changes on the master mirror. With the new stat()-less umdl implementation the message bus is no longer queried but only the ctime of the fullfiletimelist-* is checked to see if it has changed since the last run. Signed-off-by: Adrian Reber <adrian@lisas.de>
* Fix handlers, roles, and tasks to be handlers_path, roles_path and ↵Kevin Fenzi2017-04-131-2/+2
| | | | | | tasks_path so as not to conflict with ansible variables. Fix duplicate definition of become default that was in group_vars/all as well as vars/global.
* mirrormanager: adapt statistics script to new logfilesAdrian Reber2017-04-071-5/+7
| | | | Signed-off-by: Adrian Reber <adrian@lisas.de>
* setup mirrorlist containers to report stats and add a mirrorlist-proxy group ↵Kevin Fenzi2017-02-132-5/+14
| | | | for easier handling
* Enable proxy05 local mirrorlistPatrick Uiterwijk2017-02-091-1/+1
| | | | Signed-off-by: Patrick Uiterwijk <puiterwijk@redhat.com>
* add proxy02 to get pkl synced from mm-backend01Kevin Fenzi2017-02-081-0/+8
|
* Drop seperate yum clean all calls.Kevin Fenzi2016-06-251-6/+1
|
* Revert "Disable crawler and automatic pkl push before the release"Patrick Uiterwijk2016-06-211-1/+1
| | | | This reverts commit 8e83d2cc8f827e6124ac698aef37ec123e9f3eb5.
* Disable crawler and automatic pkl push before the releaseAdrian Reber2016-06-211-1/+1
| | | | | | | To better control what is available on the mirrorlist servers the cronjob are disabled. Signed-off-by: Adrian Reber <adrian@lisas.de>
* Allow MirrorManager to access pre-bitflip contentAdrian Reber2016-05-261-0/+11
| | | | | | | | | | https://fedorahosted.org/fedora-infrastructure/ticket/5289 MirrorManager cannot access pre-bitflip content. Putting the mirrormanager user into the ftpsync(263) group should enable the mirrormanager user to read the files. Signed-off-by: Adrian Reber <adrian@lisas.de>
* Added script to process mirrorlist logsAdrian Reber2015-12-182-0/+45
| | | | Signed-off-by: Adrian Reber <adrian@lisas.de>
* Run the propagation cron every second hour.Adrian Reber2015-12-181-1/+1
|
* Explicitly list the files to transfer.Adrian Reber2015-12-171-1/+1
|
* '_' and not '-'Adrian Reber2015-12-171-1/+1
|
* Install and activate cronjob for daily mirror map creationAdrian Reber2015-12-172-0/+21
| | | | Signed-off-by: Adrian Reber <adrian@lisas.de>
* Forgot to prefix the version with 'f'Adrian Reber2015-12-171-1/+1
|
* Enable propagation diagrams in MM2Adrian Reber2015-12-172-2/+42
| | | | Signed-off-by: Adrian Reber <adrian@lisas.de>
* Install mirrormanager2-statistics on the backendAdrian Reber2015-12-171-0/+2
| | | | Signed-off-by: Adrian Reber <adrian@lisas.de>
* Run secondary umdl hourlyPatrick Uiterwijk2015-12-091-2/+2
| | | | Signed-off-by: Patrick Uiterwijk <puiterwijk@redhat.com>
* Always require UMDL for secondary for nowPatrick Uiterwijk2015-12-091-1/+4
| | | | Signed-off-by: Patrick Uiterwijk <puiterwijk@redhat.com>
* Move all puppet_private stuff to ansible private so we can stop using puppet ↵Kevin Fenzi2015-09-251-1/+1
| | | | private.
* Also switch to fedmsg based umdl crawl for SecondaryAdrian Reber2015-07-023-11/+34
|
* Run umdl for each category separately.Adrian Reber2015-06-293-12/+32
| | | | | | | | From now on each umdl category is run separately at different times. The categories 'Fedora Linux' and 'Fedora EPEL' are started every 30 minutes and if there has been a sync available fedmsg umdl is run for just that category. The remaining categories are run once per day at different times (00:00, 08:00, 16:00).
* Revert "Disable umdl for a manual 'umdl --delete' run."Adrian Reber2015-06-281-1/+1
| | | | | | | This reverts commit 1b409809ebdc490a67e450a8d79ded2d00b28c3e. Manual umdl runs with '--delete' have finished. Now re-enabled cron based umdl runs.
* Disable umdl for a manual 'umdl --delete' run.Adrian Reber2015-06-251-1/+1
|
* Remove fedmsg-relay from mm2 backend and crawler.Ralph Bean2015-06-201-1/+0
|
* Decrease vfs_cache_pressure on mm backend systemsAdrian Reber2015-06-181-0/+7
| | | | | | | | To decrease the crawl duration on the mirrors we have been recommending to lower the default value of vfs_cache_pressure from 100 to 10. This causes the kernel to prefer to keep dentries when under memory pressure. Let's also set it on the mm backend systems as umdl is mainly looking at the metadata.
* Do not update backend cron script in stagingAdrian Reber2015-05-071-0/+1
|
* Sync MM2 pickles to the mirrorlist servers after they have been re-created.Adrian Reber2015-05-071-2/+3
|
* The mirrorlist server expects i2_netblocks.txt and not internet2_netblocks.txtAdrian Reber2015-05-071-1/+1
|
* Only sync the files actually needed on the mirrorlist serversAdrian Reber2015-05-071-1/+1
| | | | Also enable rsync compression like the old script did.
* Setup /var/lib/mirrormanager/.ssh directory for mm-backendAdrian Reber2015-05-071-0/+12
|
* Add script to sync MM2 generated pkls to the mirrorlist serversAdrian Reber2015-05-072-0/+11
|
* Remember the start time of the last umdl runAdrian Reber2015-05-061-4/+3
| | | | | | | | | The script which checks if umdl should be run used to store the time of the end of the current umdl run. It actually should remember the time of the start of this run as we want to make sure to pick up all changes since the start of the current run. Also print the date and time in the same line as the logging.
* Try with quotesPierre-Yves Chibon2015-05-051-2/+2
|
* move status message to the right locationAdrian Reber2015-05-051-3/+3
|
* Add and install the alembic.ini for MM2Pierre-Yves Chibon2015-05-041-3/+7
|
* installed wrong script; replaced with the correct scriptAdrian Reber2015-05-041-1/+1
|
* Only run umdl if the data has actually changedAdrian Reber2015-05-045-2/+200
| | | | | | | /usr/bin/mm2_update-master-directory-list is now wrapped with a script which queries the fedmsg bus if there is actually new data on the master mirror. So now it is wrapped with a lock wrapper and fedmsg query wrapper.
* Run the script for Internet2 netblocks very lateAdrian Reber2015-04-241-1/+5
| | | | | | to make sure the files are all there. The script is looking in date dependent directories and depending on the timezone of the remote server the files appear late.
* Make the MM2 backend scripts also run as mirrormanager (instead as root).Adrian Reber2015-04-242-6/+9
|
* Added lock-wrapper to umdl to ensure only one instance of umdl is running.Adrian Reber2015-04-141-1/+1
|
* Add fedmsg/fedmsg-relay to mm-backend01.stgKevin Fenzi2015-04-101-0/+2
|
* Install python-psycopg2 on mm-backendPierre-Yves Chibon2015-01-221-0/+1
|
* Need bzcat hereKevin Fenzi2015-01-101-0/+1
|
* Attempt to move new mirrormanager frontend to frontend2 and bring old one ↵Kevin Fenzi2014-12-181-1/+1
| | | | back so sundries isn't broken.
* mm2_get_global_netblocks also relies on zebra-dump-parserPierre-Yves Chibon2014-12-151-1/+1
|
* Change directory before running the cron job to be able to access ↵Pierre-Yves Chibon2014-12-151-1/+1
| | | | zebra-dump-parser
generated by cgit (git 2.34.1) at 2025-09-25 23:06:14 +0000