X-Git-Url: https://scripts.mit.edu/gitweb/wizard.git/blobdiff_plain/5dc9b5012125951d56f2657c191f17d1e6ac4aae..dbfdb74c8a6ba673b11153407c1cc042828182ab:/TODO diff --git a/TODO b/TODO index 2f4e646..6cf6b14 100644 --- a/TODO +++ b/TODO @@ -2,52 +2,77 @@ The Git Autoinstaller TODO NOW: -- Genericize callAsUser and drop_priviledges in shell -- Remove "already migrated" cruft that will accumulate if we do small - --limit and then increase. -- Make sure to generate reports about what errored and what had warnings. - Same goes for our output -- Allow to migrate just one user (user filtering of installs) -- Make sure MediaWiki upgrade script does not give proper exit code - if it fails, so be sure to check for "Done" in the last 10 characters. - -- Make parallel-find.pl use `sudo -u username git describe --tags` - to determine version. Make parallel-find.pl have this have greater - precedence. (Have patch, pending testing and commit) -- Make the installer use 'wizard install' /or/ do a migration - after doing a normal install (the latter makes it easier - for mass-rollbacks). -- Have the upgrader do locking (.scripts/lock, probably) - -- Better error message if daemon/scripts-security-upd - is not on scripts-security-upd list - -- Custom merge algo: absolute php.ini symlinks to relative symlinks -- Custom merge algo: re-constitute AdminSettings.php if missing. It looks - like this is the case for most 1.5.8 installs (check what the merges - do in both directions). All 1.11.0 installs except four have - the other (check diff -u with all in /root) - -- Make upgrade and install take version as a parameter +- Keep my sanity when upgrading 1000 installs + - Custom merge algo: absolute php.ini symlinks to relative symlinks (this + does not seem to have been a problem in practice) + - Custom merge algo: check if it's got extra \r's in the file, + and dos2unix it if it does, before performing the merge + - Prune -7 call errors and automatically reprocess them (with a + strike out counter of 3)--this requires better error parsing. + - IOError should be aggregated, right now contains custom string + that makes this not possible. Partition on a colon. + - Replace gaierror with a more descriptive name (this is a DNS error) + - Stronger skips means that backup failures should also be avoided + - Distinguish between types of backup failures + - Ignore empty blacklists; they should all have reasons + - wizard upgrade should have different exit codes for merge failure + and blacklist error + +- Distinguish from logging and reporting (so we can easily send mail + to users) + - Figure out a way of collecting blacklist data from .scripts/blacklisted + and aggregate it together + +- Let users use Wizard when ssh'ed into Scripts + - Make single user mass-migrate work when not logged in as root + +- Make the rest of the world use Wizard + - Make parallel-find.pl use `sudo -u username git describe --tags` + to determine version. Make parallel-find.pl have this have greater + precedence. This also means, however, that we get + full mediawiki-1.2.3-2-abcdef names (Have patch, pending testing and commit) + - Make deployed installer use 'wizard install' /or/ do a migration + after doing a normal install (the latter makes it easier + for mass-rollbacks). + +- Pre-emptively check if daemon/scripts-security-upd + is not on scripts-security-upd list (/mit/moira/bin/blanche) - Redo Wordpress conversion, with an eye for automating everything possible (such as downloading the tarball and unpacking) -- Summary script should be more machine friendly, and should not - output summary charts when I increase specificity - -Some other stuff to do in your copious free time: -- Summary script should do something intelligent when distinguishing - between old-style and new-style installs -- Check how many autoinstalls are missing w bits for - daemon.scripts (this would need pyafs) -- Make scripts AFS patch advertise its existence so we can check for it. - (This might be otherwise possible using `fs sysname`) -- Make 'wizard summary' generate nice pretty graphs of installs by date - (more histograms, will need to check actual .scripts-version files.) -- It should be able to handle installs like Django where there's a component - that gets installed in web_scripts and another directory that gets installed - in Scripts. +- Pay back code debt + - Genericize callAsUser and drop_priviledges in shell + - Summary script should be more machine friendly, and should not + output summary charts when I increase specificity + - Summary script should do something intelligent when distinguishing + between old-style and new-style installs + - Report code in wizard/command/__init__.py is ugly as sin. Also, + the Report object should operate at a higher level of abstraction + so we don't have to manually increment fails. (in fact, that should + probably be called something different). The by-percent errors should + also be automated. + - Indents in upgrade.py are getting pretty ridiculous; more breaking + into functions is probably a good idea + - Move resolutions in mediawiki.py to a text file + - Investigate QuotaParseErrors + +- Other stuff + - Don't use the scripts heuristics unless we're on scripts with the + AFS patch. Check with `fs sysname` + - Make 'wizard summary' generate nice pretty graphs of installs by date + (more histograms, will need to check actual .scripts-version files.) + - It should be able to handle installs like Django where there's a component + that gets installed in web_scripts and another directory that gets installed + in Scripts. + - ACLs is a starting point for sending mail to users, but it has + several failure modes: + - Old maintainers who don't care who are still on the ACL + - Private AFS groups that aren't mailing lists and that we + can't get to + A question is whether or not sending mail actually helps us: + many users will probably have to come back to us for help; many + other users won't care. PULLING OUT CONFIGURATION FILES IN AN AUTOMATED MANNER