When doing a Fedora upgrade (eg, F17->F20), here are some things to check on.

== Scripts Infrastructure ==

* TextPattern
* Pony
* whois

== Web features ==

* SSL
  * Do we pick the right cert for mit.edu names?
  * Do we pick the right cert for *.scripts.mit.edu names?
  * Do we pick the right cert for scripts-cert and scripts.mit.edu

== Autoinstalled Apps == 

You should check what the whole list is by running an autoinstall, but...

* MediaWiki
* WordPress
* git repo
* Trac
  * Warning: Trac will do a schema upgrade when first visited from the new distro, so you should do this with a Trac that you don't mind breaking for a while.
* Frameworks
  * Obviously, these can have substantial variation between them, but checking at least one example is maybe a good idea (if for no other reason than to be better at answering questions)
  * TurboGears
    * Pony
  * Django
    * http://ibtsocs.com/
    * [http://asa.mit.edu/ ASA DB]
  * Ruby