Things to do every day to ensure the healthy operation of the Ubuntu Error Tracker (https://errors.ubuntu.com). * Check the state of the retracers on https://graphite.engineering.canonical.com. * Check the retracer logs on snakefruit. * {{{sudo -u archvsync ~archvsync/scripts/schedule-logsync.sh production-crashdb-retracer-logs}}} * {{{cd /srv/app-logs/finfolk/production-crashdb-retracer-logs/; view retrace.log}}} * {{{cd /srv/app-logs/cassabanana/production-crashdb-retracer-logs/; view retrace.log}}} * Check the OOPS reports for the past '''couple''' of days. * https://errors.ubuntu.com/oops-local/ * https://oops.canonical.com/reports/WHOOPSIE-PROD/ * Check the CouldNotBucket CF for anything interesting in the past couple of days. * Check https://errors.ubuntu.com/status. * Check mail to daisy-pluckers-error-reports@lists.launchpad.net (output from production cron jobs, etc). * [[https://dc-nagios.admin.canonical.com/cgi-bin/nagios3/history.cgi?host=cassabanana&type=0&statetype=0&service=cassabanana+crashdb-productionsupervisorwebops-prompt-critical+Check+status+of+supervised+daemons&archive=1|Check status]] of supervisord.