Contributor
Shashwat Kathuria

Improve Wiki Education Dashboard's Error Monitoring


Mentors
Sage Ross
Organization
Wikimedia Foundation

WikiEduDashboard pulls huge data related to a wide range of WikiMedia projects via MediaWiki API, across groups of editors. This scales upwards when we go on to different courses and their types, then different campaigns. Currently, all the error logging done via Sentry-Raven is noisy (and not helpful for specific jobs) along with some error handling in the form of authentication errors, rescue development errors, rescue errors and some more typical error handling.

My project will involve making a custom error mechanism for keeping track of a variety of data related errors, removing orphan locks in course update Sidekiq workers, jobs and queues. The tracked errors will displayed separately for a course along with course update process statistics, being visible everyone. Data related errors will include errors occuring due to unexpected formats of data, API errors, application errors, etc. Regarding the orphan locks, an additional mechanism to remove them will be made so that future unique jobs don't block forever due to the orphan locks and the course update process continues normally.