Alert Redistribution System for Fink : an Apache Spark based Broker for Astronomy

A huge volume of data is generated every night by large astronomical telescopes around the world. A robust and scalable software infrastructure is necessary to be able to leverage such high volume and high velocity of data. Fink is an Apache Spark based broker infrastructure to receive, process and redistribute such high-velocity astronomical data obtained from telescopes in real-time such as the LSST. The aim of this project is to develop an Alert Redistribution System for Fink using the state-of-the-art technologies of Big Data processing and distribution (Apache Spark, Apache Avro and Apache Kafka). This Alert Redistribution system will help scientific users to access real-time data and carry out follow up research at their ends.