Data-mining Based Expert Platform for the Spectral Inspection

2014 
We propose and preliminarily implement a data-mining based platform to assist ex- perts to inspect the increasing amount of spectra with low signal to noise ratio (SNR) generated by large sky surveys. The platform includes three layers: data-mining layer, data-node layer and expert layer. It is similar to the GalaxyZoo project and VO-compatible. The preliminary experiment suggests that this platform can play an effective role in managing the spectra and assisting the experts to inspect a large number of spectra with low SNR. With the telescopes established and the surveys ongoing, such as the Guoshoujing telescope (LAMOST, Zhao 1999), more and more spectra are collected and released. Unfortunately, except the qualified data, there still exist many spectra unclassified by the automated pipeline. Usually most of these spectra are too low SNR to be classified because of the limited magnitude of the instruments or other reasons. Some important new discoveries are probably hidden in these unknown spectra. Therefore, we should not give up these seemingly useless data, even though they are quite defective. How to handle these unknown spectra is one of the biggest challenges to the modern statistics and data mining techniques as well as eyeball check. In order to ensure the accuracy of the results, we have to motivate experts to check these spectra by visual inspection. Owing to huge amount of such spectra generated continuously by the large sky surveys, it will spend much time and efforts to check spectra one by one. Consequently, a platform to efficiently manage and coarsely classify these unqualified data is in great requirement for the large surveys.
    • Correction
    • Source
    • Cite
    • Save
    • Machine Reading By IdeaReader
    4
    References
    0
    Citations
    NaN
    KQI
    []