New connection between dark matter direct detections, astrophysical and cosmological observations with self-interacting dark matter