General Big Data Architecture and Methodology: An Analysis Focused Framework

With the development of information technologies such as cloud computing, the Internet of Things, the mobile Internet, and wireless sensor networks, big data technologies are driving the transformation of information technology and business models. Based on big data technology, data-driven artificial intelligence technology represented by deep learning and reinforcement learning has also been rapidly developed and widely used. But big data technology is also facing a number of challenges. The solution of these problems requires the support of a general big data reference architecture and analytical methodology. Based on the General Architecture Framework (GAF) and the Federal Enterprise Architecture Framework 2.0 (FEAF 2.0), this paper proposes a general big data architecture focusing on big data analysis. Based on GAF and CRISP-DM (cross-industry standard process for data mining), the general methodology and structural approach of big data analysis are proposed.