Scientific paper ID 1937 : 2020/3

Abstract: Smart cities have become a necessity to make life in big cities sustainable. The number of inhabitants in cities is growing as a result of increased migrations. People move in search of work, better living conditions, and, above all, in connection with the change in the structure of existing jobs caused by modern technologies. The number of jobs in agriculture is constantly decreasing, while in industry and services it is growing. The flourishing of the information technology and communications sector has created new opportunities for monitoring the situation and processes in all areas of life and work, which has created the conditions for more accurate control of these processes, from production to transport and the environment. The undoubted support for these changes is provided by the Internet, which is becoming the Internet of everything. This article analyzes the impact of the Internet of Things and the associated challenges of being able to process the vast amount of collected data. The Internet of Things allows an unthinkable number of devices to be connected to the network. These devices collect data and/or use it for their work, so a huge amount of data is generated that cannot be processed using classical methods. New methods of processing them and receiving output are needed, so appropriate platforms have been created for this. This article compares the Hadoop and Spark platforms. The article ends with conclusions based on the analysis presented.