CyberGIS-Compute: A new cyberGIS middleware framework for enabling high-performance and data-intensive geospatial research and education

Keywords: CyberGIS, advanced cyberinfrastructure, middleware
Session Type: Virtual Paper Abstract
Day: Sunday
Session Start / End Time: 2/27/2022 05:20 PM (Eastern Time (US & Canada)) - 2/27/2022 06:40 PM (Eastern Time (US & Canada))
Room: Virtual 63

Abstract

Geospatial research and education have become increasingly dependent on cyberGIS (i.e., geographic information science and systems based on advanced cyberinfrastructure) to process large datasets using computationally complex models. However, using advanced cyberinfrastructure for geospatial research and education is highly challenging due to the complexity of cyberinfrastructure systems such as high-performance computing that confuse users with a steep learning curve and challenge developers with a high software integration cost. This paper describes CyberGIS-Compute as a middleware framework that addresses these challenges and provides access to high-performance resources through simple, easy-to-use interfaces. To focus on the technical aspect of CyberGIS-Compute, we desirable the three components that make up the CyberGIS-Compute system: (a) CyberGIS-Compute Core, a middleware server between users and HPC that automates job submission; (b) CyberGIS-Compute SDK, a Python-based Jupyter notebook client; (c) CyberGIS-Compute Contribution, a developer API that allows the users to submit arbitrary code hosted on GitHub repositories to be executed on HPC. To demonstrate effectiveness, we will consider integration with and use by application within CyberGISX.