====== Computational Earth Sciences ====== ===== Description of the group ===== The Computational Earth Sciences (CES) group is a multidisciplinary team with different IT profiles that interacts closely with all the other groups of the Department. The group provides help and guidance to the scientists with the technical issues relating to their work and develops a framework for the most efficient use of HPC resources. In order to improve the use of the variety of computing resources available at the BSC and in other HPC institutions, a solid software development, profiling and optimisation area will be created for Earth system model codes towards exascale computing, and to provide feedback on this to modellers around Europe. Last but not least, the development of a framework to disseminate the outputs generated by the BSC-ES among the research and service community will be pursued. This area will take advantage of the unique environment of the BSC where research in Big Data is already a priority that will be extended in the next years. One of the common scopes of the group is the guidance on the use of IT resources, with the aim of Designing and maintaining an IT infrastructure allowing the research teams the accomplishment of their objectives. This involves: * Maintain an IT infrastructure that ensures an efficient working environment for the development of the BSC-ES research and services, including the provision of sufficient storage to reduce this specific vulnerability of the department. * Provide and guide the department groups to use a collaborative framework and good coding practices (code version control, testing suites, style guides) to improve the work efficiency, the integration of newcomers and the sharing of the tools. * Develop and ensure a continuous training to IT members and earth sciences users to use resources in the most efficient way. The group is led by Kim Serradell and co-led by Alicia Sánchez and is organised in 3 teams (Models and Workflows, Performance and Data and Diagnostics) as shown below. {{:working_groups:ces-structure.jpg?600|}} ====Models and workflows team:==== **Current members:** Miguel Castrillo (team leader), Mario Acosta, Pablo Echevarría, Francesca Macchia, Domingo Manubens, Miriam Olid, Carles Tena **Purpose: Development of HPC user-friendly software framework for Earth system modelling and the management of operational systems** **Tasks:** * //Support the development of atmospheric research software and contribute to its maintenance// * Interact with model developers and HPC support teams to develop and deploy a software stack to run generic Earth system models on a wide range of HPC facilities. * // Maintain and improve operational systems // * Collaborate with the other three other groups to satisfy their needs for the development and efficient running, including the design of appropriate workflows, of the BSC-ES operational air quality, weather and climate forecast systems. **Projects and softwares developed:** *[[https://earth.bsc.es/gitlab/es/auto-ecearth3|Auto-Ecearth]] *[[https://earth.bsc.es/gitlab/es/autosubmit|Autosubmit]] * Caliope ==== Performance team:==== **Current members:** Mario Acosta (team leader), Miguel Castrillo, Oriol Tinto, Xavier Yepes **Purpose: Efficient use of the computational resources by the research groups** **Tasks:** * //Provide HPC Services such as performance analysis to identify bottlenecks and apply optimizations // * Collaborate with other BSC departments, especially Computer Sciences, to use state-of-the-art programming models and profiling tools to prepare Earth sciences models to run on next generation exascale HPC system. Also improve the efficiency of existing models and postprocessing tools interacting with developers and users during all stages of software development lifecycle. * // Research on new computational methods to apply on Earth Sciences models // * Collaborate with external Earth system modelling teams to implement and test new computational methods that allow the use of new platforms such as heterogeneous architectures. **Projects and softwares developed:** *[[https://earth.bsc.es/gitlab/es/ELPiN|ELPin]] ==== Data and Diagnostics Team:==== **Current members:** Francesco Benincasa, Pierre-Antoine Bretonnière (team leaders), David Arroyo, Laura Cifuentes, Júlia Giner, Alasdair Hunter, Nicolau Manubens, Javier Vegas, Elisa Distante **Purpose: Provision of data services** **Tasks:** * //Develop, manage and maintain a common data service framework // * Develop, manage and maintain a common data service framework to collect, standardize and distribute climate and atmospheric data to both internal departmental and external users of the research and services community. Setting up an ESGF Datanode is a priority of the team to give international visibility to the centre. * Implement locally and contribute to the development of international standards for data storage and exchange, with special interest in data in NetCDF and GRIB formats. * //Deploy an infrastructure ready to overcome the Big Data challenge in Earth sciences // * Improve the capability for processing Big Data volumes for the analysis of Earth system simulation using the latest technologies both at hardware and software levels. * Improve the outcome to society of user-friendly data visualization products. * Study new approaches to address the I/O challenges of the new generation of high-resolution, highly parallelized Earth system models. * //Big Data and Machine Learning applications// * In this page, you can find the current material related to [[:working_groups:computational_earth_sciences:big_data|Big Data]] in Earth Sciences. * Activities related to the Machine Learning applications on Earth Sciences can be found here ([[:working_groups:computational_earth_sciences:machine_learning| Machine Learning]]) **Projects and softwares developed:** *[[https://earth.bsc.es/gitlab/ces/C3PO|C3PO]] *[[https://earth.bsc.es/gitlab/es/earthdiagnostics|Earth Diagnostics]] *[[https://earth.bsc.es/gitlab/es/ece2cmor|ece2cmor]] *[[https://earth.bsc.es/gitlab/ces/R2D2|R2D2]] * SDS/WAS *[[https://earth.bsc.es/gitlab/es/s2dverification|s2dverification]] =====Outcomes of the CES meetings:===== Every month the CES group meets and each group presents the activities carried on (updated in the [[ https://trello.com/b/AgNUDPRp/ces-tasks | Trello ]] of the group), the issues encountered and progresses made. The following document contains [[https://earth.bsc.es/wiki/doku.php?id=working_groups:ces:ces_team_meetings | the presentations of CES team meetings]]. In the CES group, we are not only computer guys and girls, we are also cooks! [[https://goo.gl/photos/iwTGT3zLirf9djXP8| Take a look!]] ===== Publications ===== ==== Posters ==== * Supercomputing 2015, Austin, Texas, 15 - 20 November 2015, Optimization of an Ocean Model Using Performance Tools [[http://sc15.supercomputing.org/sites/all/themes/SC15images/tech_poster/poster_files/post224s2-file2.pdf|Poster]] - [[http://sc15.supercomputing.org/sites/all/themes/SC15images/tech_poster/poster_files/post224s2-file3.pdf|Two-page extended abstract]] * EGU General Assembly 2017 (EGU2017), Vienna, Austria, 24-28 April 2017, Simulation-based performance analysis of EC-Earth 3.2.0 using Dimemas {{library:external:20170426_xyepes_egu2017.pdf|pdf}} * OpenIFS workshop 2017, Trieste, Italy, 5-9 June 2017, Performance study of OpenIFS: towards a more efficiently scalable model {{:library:external:20170605_macosta_oifsworkshop.pdf|pdf}} ==== Technical Memoranda ==== * Tintó Prims, O., M. Castrillo, K. Serradell , O. Mula-Valls and F.J. Doblas-Reyes (2015). Optimization of an ocean model using performance tools.{{library:external:bsc-ces-2015-002.pdf|BSC-CES Technical Memorandum No. 2, 16 pp.}} * Basart, S., K. Serradell and J.M. Baldasano (2015). User's guide of the BSC-DREAM8b model{{library:external:bsc-ac-2015-001-bsc_dream8buserguide.pdf|BSC-AC Technical Memorandum No. 1, 74 pp.}} * Yepes-Arbós, X., M. C. Acosta, K. Serradell, A. Sanchez Lorente, F.J. Doblas-Reyes (2017). Simulation-based performance analysis of EC-Earth 3.2.0 using Dimemas. {{:library:external:bsc-ces-2017-001-dimemas_performance_analysis_report.pdf|BSC-CES Technical Memorandum 2017-001, 30 pp.}} * Acosta, M.C., X. Yepes-Arbós, S. Valcke, E. Maisonnave, K. Serradell, O. Mula-Valls and F.J. Doblas-Reyes (2016). Performance analysis of EC-Earth 3.2: Coupling {{:library:external:technical_memoranda:bsc-ces-2016-006-coupling_ec-earth.pdf|BSC-CES Technical Memorandum 2016-006, 38 pp.}} * Yepes-Arbós, X., M.C. Acosta, K. Serradell, O. Mula-Valls, F.J. Doblas-Reyes (2016). Scalability and performance analysis of EC-Earth 3.2.0 using a new metric approach (Part I) {{:library:external:technical_memoranda:bsc-ces-2016-001-scalability_ec-earth.pdf|BSC-CES Technical Memorandum 2016-001, 28 pp.}} * Yepes-Arbós, X., M.C. Acosta, K. Serradell, O. Mula-Valls, F.J. Doblas-Reyes (2016). Scalability and performance analysis of EC-Earth 3.2.0 using a new metric approach (Part II) {{:library:external:technical_memoranda:bsc-ces-2016-004-performance_ec-earth.pdf|BSC-CES Technical Memorandum 2016-004, 56 pp.}} ===== Presentations ===== - CALIOPE Mobile. European Air Quality Forecast at hand (Open Geospatial Consortium Joint Session on Citizen GEOSS, City of Mexico, Mexico, 10 November 2015), M.Castrillo {{:library:external:20151110_mcastrillo_citizen_geoss.pdf|pdf}} - CALIOPE Mobile. European Air Quality Forecast at hand (Workshop of Open Data projects cluster, Brussels, Belgium, 7-8 September 2015), M.Castrillo {{:library:external:20150908_mcastrillo_open_data_workshop.pdf|pdf}} - BSC Performance tools suite: study cases on improving the efficiency of the EC-EARTH model components (3rd JLESC, Barcelona, Spain, 29 June - 1 July 2015), M. Castrillo {{:library:external:20150701_mcastrillo_3rd_jlesc.pdf|pdf}} - BSC tools to study the computational efficiency of EC-Earth components (EC-Earth meeting, Reading, UK, 5-6 May 2015), M. Castrillo {{:library:external:20150505_mcastrillo_ecearth.pdf|pdf}} - Applying clustering and folding techniques to study performance issues on the NEMO global ocean model (HPC Knowledge Meeting’15, Barcelona, Spain, 3-4 February 2015), M. Castrillo {{:library:external:20150203_mcastrillo_hpckp15.pdf|pdf}} ===== List of people involved ===== {{ :working_groups:kmp_3780.png?300 |}} ==== Mario Acosta ==== {{:working_groups:members:mario.jpg?90 |}} Postdoctoral Researcher \\ Interests: HPC performance, Computer Architecture, Scientific Models, Computational Dynamic Fluids, Mathematical algorithms \\ Contact: [[mario.acosta@bsc.es|mario.acosta@bsc.es]] \\ ---- ==== David Arroyo Menéndez ==== {{:working_groups:davidam3.png?90 |}} \\ Computer engineer with a Master Degree in Social Research. \\ Position: Developer\\ Interests: Free Software, GNU Emacs, Web Development, e-learning, Social Movements \\ Contact: [[david.arroyo@bsc.es|david.arroyo@bsc.es]][[http://www.davidam.com]] ---- ==== Francesco Benincasa ==== {{:working_groups:members:francesco.jpg?100 |}} \\ Software Engineer \\ Interests: Software development, Data management, Big Data ---- ==== Pierre-Antoine Bretonnière ==== {{:working_groups:members:foto_pabretonniere.jpg?100 |}} \\ Software Engineer \\ Interests: Data management, Big Data ---- ==== Miguel Castrillo ==== {{:working_groups:members:mcastril.jpeg?100 |}} Computational Engineer, Software Analyst Interests: HPC performance, Scientific Models, Data management and visualization Contact: miguel.castrillo@bsc.es, [[https://twitter.com/Monoftalmos|Twitter]], [[https://www.linkedin.com/in/miguel-castrillo-melguizo-2234522b|Linkedin]] ---- ==== Laura Cifuentes Fontanals ==== {{:working_groups:members:laura.jpg?90 |}} \\ Position: Junior Developer \\ Interests: Mathematical modelling, Data science, Big data. \\ Contact: [[laura.cifuentes@bsc.es|laura.cifuentes@bsc.es]] \\ ---- ==== Pablo Echevarria ==== {{:working_groups:pablo_echevarria.jpg?90 |}} \\ Position: Research software engineer \\ Interests: Numeric modeling, HPC, Linux. \\ Contact: [[pablo.echevarria@bsc.es|pablo.echevarria@bsc.es]] [[https://www.linkedin.com/in/pablo-echevarria|Linkedin]] \\ ---- ==== Júlia Giner ==== {{:working_groups:members:jginer.png?90 |}} \\ \\ Position: Junior Developer\\ Interests: Data management, Big data, Climate data, Climate forecasting.\\ Contact: [[julia.giner@bsc.es|julia.giner@bsc.es]], ---- ==== Alasdair Hunter ==== {{:working_groups:members:alasdairhunter.jpg?90 |}} \\ Position: Software engineer \\ Interests: Statistical programming, statistical analysis of climate and extreme events, catastrophe modelling, extratropical cyclones \\ Contact: [[alasdair.hunter@bsc.es|alasdair.hunter@bsc.es]] \\ ---- ==== Domingo Manubens ==== {{:working_groups:members:mingu.jpg?100 |}} \\ Software engineer - [[https://es.linkedin.com/pub/domingo-manubens/15/3a8/232|Linkedin]] \\ Interests: Workflows, High Performance Computing ---- ==== Nicolau Manubens ==== {{:working_groups:members:nico.jpg?100 |}} Software engineer\\ Position: Technical in formation\\ Interests: High performance computing, big data, data homogenization, climate data, climate forecasting.\\ Contact: nicolau.manubens@bsc.es ---- ==== Alicia Sanchez Lorente ==== {{:working_groups:members:alicia.jpg?100 |}} \\ Computational Earth Sciences Co-Manager - \\ Interests: Research Management, BigData and Data Sciences(ML applications in Earth Sciences)\\ Earth system models, High performance computing, performance analysis and Co-Team management.\\ alicia.sanchez@bsc.es ---- ==== Kim Serradell ==== {{:working_groups:members:foto_kim.jpg?100 |}} \\ Computational Earth Sciences manager - [[http://es.linkedin.com/in/kserradell/|Linkedin]] \\ Interests: Earth system models, performance analysis and team management. \\ ---- ==== Carles Tena ==== {{:working_groups:members:ctena.jpeg?100 |}} \\ carles.tena@bsc.es Computer Engineer specialized in Computer Architecture and HPC - [[https://es.linkedin.com/pub/carles-tena-medina/64/687/358|LinkedIn]]\\ Position: Junior Developer\\ Interests: [[models:caliope:caliope|CALIOPE]], [[models:caliope:caliope#WRF|WRF]], [[models:caliope:caliope#HERMES|HERMESv2]], [[models:caliope:caliope#CMAQ|CMAQ]], Computer Architecture and High Performance Computing ---- ==== Oriol Tintó ==== {{:working_groups:members:foto_carnet_oriol_tinto.png?100 |}} \\ \\ PhD Student in High Performance Computing for Ocean Modeling Interests: Earth Sciences, Computer Sciences, Modeling and Technology ---- ==== Javier Vegas ==== {{:working_groups:members:jvegas.jpg?100 |}} \\ Software engineer\\ Interests: Workflow management, high performance computing ---- ==== Xavier Yepes ==== {{:working_groups:members:xavier_yepes.jpg?100 |}} Computer Engineer specialized in Computer Architecture and HPC - [[https://es.linkedin.com/in/xavieryepes|LinkedIn]]\\ Position: Developer\\ Interests: Earth Sciences, Astronomy, Computer Architecture and High Performance Computing ----