System Software Stack Overview

Candidates of Kernel Organization on Compute Node

   

Possibilities of OS organization

Based on the reference architectures, the following possible configurations are considered and evaluated using a KNC cluster.

McKernel: Current Status

In case of Non-Bootable Many Core In case of Bootable Many Core
  • IHK (Interface for Heterogeneous Kernel)
    • Provides interface between Linux kernel and micro kernels
    • Provides generic-purpose communication and data transfer mechanisms
  • McKernel
    • Micro lightweight kernel

Scenario

  • Linux Kernel＋Loadable LWK
    • LWK is dynamically reloaded for each applicationE.g.
      • LWK-A for application A is loaded during the A’s execution
      • LWK-B for application B is loaded during the B’s execution
    • Linux API is provided in LWK

Current Status of System Software Development

  • Features implemented and being tested
    • glibc and pthread
      • Thread and memory management
      • File I/O, delegated to Linux in host
      • Memory map and dynamic link library
    • Process launcher in host
    • Direct Communication with Infiniband
    • MPI library (not fully) running on Xeon Phi
    • OpenMP environment with Intel compiler
  • Features being developed and planned
    • Hierarchical Memory Management
    • PVAS, supporting the PGAS model
    • Direct SSD
    • Single OS kernel image for partitioned multiple light-weight kernels

 Work Package

WP1 OS organization and Interface for Heterogeneous Kernel Layer
WP2 Flat MPI vs. OpenMP and new OS/runtime supports
WP3 PVAS, supporting PGAS execution model
WP4 Management of Hierarchical Memory
WP5 User-specified Map of Memory Locations on NUMA
WP6 NUMA aware Collective I/O
WP7 File I/O, SSD and hierarchical file system
WP8 File Staging
WP9 SSD and hierarchical file system
WP10 Persistent Remote DMA and MPICH on Commodity
WP11 Persistent Remote DMA and MPICH on K
WP12 Exploit Network Configuration Information