YARN Service in Cloudera Data Platform
Yarn Service framework provides first class support and APIs to host long running services natively in YARN. In a nutshell, it serves as a container orchestration platform for managing containerized services on YARN. It supports both docker container and traditional process based containers in YARN.
The responsibility of this framework includes performing configuration resolutions and mounts, lifecycle management such as stop/start/delete the service, flexing service components up/down, rolling upgrades services on YARN, monitoring services’ healthiness and readiness and more.
The yarn-service framework primarily includes below components:
A core framework (ApplicationMaster) running on YARN to serve as a container orchestrator, being responsible for all service lifecycle managements.
A restful API-server for users to interact with YARN to deploy/manage their services via a simple JSON spec.
A DNS server backed by YARN service registry to enable discovering services on YARN by the standard DNS lookup.