YARN 和 hive2 队列有什么区别?

What is difference between YARN and hive2 queues?

yarn.scheduler.capacity.root.queueshive.server2.tez.default.queues 有什么区别?

简而言之:

hive.server2.tez.default.queues values are subset of yarn.scheduler.capacity.root.queues(If capacity scheduler is configured in YARN, if not other scheduler) values.


详细答案:

hive.server2.tez.default.queues: (Default: empty)

A list of comma separated values corresponding to YARN queues of the same name. When HiveServer2 is launched in Tez mode, this configuration needs to be set for multiple Tez sessions to run in parallel on the cluster.

This does NOT mean that queries can't be issued to other "existing" queue defined in capacity scheduler. source


yarn.scheduler.capacity.root.queues:

The CapacityScheduler has a pre-defined queue called root. All queueus in the system are children of the root queue. Further queues can be setup by configuring yarn.scheduler.capacity.root.queues with a list of comma-separated child queues. source,

因此,hive.server2.tez.default.queues 的范围仅限于 Hive 查询,但 yarn.scheduler.capacity.root.queues 范围将适用于集群中使用 YARN 作为资源管理器的所有组件(如 MapReduce 和 Spark) .