YARN 和 hive2 队列有什么区别?
What is difference between YARN and hive2 queues?
yarn.scheduler.capacity.root.queues
和 hive.server2.tez.default.queues
有什么区别?
简而言之:
hive.server2.tez.default.queues
values are subset of
yarn.scheduler.capacity.root.queues
(If capacity scheduler is configured in YARN, if not other scheduler) values.
详细答案:
hive.server2.tez.default.queues: (Default: empty)
A list of comma separated values corresponding to YARN queues of the
same name. When HiveServer2 is launched in Tez mode, this
configuration needs to be set for multiple Tez sessions to run in
parallel on the cluster.
This does NOT mean that queries can't be issued to other "existing"
queue defined in capacity scheduler. source
yarn.scheduler.capacity.root.queues:
The CapacityScheduler has a pre-defined queue called root. All queueus in the system are children
of the root queue. Further queues can be setup by configuring
yarn.scheduler.capacity.root.queues with a list of comma-separated
child queues. source,
因此,hive.server2.tez.default.queues
的范围仅限于 Hive 查询,但 yarn.scheduler.capacity.root.queues
范围将适用于集群中使用 YARN 作为资源管理器的所有组件(如 MapReduce 和 Spark) .
yarn.scheduler.capacity.root.queues
和 hive.server2.tez.default.queues
有什么区别?
简而言之:
hive.server2.tez.default.queues
values are subset ofyarn.scheduler.capacity.root.queues
(If capacity scheduler is configured in YARN, if not other scheduler) values.
详细答案:
hive.server2.tez.default.queues: (Default: empty)
A list of comma separated values corresponding to YARN queues of the same name. When HiveServer2 is launched in Tez mode, this configuration needs to be set for multiple Tez sessions to run in parallel on the cluster.
This does NOT mean that queries can't be issued to other "existing" queue defined in capacity scheduler. source
yarn.scheduler.capacity.root.queues:
The CapacityScheduler has a pre-defined queue called root. All queueus in the system are children of the root queue. Further queues can be setup by configuring yarn.scheduler.capacity.root.queues with a list of comma-separated child queues. source,
因此,hive.server2.tez.default.queues
的范围仅限于 Hive 查询,但 yarn.scheduler.capacity.root.queues
范围将适用于集群中使用 YARN 作为资源管理器的所有组件(如 MapReduce 和 Spark) .