Table Apache HIVE 中的定义问题

Table definition issues in Apache HIVE

以下是我在名为 temp_statHive table 中推送的数据集:

COUNTRY    CITY                 TEMP 
---------- -------------------- -----
US         Arizona              51.7 
US         California           56.7 
US         Bullhead City        51.1 
India      Jaisalmer            42.4 
Libya      Aziziya              57.8 
Iran       Lut Desert           70.7 
India      Banda                42.4

当我尝试通过 select 命令查看数据时,我得到以下数据集:

US,Arizona,51.7         NULL    NULL
US,California,56.7      NULL    NULL
US,Bullhead City,51.1   NULL    NULL
India,Jaisalmer,42.4    NULL    NULL
Libya,Aziziya,57.8      NULL    NULL
Iran,Lut Desert,70.7    NULL    NULL
India,Banda,42.4        NULL    NULL

接下来我想根据国家/地区对这些记录进行分组,并获取每个国家/地区的最高温度以及城市名称,因此我运行 以下查询:

select country,city,temp
from (
select country,city,temp, 
     row_number() over (partition by country order by temp desc) as part
from temp_stat
) a 
where part = 1
order by country, city;

一旦我 运行 在 hive shell 中进行上述查询,我​​得到以下结果:

US,Arizona,51.7         NULL    NULL
US,California,56.7      NULL    NULL
US,Bullhead City,51.1   NULL    NULL
India,Jaisalmer,42.4    NULL    NULL
Libya,Aziziya,57.8      NULL    NULL
Iran,Lut Desert,70.7    NULL    NULL
India,Banda,42.4        NULL    NULL

即使我运行生成row_number的内部查询,我也会得到类似的行-所有记录的数字。 (像这样:)

India,Banda,42.4        NULL    NULL    1
India,Jaisalmer,42.4    NULL    NULL    1
Iran,Lut Desert,70.7    NULL    NULL    1
Libya,Aziziya,57.8      NULL    NULL    1
US,Arizona,51.7         NULL    NULL    1
US,Bullhead City,51.1   NULL    NULL    1
US,California,56.7      NULL    NULL    1
enter code here

我也尝试了 dense_rank()运行k()。没有新的 results.Is table 定义有任何问题吗?

我们将不胜感激!

以“,”结尾的字段


您的 table 定义应该是这样的:

create external table temp_stat
(
    country     string   
   ,city        string          
   ,temp        decimal(11,1)
)
    row format delimited
    fields terminated by ','
;

select * from temp_stat;

+---------+---------------+------+
| country |     city      | temp |
+---------+---------------+------+
| US      | Arizona       | 51.7 |
| US      | California    | 56.7 |
| US      | Bullhead City | 51.1 |
| India   | Jaisalmer     | 42.4 |
| Libya   | Aziziya       | 57.8 |
| Iran    | Lut Desert    | 70.7 |
| India   | Banda         | 42.4 |
+---------+---------------+------+