如何从 QuestDB 获取查询结果到 Pandas 数据框？

Question

我正在使用 Python 和运行 select * from my_table 中的 psycopg2 连接到 QuestDB，但列名是序号：

import psycopg2
import pandas as pd

dataframe = pd.DataFrame()
try:
    connection = psycopg2.connect(user="myuser",
                                  password="mypassword",
                                  host="127.0.0.1",
                                  port="8812",
                                  database="qdb")
    cursor = connection.cursor()
    cursor.execute("SELECT * FROM my_table")

    dataframe = pd.DataFrame(cursor.fetchall())

except (Exception, psycopg2.Error) as error:
    print("Error while connecting to QuestDB", error)
finally:
    if (connection):
        cursor.close()
        connection.close()
        print("QuestDB connection closed")
print(dataframe)

没有列名的行如下所示：

                           0    1  2
0 2021-08-23 12:15:43.582771  100  1
1 2021-08-23 12:15:46.529379    1  2
2 2021-08-23 12:15:46.656823    1  2
3 2021-08-23 12:15:46.662040    1  2
4 2021-08-23 12:15:46.805505    1  2
5 2021-08-23 12:15:46.807359    1  2
6 2021-08-23 12:15:48.631560    1  2
7 2021-08-23 12:16:08.120285    6  3

Answer 1

问题是 fetchall 获取游标中每一行的结果，要正确 return table 结果，请使用 read_sql_query:

import psycopg2
import pandas as pd

dataframe = pd.DataFrame()
try:
    connection = psycopg2.connect(user="admin",
                                  password="quest",
                                  host="127.0.0.1",
                                  port="8812",
                                  database="qdb")
    cursor = connection.cursor()
    dataframe = pd.read_sql_query("select * from my_table",connection)

except (Exception, psycopg2.Error) as error:
    print("Error while connecting to QuestDB", error)
finally:
    if (connection):
        cursor.close()
        connection.close()
        print("QuestDB connection closed")
print(dataframe)

这个returns:

                    timestamp  event  origin
0  2021-08-23 12:15:43.582771    100       1
1  2021-08-23 12:15:46.529379      1       2
2  2021-08-23 12:15:46.656823      1       2
3  2021-08-23 12:15:46.662040      1       2
4  2021-08-23 12:15:46.805505      1       2
5  2021-08-23 12:15:46.807359      1       2
6  2021-08-23 12:15:48.631560      1       2
7  2021-08-23 12:16:08.120285      6       3
8  2021-08-23 12:16:58.080873      6       3
9  2021-08-23 12:16:58.081986      6       3
10 2021-08-23 12:16:58.084083      1       3

如何从 QuestDB 获取查询结果到 Pandas 数据框？

How do I get query results from QuestDB into a Pandas dataframe?

python

dataframe

pandas

questdb