捕获 objects 导致 SQLite 多线程访问错误
Catching objects causing SQLite multiple thread access errors
当我在 Python 和 SQLite 上 运行 进行单元测试时,我看到了这个熟悉的景象:
SQLite objects created in a thread can only be used in that same thread.
测试 运行 很好,但错误仍在打印出来。我假设 SQLite objects 以某种方式泄漏到后台线程。
有没有一种简单的方法可以
而不是逐段剖析我的代码
在某处放置 pdb
断点,然后查看 object 在哪个线程中导致了违规(从而立即弄清楚它最初是如何结束的)。
以某种方式打印出 objects(和引用它们的 parents)以及错误消息
到目前为止,通过查看 pysqlite 的源代码,我只能说无法共享连接或游标对象(参见 pysqlite_check_thread
函数用法)。
pysqlite_check_thread
函数引发 ProgrammingError
异常并显示该消息
SQLite objects created in a thread can only be used in that same thread.
源代码中的某些函数捕获该异常并打印它。
为了在您的源代码中找到在其他线程中调用连接方法的地方,我建议在连接对象上编写调用包装器,如下所示:
# script name: sqllitethread.py
import inspect
import sqlite3
import threading
import thread
from sqlite3 import ProgrammingError
class CallWrapper(object):
def __init__(self, obj):
self.obj = obj
self.main_thread_id = thread.get_ident()
def __getattr__(self, name):
if self.main_thread_id != thread.get_ident():
print "Thread %s requested `%s` attribute from %s" % (thread.get_ident(), name, self.obj)
for frame in inspect.getouterframes(inspect.currentframe())[1:]:
if frame[1].endswith('threading.py'):
continue
print "\t", "%s:%s" % (frame[1], frame[2]), frame[3], frame[4][0].strip()
return getattr(self.obj, name)
conn = CallWrapper(sqlite3.connect('example.db'))
c = conn.cursor()
def worker():
try:
conn.execute('.tables')
except ProgrammingError, e:
print e
t = threading.Thread(target=worker)
t.start()
t.join()
输出示例:
Thread 140390877370112 requested `execute` attribute from <sqlite3.Connection object at 0x7faf4e659858>
sqllitethread.py:30 worker conn.execute('.tables')
SQLite objects created in a thread can only be used in that same thread.The object was created in thread id 140390912665408 and this is thread id 140390877370112
当我在 Python 和 SQLite 上 运行 进行单元测试时,我看到了这个熟悉的景象:
SQLite objects created in a thread can only be used in that same thread.
测试 运行 很好,但错误仍在打印出来。我假设 SQLite objects 以某种方式泄漏到后台线程。
有没有一种简单的方法可以
而不是逐段剖析我的代码在某处放置
pdb
断点,然后查看 object 在哪个线程中导致了违规(从而立即弄清楚它最初是如何结束的)。以某种方式打印出 objects(和引用它们的 parents)以及错误消息
到目前为止,通过查看 pysqlite 的源代码,我只能说无法共享连接或游标对象(参见 pysqlite_check_thread
函数用法)。
pysqlite_check_thread
函数引发 ProgrammingError
异常并显示该消息
SQLite objects created in a thread can only be used in that same thread.
源代码中的某些函数捕获该异常并打印它。
为了在您的源代码中找到在其他线程中调用连接方法的地方,我建议在连接对象上编写调用包装器,如下所示:
# script name: sqllitethread.py
import inspect
import sqlite3
import threading
import thread
from sqlite3 import ProgrammingError
class CallWrapper(object):
def __init__(self, obj):
self.obj = obj
self.main_thread_id = thread.get_ident()
def __getattr__(self, name):
if self.main_thread_id != thread.get_ident():
print "Thread %s requested `%s` attribute from %s" % (thread.get_ident(), name, self.obj)
for frame in inspect.getouterframes(inspect.currentframe())[1:]:
if frame[1].endswith('threading.py'):
continue
print "\t", "%s:%s" % (frame[1], frame[2]), frame[3], frame[4][0].strip()
return getattr(self.obj, name)
conn = CallWrapper(sqlite3.connect('example.db'))
c = conn.cursor()
def worker():
try:
conn.execute('.tables')
except ProgrammingError, e:
print e
t = threading.Thread(target=worker)
t.start()
t.join()
输出示例:
Thread 140390877370112 requested `execute` attribute from <sqlite3.Connection object at 0x7faf4e659858>
sqllitethread.py:30 worker conn.execute('.tables')
SQLite objects created in a thread can only be used in that same thread.The object was created in thread id 140390912665408 and this is thread id 140390877370112