couchbase python sdk ascii 异常

Question

首先，这是个例外

Traceback (most recent call last):
      File "C:\Python27\lib\site-packages\scrapy\middleware.py", line 62, in _process_chain
        return process_chain(self.methods[methodname], obj, *args)
      File "C:\Python27\lib\site-packages\scrapy\utils\defer.py", line 65, in process_chain
        d.callback(input)
      File "C:\Python27\lib\site-packages\twisted\internet\defer.py", line 383, in callback
        self._startRunCallbacks(result)
      File "C:\Python27\lib\site-packages\twisted\internet\defer.py", line 491, in _startRunCallbacks
        self._runCallbacks()
    --- <exception caught here> ---
      File "C:\Python27\lib\site-packages\twisted\internet\defer.py", line 578, in _runCallbacks
        current.result = callback(current.result, *args, **kw)
      File "D:\ScrapyProjects\General_Spider_code_version_4\General_Spider_code_version_4\pipelines.py", line 14, in process_item
        connection.set(fileName, dict(item)) #write the item to the couchbase database
      File "C:\Python27\lib\site-packages\couchbase-1.2.5-py2.7-win-amd64.egg\couchbase\connection.py", line 331, in set
        persist_to, replicate_to)
      File "C:\Python27\lib\site-packages\couchbase-1.2.5-py2.7-win-amd64.egg\couchbase\_bootstrap.py", line 99, in _json_encode_wrapper
        return json.dumps(*args, ensure_ascii=False, separators=(',', ':'))
      File "C:\Python27\lib\json\__init__.py", line 250, in dumps
        sort_keys=sort_keys, **kw).encode(obj)
      File "C:\Python27\lib\json\encoder.py", line 210, in encode
        return ''.join(chunks)
    couchbase.exceptions.ValueFormatError: <Couldn't encode value, inner_cause='ascii' codec can't decode byte 0xe2 in position 5: ordinal not in range(128), C Source=(src\convert.c,131), OBJ={'bathrooms': 1.0, 'furnished': 'No', 'ad_title': 'Large Studio For Rent in IMPZ just 45K/4chqs(KK)', 'agent_fees': -1, 'size': 550.0, 'category': 'Apartment', 'company_rera_number': '12913', 'agent_company': 'AL ANAS REAL ESTATE BROKER', 'ded_licence_number': '700590', 'source': 'dubizzleproperty', 'location': 'UAE \xe2\x80\xaa>\xe2\x80\xaa Dubai \xe2\x80\xaa>\xe2\x80\xaa IMPZ International Media Production Zone ; 3.1 km from Meadows Town Centre \xc2\xa0', 'image_links': [u'http://87421a79fde09fda7e57-79445249ccb41a60f7b99c8ef6df8604.r12.cf3.rackcdn.com/4_async/2015/2/18/73ff34e2a38c7b104401c9e5c54b03628971053f/main.jpeg', u'http://87421a79fde09fda7e57-79445249ccb41a60f7b99c8ef6df8604.r12.cf3.rackcdn.com/4_async/2015/2/18/24ec831f6b4afb47fecc1c3e0991cf3090c90c24/main.jpeg', u'http://87421a79fde09fda7e57-79445249ccb41a60f7b99c8ef6df8604.r12.cf3.rackcdn.com/4_async/2015/2/18/77fee11394090aaea2d668cfe2754b92d6e36264/main.jpeg', u'http://87421a79fde09fda7e57-79445249ccb41a60f7b99c8ef6df8604.r12.cf3.rackcdn.com/4_async/2015/2/18/5d4113319ccbabcdd65b0ffe7302da59b374b5fe/main.jpeg', u'http://87421a79fde09fda7e57-79445249ccb41a60f7b99c8ef6df8604.r12.cf3.rackcdn.com/4_async/2015/2/18/8070689f309759d5860e97aa35d3f0eac425dc1d/main.jpeg', u'http://87421a79fde09fda7e57-79445249ccb41a60f7b99c8ef6df8604.r12.cf3.rackcdn.com/4_async/2015/2/18/8e86702847e69d485d147629dd2e48e1ad831e63/main.jpeg'], 'latitude': -1, 'description': 'Central A/C & Heating , Balcony , Shared Pool , Built in Wardrobes , Walk-in Closet , Shared Gym , Security , Built in Kitchen Appliances', 'bedrooms': 'Studio', 'rent_is_paid': 'Quarterly', 'action': 'Rent', 'link': 'http://dubai.dubizzle.com/property-for-rent/residential/apartmentflat/2015/2/18/large-studio-for-rent-in-impz-just-45k4chq-2/?back=ZHViYWkuZHViaXp6bGUuY29tL3Byb3BlcnR5LWZvci1yZW50L3Jlc2lkZW50aWFsL2FwYXJ0bWVudGZsYXQv&pos=1', 'longitude': -1, 'property_reference': '', 'yearly_cost': 45000.0, 'agent_mobile': -1, 'posting_date': '2015-02-19'}>

我正在尝试将字典存储在沙发底座上。我正在使用此代码

connection.set(fileName, dict(item))

将item转移到字典。正如您从错误消息中看到的那样。我有一个 unicode 值，根据 python sdk couchbase 没问题，你能帮我吗？

Answer 1

您的值不是 unicode。请记住，包含有效 unicode 转义序列的 str 对象不会自动使其成为 Python 用语中的 "Unicode"。您需要确保字符串是正确的 Unicode。

这似乎适用于正常的 json.dumps() 函数（没有任何参数）；而 python 客户端（默认情况下）传递 ensure_ascii=False 参数以减小数据大小（JSON 本身可以采用 UTF-8 编码，并且不限于 ASCII）。

因此，解决方法可能是为 JSON 设置您自己的编码函数，它不传递 ensure_ascii 参数；像这样：

import json
import couchbase

couchbase.set_json_converters(json.dumps, json.loads)

尽管不推荐使用此解决方法，因为它可能会略微增大您的文档大小。

couchbase python sdk ascii 异常

couchbase python sdk ascii exception

scrapy

python-2.7

couchbase