Twitter Firehose に接続し、処理のためにデータをダウンストリームに送信する Python スクリプトがあります。以前は問題なく動作していましたが、現在はテキスト本文のみを取得しようとしています。(Twitter からデータを抽出する方法や、ASCII 文字をエンコード/デコードする方法についての質問ではありません)。したがって、次のようにスクリプトを直接起動すると:
python -u fetch_script.py
問題なく動作し、メッセージが画面に表示されていることがわかります。例えば：
root@domU-xx-xx-xx-xx:/usr/local/streaming# python -u fetch_script.py
Cuz I'm checking you out >on Facebook<
RT @SearchlightNV: #BarryLies has crapped on all honest patriotic hard-working citizens in the USA but his abuse of WWII Vets is sick #2A…
"Why do men chase after women? Because they fear death."~Moonstruck
RT @SearchlightNV: #BarryLies has crapped on all honest patriotic hard-working citizens in the USA but his abuse of WWII Vets is sick #2A…
Never let anyone tell you not to chase your dreams. My sister came home crying today, because someone told her she's not good enough.
"I can't even ask anyone out on a date because if it doesn't end up in a high speed chase, I get bored."
RT @ColIegeStudent: Double-checking the attendance policy while still in bed
Well I just handed my life savings to ya.. #trustingyou #abouttomakebankkkkk
Zillow $Z and Redfin useless to Wells Fargo Home Mortgage, $WFC, and FannieMae $FNM. Sale history LTV now 48%, $360 appraisal fee 4 no PMI.
The latest Dump and Chase Podcast http://somedomain.com/viaRSA9W3i check it out and subscribe on iTunes, or your favorite android app #Isles
しかし、次のようにファイルに出力しようとすると:
python -u fetch_script.py >fetch_output.txt
すぐにエラーがスローされます。
root@domU-xx-xx-xx-xx:/usr/local/streaming# python -u fetch_script.py >fetch_output.txt
ERROR:tornado.application:Uncaught exception, closing connection.
Traceback (most recent call last):
File "/usr/local/lib/python2.7/dist-packages/tornado/iostream.py", line 341, in wrapper
callback(*args)
File "/usr/local/lib/python2.7/dist-packages/tornado/stack_context.py", line 331, in wrapped
raise_exc_info(exc)
File "/usr/local/lib/python2.7/dist-packages/tornado/stack_context.py", line 302, in wrapped
ret = fn(*args, **kwargs)
File "/usr/local/streaming/twitter-stream.py", line 203, in parse_json
self.parse_response(response)
File "/usr/local/streaming/twitter-stream.py", line 226, in parse_response
self._callback(response)
File "fetch_script.py", line 57, in callback
print msg['text']
UnicodeEncodeError: 'ascii' codec can't encode character u'\u2026' in position 139: ordinal not in range(128)
ERROR:tornado.application:Exception in callback <functools.partial object at 0x187c2b8>
Traceback (most recent call last):
File "/usr/local/lib/python2.7/dist-packages/tornado/ioloop.py", line 458, in _run_callback
callback()
File "/usr/local/lib/python2.7/dist-packages/tornado/stack_context.py", line 331, in wrapped
raise_exc_info(exc)
File "/usr/local/lib/python2.7/dist-packages/tornado/stack_context.py", line 302, in wrapped
ret = fn(*args, **kwargs)
File "/usr/local/lib/python2.7/dist-packages/tornado/iostream.py", line 341, in wrapper
callback(*args)
File "/usr/local/lib/python2.7/dist-packages/tornado/stack_context.py", line 331, in wrapped
raise_exc_info(exc)
File "/usr/local/lib/python2.7/dist-packages/tornado/stack_context.py", line 302, in wrapped
ret = fn(*args, **kwargs)
File "/usr/local/streaming/twitter-stream.py", line 203, in parse_json
self.parse_response(response)
File "/usr/local/streaming/twitter-stream.py", line 226, in parse_response
self._callback(response)
File "fetch_script.py", line 57, in callback
print msg['text']
UnicodeEncodeError: 'ascii' codec can't encode character u'\u2026' in position 139: ordinal not in range(128)
PS
もう少しコンテキスト：
関数でエラーが発生していcallbackます:
def callback(self, message):
if message:
msg = message
msg_props = pika.BasicProperties()
msg_props.content_type = 'application/text'
msg_props.delivery_mode = 2
#print self.count
print msg['text']
#self.count += 1
...
ただし、削除 して両方のケース['text']のみを有効にすると、魅力的に機能します。print msg