「define:[phrase]」など、Googleの特別な機能を使用した検索結果を取得したいのですが、これに関連する情報が見つからないようです。
結果ページを手動でスクレイピングせずに(Googleの他のAPIのように)JSON形式でデータを取得できる場所を知っている人はいますか?
ありがとう、エリ
「define:[phrase]」など、Googleの特別な機能を使用した検索結果を取得したいのですが、これに関連する情報が見つからないようです。
結果ページを手動でスクレイピングせずに(Googleの他のAPIのように)JSON形式でデータを取得できる場所を知っている人はいますか?
ありがとう、エリ
数日後に答えに出くわしたので、これに報奨金を設定しなかったらよかったのに、それは本当に簡単です。
好きな定義が必要な場合に呼び出す URL は次のとおりです。
http://www.google.com/dictionary/json?callback=a&sl=en&tl=en&q=love
次の内容の JSONP を含む応答ストリームを取得します (学習目的で「整形」され、API はすべてを 1 行で返します)。
a(
{
"query":"love",
"sourceLanguage":"en",
"targetLanguage":"en",
"primaries":[
{
"type":"headword",
"terms":[
{
"type":"text",
"text":"love",
"language":"en",
"labels":[
{
"text":"Noun",
"title":"Part-of-speech"
}
]
},
{
"type":"phonetic",
"text":"/ləv/",
"language":"und"
},
{
"type":"sound",
"text":"http://www.gstatic.com/dictionary/static/sounds/de/0/love.mp3",
"language":"und"
}
],
"entries":[
{
"type":"related",
"terms":[
{
"type":"text",
"text":"loves",
"language":"und",
"labels":[
{
"text":"plural"
}
]
}
]
},
{
"type":"meaning",
"terms":[
{
"type":"text",
"text":"An intense feeling of deep affection",
"language":"en"
}
],
"entries":[
{
"type":"example",
"terms":[
{
"type":"text",
"text":"babies fill parents with intense feelings of \x3cem\x3elove\x3c/em\x3e",
"language":"en"
}
]
},
{
"type":"example",
"terms":[
{
"type":"text",
"text":"their \x3cb\x3e\x3cem\x3elove\x3c/em\x3e for\x3c/b\x3e their country",
"language":"en"
}
]
}
]
},
{
"type":"meaning",
"terms":[
{
"type":"text",
"text":"A deep romantic or sexual attachment to someone",
"language":"en"
}
],
"entries":[
{
"type":"example",
"terms":[
{
"type":"text",
"text":"it was \x3cem\x3elove\x3c/em\x3e at first sight",
"language":"en"
}
]
},
{
"type":"example",
"terms":[
{
"type":"text",
"text":"they were both \x3cb\x3ein \x3cem\x3elove\x3c/em\x3e with\x3c/b\x3e her",
"language":"en"
}
]
},
{
"type":"example",
"terms":[
{
"type":"text",
"text":"we were slowly \x3cb\x3efalling in \x3cem\x3elove\x3c/em\x3e\x3c/b\x3e",
"language":"en"
}
]
}
]
},
{
"type":"meaning",
"terms":[
{
"type":"text",
"text":"A personified figure of \x3cem\x3elove\x3c/em\x3e, often represented as Cupid",
"language":"en"
}
]
},
{
"type":"meaning",
"terms":[
{
"type":"text",
"text":"A great interest and pleasure in something",
"language":"en"
}
],
"entries":[
{
"type":"example",
"terms":[
{
"type":"text",
"text":"his \x3cb\x3e\x3cem\x3elove\x3c/em\x3e for\x3c/b\x3e football",
"language":"en"
}
]
},
{
"type":"example",
"terms":[
{
"type":"text",
"text":"we share a \x3cb\x3e\x3cem\x3elove\x3c/em\x3e of\x3c/b\x3e music",
"language":"en"
}
]
}
]
},
{
"type":"meaning",
"terms":[
{
"type":"text",
"text":"Affectionate greetings conveyed to someone on one\x27s behalf",
"language":"en"
}
]
},
{
"type":"meaning",
"terms":[
{
"type":"text",
"text":"A formula for ending an affectionate letter",
"language":"en"
}
],
"entries":[
{
"type":"example",
"terms":[
{
"type":"text",
"text":"take care, lots of \x3cem\x3elove\x3c/em\x3e, Judy",
"language":"en"
}
]
}
]
},
{
"type":"meaning",
"terms":[
{
"type":"text",
"text":"A person or thing that one \x3cem\x3eloves\x3c/em\x3e",
"language":"en"
}
],
"entries":[
{
"type":"example",
"terms":[
{
"type":"text",
"text":"she was \x3cb\x3ethe \x3cem\x3elove\x3c/em\x3e of his life\x3c/b\x3e",
"language":"en"
}
]
},
{
"type":"example",
"terms":[
{
"type":"text",
"text":"their two great \x3cem\x3eloves\x3c/em\x3e are tobacco and whiskey",
"language":"en"
}
]
}
]
},
{
"type":"meaning",
"terms":[
{
"type":"text",
"text":"A friendly form of address",
"language":"en"
}
],
"entries":[
{
"type":"example",
"terms":[
{
"type":"text",
"text":"it\x27s all right, \x3cem\x3elove\x3c/em\x3e",
"language":"en"
}
]
}
]
},
{
"type":"meaning",
"terms":[
{
"type":"text",
"text":"Used to express affectionate approval for someone",
"language":"en"
}
],
"entries":[
{
"type":"example",
"terms":[
{
"type":"text",
"text":"don\x27t fret, there\x27s a \x3cem\x3elove\x3c/em\x3e",
"language":"en"
}
]
}
]
},
{
"type":"meaning",
"terms":[
{
"type":"text",
"text":"(in tennis, squash, and some other sports) A score of zero; nil",
"language":"en"
}
],
"entries":[
{
"type":"example",
"terms":[
{
"type":"text",
"text":"\x3cem\x3elove\x3c/em\x3e fifteen",
"language":"en"
}
]
},
{
"type":"example",
"terms":[
{
"type":"text",
"text":"he was down two sets to \x3cem\x3elove\x3c/em\x3e",
"language":"en"
}
]
}
]
}
]
},
{
"type":"headword",
"terms":[
{
"type":"text",
"text":"love",
"language":"en",
"labels":[
{
"text":"Verb",
"title":"Part-of-speech"
}
]
},
{
"type":"phonetic",
"text":"/ləv/",
"language":"und"
},
{
"type":"sound",
"text":"http://www.gstatic.com/dictionary/static/sounds/de/0/love.mp3",
"language":"und"
}
],
"entries":[
{
"type":"related",
"terms":[
{
"type":"text",
"text":"loved",
"language":"und",
"labels":[
{
"text":"past participle"
}
]
},
{
"type":"text",
"text":"loves",
"language":"und",
"labels":[
{
"text":"3rd person singular present"
}
]
},
{
"type":"text",
"text":"loving",
"language":"und",
"labels":[
{
"text":"present participle"
}
]
},
{
"type":"text",
"text":"loved",
"language":"und",
"labels":[
{
"text":"past tense"
}
]
}
]
},
{
"type":"meaning",
"terms":[
{
"type":"text",
"text":"Feel a deep romantic or sexual attachment to (someone)",
"language":"en"
}
],
"entries":[
{
"type":"example",
"terms":[
{
"type":"text",
"text":"do you \x3cem\x3elove\x3c/em\x3e me?",
"language":"en"
}
]
}
]
},
{
"type":"meaning",
"terms":[
{
"type":"text",
"text":"Like very much; find pleasure in",
"language":"en"
}
],
"entries":[
{
"type":"example",
"terms":[
{
"type":"text",
"text":"I\x27d \x3cem\x3elove\x3c/em\x3e a cup of tea, thanks",
"language":"en"
}
]
},
{
"type":"example",
"terms":[
{
"type":"text",
"text":"I just \x3cem\x3elove\x3c/em\x3e dancing",
"language":"en"
}
]
},
{
"type":"example",
"terms":[
{
"type":"text",
"text":"a fun-\x3cem\x3eloving\x3c/em\x3e girl",
"language":"en"
}
]
}
]
}
]
}
]
}
,200,null)
Google Dictionary API は、コールバック関数 (JSONP) の形式で返します。関数呼び出し内で JSON を処理する前に、コールバック関数のデータを取り除く必要があります。
{これは、最初の の前と最後の の後のすべてを削除することを意味します}。
この後、完了です。必要な情報はこれですべてです。Google で「define love.
from bs4 import BeautifulSoup
import requests
word = "democracy"
url = 'https://www.google.co.in/search?q=define%20' + word + '#cns=1'
response = requests.get(url, headers={"user-agent":"Mozilla/5.0(Macintosh; Intel Mac OS X 10.12; rv:49.0) Gecko/20100101 Firefox/49.0"})
html = response.content
final_soup = BeautifulSoup(html,"html5lib")
everyThing = final_soup.select("div._Jig")
for line in everyThing:
print("-",line.text)
Google から単語の定義を取得するために、このスクリプトを作成しました。役に立てば幸いですが、APIを使用していません。