i want a java library, to search a text on Google and returns some pages based on text and semantic similarity. is there any API doing this job?
i wrote a crawler myself and search to specific depth from a root page, but i dont know how to input a text as a search query for Google.
Google provides the Custom Search API which you can use to search Google from code.
You'll need to create a google account if you don't already have one, create a custom search engine, generate an API key, and then use that as part of your request. You can get the results as JSON or as an Atom XML.
The documentation for this is available at https://developers.google.com/custom-search/v1/overview
There's no java library, as such, so to actually call the API, you'll need to either use java.net.URL and java.net.URLConnection, or a REST client library like the one that jersey ships with.
Related
I would like to scrape Content from a website with AlchemyAPI. I get informed about this feature on http://www.alchemyapi.com/api/scrape/qlang.html
I will implement it in the same way as in the example:"Querying Inside Tables (Selecting a Column Inside a Specific Row)".
Could somebody please help me, how to use this in Node.js and Cquery? Which parameters do I need to get specific fields like price as output?
No, it's not currently possible to do this. Since AlchemyAPI was acquired by IBM, the remaining services have been incorporated into Watson. Most of the AlchemyAPI services are now covered in the Natural Language Understanding (NLU) service: https://www.ibm.com/watson/developercloud/doc/natural-language-understanding/ but there is no feature that allows you to scrape content from a web site per se.
The NLU service does allow you to retrieve text from a web page using the analyze endpoint: https://www.ibm.com/watson/developercloud/natural-language-understanding/api/v1/#post-analyze
I am using Google Search Appliance (GSA) on a project. We wanted to use query expansion to make searching more effective. Currently we are using the front-end to upload the synonym file.
Is there an API which GSA provides to automatically upload the synonyms. An API does exist for Google Custom Search, but could not find one for GSA.
Thanks in advance.
There is not a direct API for this. The API to the administrative console can be found
http://www.google.com/support/enterprise/static/gsa/docs/admin/72/gsa_doc_set/acapi_protocol/index.html
You could write a screenscrapper and perform a form post to achieve what you are wanting to do.
I'm looking for a solution, where users of my site can use an image search engine (e.g. Google), instead of uploading an image, they can search and pick one of the results.
My problem is:
Google image search API is deprecated!
Google custom search requires me to add "sites to search" when creating a custom search API key. However, I do not want to search my own site, I want to search the internet!
Which Google API is ment to search images on the internet?
Would it be plausible to include normal image search in an iframe, and somehow capture an image selection (i.e. when clicked)?
Google made it really difficult:
http://groups.google.com/group/google-ajax-search-api/browse_thread/thread/9885ea5ab20b8f01?pli=1
http://support.google.com/customsearch/bin/answer.py?hl=en&answer=1210656
TL;DR: You have to use Google custom search, add a random site when creating the API key, afterwards you can tweak the settings to search the entire web instead.
Have you checked out LTU technology?
I found this url which JSON - seems to be the top results when searching google images:
https://ajax.googleapis.com/ajax/services/search/images?v=1.0&q=car
I'd like to implement autocompletions on a Google site search engine. This site uses the (paid) XML API however for customizing the results. Google's documentation only talks about autocompletion for the JS API with custom search.
Is it possible to fetch some XML or JSON feed with autocompletion data? Or is there some other way to achieve autocompletion without giving up on the XML search API?
I wrote my own autocomplete, see demo here: http://olegh.cc.st/autocomplete.html
If you have your own dictionary, and own WEB-server on unix-like platform, you
can run my autocomp. I can share sources for free.
Is it legal to use the google search results in my own website not using the google custom search that google provides?
I have 2 different cases:
The first is that I design a search box, with a google logo and provide options so the user selects which type of content (web, images, videos...), and the the results open in a new window with the normal google search results page. it means I submit the the search query from my website to the google search results.
The second is that I design both the search box and the results page so that the results are shown in my website instead of the google search results page.
I found an example for this:
http://demo.tutorialzine.com/2010/09/google-powered-site-search-ajax-jquery/search.html
NB: In both of the cases I will include a google logo and link to the original google.com website as credit.
So which of the two cases or are they both legal?
Thanks.
You may be able to use the Google AJAX API for your purposes. See:
Am I allowed to use the Google AJAX Search API on my site?
Google also provides documentation for developers and example code.
For the legality of specific uses, you should refer to Google AJAX Search API Terms of Use and a lawyer. Good thing you said you don't want to use custom search, because the Google Custom Search Terms of service seem to specifically exclude using it with new windows and within frames in sections 1.4(b) and 1.4(c).