Regret for the late reply!
I have been able to crack the problem!
I have used urllib2 and beautifulsoup library for the problem!
I have another issue with this link:
click here for the webpage
In this webpage there is a form which uses ajax call on every interaction on the form!
I need to scrap the data for all the products in this form. I have been able to scrap it using python and selenium which is able to take care of the ajax call. But this approach is very slow, it takes around one and half hour to crawl on all the products.
I did some research on making a request to the webpage using library ‘Requests’ which would respond in either json or xml format.
But i am unable to implement in this problem. The problem is in creating the request,like the parameters which i need to include after inspecting the network elements of the webpage!
My basic point of confusion is how do we send the request to the server having all the parameters of the request.
Once the request is done properly i hope using BeautifulSoup we can get the data required.
It would be a great help if you can guide me in learning this stuff. Kindly help me!
Once again thanks for your reply!
Happy Holidays and Happy New Year!