I am trying to write a custom spider for retrieving information on Indian DVDs but having major problems. Here is what I did:
- Went to a site that maintains database of Indian CD/DVDs ([url]indiancdstore.com[/url]. Typed a search term "kehna" and grabbed the URL which is as follows
- Code: Select all
url=http://www.indiancdstore.com/ssearch.asp?keywords=[color=red]%searchstring%[/color]
results=<td width='100%' colspan='2' bgcolor='#1E4CA9' ><strong><small><font color='#FFFFFF' face='Arial' > 1. <a href='[color=red](?<url>/viewdetails.asp?p_id=.*?)[/color]'class='l'>[color=red](?<display>.*?)[/color]</a></font></small></strong></td>
http://www.indiancdstore.com/ssearch.asp?keywords=kehna
Went to the above URL, opened the source-code and found following HTML code of interest
<td width='100%' colspan='2' bgcolor='#1E4CA9' ><strong><small><font color='#FFFFFF' face='Arial' > 1. <a href='viewdetails.asp?p_id=139'class='l'>Kissi Se Na Kehna - Movie DVD </a></font></small></strong></td>
So, I went ahead and created following xml code
When I do a search with similar term in xlobby, it does seem to be searching and downloading info but the "search result" box is empty.
What am I doing wrong ?
Thanks