spiders fcuk'ed?

[S Pittaway]

Most of my spiders dont work anymore...

imdb, wallmart and dvdtown are the only ones which work reliably for me.

I am using the latest versions of the spiders/exe, anyone know whats up?


If they do work for you could you show me the contents of a few so i can see if anythings differant?




Cheers, Sean.

[dgemily]

Most of my spiders dont work anymore...

imdb, wallmart and dvdtown are the only ones which work reliably for me.

I am using the latest versions of the spiders/exe, anyone know whats up?

yep, look at this post... : http://www.xlobby.com/forum/viewtopic.php?t=4929

[scalt]

I was having some issues w/ the amazon music spider. I modified it, and now it works (amazon had changed their layout)

Code: Select all

url=http://www.amazon.com/exec/obidos/search-handle-url/%20index=music&field-keywords=%searchstring%
results=<td style="border-bottom: 1px dashed #999; padding-bottom: 10px" width="33%" valign="top">.*?<a href="(?<url>http://www.amazon.com/exec/obidos/tg/detail/.*?)>(?<display>.*?)</a>

//find coverart <url> tag will open that url and use next regex
//find coverart
amz_js_PopWin\('(?<url>http://www.amazon.com/gp/product/images/.*?)'
<div id="imageViewerDiv"><img src="(?<coverart>http://.*?images.amazon.com/images/P/.*?)".*?></div>


Hope this helps

[S Pittaway]

i do get search results with that one, but i still get no covers...

Like digi said i guess something has been brokken in the last few releases...

[tswhite70]

I've uploaded a zip of working DVD spiders - Amazon & Buy.com have updated their websites so they were broken. Also included DVDTown and IMPAwards in case you don't have them. Walmart and IMDB are still working from Steven's last release although the %variable% functionality is broken as stated in the other post on spiders. I've tested all these with the latest release - they will all get coverart.

http://home.houston.rr.com/rswhite/spiders/UpdatedDVDSpiders.zip

Updated: 12/03/2006 - New version of the IMPAwards.com spider, removed the DVDTown.com spider...

good luck,
tsw

[cmhardwick]

Thanks for the fixes! I'm able to update (read get better ones) the covers on several movies.

[S Pittaway]

yep, cheers that gets thye movies back up and running.


Sean.

[slaman]

broken again... did dvdtown change their site and take down highres covers?

Any other sites that offer high-res front-covers? (Not the front/back scans like cdcovers.cc)

[tswhite70]

DVDTown was offline this past weekend while they redid their entire site. I'll try and update the spider this weekend.

Try impawards.com spider for another source of hi-res coverart.

tsw

[tswhite70]

Scratch that, I took a look at DVDTown tonight and the changes they have made won't work with our spiders, they have a added a second layer of listings that we can't navigate. Plus they've jacked the search function all up - pretty useless at this point. Supposedly they are still working on bugs and features so maybe they will fix things up in the future. I'll keep an eye on it as it USED to be my favorite DVD site....

good luck,
tsw

[slaman]

tswhite70 - any other sources for easily searchable (spiderable) coverart for movies?

[slaman]

tswhite70 - any other sources for easily searchable (spiderable) coverart for movies?

[tswhite70]

No, nothing new. I'm still using Impawards.com for most of my coverart, if they don't have a cover at all or a cover I like then I'll try Amazon.com or download manually from DVDTown.

DVDTown has really gone down hill as far as I'm concerned with their new site design - and a lot of their covers now have watermarks on them. Buy.com used to have pretty good coverart but most of theirs has white borders these days.

good luck,
tsw

[slaman]

Thanks - I was under the impression that IMPAwards.com was posters and not DVD coverart?

Anyways, I'm more concerned about the "Actors" information - got a working spider that can grab this information from IMDB.com?

Thanks for the tips.

[tswhite70]

Technically - you are right Impawards.com is posters, but most of the time I prefer them over the actual DVD cover - that's just me though.

The only DVD spider pulling actors and directors right now is Amazon.com - hopefully Steven will fix the spider Variable functionality someday and we'll get IMDB working again.

So I'm actually saving the DVD info from Amazon, and then cutting and pasting the info I want from the IMDB spider (rating & year). I prefer the plots on Amazon so that's the easiest way for me.

good luck,
tsw