Is the IMDB Spider working?

Help each other out

Is the IMDB Spider working?

Postby Myth on Sat Jan 03, 2009 12:40 pm

Is the IMDB Spider working, as mine doesnt seem to get the info... has IMDB changed?
Thanks
Myth
Myth
 
Posts: 83
Joined: Sun May 09, 2004 9:48 am

Re: Is the IMDB Spider working?

Postby Cabinetguy on Sat Jan 03, 2009 1:38 pm

I'm thinking that they aren't anymore.
I wasn't able to get reliable info quite a while back, so I started using the Ant movie Catalog plugin, and haven't looked back.
There is alot of info here on the forum.

Brian
Cabinetguy
 
Posts: 86
Joined: Fri May 02, 2008 9:01 pm
Location: Largo, Florida, USA

Re: Is the IMDB Spider working?

Postby lar282 on Sat Jan 03, 2009 7:00 pm

url=http://us.imdb.com/find?s=all&q=%searchstring%;tt=1
results=<a href="(?<url>/title/.*?/).*?">(?<display>.*?)</a>


//title & year
<div id="tn15title">.*?<h1>(?<title>.*?) <span>\(<a href="/Sections/Years/.*?">(?<year>.*?)</a>\)</span></h1>

//Plot
//Single Line Plot
<h5>Plot:</h5>(?<plot>.*?)<

//Full Plot
//<h5>Plot Outline:</h5>.*?<a class="tn15more inline" href="(?<url>/title/tt.*?/plotsummary)" onClick=.*?more</a>
//<p class="plotpar">.*?(?<plot>.*?)<i>

//Directors
<h5>Director:</h5>(?<variable>.*?)<br/>
<a href="/name/.*?">(?<director>.*?)</a>

//Genre
<a href="/Sections/Genres/.*?/">(?<genre>.*?)</a> (?:/|<)

//Rating
<h5><a href="/mpaa">MPAA</a>:</h5>.*?Rated (?<rating>.*?\.).*?</div>

//Runtime
<h5>Runtime:</h5>.*?(?<runtime>.*?)</div>

//Actors
\(Cast overview, first billed only\)(?<variable>.*?)(?:<br/>|<hr/>)
<a href="/name/.*?">(?<actors>.*?)</a></td>




//Coverart
<a name="poster" href=.*? src="(?<coverart>.*?)"
// replace=coverart:VM._SY140_SX100_.jpg:VM._SY400_SX600_.jpg


// <div class="photo">
// <a name="poster" href="/media/rm3131217664/tt0811138" title="The Love Guru"><img border="0" alt="The Love Guru" title="The Love Guru" src="http://ia.media-imdb.com/images/M/MV5BMTg3OTY1MTQ3MF5BMl5BanBnXkFtZTcwMDIzMTM3MQ@@._V1._SX94_SY140_.jpg" /></a>
// </div>
lar282
 
Posts: 1624
Joined: Thu Apr 01, 2004 4:13 pm
Location: Helsingborg, Sweden

Re: Is the IMDB Spider working?

Postby Myth on Sat Jan 03, 2009 10:41 pm

Thanks, though the the photo section isnt right ;-)
Myth
 
Posts: 83
Joined: Sun May 09, 2004 9:48 am

Re: Is the IMDB Spider working?

Postby lar282 on Sun Jan 04, 2009 5:40 pm

sorry only use plot and coverart. got a direct imdb too if u want it.
lar282
 
Posts: 1624
Joined: Thu Apr 01, 2004 4:13 pm
Location: Helsingborg, Sweden

Re: Is the IMDB Spider working?

Postby slaman on Tue Jan 06, 2009 6:04 pm

Is IMPAwards.com spider not working either?
slaman
 
Posts: 145
Joined: Sat Oct 14, 2006 10:30 pm

Re: Is the IMDB Spider working?

Postby Myth on Fri Jan 09, 2009 9:56 am

lar282 wrote:sorry only use plot and coverart. got a direct imdb too if u want it.

Thanks, That would be good

Myth
Myth
 
Posts: 83
Joined: Sun May 09, 2004 9:48 am

IMDB direct

Postby lar282 on Fri Jan 09, 2009 11:25 am

url=http://us.imdb.com/find?q=%searchstring%;tt=1
results=src='/rg/title-tease/boards-top/images/b.gif.link=(?<url>.*?)board';">IMDb message board for (?<display>.*?)\s?\(.*?\)</a>


//title & year
<div id="tn15title">.*?<h1>(?<title>.*?) <span>\(<a href="/Sections/Years/.*?">(?<year>.*?)</a>\)</span></h1>
//Plot
//Single Line Plot
<div class="info">
<h5>Plot:</h5>(?<plot>.*?)</div>

//Full Plot
//<h5>Plot:</h5>.*?<a class="tn15more inline" href="(?<url>/title/tt.*?/plotsummary)" onClick=.*?more</a></div>.*?<p class="plotpar">.*?(?<plot>.*?)<i>

//Directors
<h5>Director:</h5>(?<variable>.*?)<br/>
<a href="/name/.*?">(?<director>.*?)</a>

//Genre
<a href="/Sections/Genres/.*?/">(?<genre>.*?)</a> (?:/|<)

//Rating
<h5><a href="/mpaa">MPAA</a>:</h5>.*?Rated (?<rating>.*?\.).*?</div>

//Runtime
<h5>Runtime:</h5>.*?(?<runtime>.*?)</div>

//Actors
\(Cast overview, first billed only\)(?<variable>.*?)(?:<br/>|<hr/>)
<a href="/name/.*?">(?<actors>.*?)</a></td>

//Coverart
<a name="poster" href="/media/.*?" title=.*?><img border="0" alt=.*? title=.*? src="(?<coverart>http://ia.imdb.com/media/imdb/.*?/VM._SY140_SX100_.jpg)" /></a>
replace=coverart:VM._SY140_SX100_.jpg:VM._SY400_SX600_.jpg
lar282
 
Posts: 1624
Joined: Thu Apr 01, 2004 4:13 pm
Location: Helsingborg, Sweden

Re: IMDB direct

Postby Myth on Sat Jan 10, 2009 9:36 am

Thanks
Myth
 
Posts: 83
Joined: Sun May 09, 2004 9:48 am

Re: Is the IMDB Spider working?

Postby slaman on Tue Jan 13, 2009 3:57 am

Would really appreciate an impawards.com one - they changed their format, but their coverart is so much higher quality tham imdb.
slaman
 
Posts: 145
Joined: Sat Oct 14, 2006 10:30 pm

Re: Is the IMDB Spider working?

Postby slaman on Tue Jan 27, 2009 5:26 pm

Is there anyway to "merge" two variables?

For example, the <url> tag has something like http://www.impawards.com/2003/21grams.html
and the coverart has a tag of "posters/21grams.jpg"

Is there a way to concatenate the <url> tag up until after the date and add on the coverart tag?
slaman
 
Posts: 145
Joined: Sat Oct 14, 2006 10:30 pm

Re: Is the IMDB Spider working?

Postby bsteed on Thu Jan 29, 2009 6:26 pm

OK, so I got the IMDB Spider to work from the first example you had posted, but not the second. However, all I get is a cover. I don't even want the cover, as I like to go to sites and download high-res ones, naming them folder.jpg.

How do I get XL2 to show me the other info it has found? Plot, Year, rating, genre? That's the information I truly want.

Thank you though, for the post on the spider. At least I have it showing something. It's a start.
bsteed
 
Posts: 23
Joined: Thu Jan 29, 2009 11:12 am

Re: Is the IMDB Spider working?

Postby lar282 on Thu Jan 29, 2009 6:58 pm

what movie title (exact) are u trying with. let me try here
the two examples I gave must be in seperates txt files, but I think u understood that.
//Lasse
lar282
 
Posts: 1624
Joined: Thu Apr 01, 2004 4:13 pm
Location: Helsingborg, Sweden

Re: Is the IMDB Spider working?

Postby bsteed on Thu Jan 29, 2009 8:13 pm

Um, I've tried with several. But lets say "300". I just get a little crappy cover image (i've screenshotted it), and cannot see anything esle. It even does it in the default skin. I backed up my database prior, and just clicked save to see if it downloaded any text into my movies.xml DB file, and it did not. I don't think it is finding the information correctly.

I was a little unclear what you meant when you said "Direct IMBD". Whats the difference between the two text examples you provided me?

By the way, thank you so much for you time! :D

01-29_317pmEST.jpg
Screen 001


Here is my spider file exactly: (its the only one I'm using)

dvd - imdb.com.txt
url=http://us.imdb.com/find?s=all&q=%searchstring%;tt=1
results=<a href="(?<url>/title/.*?/).*?">(?<display>.*?)</a>


//title & year
<div id="tn15title">.*?<h1>(?<title>.*?) <span>\(<a href="/Sections/Years/.*?">(?<year>.*?)</a>\)</span></h1>

//Plot
//Single Line Plot
<h5>Plot:</h5>(?<plot>.*?)<

//Full Plot
//<h5>Plot Outline:</h5>.*?<a class="tn15more inline" href="(?<url>/title/tt.*?/plotsummary)" onClick=.*?more</a>
//<p class="plotpar">.*?(?<plot>.*?)<i>

//Directors
<h5>Director:</h5>(?<variable>.*?)<br/>
<a href="/name/.*?">(?<director>.*?)</a>

//Genre
<a href="/Sections/Genres/.*?/">(?<genre>.*?)</a> (?:/|<)

//Rating
<h5><a href="/mpaa">MPAA</a>:</h5>.*?Rated (?<rating>.*?\.).*?</div>

//Runtime
<h5>Runtime:</h5>.*?(?<runtime>.*?)</div>

//Actors
\(Cast overview, first billed only\)(?<variable>.*?)(?:<br/>|<hr/>)
<a href="/name/.*?">(?<actors>.*?)</a></td>




//Coverart
<a name="poster" href=.*? src="(?<coverart>.*?)"
// replace=coverart:VM._SY140_SX100_.jpg:VM._SY400_SX600_.jpg


// <div class="photo">
// <a name="poster" href="/media/rm3131217664/tt0811138" title="The Love Guru"><img border="0" alt="The Love Guru" title="The Love Guru" src="http://ia.media-imdb.com/images/M/MV5BMTg3OTY1MTQ3MF5BMl5BanBnXkFtZTcwMDIzMTM3MQ@@._V1._SX94_SY140_.jpg" /></a>
// </div>
___________________________________________________
END OF DOCUMENT


Also, in my spider screen, I only have these elements.

- text (category>spider>cover)
- text (category>spider>title)
- text (category>spider>from)
- text (category>spider>position)
- spiderstatus
- spider ? (i just realized was hidden, looks like thumbnails of results)
bsteed
 
Posts: 23
Joined: Thu Jan 29, 2009 11:12 am

Re: Is the IMDB Spider working?

Postby bsteed on Thu Jan 29, 2009 9:14 pm

Ok, so I kept searching for answers, via the foumns, and found out why I can't see the info on the spider screen.

I wasn't using the category>spider>info

I didn't even know it existed, as it wasn't even in the default skin. Crazy, i know. I'm not sure why that was left out, as I feel it is extremely important.

01-29_426pmEST.jpg
after the spiderinfo was added and displayed


PROBLEM STILL REMAINING:
When I click save, the only thing that saves is the cover. It merely replaces the high-res one I had previously. I see the plot though now, and the genre, rating, etc. I also notice that the | symbol (which serpates the various genres) is there. I remember reading that this is bad for XML. Could that be the issue at hand, and if so, how the heck to I fix it.

I tried adding blank tags to the movies.xml DB file (named properly), in hopes that it was merely a problem with finding where to write it. No avail.

Also, is it possible to see the cover art in the spider window, but not use it wheny ou click save? I think it would make identfying plots much easier, especially on movies i have yet to see (it would be impossible -- I'd have to manualyl compare plots, which defeats the puropse).
bsteed
 
Posts: 23
Joined: Thu Jan 29, 2009 11:12 am

Next