Spiders

title says it all

Re: Spiders

Postby Grooby on Mon Feb 11, 2008 9:58 pm

Really looking forward to your spider plugin, this is the one major item i miss from when i used to mess around with Meedio years ago before i came back to Xlobby free... 8)
skinning for the fun of it
Grooby
 
Posts: 444
Joined: Tue May 18, 2004 12:53 pm
Location: England

Re: Spiders

Postby tswhite70 on Tue Feb 12, 2008 6:41 pm

homepc - The Pre-Calrad version of XL did not have any internally built spiders that I'm aware of except for the IMDB Stills function under F2, which no longer works. You'll need to review the actual commands associated with the Spider events for the skin you are using to see what they are doing...

For the Pre-Calrad version of Xlobby are there are only 4 Spider commands available:
Xlobby\Spider Save
Xlobby\Spider Save Info
Xlobby\Spider Search
Xlobby\Spider Set *This is the only spider command that has variables associated with it (Optional Category, Spider(s) txt files to use)

good luck,
tsw
Image
tswhite70
 
Posts: 319
Joined: Tue Jan 06, 2004 3:44 pm
Location: Houston, Tx

Re: Spiders

Postby homepc on Tue Feb 12, 2008 9:02 pm

Great thanks tswhite70. Can I assume that the "Xlobby\Spider Search" will use all the spiders that are located in the spiders folder?
homepc
 
Posts: 251
Joined: Tue Mar 20, 2007 1:27 pm
Location: Delaware

Re: Spiders

Postby tswhite70 on Thu Feb 14, 2008 7:32 pm

You need to set the spider to use via Spider Set prior to running the search:

music* - would use all the music spiders
dvd* - would use all the DVD spiders
dvd-imdb.com - would use only the IMDB spider

Just as an example in my setup - my spider overlay for DVD's sets the spider to dvd-impawards.com when it opens the overlay. So my default search is always impawards.com. But I also have "Modify" button on the overlay that opens another overlay with buttons for Amazon, IMDB, Buy.Com, etc - each of those buttons uses Spider Set to select the correct spider. Then I click search again to search that particular site, since personally I'm only interested in updating my coverart this works real well for me.. (I do info via F2 so I can manually modify the fields to my liking)

I don't know if XL has a "default" Spider Set already configured, or if maybe it uses all the spiders like you said, it's possible.

good luck,
tsw
Image
tswhite70
 
Posts: 319
Joined: Tue Jan 06, 2004 3:44 pm
Location: Houston, Tx

Re: Spiders

Postby homepc on Thu Feb 14, 2008 9:45 pm

tswhite70, ok thanks! I'll play with it more and see.......
homepc
 
Posts: 251
Joined: Tue Mar 20, 2007 1:27 pm
Location: Delaware

Updated DVD Spiders

Postby tswhite70 on Sun Feb 24, 2008 10:56 pm

I updated some of my DVD spiders this weekend....Amazon, IMDB, IMDB_Direct, & Buy.com have all been updated.

http://home.comcast.net/~twhite644/spid ... piders.zip

good luck,
tsw
Image
tswhite70
 
Posts: 319
Joined: Tue Jan 06, 2004 3:44 pm
Location: Houston, Tx

Re: Spiders

Postby lar282 on Fri May 23, 2008 8:26 am

tswhite, u got time to update IMDB, IMDB_Direct again? I don't get any info anymore from them?
Cover seems to work but only sometimes!

//Lasse
Image
lar282
 
Posts: 1682
Joined: Thu Apr 01, 2004 4:13 pm
Location: Helsingborg, Sweden

Re: Spiders

Postby slaman on Sat May 24, 2008 4:27 am

And Plot too.... I played around with it for a while but that stupid "|" character is killing it...
slaman
 
Posts: 147
Joined: Sat Oct 14, 2006 10:30 pm

Re: Spiders

Postby S Pittaway on Sat May 24, 2008 2:21 pm

Yep i havent had a plot from imdb for ages now...
S Pittaway
 
Posts: 713
Joined: Wed Jan 25, 2006 11:08 am
Location: Manchester, England

Re: Spiders

Postby lar282 on Mon May 26, 2008 6:49 am

tswhite70 , the regex master, we need you.


//Lasse
Image
lar282
 
Posts: 1682
Joined: Thu Apr 01, 2004 4:13 pm
Location: Helsingborg, Sweden

Re: Spiders

Postby Nex on Mon May 26, 2008 10:29 pm

It changed from "Plot Outline" to just "Plot"

Code: Select all
//Plot
//Single Line Plot
<h5>Plot:</h5>(?<plot>.*?)</div>

//Full Plot
<h5>Plot:</h5>.*?<a class="tn15more inline" href="(?<url>/title/tt.*?/plotsummary)" onClick=.*?more</a>
<p class="plotpar">.*?(?<plot>.*?)<i>


I also changed the rating variable to provide the user rating:

Code: Select all
//Rating
<b>User Rating:</b>.?<b>(?<rating>.*?)/10</b>


I just hacked this together by trial and error so please no requests :)

EDIT: More hacking....

The above expression for full plot grabs all the plots, if you just want the first one use this:
Code: Select all
//Full Plot
<h5>Plot:</h5>.*?<a class="tn15more inline" href="(?<url>/title/tt.*?/plotsummary)" onClick=.*?more</a>
</div>.*?<p class="plotpar">.*?(?<plot>.*?)<i>
Nex
 
Posts: 2
Joined: Mon May 26, 2008 10:21 pm

Re: Spiders

Postby lar282 on Wed May 28, 2008 7:47 am

Thanks for the update rex.

this is wierd though. If I search (Using imdb.com.txt) for the movie 21 in the F2 database spider section it all works. If I do it in the default skin no plot is there? How can that be.

Can someone confirm this please


//Lasse
Image
lar282
 
Posts: 1682
Joined: Thu Apr 01, 2004 4:13 pm
Location: Helsingborg, Sweden

Re: Spiders

Postby slaman on Thu May 29, 2008 2:54 am

Didn't work...

tested using "Flawless" and "Semi-Pro".
slaman
 
Posts: 147
Joined: Sat Oct 14, 2006 10:30 pm

Re: Spiders

Postby lar282 on Thu May 29, 2008 6:27 am

I do think we have a bug then. I mean if it works under F2 but not in the skin we're in trouble. Wes can u confirm also and maybe hand over to Steven?


//Lasse
Image
lar282
 
Posts: 1682
Joined: Thu Apr 01, 2004 4:13 pm
Location: Helsingborg, Sweden

Re: Spiders

Postby Nex on Fri May 30, 2008 10:25 pm

This my hacked version of tswhite70's dvd - imdb.com spider - so big thanks to him.

Note: Doesn't work with multiple directors, does work for "Flawless"

Code: Select all
url=http://us.imdb.com/find?q=%searchstring%;tt=1
results=<a href="(?<url>/title/.*?/).*?">(?<display>.*?)</a>

//title & year
<div id="tn15title">.*?<h1>(?<title>.*?) <span>\(<a href="/Sections/Years/.*?">(?<year>.*?)</a>\)</span></h1>

//Directors
<h5>Director:</h5>.?<a href="/name/.*?">(?<director>.*?)</a>

//Genre
<a href="/Sections/Genres/.*?/">(?<genre>.*?)</a> (?:/|<)

//Rating
<b>User Rating:</b>.?<b>(?<rating>.*?)/10</b>

//Runtime
<h5>Runtime:</h5>.*?(?<runtime>.*?)</div>

//Single Line Plot
<h5>Plot:</h5>(?<summary>.*?)<a

//Full Plot
<h5>Plot:</h5>.*?<a class="tn15more inline" href="(?<url>/title/tt.*?/plotsummary)" onClick=.*?more</a>
</div>.*?<p class="plotpar">.*?(?<plot>.*?)<i>
Nex
 
Posts: 2
Joined: Mon May 26, 2008 10:21 pm

PreviousNext

Return to Tips and Tricks

Who is online

Users browsing this forum: No registered users and 1 guest

cron