I can't see a way to get the body of the post from the database from this side, so I think I'll try to scrape it out as well. Shouldn't be impossible, but it'd be easier with the database in my hands >crazy madman laugh<
V
V
RSS Forum Feeds?
- Thread starter ingenious
- Start date
>crazy madman laugh< you've just blown your opportunity to host the database yourself gnignigni.
V if you could scrape the topic too, that would be wonderful just like the real thing & we wouldn't see the diff, but pls don't cause then I owe you even more than I do already ;-)
BTW hug Alexander for me & see hi to mrs. V forgot that in my e-mail. & yes I do tend to make my life one big thread with the use of all possible media.
V if you could scrape the topic too, that would be wonderful just like the real thing & we wouldn't see the diff, but pls don't cause then I owe you even more than I do already ;-)
BTW hug Alexander for me & see hi to mrs. V forgot that in my e-mail. & yes I do tend to make my life one big thread with the use of all possible media.
Hmmm. I've just had a quick look at scraping the text of the posts as well. It'll be bandwidth intensive, since I can't pluck out just the most recent post, I've got to scrape each thread and pull out relevant data. If anyone's got access to the mysql/sql, let me know.
But I should be able to get topic title and text, and maybe some other stuff
However, I'm in the office and really busy - typical V, I can't resist trying to knock together the php, but I've got no time! Ok, have to stop for 30 mins while I do some work that I actually get paid for :wink:
TGI Friday.
V
PS - you should see my rss reader for the new website. It's scraping no end of juicy good stuff, and spits it out in a 100 page summary of all the news I can eat. Adding XDA forums rss feeds will mean I can finally turn off my vestigial worm like body and turn into a true all knowing God Emperor.
But I should be able to get topic title and text, and maybe some other stuff
However, I'm in the office and really busy - typical V, I can't resist trying to knock together the php, but I've got no time! Ok, have to stop for 30 mins while I do some work that I actually get paid for :wink:
TGI Friday.
V
PS - you should see my rss reader for the new website. It's scraping no end of juicy good stuff, and spits it out in a 100 page summary of all the news I can eat. Adding XDA forums rss feeds will mean I can finally turn off my vestigial worm like body and turn into a true all knowing God Emperor.
Guys,
Give this a go (it's an rss feed btw):
http://www.vijay555.com/scrape/xdaall.php
This will attempt to gather all of the recent activity from the board from the main portal page. It's an intensive process to gather the necessary info, and some news readers will timeout doing it.
Thus, give this one a go instead:
http://www.vijay555.com/scrape/xda10.php
This is the 10 most recent posts.
Let me know how if it works for you.
Test it out here:
Google Reader (It's nicer then reading the board)
V
Give this a go (it's an rss feed btw):
http://www.vijay555.com/scrape/xdaall.php
This will attempt to gather all of the recent activity from the board from the main portal page. It's an intensive process to gather the necessary info, and some news readers will timeout doing it.
Thus, give this one a go instead:
http://www.vijay555.com/scrape/xda10.php
This is the 10 most recent posts.
Let me know how if it works for you.
Test it out here:
Google Reader (It's nicer then reading the board
)V
V they're both working very fine on my side, it's not even slow on my magician to download all of the data.
@rebellish: why wasn't this url advertised more? I've been looking for about half a year for it, but I'm a happy kid in the candy store now :-D
Thanks all of you
@rebellish: why wasn't this url advertised more? I've been looking for about half a year for it
, but I'm a happy kid in the candy store now :-DThanks all of you
I'd seen the fourm-30.rss link a while back on the news page - it works well for me. I wonder why I bothered making my scraper now, I thought the old .rss must have broken, but it works well AFAIK.
My scraper is slightly better IMHO, as it scrapes full html with formatting where possible.
V
My scraper is slightly better IMHO, as it scrapes full html with formatting where possible.
V
For my rss news reading on the PC and PDA, I have a gregarius set up that I use and that will be launched with my new website.
But otherwise, I read it a browser I wrote that reads RSS.
V
But otherwise, I read it a browser I wrote that reads RSS.
V
