Comments on: Here come the scrAPIs! http://thormuller.com/netpositive/2006/03/02/here-come-the-scrapis/ In defense of irrational exuberance Thu, 21 Aug 2008 17:17:16 +0000 http://wordpress.org/?v=2.6 By: Breyten’s Dev Blog » Blog Archive » links for 2006-05-11 http://thormuller.com/netpositive/2006/03/02/here-come-the-scrapis/#comment-142 Breyten’s Dev Blog » Blog Archive » links for 2006-05-11 Wed, 17 May 2006 11:17:32 +0000 http://thormuller.com/netpositive/2006/03/02/here-come-the-scrapis/#comment-142 [...] netpositive | Here come the scrAPIs! “It’s time to stop building scrapers and start building scrAPIs.” (tags: api xml scrapi mashups web2.0) [...] [...] netpositive | Here come the scrAPIs! “It’s time to stop building scrapers and start building scrAPIs.” (tags: api xml scrapi mashups web2.0) [...]

]]> By: tijs.org » Blog Archive » Program all of the web http://thormuller.com/netpositive/2006/03/02/here-come-the-scrapis/#comment-141 tijs.org » Blog Archive » Program all of the web Mon, 08 May 2006 12:20:26 +0000 http://thormuller.com/netpositive/2006/03/02/here-come-the-scrapis/#comment-141 [...] Altough most modern web applications have an API, many do not. For the rest we have site scrapers. Thor Muller suggests (follow up here) we open up our scapers with their own scrAPI to get to those now hard to reach sources of nfo into the mashup mix. [...] [...] Altough most modern web applications have an API, many do not. For the rest we have site scrapers. Thor Muller suggests (follow up here) we open up our scapers with their own scrAPI to get to those now hard to reach sources of nfo into the mashup mix. [...]

]]> By: THINK / Musings » Blog Archive » Scraping data and API’s http://thormuller.com/netpositive/2006/03/02/here-come-the-scrapis/#comment-140 THINK / Musings » Blog Archive » Scraping data and API’s Sun, 26 Mar 2006 10:05:53 +0000 http://thormuller.com/netpositive/2006/03/02/here-come-the-scrapis/#comment-140 [...] I was wondering how easy it would be to build a generic approach to opening up API’s on web sites who didnt formally publish them and then last night I saw this post about scrAPI’s.    Great stuff—would like to be able to cut and paste data sources and mix them together myself.   I find myself doing manually today too often (eg: the other night I was cutting and pasting rotten tomatoes reviews vs. a movie database).   So many mashup’s today and based on geo location data—its like my one year old who has six or seven words, most everything is at some point “hot”.    Latitude and longitude are just the easiest and first data source to be mined—things are going to get a lot more interesting as the data sources become increasingly diverse.  I look forward to Muller’s coming posts on the business and legal issues regarding scpAPIng. Posted by John Filed in think, building blocks, API's [...] [...] I was wondering how easy it would be to build a generic approach to opening up API’s on web sites who didnt formally publish them and then last night I saw this post about scrAPI’s.    Great stuff—would like to be able to cut and paste data sources and mix them together myself.   I find myself doing manually today too often (eg: the other night I was cutting and pasting rotten tomatoes reviews vs. a movie database).   So many mashup’s today and based on geo location data—its like my one year old who has six or seven words, most everything is at some point “hot”.    Latitude and longitude are just the easiest and first data source to be mined—things are going to get a lot more interesting as the data sources become increasingly diverse.  I look forward to Muller’s coming posts on the business and legal issues regarding scpAPIng. Posted by John Filed in think, building blocks, API’s [...]

]]> By: Richard K Miller dot coooooooooom » scrAPIs http://thormuller.com/netpositive/2006/03/02/here-come-the-scrapis/#comment-139 Richard K Miller dot coooooooooom » scrAPIs Sat, 25 Mar 2006 17:38:19 +0000 http://thormuller.com/netpositive/2006/03/02/here-come-the-scrapis/#comment-139 [...] Sources: ThorMuller.com ProgrammableWeb.com [...] [...] Sources: ThorMuller.com ProgrammableWeb.com [...]

]]> By: Thor http://thormuller.com/netpositive/2006/03/02/here-come-the-scrapis/#comment-138 Thor Thu, 23 Mar 2006 15:41:31 +0000 http://thormuller.com/netpositive/2006/03/02/here-come-the-scrapis/#comment-138 Thanks for your enthusiasm, Sean. I'll be posting suggestions (and launching a wiki) for a specific grassroots initiative around scrAPIs in the next week or so. It'll be managed by the community of users, so it should be a great vehicle for the great scraping work you're doing. Thanks for your enthusiasm, Sean. I’ll be posting suggestions (and launching a wiki) for a specific grassroots initiative around scrAPIs in the next week or so. It’ll be managed by the community of users, so it should be a great vehicle for the great scraping work you’re doing.

]]> By: seanohagan http://thormuller.com/netpositive/2006/03/02/here-come-the-scrapis/#comment-136 seanohagan Thu, 23 Mar 2006 01:48:23 +0000 http://thormuller.com/netpositive/2006/03/02/here-come-the-scrapis/#comment-136 Sounds like a great idea! I've created two web scrapers for myself over the last few years: one to scrape a specific used book site, and more recently a very generic one as a command (called <a href="http://www.yubnub.org/kernel/man?args=scrape" title="man page for scrape" rel="nofollow">scrape</a>) at <a href="http://www.yubnub.org" title="social command-line for the web" rel="nofollow">YubNub</a> which allows almost any site to be scraped (although only for a consecutive block of text). I'd be very interested in seeing a project like this get started and would like to contribute if I could. Sounds like a great idea! I’ve created two web scrapers for myself over the last few years: one to scrape a specific used book site, and more recently a very generic one as a command (called scrape) at YubNub which allows almost any site to be scraped (although only for a consecutive block of text).

I’d be very interested in seeing a project like this get started and would like to contribute if I could.

]]> By: ProgrammableWeb.com » Blog Archive » scrAPIs http://thormuller.com/netpositive/2006/03/02/here-come-the-scrapis/#comment-132 ProgrammableWeb.com » Blog Archive » scrAPIs Wed, 22 Mar 2006 06:24:16 +0000 http://thormuller.com/netpositive/2006/03/02/here-come-the-scrapis/#comment-132 [...] What’s a scrAPI? A scrAPI, which at this point is more of an idea than a thing, was recently described by Thor Muller in his blog as a type of community-built API that provides a programming layer above web sites that don’t otherwise have an API. This intermediate layer, which exists independently of the destination web site, in turn does the dirty work of screen-scraping of raw HTML from the source and returns just the relevant data in some cleaner XML format. Thus a collaboratively built and maintained set of code for data access from any source. [...] [...] What’s a scrAPI? A scrAPI, which at this point is more of an idea than a thing, was recently described by Thor Muller in his blog as a type of community-built API that provides a programming layer above web sites that don’t otherwise have an API. This intermediate layer, which exists independently of the destination web site, in turn does the dirty work of screen-scraping of raw HTML from the source and returns just the relevant data in some cleaner XML format. Thus a collaboratively built and maintained set of code for data access from any source. [...]

]]> By: Annoyingly Cheerful » Blog Archive » scrAPI? http://thormuller.com/netpositive/2006/03/02/here-come-the-scrapis/#comment-135 Annoyingly Cheerful » Blog Archive » scrAPI? Mon, 06 Mar 2006 10:15:41 +0000 http://thormuller.com/netpositive/2006/03/02/here-come-the-scrapis/#comment-135 [...] find about microformats, and today I stumbled over a concept that is somewhat related: the scrAPI. I already knew about screen scraping, of course: it’s where you [...] [...] find about microformats, and today I stumbled over a concept that is somewhat related: the scrAPI. I already knew about screen scraping, of course: it’s where you [...]

]]> By: netpositive | Another definition for scrAPI http://thormuller.com/netpositive/2006/03/02/here-come-the-scrapis/#comment-134 netpositive | Another definition for scrAPI Sun, 05 Mar 2006 11:25:22 +0000 http://thormuller.com/netpositive/2006/03/02/here-come-the-scrapis/#comment-134 [...] efinition for scrAPI March 5th, 2006 When a group of us initially discussed the idea of scrAPIs at Mashup Camp it was in the context of turning our scra [...] [...] efinition for scrAPI
March 5th, 2006

When a group of us initially discussed the idea of scrAPIs at Mashup Camp it was in the context of turning our scra [...]

]]> By: Labnotes » Blog Archive » What exactly is a scrAPI? http://thormuller.com/netpositive/2006/03/02/here-come-the-scrapis/#comment-133 Labnotes » Blog Archive » What exactly is a scrAPI? Sun, 05 Mar 2006 01:59:24 +0000 http://thormuller.com/netpositive/2006/03/02/here-come-the-scrapis/#comment-133 [...] ormation, you’ve created a contacts scrAPI. Thor makes compelling arguments for his idea. He’s also raising the point that the [...] [...] ormation, you’ve created a contacts scrAPI. Thor makes compelling arguments for his idea. He’s also raising the point that the [...]

]]>