Want a service where I can give it a piece of code (including a pointer to git or mercurial repo) and have it run that code on a regular basis.

Wishlist of features:

  • Language: python, js (node.js)
  • Notification of run and results
  • Store results locally and remotely (files and databases)
  • Logging support (possibly using XUnit)
  • Workflow support (do this after that has run successfully)
  • Spin up workers on demand

This is result of long-running discussions of Friedrich Lindenberg and Rufus Pollock and is almost certainly not original. (See also this post: http://notebook.okfn.org/2011/04/18/25k-spending-etl-process/)

submitted 03 Feb, 21:45

rgrp's gravatar image

rgrp ♦♦
accept rate: 45%

One response

It seems to me that ScraperWiki now satisfies a lot of these demands.


solved 01 Jun, 10:44

Nick's gravatar image

accept rate: 0%

Your response
toggle preview

Follow this question

By Email:

<span class='strong'>Here</span> (once you log in) you will be able to sign up for periodic email updates about this idea.



Answers and Comments

Markdown Basics

  • *italic* or _italic_
  • **bold** or __bold__
  • link:[text](http://url.com/ "title")
  • image?![alt text](/path/img.jpg "title")
  • numbered list: 1. Foo 2. Bar
  • to add a line break simply add two spaces to where you would like the new line to be.
  • basic HTML tags are also supported



Asked: 03 Feb, 21:45

Seen: 338 times

Last updated: 01 Jun, 10:44

powered by OSQA