The JobCenter, an Orchestration Workflow Engine

By: Wieger Opmeer (‎a6502‎) from Berlin.pm
Date: Wednesday, 15 August 2018 10:30
Duration: 50 minutes
Target audience: Intermediate
Language: English

You can find more information on the speaker's site:


The JobCenter is an engine for running long orchestration processes in a transaction-safe way. Another way to describe it would be as a collection of job queues where jobs move from queue to queue based on the rules specified in a domain specific language.

The main ingredients:
- the engine itself written in Perl and PL/pgSQL stored procedures
- a JSON-RPC 2.0 based API layer
- a custom modelling language that looks and feels like program code
- easily version controlled
- easily diffable
- Perl libraries for writing clients and workers

In this talk I will present some of the design principles behind the JobCenter, show some implementation highlights and some actual use-cases.


Attended by: Erik Huelsmann, Dagfinn Ilmari Mannsåker (‎ilmari‎), Aaron Rowe, Renee Bäcker (‎reneeb‎), José Joaquín Atria (‎JJ‎), Eitan Schuler, Kang-min Liu (‎gugod‎), Sorin Pop (‎finger‎), Andrew Beech, Jan Seidl (‎JaSei‎), Theo van Hoesel (‎vanHoesel‎), Andreas Koenig, FErki, Felix Antonius Wilhelm Ostmann (‎Sadrak‎), Phil King, Aaron Crane (‎arc‎), Mischa Schwieger, cono, scott, Andrew Nugged (nugged), Richard Newsham (‎rnewsham‎)

Community Sponsors

Enlightened Perl Organisation Magnum Solutions Logo Perl6 Community Perl Weekly