QCon 2010 Concurrency Track

I will be hosting the “Concurrency Challenge” track at QCon 2010. The speakers list is now ready with all titles and abstracts in place.

QCon 2010 London

I am quite pleased with the mix and the dignity of the speakers. One of the things we wanted to highlight is that there is no one-size-fits-all concurrency model, and it’s time for us to start being a little bit more specific about what kind of concurrency we have in mind.

Each setting brings its own set of challenges, and in this track, you can expect to get a good orientation from some brilliant people, who know how to tell a story and are not afraid of offering their opinion.

Erlang User Conference 2009 – In the Wild

About a month to go now to the 15th Erlang User Conference in Stockholm.
For the first time ever, the conference is arranged by someone other than Ericsson, namely Erlang Training and Consulting Ltd. In fact, it is also the first time since 1998 that the conference is held outside Ericsson premises. Then, it was held at Van der Nootska Palatset for reasons I no longer recall (I guess we wanted to spice it up a little).

This year, it will be at the Astoria in the center of Stockholm. The reason this time is clear: the EUC has outgrown the largest lecture halls at Ericsson. With a month to go, we have more than 200 registered participants, and we are now investigating what the maximum capacity of the Astoria is, to see how many more we can squeeze in.

Another difference this year is that the speaker roster filled up in no time! We now have 14 talks, which is a busy program for a one-day conference! You have every chance to make EUC week an intense learning experience, with courses on Nov 9-11, the EUC on the 12th and on the 13th either a hackathon hosted by Klarna or ProTest tutorials in Älvsjö south of Stockholm. Add to this the chance to meet people like Tom Preston-Werner, founder of Github, Rusty Klophaus, father of Nitrogen, and the members of the Erlang/OTP development team.

There is still time to register.

QCon London – Good Fun

I had great fun at QCon. This was one of my first “commercial” conferences – I’ve mainly frequented research conferences like ICFP and POPL before, partly because Erlang has enjoyed little commercial interest in the past.

I enjoyed Steve Vinosky’s account of the conference, as well as Ola Bini’s. I also enjoyed Steve’s talk on RPC, and Paul Downey’s on standardization in the Historically Bad Ideas track. And of course, listening to Sir Charles Anthony Hoare was a great treat. I’m a long-time fan of Hoare’s and warmly recommend his Turing Award Speech, “The Emperor’s Old Clothes”. There are some great lessons in there.

On Thursday, I stuck with the “Functional and Concurrent Programming Languages Applied” track, hosted by my friend and colleague Francesco Cesarini. When speaking in a track, I want to have heard the talks before mine, and also want to stay to hear the remaining talks.

This time, I was preceded by Rich Hickey’s talk on Persistent Data Structures and Managed References in Clojure. I was greatly intrigued by this talk and made a note to take a closer look at Clojure. Interestingly, Rich stressed that Clojure Agents are not actors a la Scala or Erlang. Part of my talk was to illustrate how Erlang processes are not “fibers”, and trying to use them for data-parallel algorithms can be problematic. Nice setup.

Friday ended with a few quick beers with Rich, Steve, Paul and Joe Armstrong, and then dinner at Francesco and Alison’s with Joe and Steve. Francesco is a great cook!

(Didn’t notice that Paul was taking pictures though. Judging by the angles, he was shooting from the hip…)

I'm speaking at the Erlang Factory

I’ll give the same talk at SF Bay Area Erlang Factory, April 27-29. I’m really looking forward to this conference. It should be the greatest Erlang conference yet, and I hope to see you there.

New challenges

My thirteen-year sojourn at Ericsson is now at an end.

When I first joined, I would have been appalled if anyone had suggested that I’d work there for more than a decade. Now, I can look back with pride at all the things I’ve learned because I stuck around for a while. Ericsson is certainly the kind of company where you can work for decades and still feel that you’ve had diverse and interesting challenges all the time.

I joined Ericsson in February 1996. I had been introduced to Erlang by Bjarne Däcker and Robert Virding back in 1992, and thought it was one of the most exciting technologies I had seen so far. Back then, if you wanted to work with Erlang, Ericsson was the (only) place to be.

I’ve had the good fortune to play a significant role in the development of some very demanding products, starting from scratch, inventing stuff as we went along, meeting market challenges, going into maintenance, acquiring “legacy” status, porting to new architectures, and spinning off new products. I’ve experienced how an organization matures, as the once young and fearless grow older, get married, go on parental leave and get new priorities in life, and seen how new people come in, with new ideas and fresh excitement.

Most amazing of all has been the experience of joining a small programming language community (Erlang), fighting against the odds, and trying to find its place in the world, and then seeing it grow into (relative) ubiquity. Erlang has experienced practically exponential growth since its release as Open Source in 1998, and working as something of an ambassador for Erlang has led me to an amazing array of exciting contacts.

But now it’s time to move on. I will join my old friend Francesco Cesarini as the new CTO of Erlang Training & Consulting. ETC has come far since the time, ten years ago, when Francesco was running a one-man training and consulting shop from his flat in London. It is now an important pillar in the Erlang Community, and one of the most active participants in spreading the word about Erlang. Ever since I coughed up $1000 and became one of the first (and, I think, only) paying customer of Erlang Systems AB in 1993, I’ve felt motivated to help increase Erlang’s user base. In my new role at ETC, I will be even better positioned to do so.

I’m honored to join ETC, and feel that fresh excitement brewing again. :)

I expect to become more active in my blogging activities, and perhaps that twitter account will start seeing some activity too.

POPL impressions

Back home from my first POPL conference, I’m trying to collect my thoughts.

Overall, I was impressed with the high quality of the papers and presentations. While it’s not immediately obvious why industry representatives ought to attend POPL (which is, after all, a very academic conference), I’d like to suggest that it’s worth your while. You can expand your horizons and your network, and improve your intuition about where the programming community appears to be headed. Especially as we are experiencing a major paradigm shift, I’d expect that the first indications of trouble (or hope) might well come at conferences like POPL.

The panel discussion compensated somewhat for the lack of Erlang representation in the audience and on the podium, as message passing and Erlang received favourable mention.

Much of the discussion hovered around parallelism, of course, but Martin Rinard (represented by Arvin) offered the somewhat provocative view that today’s software is over-engineered and has too few errors in it! I had touched on this in my DAMP presentation the day before, as I mentioned that correctness is elusive in our commercial products, since the specifications themselves are often buggy (a claim also made by Mats Cronqvist at the Erlang Workshop 2004: “Most of the errors were not coding errors, but a working implementation of the wrong thing.”

My main reason for attending was the DAMP workshop, where I’d been asked to give a tutorial about Erlang programming for Multicore (presentation here). I’d call it an experience report instead, since (a) Erlang’s approach to multicore programming is that it’s supposed to be transparent, and (b) I’d be embarrassed to try to give a programming tutorial in front of people like Simon Marlow, Satnam Singh and Xavier Leroy…

I initially decided to put much emphasis on testing parallel programs using QuickCheck, and this also became the reason why I could go at all. The ProTest project sponsored the trip, since it gave us a chance to present some of its latest developments. I also think this is a very valid angle. Testing and debugging in the face of non-determinism is a real challenge. While preparing the presentation, we had great fun trying out the newest QuickCheck stuff and beating up some of my old discarded code experiments. We need to continue the work, and put some more focus on the semantics of the API. I’m pretty convinced that the code cannot be made bug-free on multicore without revisiting the API (which mimics Erlang’s built-in functions, by the way).

The DAMP workshop was great. I wish the Erlang maintainers could have been there. I enjoyed the talks and the discussions. Simon Marlow’s talk on Haskell’s concurrency primitives was very enlightening, and should be read by all who are interested in STM. John Reppy’s presentation on Manticore (haven’t found it on line, but this one appears similar) was also intriguing, perhaps especially the idea of an abstract low-level language for parallel execution. It’s possible that we’ll need something like that if we are to tackle a diversity of many-core architectures. I also enjoyed Sven-Bodo Scholz’s talk on Single-Assignment C (SaC), and couldn’t help thinking about whether it would be possible to integrate that into Erlang. (:

As always with these conference, one of the greatest rewards is the socializing in the evenings and during the breaks. I will try to spend some time studying Barry Jay’s pattern calculus and the Bondi language. There seems to be some kinship here with the Erlang language…

Erlang Programming for Multicore

I was invited to give a tutorial at the Declarative Aspects of Multicore Programming (DAMP) workshop, in conjunction with POPL 2009. This was my first POPL, and I want to get back to my impressions in another post, but for now, here is the presentation.

The presentation was developed as part of the ProTest project.

Sorry for being so short, but my laptop power adapter broke, and I’m writing this on a hideously expensive computer in the hotel business center.

Windows tricks for erlangers

Not that I spend much time compiling erlang code in Windows (unless I’m using cygwin or coLinux), but the issue does pop up from time to time. Here are a few minor tricks that can help a bit.

Starting Erlang in the current directory
For a unix user, it’s of course odd that this should be a problem.

John Hughes used a nice trick that’s so simple that I slap myself for not having thought of it: Right-click on a .beam file, select “Open With…” and locate werl.exe. Now you can open an erlang shell in the current working directory by double-clicking a .beam file.

Modifying the Windows context menu
So what if you don’t have any .beam files, and you’re trying to get to an erlang shell
in order to create some?

I did some googling and found this tutorial on youtube on how to add custom entries to the context menu.

It seemed simple enough, but Vista still served me a few hours of utter confusion since it took what I inserted, and then copied it to another place in the registry (without letting me know)… but only the first time. My changes and additions were simply ignored. The solution? Search the registry for the key you inserted, and you’ll figure out where Vista wants it to be, then make your changes there.

What I’ve experimented with so far is to add under Computer\HKEY_CLASSES_ROOT\ErlangSource\shell\ the following entries:

Compile with erlc
- Command = "C:\Program Files\erl5.6.3\bin\erlc.exe" "%1"
Make all
- Command = "C:\Program Files\erl5.6.3\bin\werl.exe" "-make"
Erlang shell
- Command = "C:\Program Files\erl5.6.3\bin\werl.exe" "%1"

A problem with running erlc this way is that the window is destroyed immediately upon completion. I’ve poked around a bit for good workarounds. One option is of course to write an erlang function that compiles the file, then either sleeps a short while, or waits for input.

Contribution summary page

I once posted a question to the erlang-questions list in order to find out which of my Open Source contributions were actually used. I was hoping to remove some of them.

This didn’t seem to be doable, and I was instead asked to put together a summary of my different contributions, together with their status and what I thought I had learned from them.

Well, that was a number of years ago, but I finally put together something along those lines: My Erlang Projects (available from the right side bar). At least it was helpful to me – I guess that’s the main value of most blog activities anyway. (:

Indentation-sensitive Erlang 3

So, maybe I’m thick enough not to realise in advance when I’m barking up the wrong tree, or perhaps I just like to follow things through to the bitter end, just to know what exactly didn’t work…?

I’ve gone one more round with my indentation-sensitive Erlang scanner/parser. For a while, it looked like I was winning, but eventually, I had to admit defeat in the face of funs and record constructors.

Again, the approach I thought I’d take was to add indentation tokens to the normal scanner, and then add rule clauses to the normal grammar to make it understand both indentation-sensitive code, and all the code you’re accustomed to writing. The normal parser is an LR(1) grammar, which means that the additions have to be quite symmetrical in order to work.

This seemed to work in just about all the places that mattered, but I was stumped by funs and record constructors. The main with funs was that you could no longer write them in the conventional way (failing one of my preconditions), and record constructors usually cannot be written without including a few commans in a way that was …uhm, less than obvious.

I include the test module, which pretty much illustrates what works, and what doesn’t. At this point, I doubt that I can achieve better than a 90% solution, which is probably just good enough to eventually drive people crazy.

It’s been fun, though. I’m have no particular craving for indentation-sensitive syntax myself, so I thought I’d tackle this as a learning experience. Not for the first time, I feel like concluding that retrofitting concepts onto existing programming languages is usually very difficult to do well.

The code is at http://svn.ulf.wiger.net/indent/branches/0.3




f(X) ->

g(X) ->
.          % dot can either be 'outdented' or
           % terminating last line

g1(X) ->

h(X) ->
    Y = case X of
          a ->
          b ->
    end          % end is optional

h1(X) ->
    Y = case X of
          a ->
          b ->

h2(X) ->
    case X of
        a ->
        b ->

h3(X) ->
    case X of
        a -> 1;  % must use semicolon here :-(
        b -> 2

i(a) -> a
i(b) -> b

j(A,B) ->

j1(A,B,C) ->
     B     % indents must be greater than 1;
     C}    % else they count as aligned

k() ->
    S = "a string "
        "spanning multiple "

l0() ->
    fun(1) -> 1; (2) -> 2 end.

l1() ->
    fun            % must break line here and indent.  :-(
      (1) ->
      (2) ->

%%% This, alas, doesn't work :-(
%%% l2() ->
%%%     fun(1) ->
%%%             1;
%%%        (2) ->
%%%             2
%%%     end

m() ->
    #r{a = 1, b = 2}.

m1() ->
    R = #r{a = 1}

%%% indentation syntax works poorly for record assignment.
%%% Both commas are needed :-(
m2() ->
    R = #r{a = 1,
           b = 2},

test() ->
    2 = f(0),
    4 = f(2),
    4 = g(0),
    4 = g1(0),
    8 = g(4),
    {a} = h(a),
    {b} = h(b),
    {a} = h1(a),
    {b} = h1(b),
    1 = h2(a),
    2 = h2(b),
    1 = h3(a),
    2 = h3(b),
    a = i(a),
    b = i(b),
    {a,b} = j(a,b),
    {a,b,c} = j1(a,b,c),
    {"a string spanning multiple lines"} = k(),
    F0 = l0(), 1 = F0(1), 2 = F0(2),
    F1 = l1(), 1 = F1(1), 2 = F1(2),
    {r,1,2} = m(),
    1 = m1(),