Friday, April 29, 2011

Quick reflections on ICALP 2011 (track B), part II: Conferences and long papers

During the review process for ICALP track B, a colleague wrote to me saying that he was planning to submit a paper longer than 70 pages to the conference, but eventually decided not to do so. While he was considering submitting the paper, this colleague was naturally wondering about the implications of submitting such a long paper to a conference with a 12-page limit on submissions. This academic told me that he thought that it would not be unreasonable to reject a very long paper submitted to ICALP  without even reading it. Such a decision could be backed up by a notification notice stating that "the paper is unverifiable given the available time and resources" or even "considering the paper is pointless since only 12 pages will be published."

I can understand very well why this colleague decided not to submit the paper to ICALP. Shrinking a 70+-page paper to 12 pages is a major effort, and one has to wonder whether a conference is the right outlet for such a lengthy piece of work. Indeed, one may argue that our conference publication structure does not lend itself to the publication of (very) long papers. However, I know of at least three exceptions (listed here in chronological order).
  1. The ICALP 1990 paper in which Daniel Krob presented his equational axiomatizations of equality of regular expressions was 14 pages long, but the journal paper Complete Systems of B-Rational Identities (solving two problems posed by John Horton Conway in his monograph Regular Algebra and Finite Machines) that appeared in TCS in 1991 was 137 pages long. 
  2. The ICALP paper in which Sénizergues introduced the decidability of DPDA equivalence is only 10 pages long, but the journal paper is 166 pages long.
  3. The short paper by Martin Grohe at http://www2.informatik.hu-berlin.de/~grohe/pub/gro10.pdf was published in LICS 2010, but the full work takes a book that is still under development. See http://www2.informatik.hu-berlin.de/~grohe/pub/cap/index.html.
Now, one might ask what the purpose of those conference papers is. In some sense, my colleague was right in saying that they are "unverifiable" (given the length and time constraints imposed by conferences). I doubt that the conference reviewers went through all the details of the full versions of those papers, when they were available. Even a journal reviewer would probably not do so.

I guess that the answer is simply that the conference versions announce the results and "mark the territory" by saying "I did it". However, IMHO, the results only stand after the interested community has not found any serious errors in the full versions of the papers for a long time.

A separate issue is that of writing a conference paper based on a long full paper, which does justice to the main results and techniques presented by the authors in the full version in all the gory details. IMHO, conference papers reporting  on very long and technical developments are "trailers"  for the full version of the story, which is told elsewhere in all its glory. As a movie trailer, the conference paper serves the purpose of enticing potential readers to check out the full version by motivating the work, putting it in context, stating the achieved results, discussing their importance and giving a high-level sketch of the techniques and of the tools involved in the proof. (I am thinking here, for example, of the above-mentioned paper Grohe published at last year´s LICS, where he did precisely what I wrote above and, to my mind, did it well.) Of course, this is easier said than done..

2 comments:

Martin said...

As Luca mentions my paper, let me comment on this: My main motivation for attending a conference like LICS or ICALP (or looking at the proceedings) is to hear about the best new results in the area, regardless of whether they happen to fit the format or not.

And I think it is possible to give informative talks about long papers (and also to give terrible talks about standard 12 page conference papers), so I don't see a problem in submitting and accepting even very long papers to conferences.

Plus, I think it is much better to have one conference paper and one talk about a result rather than splitting it up in many pieces.

It's true that it is not realistic to verify the proofs in such papers, that's probably the price to pay, and the reason why we also need journal versions. (Even if it won't be checked in detail, I would always require the authors to make a full version of the paper accessible to the conference PC.)

Luca Aceto said...

Martin, thanks a lot for your thoughtful and inspiring comment.

For what it is worth, I completely agree with you on all points. Let me also say that I believe that there should be room for "technical papers" in our conference system.

Presenting (very) long and/or technical papers in a conference-proceedings format, however, places high demands on the quality and style of the write-up.

Making the effort of presenting one's work concisely and in a high-level fashion will also pay off when writing the journal version of the paper. The high-level explanation can serve as an introductory section (an appetizer, using a culinary analogy) that prepares the interested readers for the gory details (the main course) and helps them digest them better.