ICFHR 2020 Call for Competitions

The ICFHR 2020 Organizing Committee invites proposals for competitions addressing current research challenges in handwriting recognition and related areas of pattern recognition and vision. Competitions should aim at evaluating the performance of individual methods and systems that fall within the context of the conference’s call for papers. Competitions should also participate in the sharing and standardization of handwriting recognition processes.

Proposals must contain the following information:

  1. A brief description of the competition, including which is the particular task under evaluation and why this competition could be of interest to the ICFHR community. If a similar competition has been held in a previous edition of ICFHR, the novel additions of the proposed one must be clearly explained.
  2. A draft of the outline of the competition describing which data is planned to be used, how will the submitted methods be evaluated and which performance measures will be used. Proposals should state explicitly whether data and annotations are already available or otherwise the timeframe to prepare them.
  3. How datasets and evaluation scripts will be made publicly available.
  4. The list of rules or best practices which will be imposed to participants (allowing multiple submissions or not, allowing external data or not, public ranking or not, etc.). Each competition relies on the academic integrity of the competitors.
  5. The names, contact information, and brief CVs of the competition organizers, outlining previous experience in performance evaluation and/or organizing competitions.

Submissions

Proposals should be submitted by electronic mail to the ICFHR2020 Competitions Chairs: Harold Mouchère and Dimosthenis Karatzas (competitions@icfhr2020.org)

The pdf version can be found here: ICFHR 2020 Call for Competitions

Rules

The following rules will apply to the accepted competitions:

  • All competitions must run well in advance of the conference.
  • Datasets used in the competitions must be made available through the TC10/TC11 Online Resources website after the end of the competitions (or equivalent arrangement by approval of the competition chairs).
  • Evaluation methodologies and metrics used must be described in detail so that results can be replicated later.
  • The name of the competition must be standardized by starting with “ICFHR2020” e.g. “ICFHR2020 Competition on …”;
  • Reports (full papers) on each competition will be reviewed and, if accepted (the competition run according to plan and is appropriately described), will be published in the ICFHR2020 conference proceedings.
  • The results of accepted competitions will be announced during a dedicated session of the conference. Competition organizers are expected to participate in this dedicated session during ICFHR 2020. Participants should be encouraged to present their algorithms (if not already done) in a conference paper at ICFHR 2020.
  • Participants should be encouraged to share their algorithms and code using one of the open-source licenses
  • Competitions must have a sufficient number of participants (about 5, depending on the originality of the topic) to be able to draw meaningful conclusions.
  • Each competition will be allocated some time in parallel to the poster session, during which they can run a mini-workshop (e.g. presenting results and conclusions, inviting winning methods to present their methods, lessons learnt, etc).
  • Each competition accepted to present results in the conference, should prepare a poster presentation and present it during ICFHR 2020

Important Dates

  • 13 December 2019: Submission of competition proposals.
  • 20 December 2019: Notification of acceptance.
  • 24 December: Competitions published on ICFHR2020 website and open to participants.
  • 14 June 2020: Deadline for submission for review of full papers describing the competitions. Papers must be sent directly to the Competitions Chairs.
  • 26 June 2020: Notification of acceptance.
  • 12 July 2020: Accepted camera-ready papers reporting on the competitions for inclusion in the proceedings.

If you have any questions, please contact the ICFHR2020 Competitions Chairs  (competitions@icfhr2020.org)

Online
twitter : @IAPR_TC11 #ICFHR2020 #ICFHR2020competitions