Participation

Registration

Participants are required to register in order to obtain the development and test data-sets.

Registration must be done by sending an email to the following address: tweetmt AT elhuyar.com

Evaluation Period

Each participant will only have 48 hours to work on the test set and to send results (May 19-21).

Submitting the Results

  • Results must be submitted by email to tweetmt AT elhuyar.com .
  • Each participant can submit up to three results.

Results

Table 1: Evaluation based on whole sentences


LANG-PAIR Participant NIST BLEU
ca-es DCU1 12.3053  0.7826
DCU2 12.2935 0.7816
DCU3 12.3973 0.7943
UPC 11.1083 0.6825
UPC1 10.8757 0.6351
es-ca DCU1 12.0642 0.7669
DCU2 12.1020 0.7899
DCU3 12.0723 0.7630
UPC 12.0549 0.7832
eu-es DCU1 6.8745 0.2687
DCU2 6.9691 0.2698
DCU3 7.0290 0.2728
EHU-SMT 7.4838 0.3109
es-eu DCU1 6.5611 0.2455
DCU2 6.7847 0.2636
DCU3 6.5950 0.2493
EHU-SMT 6.7735 0.2636
EHU-RBMT 5.7763 0.2089
pt-es DCU1 8.9854 0.4465
DCU2 9.0019 0.4467
DCU3 9.0821 0.4524
es-pt DCU1 7.6727 0.3595
DCU2 7.8834 0.3711
DCU3 7.8899 0.3687

Table 2: Evaluation based on cut off at 140 characters


ca-es DCU1 12.3026 0.7822
DCU2 12.2901 0.7811
DCU3 12.3948 0.7938
UPC 11.1087 0.6826
UPC1 10.8751 0.6352
es-ca DCU1 12.0650 0.7668
DCU2 12.1025 0.7900
DCU3 12.0728 0.7630
UPC 12.0562 0.7833
eu-es DCU1 6.8710 0.2685
DCU2 6.9649 0.2695
DCU3 7.0252 0.2726
EHU-SMT 7.4806 0.3106
es-eu DCU1 6.5600 0.2455
DCU2 6.7820 0.2634
DCU3 6.5924 0.2492
EHU-SMT 6.7687 0.2633
EHU-RBMT 5.7670 0.2082
pt-es DCU1 8.9666 0.4447
DCU2 8.9887 0.4454
DCU3 9.0732 0.4515
es-pt DCU1 7.6582 0.3586
DCU2 7.8681 0.3703
DCU3 7.8740 0.3679