Registration
Participants are required to register in order to obtain the development and test data-sets.
Registration must be done by sending an email to the following address: tweetmt AT elhuyar.com
Evaluation Period
Each participant will only have 48 hours to work on the test set and to send results (May 19-21).
Submitting the Results
- Results must be submitted by email to tweetmt AT elhuyar.com .
- Each participant can submit up to three results. replica watch fake rolex replica watches
Results
Table 1: Evaluation based on whole sentences
LANG-PAIR | Participant | NIST | BLEU |
ca-es | DCU1 | 12.3053 | 0.7826 |
DCU2 | 12.2935 | 0.7816 | |
DCU3 | 12.3973 | 0.7943 | |
UPC | 11.1083 | 0.6825 | |
UPC1 | 10.8757 | 0.6351 | |
es-ca | DCU1 | 12.0642 | 0.7669 |
DCU2 | 12.1020 | 0.7899 | |
DCU3 | 12.0723 | 0.7630 | |
UPC | 12.0549 | 0.7832 | |
eu-es | DCU1 | 6.8745 | 0.2687 |
DCU2 | 6.9691 | 0.2698 | |
DCU3 | 7.0290 | 0.2728 | |
EHU-SMT | 7.4838 | 0.3109 | |
es-eu | DCU1 | 6.5611 | 0.2455 |
DCU2 | 6.7847 | 0.2636 | |
DCU3 | 6.5950 | 0.2493 | |
EHU-SMT | 6.7735 | 0.2636 | |
EHU-RBMT | 5.7763 | 0.2089 | |
pt-es | DCU1 | 8.9854 | 0.4465 |
DCU2 | 9.0019 | 0.4467 | |
DCU3 | 9.0821 | 0.4524 | |
es-pt | DCU1 | 7.6727 | 0.3595 |
DCU2 | 7.8834 | 0.3711 | |
DCU3 | 7.8899 | 0.3687 |
Table 2: Evaluation based on cut off at 140 characters
ca-es | DCU1 | 12.3026 | 0.7822 |
DCU2 | 12.2901 | 0.7811 | |
DCU3 | 12.3948 | 0.7938 | |
UPC | 11.1087 | 0.6826 | |
UPC1 | 10.8751 | 0.6352 | |
es-ca | DCU1 | 12.0650 | 0.7668 |
DCU2 | 12.1025 | 0.7900 | |
DCU3 | 12.0728 | 0.7630 | |
UPC | 12.0562 | 0.7833 | |
eu-es | DCU1 | 6.8710 | 0.2685 |
DCU2 | 6.9649 | 0.2695 | |
DCU3 | 7.0252 | 0.2726 | |
EHU-SMT | 7.4806 | 0.3106 | |
es-eu | DCU1 | 6.5600 | 0.2455 |
DCU2 | 6.7820 | 0.2634 | |
DCU3 | 6.5924 | 0.2492 | |
EHU-SMT | 6.7687 | 0.2633 | |
EHU-RBMT | 5.7670 | 0.2082 | |
pt-es | DCU1 | 8.9666 | 0.4447 |
DCU2 | 8.9887 | 0.4454 | |
DCU3 | 9.0732 | 0.4515 | |
es-pt | DCU1 | 7.6582 | 0.3586 |
DCU2 | 7.8681 | 0.3703 | |
DCU3 | 7.8740 | 0.3679 |