The XL-Sum library adds support for multilingual rouge.
It is an extension of rouge implementation from here, with support for stemming for many languages and word segmentation for chinese, thai, etc. It will be useful to have support for this package.