Vitaly Shalumov

2 paper cards in Mova's library · 2023–2024

Vitaly Shalumov wrote 2 of the papers Mova reads, in 2023–2024; often with Harel Haskey, Yuval Solaz.

The profile is the library's match of the name; two people with one name are not always told apart.

Papers

Mevaker: Conclusion Extraction and Allocation Resources for the Hebrew Language (2024)
The authors build Hebrew datasets from 1,109 State Comptroller audit reports (2005–2022). The conclusions are marked by the auditors, so their spans give labels for free. They derive MevakerConcSen (sentence labels), MevakerConcTree (conclusions attached to a heading tree) and MevakerSumm (1,106 reports with…
HeRo: RoBERTa and Longformer Hebrew Language Models (2023)
The authors build a Hebrew pre-training corpus, HeDC4, from mC4 and OSCAR 22.01. They deduplicate it with MinHash, clean it, and reach about 2.5 times the size of the corpus used for AlephBERT. On it they train HeRo, a RoBERTa-base model for inputs up to 512 tokens, and LongHeRo, a Longformer started from a…