Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

ENH comparative evaluation of RST parsers, fragmented EDUs #34

Open
wants to merge 75 commits into
base: master
Choose a base branch
from
Open

ENH comparative evaluation of RST parsers, fragmented EDUs #34

wants to merge 75 commits into from

Conversation

moreymat
Copy link
Contributor

This PR brings two notable evolutions:

  • adds support for the output of other RST parsers, for comparative evaluation,
  • adds support for fragmented EDUs.

The two latter points, plus miscellaneous other changes, follow from irit-melodi/educe#111 and irit-melodi/attelo#67.

@moreymat
WIP add comparative evaluations for different parsers
f55be6e
@moreymat
WIP special processing for same_unit
45709b0
@moreymat
WIP comparative evals, first attempts at same-unit preproc
7038585
@moreymat
FIX update naming conventions for files
5b74d14
@moreymat
MAINT minor refactoring, same-unit
20e8384
@moreymat
WIP one file per doc, same-unit
9a153ad
@moreymat
WIP de-engineering local
6888c25
@moreymat
NEW convert attelo predictions to disdep file
fee674e
@moreymat
ENH new script to compute dependency scores on disdep files
d5e2a43
@moreymat
ENH dis_dep from various sources, general eval script for dis_dep
d3e6128
@moreymat
ENH support for the output of feng's parser, evaluate several parsers
eb21923
@moreymat
WIP add nary_enc to params in gather and local
c8097a5
@moreymat
WIP cleaner evaluation: toggle for nary_enc, binarize_ref
a094aff
@moreymat
WIP cleaner eval showdown
d38d5df
@moreymat
FIX pass rel_conv and nary_enc to codra eval
290fe5c
@moreymat
WIP more compact display in showdown
2fcdfc3
@moreymat
WIP concise showdown: joty, ours
b2246b8
@moreymat
WIP tie order with nary_enc
72a2956
@moreymat
WIP support output of ji
e6c0a5b
@moreymat
ENH added support for DPLP in eval
f185f3a
@moreymat
FIX eval of dplp
2f1b13e
@moreymat
ENH variant of parseval scores, per doc then averaged
8acd957
@moreymat
ENH parseval for Feng's parser
1d31ed6
@moreymat
WIP more evals, notably on spans from SimpleRSTTree
ff278d0
@moreymat
FIX minor bugs in showdown
e3a34c3
@moreymat
ENH add metric LAS+O in eval_disdep
140e93b
@moreymat
ENH gcrf output
5ebc6e2
@moreymat
WIP repro: gCRF
0aa666a
@moreymat
ENH disdep eval for gCRF, replace globals with options
6cb02c7
@moreymat
FIX add option to load EDUs in gcrf parse.py
c721d85
@moreymat
ENH incorporate eval for li_sujian
2db94f7
@moreymat
MAINT move loaders for RST parsers from educe to ./evals
2a12e87
@moreymat
WIP disable frag pairs
5750e89
@moreymat
FIX paths for CDU-related files are now optional
5784da8
@moreymat
FIX paths for CDU-related files are now (really) optional
de58648
@moreymat
FIX paths for CDU-related files are now (really) optional
ad2dd78
@moreymat
FIX disable cdu paths
056a7b1
@moreymat
FIX add graphviz to environment.yml
86a73e9
@moreymat
Merge remote-tracking branch 'upstream/master' into enh-cleaner-rst-e…
41a13e1 
…vals

Conflicts:
	irit_rst_dt/harness.py
@moreymat
FIX evals paths
4165175
@moreymat
ENH showdown: param digits
b95e184
@moreymat
ENH param detailed, compact report
1ecb3d3
@moreymat
MAINT+ENH pylint showdown, parseval double
5b0291f
@moreymat
FIX disable print of differing spans between RST double and main
c97f68a
@moreymat
ENH evals/showdown: changes in options and table display
adf07c1
@moreymat
ENH showdown: use any author as _true
2faff31
@moreymat
ENH showdown: compact reports use author_true
b4ef3ec
@moreymat
ENH showdown: similarity matrix
1b9487c
@moreymat
ENH showdown: dep_compact_report
ca02b49
@moreymat
FIX showdown: skip dep sim matrix
3731b65
@moreymat
ENH showdown: pairwise dep similarity
a056968
@moreymat
ENH evals.showdown: new parser WLW17
349d8e4
@moreymat
FIX irit_rst_dt.harness: pick upstream/master to resolve conflict
3bfca65
@moreymat
ENH d-metrics: add N+O, rm R+O ; c-metrics: add +H
8034514
@moreymat
FIX showdown: out_fmt, span metrics +H+K+HH
1043db3
@moreymat
WIP nuc_clf
ff4177d
@moreymat
FIX load either c- or d-trees once, pass them to the other loader
822af14
@moreymat
ENH rel_clf, nuc_clf, model_split='sent'
9693796
@moreymat
FIX pass doc_edus to loaders
4fb6eaa
@moreymat
FIX nary_enc_pred tied to each set of predictions, no longer CLI arg
9f06865
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@moreymat