ENH+FIX+WIP fragmented EDUs, dep2con, move Parseval, one file per doc #67

moreymat · 2017-02-14T14:28:55Z

This PR adds several (arg) unrelated (ugh) changes that go together with changes in the educe API (see irit-melodi/educe#111):

support fragmented EDUs (for RST-DT),
fix and clarify conversion between c-tree and d-tree with nuc and rank (dep2con): representations, procedures and heuristics ;
removed the Parseval metrics for (RST) c-trees that are now part of educe,
add preliminary support for one (set of) files per doc instead of the current one (set of) files per corpus split.

…unit Conflicts: attelo/harness/evaluate.py attelo/harness/example.py attelo/harness/interface.py attelo/parser/pipeline.py attelo/report.py attelo/score.py

moreymat added 30 commits July 1, 2016 23:16

FIX minor issues in report, score, learning.local

e10ba13

WIP special processing for same_unit

d33d65f

ENH first implementation of CDUs, for frag EDUs

f070c51

ENH require joblib >= 0.9.4

b35779a

WIP update DataPack to include cdu{s,_pairings,_data,_target}

e09c034

WIP same-unit as preproc

e982d23

WIP nonfixed_pairs are handled by classifier wrappers

fb462dd

FIX revert to binary same-unit

dd3f80a

WIP one file per doc

651fbd2

WIP use regular AttachClassifiers for Same-Unit, delete now useless code

cc77239

WIP one file per doc, same-unit

7e204bf

FIX selection of cdus in Datapack.selected

c56558a

MAINT carve out barebones_rst_deptree from get_oracle_ctrees

e002607

DOC+COSMIT minor fixes in harness.graph and io

71412b1

MAINT cleanups in io

dffdf19

DOC fix type and description of an argument in docstring

e34c780

MAINT renaming of rank strategy in educe dep2con

384896d

WIP print nb of spans in pred_ctree for debug

6b242ce

MAINT minor fix in metrics.util

cc842f9

WIP add support_pred in eval structured for ctrees

45e813d

WIP metrics.constituency: span_sel, fix sup_pred

6785970

MAINT refactor parseval_report

12c9846

ENH variant of parseval scores, per doc then averaged

cde05df

MAINT get_spans is now a method from {Simple}RSTTree

c19577e

WIP detailed metric: 'undirected spans' on deptree

639deee

FIX limit parseval to one ctree per doc

7f63ef4

FIX disable extra verbosity in ctree eval

abf439b

MAINT constituency metrics moved to educe

23b85da

ENH add scores LAS+N, LAS+O, LAS+N+O

a042559

MAINT contain CDU-related code

05b8f02

moreymat added 15 commits February 6, 2017 17:05

FIX load_multipack has file_split

bf8006a

FIX add verbose param to _load_multipack_cdus

26ba73d

FIX tuple takes a unique argument

13be763

FIX repair file_split=corpus

2f21c3c

FIX DataPack.selected() with no CDUs

48b1222

MAINT factor out dump_frag_edus (unfinished)

e93c74e

FIX parser.same_unit exclude pairs (ROOT, _)

532abf9

FIX attelo.parser.intra skip fake root to compute intra_tgts

7c6d064

FIX parser.intra _for_intra_cdu when no CDU pairing

bfea509

FIX parser.same_unit first real EDU at posn 0

e37585e

FIX disable forests for ctree eval

73331b7

FIX dpack.edus[0] is the fake root EDU if file_split='corpus'

a269f51

FIX workaround inconsistent API in conv from dtree to simplersttree

5602c43

FIX optional display of predicted same-unit

bc1d5ec

FIX use Torpor

ddcf3a1

This was referenced Feb 14, 2017

ENH comparative evaluation of RST parsers, fragmented EDUs irit-melodi/irit-rst-dt#34

Open

MAINT catchup with changes in API of educe and attelo irit-melodi/irit-stac#40

Open

moreymat added 10 commits February 15, 2017 11:49

FIX merge ctargets in DataPack.vstack

795fea0

FIX assume pos_label=1 for unpickled SklearnAttachClassifier

f17f57c

Merge remote-tracking branch 'upstream/master' into enh-preproc-same-…

ecee6fb

…unit Conflicts: attelo/harness/evaluate.py attelo/harness/example.py attelo/harness/interface.py attelo/parser/pipeline.py attelo/report.py attelo/score.py

ENH compute_uas_las() has param metrics

dd58064

ENH optionally pass doc_names to compute_uas_las()

41456e9

ENH metrics.deptree: dep_compact_report()

974ef79

ENH pairwise dep similarity

8aedc13

FIX pairwise sim report: no underscore

2964e82

ENH add dep metric R+O

50d7da4

FIX out_format latex

ada8822

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

ENH+FIX+WIP fragmented EDUs, dep2con, move Parseval, one file per doc #67

ENH+FIX+WIP fragmented EDUs, dep2con, move Parseval, one file per doc #67

moreymat commented Feb 14, 2017

ENH+FIX+WIP fragmented EDUs, dep2con, move Parseval, one file per doc #67

Are you sure you want to change the base?

ENH+FIX+WIP fragmented EDUs, dep2con, move Parseval, one file per doc #67

Conversation

moreymat commented Feb 14, 2017