Con oracle #1391
Merged
Con oracle #1391
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
…void making the recall error (the wrong open/open already being a precision error) Put the ambiguous transition to the bottom of the in-order list. Add some notes on a slightly improved (?) unambiguous open subtree analysis
…reused in other oracles Also separate out a find-previous function
Add a partial test as well Mostly fill out a chart of dynamic oracle transitions for in_order_compound
…taset several times to make ensemble datasets which have a different profile, hopefully resulting in different models
…the transition scheme name a bit less verbose
…of all constituent types (transition types are not covered yet, though, for the case of compound transitions)
…en intentionally reweighting trees
Update some stats for when to close an incorrect shift-open
… as to keep statistics on transitions even when they aren't leading to repairs
…ens frequently, it undoes the previous experiments measuring the oracle effectiveness)
Unambiguous solution for some cases as a default repair Includes two versions of the fix for ambiguous cases
…emed to hurt scores somewhat. Will run another experiment
… tree construction for that test
…closing the extra constituent early or at the end of the surrounding bracket
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Add an oracle for the in-order-compound transition scheme, along with extensive upgrades to the in-order oracle (although the accuracy gainz are of course not earth-shattering) and some instrumentation such as the ability to add dummy oracle transitions which log the misses in the in-order system.
As incidental changes, include a script to go through the current formatting of conparse results (not expected to change) and some scripts to experiment with different data divisions for building the ensemble. Spoiler: none of the ensemble mechanisms actually helped improve results over just averaging 5 models together