Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Switch to DataFrames and add Metrics Filters #84

Merged
merged 41 commits into from
May 14, 2024
Merged

Switch to DataFrames and add Metrics Filters #84

merged 41 commits into from
May 14, 2024

Conversation

kylemann16
Copy link
Collaborator

@kylemann16 kylemann16 commented May 2, 2024

This pull request makes a couple of major changes:

  1. Convert from using mostly numpy ndarrays to pandas DataFrames

    • Dataframes are easier to work with, and easier to manipulate overall
    • Dataframes make it easier to implement the filters feature, as it's easier to pass around DataFrames with select attributes
  2. Add Filters to Metrics

    • Filters will act as a list of functions that manipulate a DataFrame before it arrives at the Metric's main method.
    • This will allow for users to add thresholds, like an elevation threshold for a specific metric
  3. Split up methods a bit more in Shatter so that computationally heavy pieces have more room to operate.

  4. Add Attribute dependencies for a Metric so we can be sure that the database and any ingested data has that attribute

  5. Change Extract to be using pandas DataFrames as well.

    • Added better filtering and overlap detection

…documentation to include delete, restart, resume. Updating info command to filter history, metadata, and attributes.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants