Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Ready: Add Faculty Profile Builder #485

Open
wants to merge 15 commits into
base: master
Choose a base branch
from
Open

Conversation

goldpbear
Copy link
Member

@goldpbear goldpbear commented Dec 5, 2017

Ready for review

Add an invoke task for scraping faculty bios generated via our google form. The task will pull data from the google spreadsheet linked to the form, and build Markdown files with the information based on the existing faculty template. New templates will be output to _people/faculty/. The task will also pull down profile images uploaded via the form and save them in the same directory.

The task expects a Google API service account credentials file to be found at secrets/google-api-credentials.json.

Usage (from the root of the project):

invoke build_faculty_profiles

This task will only access rows of the google spreadsheet after the last_accessed_row stored in a new file, _remote_data_sequences.yml. After processing new spreadsheet rows, the task will update the value of last_accessed_row.

Also add an invoke task for running face detection and cropping on uploaded faculty profile images.

The task expects AWS credentials to be found at secrets/aws-config.

Usage (from the root of the project):

invoke process_faculty_images

TODO

  • use google-api-python-client for interacting with Google Drive; otherwise, it seems that all uploaded faculty images need to be given a shareable link manually
  • image face detection via AWS Rekognition
  • handling of existing faculty info (from old people branch)
    • UPDATE: we'll discard all old information
  • managing repeated uses of this script (do we rebuild all templates? Only those that are new or have changed? etc.)
    • UPDATE: let's keep track of the last accessed row in the source spreadsheet (perhaps in a modified _compile_calendar_sequences.yml file). Repeated uses of the faculty profile builder script will only touch rows beyond the last used index. Modifications to existing templates should be made directly in template files themselves, not in the spreadsheet.

*update tests

@jayfo jayfo changed the title Add faculty profile builder In Progress: Add Faculty Profile Builder Dec 6, 2017
@goldpbear goldpbear changed the title In Progress: Add Faculty Profile Builder Ready: Add Faculty Profile Builder Jan 26, 2018
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants