$ scrapydweb [2024-05-06 15:17:54,189] INFO in apscheduler.scheduler: Scheduler started [2024-05-06 15:17:54,198] INFO in scrapydweb.run: ScrapydWeb version: 1.4.0 [2024-05-06 15:17:54,198] INFO in scrapydweb.run: Use 'scrapydweb -h' to get help [2024-05-06 15:17:54,199] INFO in scrapydweb.run: Main pid: 16997 [2024-05-06 15:17:54,199] DEBUG in scrapydweb.run: Loading default settings from /Users/pdurbin/github/mlcommons/croissant/health/venv/lib/python3.12/site-packages/scrapydweb/default_settings.py Traceback (most recent call last): File "/Users/pdurbin/github/mlcommons/croissant/health/venv/bin/scrapydweb", line 8, in sys.exit(main()) ^^^^^^ File "/Users/pdurbin/github/mlcommons/croissant/health/venv/lib/python3.12/site-packages/scrapydweb/run.py", line 32, in main app = create_app() ^^^^^^^^^^^^ File "/Users/pdurbin/github/mlcommons/croissant/health/venv/lib/python3.12/site-packages/scrapydweb/__init__.py", line 81, in create_app handle_db(app) File "/Users/pdurbin/github/mlcommons/croissant/health/venv/lib/python3.12/site-packages/scrapydweb/__init__.py", line 123, in handle_db db.create_all() File "/Users/pdurbin/github/mlcommons/croissant/health/venv/lib/python3.12/site-packages/flask_sqlalchemy/extension.py", line 900, in create_all self._call_for_binds(bind_key, "create_all") File "/Users/pdurbin/github/mlcommons/croissant/health/venv/lib/python3.12/site-packages/flask_sqlalchemy/extension.py", line 871, in _call_for_binds engine = self.engines[key] ^^^^^^^^^^^^ File "/Users/pdurbin/github/mlcommons/croissant/health/venv/lib/python3.12/site-packages/flask_sqlalchemy/extension.py", line 687, in engines app = current_app._get_current_object() # type: ignore[attr-defined] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/Users/pdurbin/github/mlcommons/croissant/health/venv/lib/python3.12/site-packages/werkzeug/local.py", line 519, in _get_current_object raise RuntimeError(unbound_message) from None RuntimeError: Working outside of application context. This typically means that you attempted to use functionality that needed the current application. To solve this, set up an application context with app.app_context(). See the documentation for more information. 2024-05-06 15:17:54,214 INFO sqlalchemy.engine.Engine BEGIN (implicit) [2024-05-06 15:17:54,214] INFO in sqlalchemy.engine.Engine: BEGIN (implicit) 2024-05-06 15:17:54,216 INFO sqlalchemy.engine.Engine SELECT metadata.id AS metadata_id, metadata.version AS metadata_version, metadata.last_check_update_timestamp AS metadata_last_check_update_timestamp, metadata.main_pid AS metadata_main_pid, metadata.logparser_pid AS metadata_logparser_pid, metadata.poll_pid AS metadata_poll_pid, metadata.pageview AS metadata_pageview, metadata.url_scrapydweb AS metadata_url_scrapydweb, metadata.url_jobs AS metadata_url_jobs, metadata.url_schedule_task AS metadata_url_schedule_task, metadata.url_delete_task_result AS metadata_url_delete_task_result, metadata.username AS metadata_username, metadata.password AS metadata_password, metadata.scheduler_state AS metadata_scheduler_state, metadata.jobs_per_page AS metadata_jobs_per_page, metadata.tasks_per_page AS metadata_tasks_per_page, metadata.jobs_style AS metadata_jobs_style FROM metadata WHERE metadata.version = ? LIMIT ? OFFSET ? [2024-05-06 15:17:54,216] INFO in sqlalchemy.engine.Engine: SELECT metadata.id AS metadata_id, metadata.version AS metadata_version, metadata.last_check_update_timestamp AS metadata_last_check_update_timestamp, metadata.main_pid AS metadata_main_pid, metadata.logparser_pid AS metadata_logparser_pid, metadata.poll_pid AS metadata_poll_pid, metadata.pageview AS metadata_pageview, metadata.url_scrapydweb AS metadata_url_scrapydweb, metadata.url_jobs AS metadata_url_jobs, metadata.url_schedule_task AS metadata_url_schedule_task, metadata.url_delete_task_result AS metadata_url_delete_task_result, metadata.username AS metadata_username, metadata.password AS metadata_password, metadata.scheduler_state AS metadata_scheduler_state, metadata.jobs_per_page AS metadata_jobs_per_page, metadata.tasks_per_page AS metadata_tasks_per_page, metadata.jobs_style AS metadata_jobs_style FROM metadata WHERE metadata.version = ? LIMIT ? OFFSET ? 2024-05-06 15:17:54,216 INFO sqlalchemy.engine.Engine [generated in 0.00022s] ('1.4.0', 1, 0) [2024-05-06 15:17:54,216] INFO in sqlalchemy.engine.Engine: [generated in 0.00022s] ('1.4.0', 1, 0) 2024-05-06 15:17:54,216 INFO sqlalchemy.engine.Engine ROLLBACK [2024-05-06 15:17:54,216] INFO in sqlalchemy.engine.Engine: ROLLBACK Exception ignored in atexit callback: at 0x106f5d760> Traceback (most recent call last): File "/Users/pdurbin/github/mlcommons/croissant/health/venv/lib/python3.12/site-packages/scrapydweb/utils/scheduler.py", line 111, in atexit.register(lambda: shutdown_scheduler()) ^^^^^^^^^^^^^^^^^^^^ File "/Users/pdurbin/github/mlcommons/croissant/health/venv/lib/python3.12/site-packages/scrapydweb/utils/scheduler.py", line 98, in shutdown_scheduler handle_metadata().get('main_pid')) ^^^^^^^^^^^^^^^^^ File "/Users/pdurbin/github/mlcommons/croissant/health/venv/lib/python3.12/site-packages/scrapydweb/common.py", line 85, in handle_metadata metadata = Metadata.query.filter_by(version=__version__).first() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/Users/pdurbin/github/mlcommons/croissant/health/venv/lib/python3.12/site-packages/sqlalchemy/orm/query.py", line 2728, in first return self.limit(1)._iter().first() # type: ignore ^^^^^^^^^^^^^^^^^^^^^ File "/Users/pdurbin/github/mlcommons/croissant/health/venv/lib/python3.12/site-packages/sqlalchemy/orm/query.py", line 2827, in _iter result: Union[ScalarResult[_T], Result[_T]] = self.session.execute( ^^^^^^^^^^^^^^^^^^^^^ File "/Users/pdurbin/github/mlcommons/croissant/health/venv/lib/python3.12/site-packages/sqlalchemy/orm/session.py", line 2351, in execute return self._execute_internal( ^^^^^^^^^^^^^^^^^^^^^^^ File "/Users/pdurbin/github/mlcommons/croissant/health/venv/lib/python3.12/site-packages/sqlalchemy/orm/session.py", line 2236, in _execute_internal result: Result[Any] = compile_state_cls.orm_execute_statement( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/Users/pdurbin/github/mlcommons/croissant/health/venv/lib/python3.12/site-packages/sqlalchemy/orm/context.py", line 293, in orm_execute_statement result = conn.execute( ^^^^^^^^^^^^^ File "/Users/pdurbin/github/mlcommons/croissant/health/venv/lib/python3.12/site-packages/sqlalchemy/engine/base.py", line 1418, in execute return meth( ^^^^^ File "/Users/pdurbin/github/mlcommons/croissant/health/venv/lib/python3.12/site-packages/sqlalchemy/sql/elements.py", line 515, in _execute_on_connection return connection._execute_clauseelement( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/Users/pdurbin/github/mlcommons/croissant/health/venv/lib/python3.12/site-packages/sqlalchemy/engine/base.py", line 1640, in _execute_clauseelement ret = self._execute_context( ^^^^^^^^^^^^^^^^^^^^^^ File "/Users/pdurbin/github/mlcommons/croissant/health/venv/lib/python3.12/site-packages/sqlalchemy/engine/base.py", line 1846, in _execute_context return self._exec_single_context( ^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/Users/pdurbin/github/mlcommons/croissant/health/venv/lib/python3.12/site-packages/sqlalchemy/engine/base.py", line 1986, in _exec_single_context self._handle_dbapi_exception( File "/Users/pdurbin/github/mlcommons/croissant/health/venv/lib/python3.12/site-packages/sqlalchemy/engine/base.py", line 2353, in _handle_dbapi_exception raise sqlalchemy_exception.with_traceback(exc_info[2]) from e File "/Users/pdurbin/github/mlcommons/croissant/health/venv/lib/python3.12/site-packages/sqlalchemy/engine/base.py", line 1967, in _exec_single_context self.dialect.do_execute( File "/Users/pdurbin/github/mlcommons/croissant/health/venv/lib/python3.12/site-packages/sqlalchemy/engine/default.py", line 924, in do_execute cursor.execute(statement, parameters) sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) no such table: metadata [SQL: SELECT metadata.id AS metadata_id, metadata.version AS metadata_version, metadata.last_check_update_timestamp AS metadata_last_check_update_timestamp, metadata.main_pid AS metadata_main_pid, metadata.logparser_pid AS metadata_logparser_pid, metadata.poll_pid AS metadata_poll_pid, metadata.pageview AS metadata_pageview, metadata.url_scrapydweb AS metadata_url_scrapydweb, metadata.url_jobs AS metadata_url_jobs, metadata.url_schedule_task AS metadata_url_schedule_task, metadata.url_delete_task_result AS metadata_url_delete_task_result, metadata.username AS metadata_username, metadata.password AS metadata_password, metadata.scheduler_state AS metadata_scheduler_state, metadata.jobs_per_page AS metadata_jobs_per_page, metadata.tasks_per_page AS metadata_tasks_per_page, metadata.jobs_style AS metadata_jobs_style FROM metadata WHERE metadata.version = ? LIMIT ? OFFSET ?] [parameters: ('1.4.0', 1, 0)] (Background on this error at: https://sqlalche.me/e/20/e3q8)