Skip to content

Commit

Permalink
284 integrate airflow to webapp (#285)
Browse files Browse the repository at this point in the history
* Update environment variables and API endpoints in webapp and server code, and add Spark UI and Airflow base URLs to config.js and .env.dev

* Update nginx.conf to proxy_pass to airflow-webserver instead of history-server and update X-Frame-Options header in docker/nginx/nginx.conf

* Update nginx.conf, environment variables, and API endpoints, and add Spark UI and Airflow base URLs

* Update environment variables and API endpoints, and add Spark UI and Airflow base URLs to webapp and server code
  • Loading branch information
xuwenyihust authored Jul 12, 2024
1 parent 8b5c445 commit 63672f2
Show file tree
Hide file tree
Showing 12 changed files with 3,211 additions and 2 deletions.
9 changes: 9 additions & 0 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -78,6 +78,15 @@ PawMark is a platform for big data and AI. It is based on Apache Spark and Kuber

</details>

<details>
<summary>Server</summary>

[![Build Docker - Server](https://github.com/xuwenyihust/PawMark/actions/workflows/build-docker-server.yml/badge.svg)](https://github.com/xuwenyihust/PawMark/actions/workflows/build-docker-server.yml)

- [Dockerfile](./server/Dockerfile)

</details>

<details>
<summary>Spark</summary>

Expand Down
3 changes: 3 additions & 0 deletions docker/airflow/Dockerfile
Original file line number Diff line number Diff line change
Expand Up @@ -18,3 +18,6 @@ RUN python3 -m ipykernel install --user --name python3 --display-name "Python 3"
# Set JAVA_HOME environment variable
ENV JAVA_HOME /usr/lib/jvm/java-17-openjdk-amd64

COPY webserver_config.py /opt/airflow/webserver_config.py
COPY airflow.cfg /opt/airflow/airflow.cfg

Loading

0 comments on commit 63672f2

Please sign in to comment.