Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix typeorm caching #136

Merged
merged 139 commits into from
Dec 9, 2024
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
139 commits
Select commit Hold shift + click to select a range
1e52350
refactored statistic
yianzhang14 Jan 24, 2024
873b181
Merge remote-tracking branch 'upstream/v2' into v2
yianzhang14 Jan 24, 2024
acbba26
refactoring + documentation
yianzhang14 Jan 24, 2024
d548ca8
finished refactoring on maintainers
yianzhang14 Feb 8, 2024
d77a6d1
finished connector refactoring
yianzhang14 Feb 8, 2024
6862c6e
finished eslinting all remaining ts files
yianzhang14 Feb 8, 2024
b680126
documented server.ts + added markdown files
yianzhang14 Feb 8, 2024
c6a811a
refactored cli.ts
yianzhang14 Feb 8, 2024
b4c6990
fixed some typing issues
yianzhang14 Feb 14, 2024
4ea540d
revamped packages + redid express structure + more linting
yianzhang14 Feb 14, 2024
0c6d266
more type hinting + async removal on models
yianzhang14 Feb 15, 2024
4a48c8c
linting on main src/ files
yianzhang14 Feb 15, 2024
806c8b0
changes to type assertions
yianzhang14 Feb 15, 2024
d88c0e4
finished maintainers
yianzhang14 Feb 15, 2024
9b99202
make types more meaningful
yianzhang14 Feb 15, 2024
e4bffa2
finished with util rework + minor changes elsewhere
yianzhang14 Feb 15, 2024
ddd5876
finished linting + helper rework + better nullguarding + max line size
yianzhang14 Feb 15, 2024
62efff4
fixed helper typo & slurmconnector doc
yianzhang14 Feb 15, 2024
e2a4f40
add specialized manifest download functionality + lint action
yianzhang14 Feb 15, 2024
bc6fcfc
documentation initial commit + helper moving + abstract functions + i…
yianzhang14 Feb 22, 2024
780c66b
finished codebase overview doc
yianzhang14 Feb 29, 2024
299183c
finished codebase documentation doc
yianzhang14 Feb 29, 2024
bf98248
added caching to folder uploaders + a bit more linting
yianzhang14 Feb 29, 2024
68ca9a3
disable cached upload on data
yianzhang14 Mar 6, 2024
c69a44f
added cache refresing functionality
yianzhang14 Mar 7, 2024
e10b151
fixed swagger error
yianzhang14 Mar 7, 2024
bcaf837
fixed cli
yianzhang14 Mar 7, 2024
6ab0c5c
readd typedoc
yianzhang14 Mar 7, 2024
b2c2bc6
more package updates
yianzhang14 Mar 7, 2024
3fd1307
added mysql
yianzhang14 Mar 7, 2024
9e8b02b
disable uml
yianzhang14 Mar 7, 2024
5ed7e8d
move all documentation out of build
yianzhang14 Mar 7, 2024
a9ebf42
fixed generate swagger bug
yianzhang14 Mar 7, 2024
ebffec6
reenable documentation
yianzhang14 Mar 7, 2024
e642727
fixed gitutil bug + updated packages
yianzhang14 Mar 7, 2024
d6e5d2d
recursive mkdirs
yianzhang14 Mar 7, 2024
060f933
more gitutil bugfixes
yianzhang14 Mar 7, 2024
cb014e3
silenced console.logs
yianzhang14 Mar 7, 2024
064d01c
reenabled urlencoded
yianzhang14 Mar 7, 2024
d0bf93f
fixed folder uploader bug
yianzhang14 Mar 7, 2024
e3f7713
more bugfixing + removing console logs
yianzhang14 Mar 20, 2024
bb525b9
Merge branch 'v2' of https://github.com/yianzhang14/cybergis-compute-…
yianzhang14 Mar 20, 2024
4fcaab0
fixed remotefsexists bug
yianzhang14 Mar 20, 2024
93ba587
job upload now works
yianzhang14 Mar 20, 2024
6a5f576
update build script to copy example jsons
yianzhang14 Mar 20, 2024
2c3dc0b
fixed github actions
yianzhang14 Mar 20, 2024
77a2711
added ruff for the python files for now
yianzhang14 Mar 20, 2024
31d2343
add js globus sdk
yianzhang14 Mar 28, 2024
396a17b
added typing to cachedupload
yianzhang14 Mar 28, 2024
947de14
switched to git sdk
yianzhang14 Mar 28, 2024
cb158c0
switch to fs promises
yianzhang14 Mar 28, 2024
734cce6
automated branch resolution + out of date checking
yianzhang14 Mar 28, 2024
ce8453e
moved configs to example
yianzhang14 Mar 28, 2024
1328b0b
undo config.json move
yianzhang14 Mar 28, 2024
20add35
fixed action typo
yianzhang14 Mar 28, 2024
61ed399
removed all refreshing code + added automatic logic to decide when to…
yianzhang14 Mar 28, 2024
0f5096d
added yaml parser
yianzhang14 Mar 28, 2024
f59e2c7
add js globus sdk
yianzhang14 Mar 28, 2024
3d08ba9
Merge branch 'globus-rewrite' of https://github.com/yianzhang14/cyber…
yianzhang14 Mar 28, 2024
09f80ed
sync package lock
yianzhang14 Mar 28, 2024
40eadf8
rework folder typing to be more enumy
yianzhang14 Mar 28, 2024
49695c1
leftover changes from folder rework
yianzhang14 Mar 28, 2024
a9f56f6
added cache model
yianzhang14 Mar 28, 2024
5103fa9
force synchronize
yianzhang14 Mar 28, 2024
18d58a4
synchronize in the json
yianzhang14 Mar 28, 2024
90c1c12
actually force reinitialize
yianzhang14 Mar 28, 2024
80accd5
turned strict on + updated packages + migrated to typeorm 0.3 + migra…
yianzhang14 Mar 31, 2024
d794992
reworked tsconfig
yianzhang14 Mar 31, 2024
6e2733d
remove typeorm-uml
yianzhang14 Mar 31, 2024
4ded9c2
actually disable uml + add cache to entities
yianzhang14 Mar 31, 2024
e67021a
actually disable uml instead of tsdoc
yianzhang14 Mar 31, 2024
a95faa9
fixed redis
yianzhang14 Apr 4, 2024
f627ba4
connect to redis client
yianzhang14 Apr 4, 2024
326bef9
reworked cache + deprecated specialized manifest + added more git cac…
yianzhang14 Apr 4, 2024
3b0a2d1
reworked refreshing in getexecutablemanifest
yianzhang14 Apr 4, 2024
d3cb922
reworked db to not be a class per typeorm guidelines
yianzhang14 Apr 4, 2024
feb785c
leftover db port changes
yianzhang14 Apr 4, 2024
2102387
remove ormconfig
yianzhang14 Apr 4, 2024
cba2125
initialize database in server.ts
yianzhang14 Apr 4, 2024
92824f4
fixed some minor errors
yianzhang14 Apr 4, 2024
f4fd3d0
initialize datasource in init hello world
yianzhang14 Apr 4, 2024
b0a38dd
reenable register
yianzhang14 Apr 4, 2024
ca3b69b
move this.register
yianzhang14 Apr 11, 2024
b35aadc
Merge branch 'v2' of https://github.com/yianzhang14/cybergis-compute-…
yianzhang14 Apr 11, 2024
3e28485
fix db registering
yianzhang14 Apr 11, 2024
55138a8
fix db registering
yianzhang14 Apr 11, 2024
5a6b3b1
Merge branch 'v2' of https://github.com/yianzhang14/cybergis-compute-…
yianzhang14 Apr 11, 2024
acf841f
add print statements
yianzhang14 Apr 11, 2024
1865264
debugging job2object
yianzhang14 Apr 11, 2024
fdd96d5
updated dockerfile + removed print statements
yianzhang14 Apr 11, 2024
7ee168d
fixed typing on nullable model columns
yianzhang14 Apr 11, 2024
93d113d
better undefined/null handling + typeorm function fixes
yianzhang14 Apr 11, 2024
49a50e3
added more is_testing clauses to console logs
yianzhang14 Apr 11, 2024
9980cb3
fixed registercache
yianzhang14 Apr 11, 2024
ae1e7bc
more fixes to hpcpath -> cachepath
yianzhang14 Apr 11, 2024
0f292f8
disable removing comments
yianzhang14 Apr 11, 2024
c939077
styling change + git manifest cache + new git routes
yianzhang14 Apr 26, 2024
c0a4d76
Merge branch 'v2' of https://github.com/yianzhang14/cybergis-compute-…
yianzhang14 Apr 26, 2024
770e0b8
rework server structure
yianzhang14 Apr 26, 2024
b87c2a2
initialize cache
yianzhang14 Apr 26, 2024
340bb14
change rimraf
yianzhang14 May 6, 2024
c70ff0e
changed promises to awaits
yianzhang14 May 6, 2024
20a6188
change unix time scaling
yianzhang14 May 6, 2024
5c9815b
fix linting in cli
yianzhang14 May 6, 2024
022a644
undo examples folder
yianzhang14 May 13, 2024
bf45017
rename a file
yianzhang14 May 31, 2024
ad85b8c
Merge remote-tracking branch 'upstream/v2' into v2
yianzhang14 May 31, 2024
9cec97c
fixed merge bugs
yianzhang14 May 31, 2024
6ea10a7
fixed linting
yianzhang14 May 31, 2024
f06ae54
change the eslint config
yianzhang14 May 31, 2024
f717143
revert back to commonjs
yianzhang14 May 31, 2024
74c9b4f
change global variables
yianzhang14 May 31, 2024
42b9396
Merge remote-tracking branch 'upstream/v2' into v2
yianzhang14 Jun 11, 2024
4dff8c1
disable typeorm redis caching
yianzhang14 Jun 11, 2024
f17d807
Merge remote-tracking branch 'upstream/v2' into v2
yianzhang14 Jun 23, 2024
9fa4c6a
Merge branch 'v2' into globus-rewrite
yianzhang14 Jun 23, 2024
e0e9e95
update packages
yianzhang14 Jun 23, 2024
7dcb5b5
changed file structure + updated linting
yianzhang14 Jun 23, 2024
f6da777
update file paths
yianzhang14 Jun 23, 2024
4dc3ed7
update file paths again
yianzhang14 Jun 23, 2024
7955a92
fix paths and eslint
yianzhang14 Jun 24, 2024
ff00d07
more path fixes
yianzhang14 Jun 24, 2024
3a88d1c
added axios-based globus ts impl
yianzhang14 Jul 14, 2024
555ffd2
fix globus imports
yianzhang14 Jul 14, 2024
566d5e3
fix entities
yianzhang14 Jul 14, 2024
3fdeb0c
more typeorm fixes
yianzhang14 Jul 14, 2024
5f0b808
fix typeorm again
yianzhang14 Jul 14, 2024
feb74fe
change a path
yianzhang14 Jul 14, 2024
b503567
add logging
yianzhang14 Jul 14, 2024
5acfca5
add submission id retrieval
yianzhang14 Jul 14, 2024
34f13ea
Merge pull request #1 from yianzhang14/globus
yianzhang14 Jul 14, 2024
8031e41
fix caching invalidation
yianzhang14 Oct 10, 2024
3aae948
add sanity check for verifying cache refresh
yianzhang14 Oct 10, 2024
a7bb8e6
Merge remote-tracking branch 'upstream/v2' into v2
yianzhang14 Oct 11, 2024
7a4575c
Merge branch 'v2' into refresh-fix
yianzhang14 Oct 11, 2024
f87c79a
edit entrypoint
yianzhang14 Oct 21, 2024
7f00296
enable cache again
yianzhang14 Oct 21, 2024
ac6b234
change entrypoint
yianzhang14 Oct 21, 2024
deb24a9
Merge remote-tracking branch 'upstream/v2' into v2
yianzhang14 Dec 9, 2024
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
3 changes: 3 additions & 0 deletions docker/docker-entrypoint.sh
Original file line number Diff line number Diff line change
Expand Up @@ -29,4 +29,7 @@ EOT

# run server
redis-server /job_supervisor/docker/redis.conf --daemonize yes

echo "127.0.0.1 localhost" > /etc/hosts

npm run start
17 changes: 8 additions & 9 deletions src/utils/DB.ts
Original file line number Diff line number Diff line change
Expand Up @@ -27,15 +27,14 @@ let dbConfig: DataSourceOptions = {
logging: false,
migrationsRun: true,
entities: entities,
// cache: {
// type: "redis",
// options: {
// host: config.redis.host,
// port: config.redis.port,
// // TODO: add password support
// },
// ignoreErrors: true,
// },
cache: {
type: "redis",
options: {
host: config.redis.host,
port: config.redis.port,
// TODO: add password support
}
},
};

if (config.is_jest) {
Expand Down
Loading