Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

docs: Update README for PostgreSQL / Cosmos DB Integration #1576

Merged
merged 166 commits into from
Dec 20, 2024
Merged
Changes from all commits
Commits
Show all changes
166 commits
Select commit Hold shift + click to select a range
c5f069f
add postgressql lib
Fr4nc3 Nov 7, 2024
4fa9aa9
Create postgresdbservice.py
Fr4nc3 Nov 7, 2024
42eca2e
update ayncgp lib
Fr4nc3 Nov 8, 2024
42f66b9
add psycopg2 to poetry
Fr4nc3 Nov 12, 2024
1db0d65
User Story 10379: Refactor: Group Azure Blob Storage and Form Recogni…
Nov 12, 2024
87f557e
Update app_config.py to fix testcase failure
Pavan-Microsoft Nov 12, 2024
84817a4
Merge pull request #29 from Fr4nc3/PSL-US-10379
Fr4nc3 Nov 12, 2024
2293dd6
Merge remote-tracking branch 'upstream/main'
Fr4nc3 Nov 12, 2024
52abaa3
readme update for Group Azure Blob Storage and Form Recognizer Config…
Nov 12, 2024
857e7c9
Update LOCAL_DEPLOYMENT.md
Pavan-Microsoft Nov 13, 2024
3557a00
Update TEAMS_LOCAL_DEPLOYMENT.md
Pavan-Microsoft Nov 13, 2024
b25b585
Update .env.sample
Pavan-Microsoft Nov 13, 2024
28e2513
User Story 10017: Configure Environment Variables for Database Connec…
Nov 13, 2024
055ef0d
DATABASE_TYPE
Nov 13, 2024
bd5bc09
Merge pull request #31 from Fr4nc3/PSL-US-10017
Fr4nc3 Nov 13, 2024
d55b3b4
Merge pull request #30 from Fr4nc3/PSL-US-10379
Fr4nc3 Nov 13, 2024
f743e54
Merge remote-tracking branch 'upstream/main'
Fr4nc3 Nov 13, 2024
0bee336
Update poetry.lock
Fr4nc3 Nov 13, 2024
428130e
Load Respective Database Class Dynamically - either CosmosDB or Postg…
Nov 14, 2024
a3d4b2b
Merge pull request #32 from Fr4nc3/PSL-US-10020
Fr4nc3 Nov 14, 2024
3a60e6f
Error handling and close conversation
Nov 15, 2024
1012e82
alignment fix
Nov 15, 2024
bde750a
Set Default Configuration to CosmosDB
Nov 15, 2024
c05ce19
Merge pull request #33 from Fr4nc3/PSL-US-10020
Fr4nc3 Nov 15, 2024
ed1327e
postgress table scripts
Fr4nc3 Nov 18, 2024
05f386c
Update create_tables.py
Fr4nc3 Nov 18, 2024
b1f73fc
Merge remote-tracking branch 'upstream/main'
Fr4nc3 Nov 18, 2024
055cd04
Restrict Admin Dashboard Options for PostgreSQL Deployment
Nov 19, 2024
73c690c
added postgres option
gpickett Nov 19, 2024
5eb0513
updated main.json
gpickett Nov 19, 2024
58a60e0
updated oneclick deploy
gpickett Nov 19, 2024
8cfd276
updated oneclick
gpickett Nov 19, 2024
f6a9fe2
fixed oneclick again
gpickett Nov 19, 2024
a3e1d62
Configure Admin Options Based on PostgreSQL Selection
Nov 20, 2024
682e5d7
scaffolder for postgress create search vectors
Fr4nc3 Nov 21, 2024
f42141d
Merge pull request #34 from Fr4nc3/PSL-US-10754
Fr4nc3 Nov 21, 2024
70296f6
format code
Fr4nc3 Nov 21, 2024
8e05301
Implement retrieve Index Functionality in PostgreSQL - structure
Nov 21, 2024
7e0756d
Merge pull request #35 from Fr4nc3/PSL-US-10501
Fr4nc3 Nov 21, 2024
fb1e6b2
changed allowIps to false
gpickett Nov 21, 2024
b9e4875
rebuilt main.json
gpickett Nov 21, 2024
c673261
create scalfold for insert vector to postgress
Fr4nc3 Nov 22, 2024
4cc9507
Create index and retrieve index changes
Nov 22, 2024
942220b
format fix
Nov 22, 2024
34f1702
Merge pull request #36 from Fr4nc3/PSL-US-10501_1
Fr4nc3 Nov 22, 2024
6339d4f
Merge remote-tracking branch 'upstream/main'
Fr4nc3 Nov 22, 2024
9ab4539
Update poetry.lock
Fr4nc3 Nov 22, 2024
4d34296
update type with enums
Fr4nc3 Nov 22, 2024
d077183
Update create_postgres_tables.py
Fr4nc3 Nov 22, 2024
a997f89
Delete PostgreSQL Search Indexes When Files Are Deleted
Nov 25, 2024
fa2276d
Set up a limit for postgres query results using an environment variable
Nov 25, 2024
ab37eae
Code fix: Deploymen issue on adding Postgres details to keyvault
Prajwal-Microsoft Nov 26, 2024
f0f07d6
Set default DB as Cosmos
Prajwal-Microsoft Nov 26, 2024
baa2128
Merge pull request #39 from Fr4nc3/PSL-US-10973
Fr4nc3 Nov 26, 2024
e9e097e
Merge pull request #38 from Fr4nc3/postgresBicepChanges
Fr4nc3 Nov 26, 2024
06516c0
Merge remote-tracking branch 'upstream/main'
Fr4nc3 Nov 26, 2024
1fa7709
Updated Default values and removed Chat history flag from deployment
Prajwal-Microsoft Nov 26, 2024
ea07332
Merge remote-tracking branch 'origin/main' into bicepdefaults
Prajwal-Microsoft Nov 26, 2024
5aad9cb
Default values set
Prajwal-Microsoft Nov 27, 2024
84f56b9
Added changes for running Python script
Prajwal-Microsoft Nov 27, 2024
658cf3c
Added requirements.txt
Prajwal-Microsoft Nov 27, 2024
5379ef1
Updated requirements.txt
Prajwal-Microsoft Nov 27, 2024
a7a4bbb
Updated requirements.txt
Prajwal-Microsoft Nov 27, 2024
3f1cacf
Updated requiremnts.txt
Prajwal-Microsoft Nov 27, 2024
2b1670e
Updated script
Prajwal-Microsoft Nov 27, 2024
baaacd8
Updated requirements.txt
Prajwal-Microsoft Nov 27, 2024
23249be
Retrieve PostgreSQL Search Indexes When Exploring Uploaded Files
Nov 27, 2024
7305b6a
Merge pull request #40 from Fr4nc3/PSL-US-10974
Fr4nc3 Nov 27, 2024
6a73dd1
Added IP whitelisting of depliyment environment
Prajwal-Microsoft Nov 27, 2024
ef034f5
Updated script
Prajwal-Microsoft Nov 27, 2024
b2d6fcd
Updated the command to get IP
Prajwal-Microsoft Nov 27, 2024
f8d6a9b
Updated the Script to add ip
Prajwal-Microsoft Nov 27, 2024
c5d94f3
Added the rule name
Prajwal-Microsoft Nov 27, 2024
6804348
Update env_helper.py
Pavan-Microsoft Nov 27, 2024
6267998
Updated the Script with correct values
Prajwal-Microsoft Nov 27, 2024
e9f7c9d
Added code to run the Postgre SQL script
Prajwal-Microsoft Nov 27, 2024
e3eb512
Updated the Wai function
Prajwal-Microsoft Nov 28, 2024
4019078
Updated the main.json with latest changes
Prajwal-Microsoft Nov 28, 2024
363d4f9
Merge remote-tracking branch 'origin/main' into bicepdefaults
Prajwal-Microsoft Nov 28, 2024
996daea
Merge branch 'main' into latestmainbranch
Prajwal-Microsoft Nov 28, 2024
7c38f12
Merge pull request #42 from Fr4nc3/latestmainbranch
Pavan-Microsoft Nov 28, 2024
0506634
Merge remote-tracking branch 'origin/main' into bicepdefaults
Prajwal-Microsoft Nov 28, 2024
9a173fd
Merge issue fix
Prajwal-Microsoft Nov 28, 2024
7fc608d
fix: Lint issue
Prajwal-Microsoft Nov 28, 2024
185efe1
Merge pull request #41 from Fr4nc3/bicepdefaults
Fr4nc3 Nov 28, 2024
2ee0beb
Added Role based assignment to connect to db for web app
Prajwal-Microsoft Nov 28, 2024
4e9d5ab
Added dependencies
Prajwal-Microsoft Nov 28, 2024
68a968f
Disable Computer Vision Client & Disable Integrated Vectorization Whe…
Nov 28, 2024
e54f13e
Modified the script
Prajwal-Microsoft Nov 28, 2024
0b841c1
Fix: Added Principal to DB
Prajwal-Microsoft Nov 28, 2024
9079910
Fix: Added Managed identity to DB
Prajwal-Microsoft Nov 28, 2024
07ef813
fix: Modified the paramater
Prajwal-Microsoft Nov 28, 2024
110d666
fix: parameter changes
Prajwal-Microsoft Nov 28, 2024
d697cd6
test: for connectivity with aad
Prajwal-Microsoft Nov 28, 2024
5ab585b
fix: access token issue
Prajwal-Microsoft Nov 28, 2024
cd74dfd
Updated script
Prajwal-Microsoft Nov 28, 2024
6dace10
Merge remote-tracking branch 'origin/main' into bicepdefaults
Prajwal-Microsoft Nov 28, 2024
5f29e5b
fix: Updates script to run with managed identity
Prajwal-Microsoft Nov 28, 2024
76ad443
Merge pull request #44 from Fr4nc3/PSL-US-10919_1
Fr4nc3 Nov 29, 2024
0119f94
Merge remote-tracking branch 'origin/main' into bicepdefaults
Prajwal-Microsoft Nov 29, 2024
c9fe9ef
Updated code for testing
Prajwal-Microsoft Nov 29, 2024
9b0ae47
Test script
Prajwal-Microsoft Nov 29, 2024
56963f9
Merge pull request #45 from Fr4nc3/bicepdefaults
Fr4nc3 Nov 29, 2024
8d434f7
Added Function app to DB
Prajwal-Microsoft Nov 29, 2024
029054c
fix: Updated python script
Prajwal-Microsoft Nov 29, 2024
f392082
Commented PG_DISKANN as it is not available currently
Prajwal-Microsoft Nov 29, 2024
1887f64
Unit Testcase Chathistory
Nov 29, 2024
36a29f6
Code changes to test E2E functionality
Prajwal-Microsoft Dec 2, 2024
63c16ad
fix: Script issue & code refactoring
Prajwal-Microsoft Dec 2, 2024
3354762
Unit Testing for Chat History Functionality - Utilities
Dec 2, 2024
270386c
Mock default credentials
Dec 2, 2024
6198de7
mock default credentials
Dec 2, 2024
1dcde97
Changed from PG_DISAKNN to Vector
Prajwal-Microsoft Dec 3, 2024
11d78d0
Set PostgreSQL as the Default Database for CWYD Deployment & unittest…
Dec 3, 2024
dbba588
fix DATABASE_TYPE for testcases
Dec 3, 2024
dfb2fe6
fix boolean value
Dec 3, 2024
0e11306
fix testcase
Dec 3, 2024
5c7b01b
Reverted changes and Index option changed
Prajwal-Microsoft Dec 3, 2024
921b7e6
Added Main.json file
Prajwal-Microsoft Dec 3, 2024
6215f18
Merge pull request #47 from Fr4nc3/bicepdefaults
Fr4nc3 Dec 3, 2024
4241491
Merge remote-tracking branch 'origin/main' into PSL-US-10881
Prajwal-Microsoft Dec 4, 2024
a66e9ca
Merge pull request #46 from Fr4nc3/PSL-US-10881
Pavan-Microsoft Dec 4, 2024
9c23afa
fix env issue
Dec 4, 2024
412db17
Merge pull request #48 from Fr4nc3/PSL-US-10972
Fr4nc3 Dec 4, 2024
7d78aab
Updated the base url based on fork branch
Prajwal-Microsoft Dec 5, 2024
552355d
Merge pull request #49 from Fr4nc3/bicepdefaults
Pavan-Microsoft Dec 5, 2024
fc602e2
Updated base URL
Prajwal-Microsoft Dec 5, 2024
78a1eb8
Merge pull request #50 from Fr4nc3/bicepdefaults
Pavan-Microsoft Dec 5, 2024
23a8211
Update README.md
Prajwal-Microsoft Dec 5, 2024
24da885
Updated script to change the table owner
Prajwal-Microsoft Dec 5, 2024
9bac583
Merge pull request #51 from Fr4nc3/bicepdefaults
Pavan-Microsoft Dec 5, 2024
63eadfa
Merge branch 'main' into PSL-Latest-AzureSamples
Pavan-Microsoft Dec 5, 2024
c02aa20
Merge pull request #52 from Azure-Samples/PSL-Latest-AzureSamples
Fr4nc3 Dec 5, 2024
d741e7b
Create postgreSQL.md
Fr4nc3 Dec 5, 2024
30c6acf
Updated the container and version for 1 click deployment verification
Prajwal-Microsoft Dec 5, 2024
b0093ed
Merge pull request #53 from Fr4nc3/bicepdefaults
Fr4nc3 Dec 5, 2024
404de03
feat: Updated the script to remove keyvault dependency
Prajwal-Microsoft Dec 5, 2024
9aa57b4
Merge branch 'main' of https://github.com/Fr4nc3/chat-with-your-data-…
Prajwal-Microsoft Dec 5, 2024
49314ba
fix: passing server deails to deployment script
Prajwal-Microsoft Dec 5, 2024
396b68b
fix: For database type of Cosmos DB
Prajwal-Microsoft Dec 6, 2024
d4fa94c
fix delete page issue
Dec 6, 2024
da13aa7
Merge pull request #54 from Fr4nc3/psl-postgresbugfix
Fr4nc3 Dec 6, 2024
9b91c96
update db to enum values
Fr4nc3 Dec 9, 2024
b2c199e
updte postgreSQL vector table name in the documents, and update document
Fr4nc3 Dec 9, 2024
2a253ae
Update postgreSQL.md
Fr4nc3 Dec 9, 2024
3225ce2
Merge branch 'main' into Downmerge_1012
Dec 10, 2024
4642e36
Merge pull request #55 from Fr4nc3/Downmerge_1012
Pavan-Microsoft Dec 10, 2024
fbfb1ad
Update architrecture_pg.png
Fr4nc3 Dec 10, 2024
d05be4d
fix for Reference is shown multiple times for every sentence in respo…
Dec 10, 2024
a617433
Update baseURL
Dec 10, 2024
8a5ea7c
Add info for conversationFlow & Orchestration strategy for postgres i…
Dec 10, 2024
6567a3d
Update Registry name
Dec 11, 2024
e61dfc9
Merge pull request #56 from Fr4nc3/PSL-BUG-11349_1
Fr4nc3 Dec 11, 2024
6c42b28
Update Onclick deployment link
Pavan-Microsoft Dec 11, 2024
207c814
Set COSMOSDB as the default for missing DATABASE_TYPE to ensure compa…
Dec 11, 2024
d6cc15a
Merge pull request #57 from Fr4nc3/PSL-BUG-11349_2
Fr4nc3 Dec 11, 2024
7f139e1
update readme and position of database
Fr4nc3 Dec 12, 2024
46d1440
quick update to readme to get the template screenshot
Fr4nc3 Dec 12, 2024
19ce95c
add database selection
Fr4nc3 Dec 12, 2024
194ad6d
remove characters
Fr4nc3 Dec 12, 2024
f4c400a
rollback to the main repo endpoint
Fr4nc3 Dec 12, 2024
ccd685d
update architecture files
Fr4nc3 Dec 12, 2024
92e97fb
Update db_selection.png
Fr4nc3 Dec 13, 2024
70634b3
Update README.md
Fr4nc3 Dec 13, 2024
c9c95fb
Merge branch 'Azure-Samples:main' into main
Fr4nc3 Dec 19, 2024
f293f62
Update README.md
Fr4nc3 Dec 20, 2024
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion README.md
Original file line number Diff line number Diff line change
Expand Up @@ -171,7 +171,7 @@ With the addition of PostgreSQL, customers can leverage the power of a relations

Customers have the option to deploy this solution with PostgreSQL or Cosmos DB. Consider the following when deciding which database to use:
- PostgreSQL enables a relationship-based AI solution and search indexing for Retrieval Augmented Generation (RAG)
- Cosmos DB is a NoSQL-based solution for chat history
- Cosmos DB enables chat history and is a NoSQL-based solution. With Cosmos DB, Azure AI Search is used for storing extracted documents and embeddings.


To review PostgreSQL configuration overview and steps, follow the link [here](docs/postgreSQL.md).
Expand Down
Loading