Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

New Experimental Training Features, Providers Refactor #1155

Merged
merged 110 commits into from
Apr 2, 2024
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
110 commits
Select commit Hold shift + click to select a range
11e3abd
Lean AGiXT
Josh-XT Mar 29, 2024
f1a94ad
Leannnnnnnn
Josh-XT Mar 29, 2024
8d2f40f
Add defaults
Josh-XT Mar 29, 2024
7745db9
Add to default embedder
Josh-XT Mar 29, 2024
85c4f55
Remove requirement
Josh-XT Mar 29, 2024
6e5444b
Clean up
Josh-XT Mar 29, 2024
2cc38c7
Add provider services
Josh-XT Mar 29, 2024
fd1d437
Add service endpoint
Josh-XT Mar 29, 2024
99b097f
Add services to agent
Josh-XT Mar 29, 2024
85d3b95
Add to defaults
Josh-XT Mar 29, 2024
ace2ffc
Add provider settings
Josh-XT Mar 29, 2024
825be41
Fix bad refs
Josh-XT Mar 29, 2024
ba84b0a
Add services test
Josh-XT Mar 29, 2024
279c64e
Switch model to gpt-4-vision-preview if images uploaded
Josh-XT Mar 29, 2024
faea996
Remove old refs
Josh-XT Mar 29, 2024
510c5e0
Add image generations endpoint
Josh-XT Mar 29, 2024
eb4fa9b
QA Improvements for DPO training
Josh-XT Mar 29, 2024
c727574
Update dataset creation to use DPO method
Josh-XT Mar 29, 2024
90cd0bb
Remove embeddings, clean up
Josh-XT Mar 29, 2024
15a8dba
Move functionality
Josh-XT Mar 29, 2024
d35bc90
Add np
Josh-XT Mar 29, 2024
dba085d
Attempt to fix embedder
Josh-XT Mar 29, 2024
14b677a
Remove old voice code
Josh-XT Mar 29, 2024
3c39bca
Maybe fix embedder
Josh-XT Mar 29, 2024
aacd337
Use input instead of text
Josh-XT Mar 29, 2024
2bbd55a
Tuning wip
Josh-XT Mar 29, 2024
290dbd7
Add fine_tune_llm function
Josh-XT Mar 29, 2024
810db91
Attempt at fixing embedders
Josh-XT Mar 29, 2024
83c87db
Use memories directly
Josh-XT Mar 29, 2024
3cb7cd6
Add auto installs
Josh-XT Mar 29, 2024
256c79e
Clean up
Josh-XT Mar 30, 2024
8bd5664
Clean up
Josh-XT Mar 30, 2024
97cffb8
Added huggingface api key from agent settings
Josh-XT Mar 30, 2024
b626a24
Update embedding provider
Josh-XT Mar 30, 2024
2b104f3
Use messages style for good/bad answers
Josh-XT Mar 30, 2024
5a5ccd6
Add .embeddings
Josh-XT Mar 30, 2024
b3d825b
Add static methods for services
Josh-XT Mar 30, 2024
186f8d2
Lint
Josh-XT Mar 30, 2024
45a143f
Add training status
Josh-XT Mar 30, 2024
8aa9b12
Remove text
Josh-XT Mar 30, 2024
e28c244
Fix ref
Josh-XT Mar 30, 2024
7e62ee2
this seems crazy
Josh-XT Mar 30, 2024
58d8144
Improve training endpoint
Josh-XT Mar 30, 2024
4b73780
v1.5.0
Josh-XT Mar 30, 2024
e04a5e6
Increase sleep on test
Josh-XT Mar 30, 2024
4f7fcc5
Fix api_base ref
Josh-XT Mar 30, 2024
f0ec61b
Clean up provider docs
Josh-XT Mar 30, 2024
4b018e7
Fix warning about model_name
Josh-XT Mar 30, 2024
610ecd4
Update agixtsdk to 0.0.34
Josh-XT Mar 30, 2024
e596e01
Update requirements
Josh-XT Mar 30, 2024
b849fb2
Add claude vision
Josh-XT Mar 30, 2024
5f1335d
Add system message
Josh-XT Mar 30, 2024
6b2d4c1
Clean up readme
Josh-XT Mar 30, 2024
f8157a1
Improve dev compose
Josh-XT Mar 30, 2024
a086d21
Add dev pg
Josh-XT Mar 30, 2024
571bbc2
Remove code causing error
Josh-XT Mar 30, 2024
e00fabe
Updates
Josh-XT Mar 30, 2024
d112f19
Handle provider setting update
Josh-XT Mar 30, 2024
53e702f
Fix get_agents
Josh-XT Mar 30, 2024
18b581c
Add status for user agents
Josh-XT Mar 30, 2024
175b353
Modify get_agents
Josh-XT Mar 30, 2024
37aeafa
Fix duplicates in agent list
Josh-XT Mar 30, 2024
d3fe2ae
Remove condition causing issue
Josh-XT Mar 30, 2024
dbf048e
Add tests, fix endpoints
Josh-XT Mar 30, 2024
0a574be
Improve tests
Josh-XT Mar 30, 2024
83e9ab6
Fix translate_audio response
Josh-XT Mar 31, 2024
1e14f81
Fix transcribe audio
Josh-XT Mar 31, 2024
4f7cb03
Add completions tests to tests on main
Josh-XT Mar 31, 2024
4ab482c
Trnascription fix attempt
Josh-XT Mar 31, 2024
1a23800
Convert audio
Josh-XT Mar 31, 2024
b380a4f
Fix endpoints
Josh-XT Mar 31, 2024
f9eb5cd
work?
Josh-XT Mar 31, 2024
96dd81d
Switch x-wav to wav
Josh-XT Mar 31, 2024
18c259a
Updates
Josh-XT Mar 31, 2024
343e113
Use file extension
Josh-XT Mar 31, 2024
a97af9e
Use wav
Josh-XT Mar 31, 2024
2eac1d3
Use full path
Josh-XT Mar 31, 2024
4a4598c
Always segment
Josh-XT Mar 31, 2024
b15f79c
Add dot
Josh-XT Mar 31, 2024
efeec0a
fix tts return
Josh-XT Mar 31, 2024
abe7d92
Fix tts response
Josh-XT Mar 31, 2024
20dbece
add decoder
Josh-XT Mar 31, 2024
9906f61
STT Fix attempt
Josh-XT Mar 31, 2024
bffa374
Use ffmpeg
Josh-XT Apr 1, 2024
d8cc322
Fix test
Josh-XT Apr 1, 2024
f7fd0b4
Clean up
Josh-XT Apr 1, 2024
07f19a3
wOrKs oN mY mAcHiNe
Josh-XT Apr 1, 2024
4dc7709
Add providers to example
Josh-XT Apr 1, 2024
6c4939d
use if not
Josh-XT Apr 2, 2024
d318d43
use agent_name
Josh-XT Apr 2, 2024
e39913c
Use if not user
Josh-XT Apr 2, 2024
0baaad0
Add user to collection name
Josh-XT Apr 2, 2024
01f37a2
get default user global
Josh-XT Apr 2, 2024
43d7cfc
Updates
Josh-XT Apr 2, 2024
40131b2
change file type
Josh-XT Apr 2, 2024
0bf3901
pass thru urls
Josh-XT Apr 2, 2024
0b6fc7c
Updates
Josh-XT Apr 2, 2024
c28d8a1
Clean up ezlocalai response
Josh-XT Apr 2, 2024
40d2b84
improve vision
Josh-XT Apr 2, 2024
6997882
change output location for file in test
Josh-XT Apr 2, 2024
f824513
Try using gtts as default?
Josh-XT Apr 2, 2024
91fb68c
Use audiosegment
Josh-XT Apr 2, 2024
49468fc
Fix google provider
Josh-XT Apr 2, 2024
e1859e4
Fix api key for google provider
Josh-XT Apr 2, 2024
5b4dd27
continue
Josh-XT Apr 2, 2024
80f51d1
Fix defaults
Josh-XT Apr 2, 2024
3057f77
Add mode
Josh-XT Apr 2, 2024
ee9a82d
Hope this works!
Josh-XT Apr 2, 2024
11f7fef
Fix tabbing
Josh-XT Apr 2, 2024
d272592
Remove unused refs
Josh-XT Apr 2, 2024
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
11 changes: 10 additions & 1 deletion .github/workflows/publish-docker-dev.yml
Original file line number Diff line number Diff line change
Expand Up @@ -66,4 +66,13 @@ jobs:
report-name: "agixt-db-tests"
additional-python-dependencies: agixtsdk
needs: build-agixt

test-completions:
uses: josh-xt/AGiXT/.github/workflows/operation-test-with-jupyter.yml@main
with:
notebook: tests/completions-tests.ipynb
image: ghcr.io/${{ needs.build-agixt.outputs.github_user }}/${{ needs.build-agixt.outputs.repo_name }}:${{ github.sha }}
port: "7437"
db-connected: false
report-name: "completions-tests"
additional-python-dependencies: openai requests python-dotenv
needs: build-agixt
11 changes: 10 additions & 1 deletion .github/workflows/publish-docker.yml
Original file line number Diff line number Diff line change
Expand Up @@ -46,4 +46,13 @@ jobs:
report-name: "agixt-db-tests"
additional-python-dependencies: agixtsdk
needs: build-agixt

test-completions:
uses: josh-xt/AGiXT/.github/workflows/operation-test-with-jupyter.yml@main
with:
notebook: tests/completions-tests.ipynb
image: ${{ needs.build-agixt.outputs.primary-image }}
port: "7437"
db-connected: false
report-name: "completions-tests"
additional-python-dependencies: openai requests python-dotenv
needs: build-agixt
78 changes: 0 additions & 78 deletions agixt/AudioToText.py

This file was deleted.

13 changes: 10 additions & 3 deletions agixt/Defaults.py
Original file line number Diff line number Diff line change
Expand Up @@ -6,16 +6,23 @@

DEFAULT_SETTINGS = {
"provider": "gpt4free",
"embedder": "default",
"AI_MODEL": "gpt-3.5-turbo",
"mode": "prompt",
"prompt_category": "Default",
"prompt_name": "Chat",
"embeddings_provider": "default",
"tts_provider": "default",
"transcription_provider": "default",
"translation_provider": "default",
"image_provider": "default",
"VOICE": "Brian",
"AI_MODEL": "mixtral-8x7b",
"AI_TEMPERATURE": "0.7",
"AI_TOP_P": "1",
"MAX_TOKENS": "4096",
"helper_agent_name": "gpt4free",
"WEBSEARCH_TIMEOUT": 0,
"WAIT_BETWEEN_REQUESTS": 1,
"WAIT_AFTER_FAILURE": 3,
"stream": False,
"WORKING_DIRECTORY": "./WORKSPACE",
"WORKING_DIRECTORY_RESTRICTED": True,
"AUTONOMOUS_EXECUTION": True,
Expand Down
59 changes: 0 additions & 59 deletions agixt/Embedding.py

This file was deleted.

19 changes: 0 additions & 19 deletions agixt/Extensions.py
Original file line number Diff line number Diff line change
Expand Up @@ -145,25 +145,6 @@ def get_commands_list(self):
return commands_list

async def execute_command(self, command_name: str, command_args: dict = None):
if command_args:
if "is_m4a_audio" in command_args or "is_wav_audio" in command_args:
new_command_args = {}
for arg in command_args:
if "is_m4a_audio" in command_args:
if arg == command_args["is_m4a_audio"]:
new_command_args[arg] = await self.execute_command(
command_name="Transcribe M4A Audio",
command_args={"base64_audio": command_args[arg]},
)
if "is_wav_audio" in command_args:
if arg == command_args["is_wav_audio"]:
new_command_args[arg] = await self.execute_command(
command_name="Transcribe WAV Audio",
command_args={"base64_audio": command_args[arg]},
)
if arg not in new_command_args:
new_command_args[arg] = command_args[arg]
command_args = new_command_args
injection_variables = {
"user": self.user,
"agent_name": self.agent_name,
Expand Down
18 changes: 0 additions & 18 deletions agixt/Interactions.py
Original file line number Diff line number Diff line change
Expand Up @@ -409,27 +409,9 @@ async def run(
browse_links: bool = False,
prompt_category: str = "Default",
persist_context_in_history: bool = False,
is_m4a_audio: bool = False,
is_wav_audio: bool = False,
images: list = [],
**kwargs,
):
if is_m4a_audio or is_wav_audio:
# Convert the audio to text
ext = Extensions(
agent_name=self.agent_name,
agent_config=self.agent.AGENT_CONFIG,
conversation_name=conversation_name,
ApiClient=self.ApiClient,
user=self.user,
)
command_output = await ext.execute_command(
command_name=(
"Transcribe M4A Audio" if is_m4a_audio else "Transcribe WAV Audio"
),
command_args={"base64_audio": user_input},
)
user_input = command_output
shots = int(shots)
if "prompt_category" in kwargs:
prompt_category = kwargs["prompt_category"]
Expand Down
Loading
Loading