Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Dev #260

Closed
wants to merge 57 commits into from
Closed

Dev #260

wants to merge 57 commits into from

Conversation

mitya52
Copy link
Member

@mitya52 mitya52 commented Jan 3, 2024

No description provided.

FuzzyReason and others added 30 commits November 20, 2023 11:01
@FuzzyReason
add footer (#225)
ad359f8
@oxyplay
Revert "add footer (#225)"
07dd11e 
This reverts commit ad359f8.
@FuzzyReason
add resources (#229)
84d3f89
@valaises @olegklimov
Tab stats (#233)
39f88e3 
* pass

added telemetry handlers for snippets

adjusted format

added insert_fake_tele_data

WIP

new WIP

another WIP

* removed unneeded files

* partially restored self_hosting_machinery/webgui/selfhost_fastapi_completions.py

* added corrected telemetry endpoints

* feature: added active attribute to plot-btns

* modified telemetry_basic_dest && telemetry_corrected_snippets_dest

* moved div with tab-stats

---------

Co-authored-by: Oleg Klimov <[email protected]>
@mitya52
proxies not needed for async request (#236)
21491a2
@JegernOUTT
apply triton sa only for the refact model (#234)
bc33c90
@olegklimov
filtering error message fix
f76f6aa
@mitya52
add handlers, wip
ccdab0e
@mitya52
error handling
fec4029
@mitya52
add lsp server install and startup
38e70ee
@mitya52
lsp indtallation fixes
89ade75
@mitya52
fix refact-lsp params
159b8f8
@mitya52
restart lsp server in case of inference config changes
768e4c7
@mitya52
add endpoint_chat_passthrough
9c7da4a
@mitya52
litellm-based integrations
eacb3be
@mitya52
remove no gpu inference code
77d76ef
@mitya52
set key only if openai enabled
8f56db9
@mitya52
do not run job if command not found
a558c59
@mitya52
default code chat model
846763e
@olegklimov
stream_results better status code print
c7563b8
@mitya52
stats impl copy
6952301
@mitya52
add missed stats tab plugin
90b8485
@valaises @mitya52
fix: on database.statistics.empty
d75fd83
@valaises @mitya52
fixes due to pandas lib update
1aca09b
@mitya52
move db to sqlalchemy instead of cassandra
5128777
@mitya52
fix compose and setup of package
95e0d47
@mitya52
missed data, litellm and fix docker compose file
b237694
@mitya52
move back to cassandra nosql db
a068a47
@mitya52
up version
3151131
@valaises @mitya52
Changelist:
1a4741e 
* fake_tele_data -> mock_tele_data
* showing tele results from the beginning of this year
valaises and others added 27 commits December 20, 2023 20:18
@valaises @mitya52
minor edit
38ad851
@mitya52
ability to start server without database
a3b489f
@mitya52
fix rebase
e5ab435
@mitya52
more informative message on database connection wait
0af149e
@mitya52
small refactoring of webgui: we need outer initialization of args
45d7ff8
@olegklimov @mitya52
KEYSPACE = os.environ.get("REFACT_KEYSPACE", "smc")
b34fc2f
@mitya52
div by zero fix
9cfda56
@mitya52
add database posrt env var
149686a
@valaises @mitya52
quickfix
ba636e8
@JegernOUTT
loss caching (#245)
23ec046 
more precise error handling
@olegklimov @mitya52
do_sample=temperature >= 0.05
048ef23
@mitya52
fix no response for streaming
7e0fba1
@oxyplay @mitya52
model selection tree
9839567
@mitya52
WIP: adding new models, needs test
4836b51
@mitya52
fix models loading
bc8e2e8
@mitya52
fix setup
7c5e826
@mitya52
detect chat as filter caps
7ac8efb
@mitya52
update setup to build auto-gptq cuda extensions
103bf08
@mitya52
install autogptq with cuda 11.8 in dockerfile
b4efd7c
@mitya52
update torch to 2.1.2
1e1fabd
@mitya52
disable phind model due to tokenizer and unexpectedly stop errors
5108872
@mitya52
update models table
3ca8936
@mitya52
new way to run server
69144e6
@mitya52
up deepspeed version
7abe19a
@JegernOUTT @mitya52
fix
d99e6b8
@mitya52 @olegklimov
Cassandra (#254)
e41c84d 
* start local cassandra is not specified

* executable script and fixes

* fix readme

* fix entrypoint for docker

* wording

* perm-storage -> refact-perm-storage

---------

Co-authored-by: Oleg Klimov <[email protected]>
@mitya52
disable efficient sdp for old caps gpus (#258)
4e158f9
@mitya52 mitya52 closed this Jan 3, 2024
@mitya52 mitya52 deleted the dev branch January 3, 2024 16:15
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
6 participants
@mitya52 @FuzzyReason @oxyplay @valaises @JegernOUTT @olegklimov