Adeeb Shihadeh
701868d5cd
firehose auto start + stats ( #34747 )
...
* don't need that
* stats
* lil more
* lil more
* cleanup
* tweaks
---------
Co-authored-by: Comma Device <device@comma.ai>
2 months ago
Adeeb Shihadeh
27b5a727e3
Revert "Mypy: Got passing on macos ( #34591 )"
...
This reverts commit b09b48130e
.
2 months ago
BrainLess
b09b48130e
Mypy: Got passing on macos ( #34591 )
...
* Mypy: Got mypy passing on macos
* common/realtime.py refactor
* Mypy: mypy passing on darwin
* Refactor: Removed else: pass statement
* Refactor: Removed unnecessary check
* added xattr to pyproject
* loggerd: switched to xatter module
* loggerd: removed unused module in xattr_cache.py
* UV: update uv.lock
* Update system/athena/athenad.py
Co-authored-by: Maxime Desroches <desroches.maxime@gmail.com>
* athenad: fixed blank lines
* loggerd: refactor of xattr_cache
* cleanup
---------
Co-authored-by: Maxime Desroches <desroches.maxime@gmail.com>
2 months ago
Dean Lee
27c11eb597
athena upload: streaming file upload ( #34559 )
...
streaming file upload
2 months ago
Dean Lee
9ec54f59c6
loggerd: switch logging from raw file format to zstd compressed files ( #34549 )
...
* switch logging from raw file format to zstd compressed files
* more zst suffix
* compress bootlog
* remove class RawFile
* Optimize ZstdFileWriter by adding input caching
* use ZSTD_compressStream2
* cleanup
* LOG_COMPRESSION_LEVEL=10
* space
* add zst suffix to LOGS_SIZE_RATE
3 months ago
Adeeb Shihadeh
9bc35c0919
Revert "athena upload: reduce memory usage and improve efficiency with streaming ( #34528 )"
...
This reverts commit 4c65f51a55
.
3 months ago
Dean Lee
4c65f51a55
athena upload: reduce memory usage and improve efficiency with streaming ( #34528 )
...
* reduce memory usage and improve upload efficiency with streaming
* space
3 months ago
Adeeb Shihadeh
a5dd2ab2aa
athena: upload logs in parallel ( #34509 )
...
Co-authored-by: Comma Device <device@comma.ai>
3 months ago
Adeeb Shihadeh
79e52ea83d
FIREHOSE mode v0.1 ( #34496 )
...
* add toggle
* athena
* fix mypy
3 months ago
Adeeb Shihadeh
9cf02ca8db
Skip registration on newer devices ( #34316 )
4 months ago
Shane Smiskol
cd6d9fee3f
Revert "athenad: fix thread safety issues in upload handing" ( #34224 )
...
Revert "athenad: fix thread safety issues in upload handing (#34199 )"
This reverts commit dcb3113c4b
.
4 months ago
Dean Lee
dcb3113c4b
athenad: fix thread safety issues in upload handing ( #34199 )
...
* fix thread safety issues in upload handing
* remove cancelled_uploads
* remove None from current upload items & atomic updates
5 months ago
Shane Smiskol
015aadd48c
Revert "athenad: fix thread safety issues in upload handing" ( #34198 )
...
Revert "athenad: fix thread safety issues in upload handing (#34084 )"
This reverts commit 7c101a40c8
.
5 months ago
Dean Lee
7ec6a47c1e
athenad: optimize network state check in upload callback ( #34185 )
...
optimize network state check in upload callback
5 months ago
Dean Lee
7c101a40c8
athenad: fix thread safety issues in upload handing ( #34084 )
...
* fix thread safety issues in upload handing
* remove cancelled_uploads
5 months ago
Dean Lee
43807746ff
athenad: fix memory leak by closing Response objects ( #34101 )
...
* fix memory leak by closing Response
* use with
5 months ago
Dean Lee
adb9560870
athenad: move last_scan outside the loop ( #34099 )
...
move last_scan outside the loop
5 months ago
Dean Lee
b737e8472f
athenad: explicitly delete socket in getMessage ( #34098 )
...
explicitly delete socket in getMessage
5 months ago
Dean Lee
957d39a5b6
athenad: close websocket before starting next loop iteration ( #34085 )
...
explicitly close websocket before starting next loop iteration
5 months ago
Adeeb Shihadeh
9ad2333546
athena: migrate old termux SSH port to new one
6 months ago
Adeeb Shihadeh
53f514cbd3
athena: update SSH port ( #33804 )
6 months ago
Adeeb Shihadeh
e04455cbaa
selfdrived: controlsd only does controls ( #33485 )
...
* selfdrived
* process replay
* lil more
* set the valids
* rename that
8 months ago
Adeeb Shihadeh
333c666a80
athena: use dongle ID on /persist/ when available ( #33259 )
...
* athena: use dongle ID on /persist/ when available
* comment
* test
* cleanup
old-commit-hash: 91db49b9bf
8 months ago
Maxime Desroches
df13b36638
fix all codespell issues ( #33194 )
...
* bring back
* remove 2020 dictionary
old-commit-hash: 44c7144e1c
9 months ago
Shane Smiskol
7b67994a05
use zstandard library ( #33110 )
...
* use zstandard
* run 10
* bye bye
* this was a little overzealous
* clean up
old-commit-hash: 1b3b5ab758
9 months ago
Shane Smiskol
b0a8b3bc9d
uploader: compress with zstd ( #32736 )
...
* zstd uploader
* fix that
* fix name of function
* comment
* log failed
* fix comma_api_source for routes with both bz2 and zst rlogs
* TODO
* 10-14 achieves almost no benefit on qlogs in a few cases, but takes 2x the time
* these aren't written out
* regen: specify any list of sources
ooh this is pretty nice
* regen and process replay
* damn, actually we don't need all this (cool tho)
Revert "regen: specify any list of sources"
This reverts commit ceb0b4abed
.
* just let it auto resolve
* fix athenad/uploader tests
* zst here too
* TODOs
* yes
* Revert "TODOs"
This reverts commit 8c7da1dbd0
.
* Revert "zst here too"
This reverts commit 23b0023ddf
.
* Revert "just let it auto resolve"
This reverts commit f296d62424
.
* Revert "regen and process replay"
This reverts commit 0768330e96
.
* revert readme
* not in save_log either
* lfg
* Revert "lfg"
This reverts commit 3718559c6c
.
old-commit-hash: 7dec7c39be
9 months ago
Shane Smiskol
5fdbd73ba3
athenad: log failed upload items
...
old-commit-hash: add958bb08
9 months ago
Adeeb Shihadeh
3b8ed67aa3
remove navigation ( #32773 )
...
* remove navigation
* lil more
* fix cabana
* revert for now
* fix docs
* move that over
* lock
* rm assets
old-commit-hash: e491c9d964
10 months ago
Mauricio Alvarez Leon
008008b03a
Update to Python 3.12 ( #32548 )
...
* 3.12
* pprofile is broken
* use modified metadrivepy3-12
* 0.3.0 metadrive
* add metadrive/commaai git dependency
* metadrive git set
* pin sounddevice 0.4.6
* datetime.utcnow() deprecation
* poetry lock
* make datetime not aware
* poetry lock
* pin pytools
* google_crc32c wheel
* unpin sounddevice
* clean metadrive
* use python crc
* mypy
* 3.12.4
* allow python3.11
* test
* no pip
* poetry
* better
* better
* merge
* remove
* try
* test
* try this
* snok
* python
* simpler
* setuptools
* lower
* try
* try
* work?
* ubuntu deps
* ubuntu
* try
* remove
* move
* remove this
* names
* Update .github/workflows/tools_tests.yaml
Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
* python<4
* <3.13
---------
Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
Co-authored-by: Maxime Desroches <desroches.maxime@gmail.com>
old-commit-hash: 148eaf8fa6
11 months ago
Adeeb Shihadeh
86b6103657
test_*.py files are no longer executable ( #32610 )
...
* test_*.py files are no longer executable
* cleanup empty lines
* update precommit
* fixme
* enable
* build
old-commit-hash: c59887c810
11 months ago
Adeeb Shihadeh
cc4f53e6c6
manager: move to system/ ( #32538 )
...
* manager: move to system/
* one more
old-commit-hash: accdade4cf
11 months ago
Adeeb Shihadeh
3358745103
ruff: enable UP
...
old-commit-hash: b2e4c64cf8
11 months ago
Adeeb Shihadeh
18970afb0e
athena: move to system/ ( #32488 )
...
* athena: move to system/
* slash
old-commit-hash: 3279dbeff7
11 months ago