Dean Lee
c52112ad4e
loggerd: eliminate recursion from handle_encoder_msg ( #33453 )
...
* refactor handle_encoder_msg
* removing the recursion only
---------
Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
2 months ago
Adeeb Shihadeh
54f1b00447
Log git source commit ( #34749 )
...
* Log git source commit
* strip
* fix trim
* no trim
2 months ago
Dean Lee
0619e9a581
v4l_encoder: used encoder_info.fps instead of hardcoded 20 ( #34701 )
...
Used encoder_info.fps instead of hardcoded 20
2 months ago
Adeeb Shihadeh
e00b5337d2
misc encoder cleanups
2 months ago
Adeeb Shihadeh
6f5f8e7746
loggerd: reduce debug log frequency
2 months ago
Adeeb Shihadeh
27b5a727e3
Revert "Mypy: Got passing on macos ( #34591 )"
...
This reverts commit b09b48130e
.
2 months ago
BrainLess
b09b48130e
Mypy: Got passing on macos ( #34591 )
...
* Mypy: Got mypy passing on macos
* common/realtime.py refactor
* Mypy: mypy passing on darwin
* Refactor: Removed else: pass statement
* Refactor: Removed unnecessary check
* added xattr to pyproject
* loggerd: switched to xatter module
* loggerd: removed unused module in xattr_cache.py
* UV: update uv.lock
* Update system/athena/athenad.py
Co-authored-by: Maxime Desroches <desroches.maxime@gmail.com>
* athenad: fixed blank lines
* loggerd: refactor of xattr_cache
* cleanup
---------
Co-authored-by: Maxime Desroches <desroches.maxime@gmail.com>
2 months ago
Dean Lee
644130ca3d
encoderd: use AV_CODEC_ID_H264 codec for qcamera encoding ( #34498 )
2 months ago
Dean Lee
3c0990e716
move thumbnail generation from camerad to encoderd ( #34554 )
...
Co-authored-by: Cameron Clough <cameronjclough@gmail.com>
2 months ago
Dean Lee
27c11eb597
athena upload: streaming file upload ( #34559 )
...
streaming file upload
2 months ago
Dean Lee
4b7a25efc3
loggerd: remove unused zlib and libswscale linkage ( #34552 )
...
remove unused link
3 months ago
Dean Lee
9ec54f59c6
loggerd: switch logging from raw file format to zstd compressed files ( #34549 )
...
* switch logging from raw file format to zstd compressed files
* more zst suffix
* compress bootlog
* remove class RawFile
* Optimize ZstdFileWriter by adding input caching
* use ZSTD_compressStream2
* cleanup
* LOG_COMPRESSION_LEVEL=10
* space
* add zst suffix to LOGS_SIZE_RATE
3 months ago
Adeeb Shihadeh
9bc35c0919
Revert "athena upload: reduce memory usage and improve efficiency with streaming ( #34528 )"
...
This reverts commit 4c65f51a55
.
3 months ago
Dean Lee
4c65f51a55
athena upload: reduce memory usage and improve efficiency with streaming ( #34528 )
...
* reduce memory usage and improve upload efficiency with streaming
* space
3 months ago
Dean Lee
e7b63dce65
encoderd: enhance robustness of open() with HANDLE_EINTR Macro ( #34478 )
...
HANDLE_EINTR
3 months ago
Dean Lee
3219fe1472
encoder: optimize MessageBuilder data handling by adopting encoded data ( #34391 )
...
optimize data handing by adopting external data
3 months ago
Dean Lee
47b13f54f6
encoderd: refactor VideoEncoder::publisher_publish to standardize member variable access ( #34342 )
...
remove redundant pointer parameter
3 months ago
Cameron Clough
08779941e5
loggerd: typing and remove unused default arg ( #34349 )
4 months ago
Cameron Clough
f761f53205
deleter cleanups ( #34345 )
4 months ago
Adeeb Shihadeh
29577a3346
bootlog: monotonic ts for journalctl
5 months ago
Adeeb Shihadeh
c287232374
uploader: increase max qlog size ( #34106 )
5 months ago
Maxime Desroches
7d5031a6d6
ci: reduce sleep in test_uploader ( #34009 )
...
less
5 months ago
Maxime Desroches
ce7317407f
ci: faster test_encoder ( #33968 )
...
* try
* timeout
* fix
6 months ago
Maxime Desroches
e0acd86ca1
ci: faster unit_tests ( #33962 )
...
faster
6 months ago
Adeeb Shihadeh
853febe21d
visionipc: remove RGB support ( #33739 )
...
* visionipc: remove RGB support
* bump
* msgq master
* fix sim
7 months ago
Dean Lee
0bdad1fee0
loggerd: direct Initialize params instead of copy ( #33622 )
...
Direct Initialize Instead of Copy
7 months ago
Dean Lee
2b37624dee
encoderd: use const reference for VisionBuf access ( #33621 )
...
use const reference for VisionBuf access
7 months ago
Dean Lee
467bd74944
camerad: remove `CameraType` enum from `camera_common.h` ( #33588 )
...
remove CameraType from camera_common.h
7 months ago
Adeeb Shihadeh
102f1b0d85
loggerd: fix mac build
7 months ago
Adeeb Shihadeh
718835a825
camerad: prep part 2 ( #33584 )
...
* no camerastate in sensors
* bring this over
* and encoder
7 months ago
Adeeb Shihadeh
139f4034a8
Revert "uploader.py: simplify clear_locks by using rglob ( #32974 )"
...
This reverts commit 870f5cbeb39fa63829e6f3a64fa8df57e82d52c3.
old-commit-hash: 9474523add
9 months ago
Dean Lee
7fcba71725
uploader.py: simplify clear_locks by using rglob ( #32974 )
...
simplify clear_locks
old-commit-hash: cafca4f891
9 months ago
Dean Lee
d802a423a6
loggerd: Initialize atomic variables to zero ( #33130 )
...
Initialize atomic variables in LoggerdState to zero
old-commit-hash: 8f3fc699d4
9 months ago
Hoang Bui
cb306fd7a8
CI: fix recent test_rotation skip ( #33167 )
...
old-commit-hash: 5b4b7a08fc
9 months ago
Adeeb Shihadeh
d59f9262c8
disable test_rotation until it's fixed
...
old-commit-hash: bfa8e0b2ec
9 months ago
Dean Lee
3c1af12490
uploader.py: ensure proper resource management with io.BytesIO ( #33108 )
...
* ensure proper resource management with io.BytesIO
* improve
old-commit-hash: 2728c95b0d
9 months ago
Adeeb Shihadeh
8cc6b66cde
docs: add concepts section
...
old-commit-hash: 5ebc65f254
9 months ago
Shane Smiskol
7b67994a05
use zstandard library ( #33110 )
...
* use zstandard
* run 10
* bye bye
* this was a little overzealous
* clean up
old-commit-hash: 1b3b5ab758
9 months ago
Shane Smiskol
b0a8b3bc9d
uploader: compress with zstd ( #32736 )
...
* zstd uploader
* fix that
* fix name of function
* comment
* log failed
* fix comma_api_source for routes with both bz2 and zst rlogs
* TODO
* 10-14 achieves almost no benefit on qlogs in a few cases, but takes 2x the time
* these aren't written out
* regen: specify any list of sources
ooh this is pretty nice
* regen and process replay
* damn, actually we don't need all this (cool tho)
Revert "regen: specify any list of sources"
This reverts commit ceb0b4abed
.
* just let it auto resolve
* fix athenad/uploader tests
* zst here too
* TODOs
* yes
* Revert "TODOs"
This reverts commit 8c7da1dbd0
.
* Revert "zst here too"
This reverts commit 23b0023ddf
.
* Revert "just let it auto resolve"
This reverts commit f296d62424
.
* Revert "regen and process replay"
This reverts commit 0768330e96
.
* revert readme
* not in save_log either
* lfg
* Revert "lfg"
This reverts commit 3718559c6c
.
old-commit-hash: 7dec7c39be
9 months ago
Shane Smiskol
82ebea3d12
deleter: preserve two previous segments on user flag ( #32822 )
...
preserve 2 segs
old-commit-hash: dc41848597
10 months ago
Harald Schäfer
05ed3d8c15
Restructure msgq ( #32652 )
...
* Update ref
* Compiles
* compiles
* Refactor rest of libs
* import all
* small fiex
* cleanup import
* Need msgq simlink too
* Add to openpilot docker too
* try repo
* Updates
* Fix lint
* fix docs
* Try blank slate
* Revert "Try blank slate"
This reverts commit f078ce04acacfe115c19e23e86038b01e2b84a6d.
* Maybe scons needs this to clear cache
* fix tests
* Disable test for now
* Update SConstruct
Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
* Fix whitespace
* Write skip normal
* small fixes
* add test path
* Revert repo
* linting
* whitespace
* Bump msgq
---------
Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
old-commit-hash: e70dc90a45
11 months ago
Adeeb Shihadeh
ad42b61427
test_encoder: adjust file size tolerance
...
old-commit-hash: b51472048c
11 months ago
Harald Schäfer
f870a968e9
Split cereal into cereal/msgq ( #32631 )
...
* squash
* fix doc
* compile device
* compile device
* Update ref
* add msgq to precommit exclusions
* No service ports
* fix compile
* address comments
* More comments
* Delete logger
* Update opendbc
* Linting
* bump msgq
old-commit-hash: e71ec4e8d7
11 months ago
Adeeb Shihadeh
86b6103657
test_*.py files are no longer executable ( #32610 )
...
* test_*.py files are no longer executable
* cleanup empty lines
* update precommit
* fixme
* enable
* build
old-commit-hash: c59887c810
11 months ago
Adeeb Shihadeh
cc4f53e6c6
manager: move to system/ ( #32538 )
...
* manager: move to system/
* one more
old-commit-hash: accdade4cf
11 months ago
Adeeb Shihadeh
3358745103
ruff: enable UP
...
old-commit-hash: b2e4c64cf8
11 months ago
Dean Lee
46183bc11b
encoderd: publish i-frame as thumbnail ( #32202 )
...
* pusblish i-frame as thumbnail
* generic
* disable for now
* fix
---------
Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
old-commit-hash: b742776bff
11 months ago
cl0cks4fe
639a634f7c
Unittest to pytest ( #32366 )
...
* add pytest-asyncio
* switch common
* switch selfdrive
* switch system
* switch tools
* small fixes
* fix setUp and valgrind pytest
* switch to setup
* fix random
* switch mock
* switch test_lateral_limits
* revert test_ui
* fix poetry.lock
* add unittest to banned-api
* add inline ignores to remaining unittest imports
* revert test_models
* revert check_can_parser_performance
* one more skip
---------
Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
old-commit-hash: dd9d5d4528
11 months ago
Dean Lee
0147c559c0
loggerd/logger.cc: use std::stoul instead of std::stol ( #32133 )
...
old-commit-hash: 99285ef1f2
1 year ago
Dean Lee
fc1d2edf81
loggerd/logger.cc: fix typo ( #32134 )
...
old-commit-hash: cad7b96c3a
1 year ago