Dean Lee
3c0990e716
move thumbnail generation from camerad to encoderd ( #34554 )
...
Co-authored-by: Cameron Clough <cameronjclough@gmail.com>
3 months ago
Dean Lee
27c11eb597
athena upload: streaming file upload ( #34559 )
...
streaming file upload
3 months ago
Dean Lee
4b7a25efc3
loggerd: remove unused zlib and libswscale linkage ( #34552 )
...
remove unused link
3 months ago
Dean Lee
9ec54f59c6
loggerd: switch logging from raw file format to zstd compressed files ( #34549 )
...
* switch logging from raw file format to zstd compressed files
* more zst suffix
* compress bootlog
* remove class RawFile
* Optimize ZstdFileWriter by adding input caching
* use ZSTD_compressStream2
* cleanup
* LOG_COMPRESSION_LEVEL=10
* space
* add zst suffix to LOGS_SIZE_RATE
3 months ago
Adeeb Shihadeh
9bc35c0919
Revert "athena upload: reduce memory usage and improve efficiency with streaming ( #34528 )"
...
This reverts commit 4c65f51a55
.
3 months ago
Dean Lee
4c65f51a55
athena upload: reduce memory usage and improve efficiency with streaming ( #34528 )
...
* reduce memory usage and improve upload efficiency with streaming
* space
3 months ago
Dean Lee
e7b63dce65
encoderd: enhance robustness of open() with HANDLE_EINTR Macro ( #34478 )
...
HANDLE_EINTR
3 months ago
Dean Lee
3219fe1472
encoder: optimize MessageBuilder data handling by adopting encoded data ( #34391 )
...
optimize data handing by adopting external data
3 months ago
Dean Lee
47b13f54f6
encoderd: refactor VideoEncoder::publisher_publish to standardize member variable access ( #34342 )
...
remove redundant pointer parameter
4 months ago
Cameron Clough
08779941e5
loggerd: typing and remove unused default arg ( #34349 )
4 months ago
Cameron Clough
f761f53205
deleter cleanups ( #34345 )
4 months ago
Adeeb Shihadeh
29577a3346
bootlog: monotonic ts for journalctl
5 months ago
Adeeb Shihadeh
c287232374
uploader: increase max qlog size ( #34106 )
5 months ago
Maxime Desroches
7d5031a6d6
ci: reduce sleep in test_uploader ( #34009 )
...
less
6 months ago
Maxime Desroches
ce7317407f
ci: faster test_encoder ( #33968 )
...
* try
* timeout
* fix
6 months ago
Maxime Desroches
e0acd86ca1
ci: faster unit_tests ( #33962 )
...
faster
6 months ago
Adeeb Shihadeh
853febe21d
visionipc: remove RGB support ( #33739 )
...
* visionipc: remove RGB support
* bump
* msgq master
* fix sim
7 months ago
Dean Lee
0bdad1fee0
loggerd: direct Initialize params instead of copy ( #33622 )
...
Direct Initialize Instead of Copy
7 months ago
Dean Lee
2b37624dee
encoderd: use const reference for VisionBuf access ( #33621 )
...
use const reference for VisionBuf access
7 months ago
Dean Lee
467bd74944
camerad: remove `CameraType` enum from `camera_common.h` ( #33588 )
...
remove CameraType from camera_common.h
7 months ago
Adeeb Shihadeh
102f1b0d85
loggerd: fix mac build
7 months ago
Adeeb Shihadeh
718835a825
camerad: prep part 2 ( #33584 )
...
* no camerastate in sensors
* bring this over
* and encoder
7 months ago
Adeeb Shihadeh
139f4034a8
Revert "uploader.py: simplify clear_locks by using rglob ( #32974 )"
...
This reverts commit 870f5cbeb39fa63829e6f3a64fa8df57e82d52c3.
old-commit-hash: 9474523add
9 months ago
Dean Lee
7fcba71725
uploader.py: simplify clear_locks by using rglob ( #32974 )
...
simplify clear_locks
old-commit-hash: cafca4f891
9 months ago
Dean Lee
d802a423a6
loggerd: Initialize atomic variables to zero ( #33130 )
...
Initialize atomic variables in LoggerdState to zero
old-commit-hash: 8f3fc699d4
9 months ago
Hoang Bui
cb306fd7a8
CI: fix recent test_rotation skip ( #33167 )
...
old-commit-hash: 5b4b7a08fc
9 months ago
Adeeb Shihadeh
d59f9262c8
disable test_rotation until it's fixed
...
old-commit-hash: bfa8e0b2ec
9 months ago
Dean Lee
3c1af12490
uploader.py: ensure proper resource management with io.BytesIO ( #33108 )
...
* ensure proper resource management with io.BytesIO
* improve
old-commit-hash: 2728c95b0d
9 months ago
Adeeb Shihadeh
8cc6b66cde
docs: add concepts section
...
old-commit-hash: 5ebc65f254
9 months ago
Shane Smiskol
7b67994a05
use zstandard library ( #33110 )
...
* use zstandard
* run 10
* bye bye
* this was a little overzealous
* clean up
old-commit-hash: 1b3b5ab758
9 months ago
Shane Smiskol
b0a8b3bc9d
uploader: compress with zstd ( #32736 )
...
* zstd uploader
* fix that
* fix name of function
* comment
* log failed
* fix comma_api_source for routes with both bz2 and zst rlogs
* TODO
* 10-14 achieves almost no benefit on qlogs in a few cases, but takes 2x the time
* these aren't written out
* regen: specify any list of sources
ooh this is pretty nice
* regen and process replay
* damn, actually we don't need all this (cool tho)
Revert "regen: specify any list of sources"
This reverts commit ceb0b4abed
.
* just let it auto resolve
* fix athenad/uploader tests
* zst here too
* TODOs
* yes
* Revert "TODOs"
This reverts commit 8c7da1dbd0
.
* Revert "zst here too"
This reverts commit 23b0023ddf
.
* Revert "just let it auto resolve"
This reverts commit f296d62424
.
* Revert "regen and process replay"
This reverts commit 0768330e96
.
* revert readme
* not in save_log either
* lfg
* Revert "lfg"
This reverts commit 3718559c6c
.
old-commit-hash: 7dec7c39be
9 months ago
Shane Smiskol
82ebea3d12
deleter: preserve two previous segments on user flag ( #32822 )
...
preserve 2 segs
old-commit-hash: dc41848597
10 months ago
Harald Schäfer
05ed3d8c15
Restructure msgq ( #32652 )
...
* Update ref
* Compiles
* compiles
* Refactor rest of libs
* import all
* small fiex
* cleanup import
* Need msgq simlink too
* Add to openpilot docker too
* try repo
* Updates
* Fix lint
* fix docs
* Try blank slate
* Revert "Try blank slate"
This reverts commit f078ce04acacfe115c19e23e86038b01e2b84a6d.
* Maybe scons needs this to clear cache
* fix tests
* Disable test for now
* Update SConstruct
Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
* Fix whitespace
* Write skip normal
* small fixes
* add test path
* Revert repo
* linting
* whitespace
* Bump msgq
---------
Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
old-commit-hash: e70dc90a45
11 months ago
Adeeb Shihadeh
ad42b61427
test_encoder: adjust file size tolerance
...
old-commit-hash: b51472048c
11 months ago
Harald Schäfer
f870a968e9
Split cereal into cereal/msgq ( #32631 )
...
* squash
* fix doc
* compile device
* compile device
* Update ref
* add msgq to precommit exclusions
* No service ports
* fix compile
* address comments
* More comments
* Delete logger
* Update opendbc
* Linting
* bump msgq
old-commit-hash: e71ec4e8d7
11 months ago
Adeeb Shihadeh
86b6103657
test_*.py files are no longer executable ( #32610 )
...
* test_*.py files are no longer executable
* cleanup empty lines
* update precommit
* fixme
* enable
* build
old-commit-hash: c59887c810
11 months ago
Adeeb Shihadeh
cc4f53e6c6
manager: move to system/ ( #32538 )
...
* manager: move to system/
* one more
old-commit-hash: accdade4cf
11 months ago
Adeeb Shihadeh
3358745103
ruff: enable UP
...
old-commit-hash: b2e4c64cf8
11 months ago
Dean Lee
46183bc11b
encoderd: publish i-frame as thumbnail ( #32202 )
...
* pusblish i-frame as thumbnail
* generic
* disable for now
* fix
---------
Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
old-commit-hash: b742776bff
12 months ago
cl0cks4fe
639a634f7c
Unittest to pytest ( #32366 )
...
* add pytest-asyncio
* switch common
* switch selfdrive
* switch system
* switch tools
* small fixes
* fix setUp and valgrind pytest
* switch to setup
* fix random
* switch mock
* switch test_lateral_limits
* revert test_ui
* fix poetry.lock
* add unittest to banned-api
* add inline ignores to remaining unittest imports
* revert test_models
* revert check_can_parser_performance
* one more skip
---------
Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
old-commit-hash: dd9d5d4528
12 months ago
Dean Lee
0147c559c0
loggerd/logger.cc: use std::stoul instead of std::stol ( #32133 )
...
old-commit-hash: 99285ef1f2
1 year ago
Dean Lee
fc1d2edf81
loggerd/logger.cc: fix typo ( #32134 )
...
old-commit-hash: cad7b96c3a
1 year ago
Adeeb Shihadeh
da31ce154a
refactor camera transformations ( #31818 )
...
* refactor camera transormations
* update users
* more stuff
* more fix
* swap
* tici
* lil shorter
old-commit-hash: e3589e4b5c
1 year ago
Adeeb Shihadeh
b73a5fba4c
fix old route sorting ( #31787 )
...
* fix old route sorting
* cleanup
* Update system/loggerd/uploader.py
---------
Co-authored-by: Comma Device <device@comma.ai>
old-commit-hash: 158e36976b
1 year ago
Adeeb Shihadeh
402e8f8b0e
encoderd: fix large frames ( #31681 )
...
* encoderd: fix large frames
* Update camera_common.cc
* just do this for now
---------
Co-authored-by: Comma Device <device@comma.ai>
old-commit-hash: 84797482e9
1 year ago
Adeeb Shihadeh
9735cf2eb6
timeless routes ( #31119 )
...
* timeless route
* update sort
* update test
* fix param name
old-commit-hash: 7cfc571f56
1 year ago
Cameron Clough
a09300385b
mypy: use implicit-optional ( #31590 )
...
* mypy: set implicit-optional = true
* find and replace '| None = None' -> '= None' in function args
old-commit-hash: 80da3aee14
1 year ago
Cameron Clough
9bd90112d0
use pyupgrade to update to new typing syntax ( #31580 )
...
* add pyupgrade hook
* run pyupgrade (pre-commit run -a)
* ruff --fix
* Revert "add pyupgrade hook"
This reverts commit 56ec18bb6b
.
* revert changes to third_party/
* manual type fixes
* explicit Optional wrapping capnp objects
old-commit-hash: 995250ae49
1 year ago
Adeeb Shihadeh
dd3b005456
uploader: sleep more when no files in queue ( #31523 )
...
* uploader: sleep more when no files in queue
* fix test
old-commit-hash: 1c794b710c
1 year ago
Adeeb Shihadeh
df6154b591
log git commit date ( #31490 )
...
* log git commit date
* unix ts
* fix
* bump cereal
* cleanup
old-commit-hash: 0723c2bc5f
1 year ago