Adeeb Shihadeh
9474523add
Revert "uploader.py: simplify clear_locks by using rglob ( #32974 )"
...
This reverts commit cafca4f891
.
9 months ago
Dean Lee
cafca4f891
uploader.py: simplify clear_locks by using rglob ( #32974 )
...
simplify clear_locks
9 months ago
Dean Lee
8f3fc699d4
loggerd: Initialize atomic variables to zero ( #33130 )
...
Initialize atomic variables in LoggerdState to zero
9 months ago
Hoang Bui
5b4b7a08fc
CI: fix recent test_rotation skip ( #33167 )
9 months ago
Adeeb Shihadeh
bfa8e0b2ec
disable test_rotation until it's fixed
9 months ago
Dean Lee
2728c95b0d
uploader.py: ensure proper resource management with io.BytesIO ( #33108 )
...
* ensure proper resource management with io.BytesIO
* improve
9 months ago
Adeeb Shihadeh
5ebc65f254
docs: add concepts section
9 months ago
Shane Smiskol
1b3b5ab758
use zstandard library ( #33110 )
...
* use zstandard
* run 10
* bye bye
* this was a little overzealous
* clean up
9 months ago
Shane Smiskol
7dec7c39be
uploader: compress with zstd ( #32736 )
...
* zstd uploader
* fix that
* fix name of function
* comment
* log failed
* fix comma_api_source for routes with both bz2 and zst rlogs
* TODO
* 10-14 achieves almost no benefit on qlogs in a few cases, but takes 2x the time
* these aren't written out
* regen: specify any list of sources
ooh this is pretty nice
* regen and process replay
* damn, actually we don't need all this (cool tho)
Revert "regen: specify any list of sources"
This reverts commit ceb0b4abed
.
* just let it auto resolve
* fix athenad/uploader tests
* zst here too
* TODOs
* yes
* Revert "TODOs"
This reverts commit 8c7da1dbd0
.
* Revert "zst here too"
This reverts commit 23b0023ddf
.
* Revert "just let it auto resolve"
This reverts commit f296d62424
.
* Revert "regen and process replay"
This reverts commit 0768330e96
.
* revert readme
* not in save_log either
* lfg
* Revert "lfg"
This reverts commit 3718559c6c
.
9 months ago
Shane Smiskol
dc41848597
deleter: preserve two previous segments on user flag ( #32822 )
...
preserve 2 segs
10 months ago
Harald Schäfer
e70dc90a45
Restructure msgq ( #32652 )
...
* Update ref
* Compiles
* compiles
* Refactor rest of libs
* import all
* small fiex
* cleanup import
* Need msgq simlink too
* Add to openpilot docker too
* try repo
* Updates
* Fix lint
* fix docs
* Try blank slate
* Revert "Try blank slate"
This reverts commit f078ce04acacfe115c19e23e86038b01e2b84a6d.
* Maybe scons needs this to clear cache
* fix tests
* Disable test for now
* Update SConstruct
Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
* Fix whitespace
* Write skip normal
* small fixes
* add test path
* Revert repo
* linting
* whitespace
* Bump msgq
---------
Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
11 months ago
Adeeb Shihadeh
b51472048c
test_encoder: adjust file size tolerance
11 months ago
Harald Schäfer
e71ec4e8d7
Split cereal into cereal/msgq ( #32631 )
...
* squash
* fix doc
* compile device
* compile device
* Update ref
* add msgq to precommit exclusions
* No service ports
* fix compile
* address comments
* More comments
* Delete logger
* Update opendbc
* Linting
* bump msgq
11 months ago
Adeeb Shihadeh
c59887c810
test_*.py files are no longer executable ( #32610 )
...
* test_*.py files are no longer executable
* cleanup empty lines
* update precommit
* fixme
* enable
* build
11 months ago
Adeeb Shihadeh
accdade4cf
manager: move to system/ ( #32538 )
...
* manager: move to system/
* one more
11 months ago
Adeeb Shihadeh
b2e4c64cf8
ruff: enable UP
11 months ago
Dean Lee
b742776bff
encoderd: publish i-frame as thumbnail ( #32202 )
...
* pusblish i-frame as thumbnail
* generic
* disable for now
* fix
---------
Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
11 months ago
cl0cks4fe
dd9d5d4528
Unittest to pytest ( #32366 )
...
* add pytest-asyncio
* switch common
* switch selfdrive
* switch system
* switch tools
* small fixes
* fix setUp and valgrind pytest
* switch to setup
* fix random
* switch mock
* switch test_lateral_limits
* revert test_ui
* fix poetry.lock
* add unittest to banned-api
* add inline ignores to remaining unittest imports
* revert test_models
* revert check_can_parser_performance
* one more skip
---------
Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
12 months ago
Dean Lee
99285ef1f2
loggerd/logger.cc: use std::stoul instead of std::stol ( #32133 )
1 year ago
Dean Lee
cad7b96c3a
loggerd/logger.cc: fix typo ( #32134 )
1 year ago
Adeeb Shihadeh
e3589e4b5c
refactor camera transformations ( #31818 )
...
* refactor camera transormations
* update users
* more stuff
* more fix
* swap
* tici
* lil shorter
1 year ago
Adeeb Shihadeh
158e36976b
fix old route sorting ( #31787 )
...
* fix old route sorting
* cleanup
* Update system/loggerd/uploader.py
---------
Co-authored-by: Comma Device <device@comma.ai>
1 year ago
Adeeb Shihadeh
84797482e9
encoderd: fix large frames ( #31681 )
...
* encoderd: fix large frames
* Update camera_common.cc
* just do this for now
---------
Co-authored-by: Comma Device <device@comma.ai>
1 year ago
Adeeb Shihadeh
7cfc571f56
timeless routes ( #31119 )
...
* timeless route
* update sort
* update test
* fix param name
1 year ago
Cameron Clough
80da3aee14
mypy: use implicit-optional ( #31590 )
...
* mypy: set implicit-optional = true
* find and replace '| None = None' -> '= None' in function args
1 year ago
Cameron Clough
995250ae49
use pyupgrade to update to new typing syntax ( #31580 )
...
* add pyupgrade hook
* run pyupgrade (pre-commit run -a)
* ruff --fix
* Revert "add pyupgrade hook"
This reverts commit 56ec18bb6b
.
* revert changes to third_party/
* manual type fixes
* explicit Optional wrapping capnp objects
1 year ago
Adeeb Shihadeh
1c794b710c
uploader: sleep more when no files in queue ( #31523 )
...
* uploader: sleep more when no files in queue
* fix test
1 year ago
Adeeb Shihadeh
0723c2bc5f
log git commit date ( #31490 )
...
* log git commit date
* unix ts
* fix
* bump cereal
* cleanup
1 year ago
Adeeb Shihadeh
cbd46802b0
fix bootlog count ( #31319 )
1 year ago
Adeeb Shihadeh
a5766e2796
encoderd: get frame size over vipc ( #31276 )
...
* encoderd: get frame size over vipc
* bump cereal
* fix ffmpeg
* no print
1 year ago
Adeeb Shihadeh
2504341070
bootlog: remove timestamp from filename ( #31187 )
...
* bootlog: remove timestamp from filename
* revert route
* test
* revert that
* fix loggerd test
1 year ago
Adeeb Shihadeh
6fbd844216
mark as flaky for now
1 year ago
Justin Newberry
979dba33cd
Revert "test_loggerd: make rotation test more robust" ( #31168 )
1 year ago
Justin Newberry
35374f4d57
test_loggerd: make rotation test more robust ( #31160 )
...
* no randomness
* lots
* Revert "lots"
This reverts commit 2052fd6f7b
.
1 year ago
Adeeb Shihadeh
694fc378dd
loggerd: speedup unit tests ( #31115 )
...
* first speed it up
* pytestify
* no sleep
1 year ago
Adeeb Shihadeh
7cd9568423
remove dashcam branch ( #31081 )
...
* remove dashcam branch
* fix
* more cleanup
* remove param
* one more
1 year ago
Adeeb Shihadeh
2280ac50b7
uploader: restrict qcam upload on metered connctions ( #31047 )
...
* uploader: restrict qcam upload on metered connctions
* route requesting
* rename
* str
* cleanup
* strip dongle
* upload bookmarked segments
---------
Co-authored-by: Comma Device <device@comma.ai>
1 year ago
Adeeb Shihadeh
19630c5af9
uploader: delay uploading crash and boot logs on metered connections ( #31045 )
...
* uploader: delay uploading some files on metered connections
* just crash and boot for now
1 year ago
Adeeb Shihadeh
5f1e7649e3
update param in loggerd unit test
1 year ago
Adeeb Shihadeh
0b5fd7287e
uploader cleanup ( #31035 )
...
* Reapply "uploader cleanup" (#31033 )
This reverts commit 5e4df41b2f
.
* always sleep
* more cleanup
* little more
* fix linter
* little more
1 year ago
Justin Newberry
5e4df41b2f
Revert "uploader cleanup" ( #31033 )
1 year ago
Adeeb Shihadeh
c6c6a441eb
uploader cleanup ( #31029 )
...
* cleanup
* startup cleanup
* step
* Update test_uploader.py
1 year ago
Dean Lee
a1f53c70e6
uploader.py/listdir_by_creation: list directories only ( #30806 )
...
list only directories
Co-authored-by: Comma Device <device@comma.ai>
1 year ago
Adeeb Shihadeh
37351cbdc1
uploader: reduce max qlog/qcam size ( #30746 )
1 year ago
Dean Lee
a4179a7c23
encoder: reduce memory allocations and copying ( #28704 )
...
* reduce memory allocations and copying
* #include <vector>
1 year ago
Adeeb Shihadeh
35f819c823
swaglog.py goes in common/ ( #30631 )
...
* swaglog.py goes in common/
* all of these go in release
* we'll even include the pyx
1 year ago
Adeeb Shihadeh
a1d36961cf
new msgs default to invalid ( #30587 )
...
* new msgs default to invalid
* fix lm
* set more valid
* update rest
* update refs
* fix logMessage
* more valids
* cleanup
* fix llk test
* pigeond is also valid
* more valids
1 year ago
Justin Newberry
4086795c29
Pytest: more post-test path cleanup ( #30556 )
...
* test cleanup
* missed this one
* remove that
* static class
1 year ago
Adeeb Shihadeh
c055fdc853
one more
1 year ago
Adeeb Shihadeh
3d36a0f70d
rm old loggerd debug scripts
1 year ago